deeplake

Database for AI. Store Vectors, Images, Texts, Videos, etc. Use with LLMs/LangChain. Store, query, version, & visualize any AI data. Stream data in real-time to PyTorch/TensorFlow. https://activeloop.ai

MPL-2.0 License

Downloads
56K
Stars
7.8K
Committers
121

Bot releases are visible (Hide)

deeplake - v3.5.0 🌈

Published by github-actions[bot] over 1 year ago

🧭 What's Changed

  • [AL-2282] Store transform checkpoint number of processed samples (#2346) @FayazRahman
  • [AL-2275] DeepLakeVector module (#2313) @adolkhan
  • [AL-2287] Fix summary slowdown (#2356) @FayazRahman

⚙️ Who Contributes

@FayazRahman and @adolkhan

deeplake - v3.4.4 🌈

Published by github-actions[bot] over 1 year ago

🧭 What's Changed

  • Expose indra virtual tensors in deeplake (#2350) @khustup
  • Fix dtype bug (#2343) @FayazRahman
  • [AL-2277] Avoid producing corrupt datasets in transforms (#2339) @FayazRahman

⚙️ Who Contributes

@FayazRahman, @khustup, @levongh and @mikayelh

deeplake - v3.4.3 🌈

Published by github-actions[bot] over 1 year ago

🧭 What's Changed

  • bump libdeeplake version to 0.0.52 (#2348) @levongh

⚙️ Who Contributes

@FayazRahman and @levongh

deeplake - v3.4.2 🌈

Published by github-actions[bot] over 1 year ago

🧭 What's Changed

  • [AL-2280] Fix numpy slowdown with iteration and groups (#2345) @FayazRahman
  • [AL-2278] append_empty option in transforms (#2340) @FayazRahman
  • corrected tensor calculation logic (#2342) @levongh

⚙️ Who Contributes

@FayazRahman, @levongh and @mikayelh

deeplake - v3.4.1 🌈

Published by github-actions[bot] over 1 year ago

🧭 What's Changed

  • [AL-2215] Run transforms in processes for OSS dataloader (#2287) @AbhinavTuli
  • Fixed restrictions in docs (#2333) @istranic
  • Optimizing reporting (#2318) @istranic
  • [AL-2270] Transforms - Error if all samples are skipped +bugfixes (#2334) @FayazRahman
  • [AL-2215] Change byte calculation for PIL image in shuffle buffer (#2288) @AbhinavTuli
  • ds.extend speedup (#2328) @farizrahman4u

⚙️ Who Contributes

@AbhinavTuli, @FayazRahman, @farizrahman4u, @istranic and @levongh

deeplake - v3.4.0 🌈

Published by github-actions[bot] over 1 year ago

🧭 What's Changed

  • Dataset creation with DB Engine (#2289) @farizrahman4u
  • [AL-2086] Added data as decode_method to dataloaders (#2246) @AbhinavTuli
  • [AL-2269] Fix transform high memory usage (#2330) @FayazRahman
  • [AL-2249] Pop + Merge (#2323) @farizrahman4u
  • updated readme with vector db phrasing and comparisons (#2327) @mikayelh
  • fix typo in dataset.py (#2325) @eltociear
  • [AL-2206] Override platform credentials with ENV/User provided dictionary (#2314) @levongh
  • [AL-2267] Fix transform pad_data_in (#2315) @FayazRahman
  • Add embedding (#2309) @istranic

⚙️ Who Contributes

@AbhinavTuli, @FayazRahman, @ProgerDav, @eltociear, @farizrahman4u, @istranic, @levongh and @mikayelh

deeplake - v3.3.2 🌈

Published by github-actions[bot] over 1 year ago

🧭 What's Changed

  • [AL_2174] Fix tiling + indexing bug (#2302) @farizrahman4u
  • [AL-2252] Fix materialization for links (#2312) @FayazRahman
  • [AL-2247] Fix bug when appending with json tensor (#2303) @farizrahman4u
  • [AL-2268] Fix rechunk issue with poylgons (#2316) @FayazRahman
  • Added support for persistent_workers (#2311) @adolkhan
  • Test fix (#2308) @levongh
deeplake - v3.3.1 🌈

Published by github-actions[bot] over 1 year ago

🧭 What's Changed

  • [AL_2174] Fix tiling + indexing bug (#2302) @farizrahman4u
  • [AL-2252] Fix materialization for links (#2312) @FayazRahman
  • [AL-2247] Fix bug when appending with json tensor (#2303) @farizrahman4u
  • [AL-2268] Fix rechunk issue with poylgons (#2316) @FayazRahman
  • Added support for persistent_workers (#2311) @adolkhan
  • Test fix (#2308) @levongh

⚙️ Who Contributes

@FayazRahman, @adolkhan, @farizrahman4u and @levongh

deeplake - v3.3.0 🌈

Published by github-actions[bot] over 1 year ago

🧭 What's Changed

  • Bump version pre-release (#2306) @FayazRahman
  • Disable spinner with verbose = False (#2301) @FayazRahman
  • Set org_id for local datasets if environment variable is set (#2300) @farizrahman4u
  • [AL-2252] Update user not logged in and transform errors (#2299) @FayazRahman
  • [AL-2184] Adds Json and list support to enterprise dataloader (#2232) @AbhinavTuli
  • Temporarily disable S3 async flush (#2304) @FayazRahman
  • [AL-2038] Faster transforms (#2094) @FayazRahman
  • Added reporting for CLI token commands (#2297) @istranic
  • [AL-2227] Commit level info (#2271) @FayazRahman
  • Fix hard dependency on aioboto3 10.4.0 (#2296) @farizrahman4u
  • Video Query API - Load non linear views in deeplake (#2136) @adolkhan
  • Fix issue with async upload in notebook environments (#2295) @farizrahman4u
  • Devops/benchmarks (#2294) @artgish
  • Devops/benchmarks (#2293) @artgish
  • Devops/benchmarks (#2292) @artgish
  • Devops/benchmarks (#2291) @artgish
  • Devops/benchmarks (#2290) @artgish
  • Devops/benchmarks (#2276) @artgish
  • [AL-2238] Fix unexpected behaviour when islice is used on dataloader (#2286) @AbhinavTuli
  • Update Deep Lake version after release (#2285) @AbhinavTuli

⚙️ Who Contributes

@AbhinavTuli, @FayazRahman, @adolkhan, @artgish, @davidbuniat, @farizrahman4u, @istranic, @khustup and @levongh

deeplake - v3.2.22 🌈

Published by github-actions[bot] over 1 year ago

🧭 What's Changed

  • [AL-2235] [AL-2244] [AL-2245] Fix summary for views (#2278) @FayazRahman
  • Update environment API token (#2283) @FayazRahman
  • [AL-2137] Added optional inputs to kp coco (#2274) @istranic
  • mmdet version fix (#2279) @adolkhan
  • Write spinner to stderr (#2281) @FayazRahman
  • Catch all exceptions when initializing async libraries (#2282) @AbhinavTuli
  • Tests fix (#2273) @adolkhan
  • [AL-2212] Fix wrong data returned in sequences (#2272) @FayazRahman
  • Bugout blacklist (#2269) @istranic
  • [AL-2186] Fix warning when extending with None (#2241) @farizrahman4u
  • [AL-2229] Images always 3D (#2265) @farizrahman4u
  • Better rechunk logic post transform (#2263) @FayazRahman

⚙️ Who Contributes

@AbhinavTuli, @FayazRahman, @adolkhan, @farizrahman4u, @istranic and @mikayelh

deeplake - v3.2.21 🌈

Published by github-actions[bot] over 1 year ago

🧭 What's Changed

⚙️ Who Contributes

@AbhinavTuli and @levongh

deeplake - v3.2.19 🌈

Published by github-actions[bot] over 1 year ago

🧭 What's Changed

  • Hide spinner for agreement prompt (#2262) @FayazRahman
  • fix: hash_id catch wrong type. (#2249) @drahnreb
  • update benchmarks timeout (#2261) @artgish
  • View updates (#2259) @farizrahman4u
  • Updates to ingest_huggingface (#2256) @FayazRahman
  • Disabling summary for views (#2257) @istranic
  • [AL-2223] Better transform error handling + rollbacks in transform (#2253) @FayazRahman
  • Fixed bad link in docs (#2258) @istranic
  • [AL-2179] Reset option for load and checkout (#2231) @FayazRahman

⚙️ Who Contributes

@AbhinavTuli, @FayazRahman, @artgish, @drahnreb, @farizrahman4u and @istranic

deeplake - v3.2.18 🌈

Published by github-actions[bot] over 1 year ago

🧭 What's Changed

  • Update Deep Lake version (#2252) @AbhinavTuli
  • Read data efficiently by reusing storage providers (#2245) @FayazRahman
  • [AL-2114] Improved Error propogation (#2195) @AbhinavTuli
  • [AL-2170] Handle pad nones differently (#2236) @farizrahman4u

⚙️ Who Contributes

@AbhinavTuli, @FayazRahman and @farizrahman4u

deeplake - v3.2.17 🌈

Published by github-actions[bot] over 1 year ago

🧭 What's Changed

  • [DL-997] Feature/generalize ingest dataframe (#2216) @istranic
  • [AL-2213] Fix popping from sequences (#2238) @FayazRahman
  • [AL-2205] Fix accessing cache with transforms (#2242) @FayazRahman
  • [AL-2176] Ignore wandb exceptions (#2239) @farizrahman4u
  • Temporarily disable apng compression (#2234) @AbhinavTuli
  • Token update (#2244) @levongh

⚙️ Who Contributes

@AbhinavTuli, @FayazRahman, @ProgerDav, @farizrahman4u, @istranic and @levongh

deeplake - v3.2.16 🌈

Published by github-actions[bot] over 1 year ago

🧭 What's Changed

  • Bump libdeeplake version (#2237) @levongh
  • Combine update_creds_key and change_creds_management into a single method (#2224) @AbhinavTuli
  • Add benchmarks (#2227) @artgish
  • Fixed undefined ASYNC_INSTALLED error. (#2235) @khustup
  • Remove hub dependency (#2229) @farizrahman4u
  • Disable async flush in case import fails (#2233) @AbhinavTuli
  • [AL-2171] Flush data asynchronously to S3, speed up uploads and version control operations (#2184) @AbhinavTuli
  • Updated intrinsics docstring (#2230) @istranic

⚙️ Who Contributes

@AbhinavTuli, @artgish, @farizrahman4u, @istranic, @khustup and @levongh

deeplake - v3.2.15 🌈

Published by github-actions[bot] over 1 year ago

🧭 What's Changed

  • Update libdeeplake (#2228) @AbhinavTuli

⚙️ Who Contributes

@AbhinavTuli

deeplake - v3.2.14 🌈

Published by github-actions[bot] over 1 year ago

🧭 What's Changed

  • Automatically rechunk uncompressed tensors at the end of transform (#2201) @FayazRahman
  • Adds the ability to return dummy data from dataloader for debugging purposes (#2190) @AbhinavTuli
  • Load VDS in same read_only mode as parent (#2225) @FayazRahman
  • [AL-2185] Return empty sample if downsampling fails due to any reason (#2200) @AbhinavTuli
  • MMDet GPU fix (#2223) @adolkhan
  • Intrinsics (#2207) @farizrahman4u
  • Mmdet validation fix (#2215) @adolkhan

⚙️ Who Contributes

@AbhinavTuli, @FayazRahman, @adolkhan and @farizrahman4u

deeplake - v3.2.13 🌈

Published by github-actions[bot] over 1 year ago

🧭 What's Changed

  • [AL-2177] Fix delete error message (#2214) @FayazRahman
  • Better behaviour of .numpy with grayscale images in linked tensors + fixes link materialization (#2203) @AbhinavTuli
  • [AL-2187] Fix transforms with processed scheduler (#2212) @FayazRahman
  • Update credentials before creating enterprise dataloader (#2217) @AbhinavTuli
  • Version control updates (#2181) @farizrahman4u
  • ds.append slowdown fix (#2210) @farizrahman4u

⚙️ Who Contributes

@AbhinavTuli, @FayazRahman and @farizrahman4u

deeplake - v3.2.12 🌈

Published by github-actions[bot] over 1 year ago

🧭 What's Changed

  • Fix update sample test (#2208) @FayazRahman

⚙️ Who Contributes

@AbhinavTuli and @FayazRahman

deeplake - v3.2.11 🌈

Published by github-actions[bot] over 1 year ago

🧭 What's Changed

  • Revert mmdet validation fix (#2205) @adolkhan

⚙️ Who Contributes

@adolkhan and @davidbuniat