deeplake

Database for AI. Store Vectors, Images, Texts, Videos, etc. Use with LLMs/LangChain. Store, query, version, & visualize any AI data. Stream data in real-time to PyTorch/TensorFlow. https://activeloop.ai

MPL-2.0 License

Downloads
56K
Stars
7.8K
Committers
121
View Code on GitHub Visit Website View on X
Ecosystems: PyTorch, Tensorflow, Python, Langchain

Bot releases are visible (Hide)

deeplake - v3.8.4 🌈

Published by github-actions[bot] 12 months ago

🧭 What's Changed

  • Incremental Index Maintenance. (#2633) @sounakr
  • Deep memory waitlist (#2678) @adolkhan
  • Multiple typos inside /docs fixed. (#2667) @parikshit-adhikari
  • Removing "enterprise" terminology (#2672) @nvoxland

⚙️ Who Contributes

@adolkhan, @levongh, @nvoxland, @parikshit-adhikari and @sounakr

deeplake - v3.8.3 🌈

Published by github-actions[bot] 12 months ago

🧭 What's Changed

  • Deep memory fixes (#2662) @adolkhan
  • Update README.md (#2668) @istranic
  • Fixed: name 'TorchDataset' is not defined (#2664) @levongh

⚙️ Who Contributes

@adolkhan, @istranic, @levongh and @nvoxland

deeplake - v3.8.2 🌈

Published by github-actions[bot] about 1 year ago

🧭 What's Changed

  • Remove default image dtype (#2659) @FayazRahman
  • dataloader signature changes (#2660) @levongh
  • Switch to lz4 block. (#2657) @khustup

⚙️ Who Contributes

@FayazRahman, @khustup, @levongh and @nvoxland

deeplake - v3.8.1 🌈

Published by github-actions[bot] about 1 year ago

🧭 What's Changed

  • Added sample_indices api to virtual tensors. (#2654) @khustup
  • Deep memory typo fix (#2653) @adolkhan
  • VectorStore docs fix (#2655) @adolkhan
  • Saving views of views (#2649) @FayazRahman
  • Brought back index regeneration (#2648) @istranic
  • Switch lz4 implementation to python-lz4 (#2645) @FayazRahman

⚙️ Who Contributes

@FayazRahman, @adolkhan, @istranic, @khustup and @nvoxland

deeplake - v3.8.0 🌈

Published by github-actions[bot] about 1 year ago

🧭 What's Changed

  • Deep Memory search speed up (#2646) @adolkhan
  • Deep Memory virtual tensors support (#2643) @adolkhan
  • Better view saving error message (#2639) @FayazRahman
  • Bump libdeeplake version. (#2642) @khustup

⚙️ Who Contributes

@FayazRahman, @adolkhan, @davidbuniat, @khustup, @levongh and @nvoxland

deeplake - v3.7.3 🌈

Published by github-actions[bot] about 1 year ago

🧭 What's Changed

  • Deep Memory support on aws (#2635) @adolkhan
  • [AL-2417] Fix transform memory leak (#2631) @FayazRahman
  • [AL-2419] [AL-2416] Fixes for tensor.path and tensor.creds_key (#2620) @FayazRahman
  • [AL-2422] Tensor update by __setattr__ (#2632) @FayazRahman
  • Deep memory support in VectorStore (#2594) @adolkhan

⚙️ Who Contributes

@FayazRahman, @adolkhan and @nvoxland

deeplake - v3.7.2 🌈

Published by github-actions[bot] about 1 year ago

🧭 What's Changed

  • Fixed cursor disappear on fast spinners. (#2623) @khustup
  • added libdeeplake to default extras list (#2627) @levongh
  • Fixed virtual tensor test. (#2625) @khustup

⚙️ Who Contributes

@khustup, @levongh and @nvoxland

deeplake - v3.7.1 🌈

Published by github-actions[bot] about 1 year ago

🧭 What's Changed

  • Fix default metric and virtual tensor logic (#2616) @istranic

⚙️ Who Contributes

@istranic and @nvoxland

deeplake - v3.7.0 🌈

Published by github-actions[bot] about 1 year ago

🧭 What's Changed

  • Index regeneration on maintenance (#2489) @sounakr
  • Ability to release resources associated with a DataLoader (#2611) @levongh
  • Removed typing_extensions usage (#2610) @nvoxland
  • test_vdb_indexes.py::Test case fix. (#2614) @sounakr
  • added verbose argument to ds.dataloader (#2608) @levongh
  • [AL-2413] Iterative implementation of merging node maps (#2600) @FayazRahman
  • [AL-2414] ds.extend for transforms (#2606) @FayazRahman
  • Cache size propagete to libdeeplake. (#2607) @khustup
  • Fixed query chaining. (#2609) @khustup
  • enable python3.11 for linux dists (#2603) @levongh
  • Fixed large file upload, by passing bytes instead of bytearray. (#2604) @khustup
  • Set default embedding htype to float32 (#2595) @FayazRahman

⚙️ Who Contributes

@FayazRahman, @istranic, @khustup, @levongh, @nvoxland and @sounakr

deeplake - v3.6.26 🌈

Published by github-actions[bot] about 1 year ago

🧭 What's Changed

  • Updated deeplake.random.seed documentation (#2593) @levongh
  • [AL-2405] Add ability to change htype (#2590) @FayazRahman
  • [AL-2409] Enable local dataset usage with Indra (#2573) @adolkhan
  • Allow libdeeplake with python 3.11 (#2592) @levongh

⚙️ Who Contributes

@FayazRahman, @adolkhan, @istranic, @levongh and @nvoxland

deeplake - v3.6.25 🌈

Published by github-actions[bot] about 1 year ago

🧭 What's Changed

  • Adding Rate limiter parameters to VectorStore add function (#2578) @adolkhan
  • [AL-2411] Fix Azure download of empty blobs (#2584) @FayazRahman
  • Remove dataloader close (#2589) @levongh

⚙️ Who Contributes

@FayazRahman, @adolkhan, @levongh and @nvoxland

deeplake - v3.6.24 🌈

Published by github-actions[bot] about 1 year ago

🧭 What's Changed

  • bump libdeeplake version to 0.0.75 (#2587) @levongh
  • correct indent (#2585) @levongh
  • [AL-2406] ignore_errors param for tensor.extend (#2577) @FayazRahman
  • Correctly load chunks with larger headers (#2574) @nvoxland

⚙️ Who Contributes

@FayazRahman, @levongh and @nvoxland

deeplake - v3.6.23 🌈

Published by github-actions[bot] about 1 year ago

🧭 What's Changed

  • Added .offset parameter to enterprise dataloader (#2579) @levongh
  • Updated docs for delete_branch() (#2572) @nvoxland
  • Fixed failing build (#2576) @nvoxland
  • Fixed failing build (#2575) @nvoxland
  • added torch batch_sampler (#2571) @levongh
  • Improved test execution (#2482) @nvoxland
  • Removing Version Control in Vector Store (#2569) @istranic
  • Better metadata search (#2444) @istranic
  • Vector Store Memory leak Fix (#2570) @adolkhan

⚙️ Who Contributes

@adolkhan, @istranic, @levongh and @nvoxland

deeplake - v3.6.22 🌈

Published by github-actions[bot] about 1 year ago

🧭 What's Changed

  • Vectorstore numpy version fix (#2567) @adolkhan
  • Fix support for deeplake.random.seed() on python 3.9 and earlier (#2564) @nvoxland
  • [AL-2255] Proper rollbacks for extend in case of failures (#2566) @FayazRahman
  • Fix create_tensor(..., exist_ok=True) behavior with htypes (#2557) @FayazRahman
  • Libdeeplake 0 0 73 (#2565) @levongh

⚙️ Who Contributes

@FayazRahman, @adolkhan, @levongh and @nvoxland

deeplake - v3.6.21 🌈

Published by github-actions[bot] about 1 year ago

🧭 What's Changed

  • Ingest deprecation (#2558) @adolkhan
  • bump libdeeplake version to 0.0.71 (#2560) @levongh

⚙️ Who Contributes

@FayazRahman, @adolkhan and @levongh

deeplake - v3.6.20 🌈

Published by github-actions[bot] about 1 year ago

🧭 What's Changed

  • Allow user-control of random seeds (#2537) @levongh
  • [AL-2332] Suggest ignore_errors flag in extend and transform (#2549) @FayazRahman
  • Rate limit fix (#2544) @adolkhan
  • langchain tests (#2554) @zaaram
  • Batched azure storage clear (#2550) @FayazRahman
  • [AL-2401] Fix spinner closed IO error after pytest exit (#2551) @FayazRahman
  • [AL-2400] Set query as default view message (#2543) @FayazRahman
  • [AL-2402] Fix LRUCache unpickle (#2542) @FayazRahman
  • Updated version for 3.6.20 (#2541) @nvoxland

⚙️ Who Contributes

@FayazRahman, @adolkhan, @davidbuniat, @levongh, @nvoxland, @zaaram and Ubuntu

deeplake - v3.6.19 🌈

Published by github-actions[bot] about 1 year ago

🧭 What's Changed

  • Set VectorStore.search embedding argument type (#2538) @adolkhan
  • Handle closed I/O error in spinner (#2520) @FayazRahman
  • [AL-2392][BUGFIX] ds.pop() not working as expected (#2536) @FayazRahman
  • Added _squash_main() method (#2532) @nvoxland
  • Exec option autocasting fix (#2534) @adolkhan

⚙️ Who Contributes

@FayazRahman, @adolkhan and @nvoxland

deeplake - v3.6.18 🌈

Published by github-actions[bot] about 1 year ago

🧭 What's Changed

  • Fix sub-dataset length calculation (#2533) @levongh
  • Error out for invalid path in deeplake.delete (#2522) @FayazRahman
  • Add progress bar to ds.extend (#2527) @FayazRahman
  • [AL-2373] Init used creds (#2528) @levongh
  • [AL-2373] Limit subprocess threads (#2525) @levongh

⚙️ Who Contributes

@FayazRahman, @levongh and @nvoxland

deeplake - v3.6.17 🌈

Published by github-actions[bot] about 1 year ago

🧭 What's Changed

  • Fixed List[str] annotation in delete_branch feature (#2518) @nvoxland

⚙️ Who Contributes

@FayazRahman, @davidbuniat and @nvoxland

deeplake - v3.6.16 🌈

Published by github-actions[bot] about 1 year ago

🧭 What's Changed

  • [AL-2353] Add delay for transform progress bar updates (#2515) @FayazRahman
  • [AL-2360] Added dataset.delete_branch() feature (#2499) @nvoxland
  • Reuse indra dataset in query. (#2513) @khustup
  • Read only mode autocasting for VectorStore (#2506) @adolkhan
  • fix ternary operator (#2514) @levongh

⚙️ Who Contributes

@FayazRahman, @adolkhan, @khustup, @levongh and @nvoxland

Package Rankings
Top 1.35% on Pypi.org
Top 6.75% on Proxy.golang.org
Badges
Extracted from project README
Visualizer deeplake
Related Projects
DLTK

Deep Learning Toolkit for Medical Image Analysis

02 May 2017 1,426
datasets

🤗 The largest hub of ready-to-use datasets for ML models with fast, easy-to-use and efficient dat...

26 Mar 2020 18,550
io

Dataset, streaming, and file system extensions maintained by TensorFlow SIG-IO

09 Nov 2018 690
machine-learning-curriculum

Learn to make machines learn so that you don't have to struggle to program them; The ultimate list

12 Dec 2016 1,084
deephyper

DeepHyper: Scalable Asynchronous Neural Architecture and Hyperparameter Search for Deep Neural Ne...

06 Nov 2018 271
deepxde

A library for scientific machine learning and physics-informed learning

08 Feb 2019 2,634
Open3D-ML

An extension of Open3D to address 3D Machine Learning tasks

01 Jul 2020 1,824
djl

An Engine-Agnostic Deep Learning Framework in Java

29 Oct 2019 4,084
dlio_benchmark

An I/O benchmark for deep Learning applications

22 Aug 2022 61