embedding-reader

Efficiently read embedding in streaming from any filesystem

MIT License

Downloads
409.9K
Stars
94
View Code on GitHub
Ecosystems: Python

Bot releases are hidden (Show)

No releases found yet, please check back later.
Package Rankings
Top 2.65% on Pypi.org
Badges
Extracted from project README
pypi Open In Colab Try it on gitpod
Related Projects
bulk

A Simple Bulk Labelling Tool

25 May 2022 487
word_knn

Quickly find closest words using an efficient knn and word embeddings

24 Aug 2019 6
bilm-tf

Tensorflow implementation of contextualized word representations from bi-directional language models

29 Sep 2017 1,620
generative-models

Generative Models by Stability AI

22 Jun 2023 24,227
granular

Fast dataset format and loader

27 Jun 2024 17
audio2dataset

Easily turn large sets of audio urls to an audio dataset.

15 May 2022 20
cc2dataset

Easily convert common crawl to a dataset of caption and document. Image/text Audio/text Video/tex...

29 Nov 2022 303
embeddings

Fast, DB Backed pretrained word embeddings for natural language processing.

27 Feb 2017 222
gaussian-splatting

Original reference implementation of "3D Gaussian Splatting for Real-Time Radiance Field Rendering"

04 Jul 2023 13,857
spacy-extreme

An example of how to use spaCy for extremely large files without running into memory issues

03 May 2019 35
any2dataset

Turn any collection of files into a dataset

06 Jan 2023 42
img2dataset

Easily turn large sets of image urls to an image dataset. Can download, resize and package 100M u...

11 Aug 2021 3,256
Megatron-DeepSpeed

Ongoing research training transformer language models at scale, including: BERT & GPT-2

02 Jul 2021 1,323
starcoder

Home of StarCoder: fine-tuning & inference!

24 Apr 2023 7,267
languagemodels

Explore large language models in 512MB of RAM

07 May 2023 1,154