fast-sentence-transformers

Simply, faster, sentence-transformers

MIT License

Stars

135

Committers

View Code on GitHub

Ecosystems: Python

fast-sentence-transformers - added support for token_embeddings Latest Release

Published by davidberenstein1957 almost 2 years ago

fast-sentence-transformers - added support for Automodels via MeanPooling

Published by davidberenstein1957 almost 2 years ago

fast-sentence-transformers - resolve normalization bug

Published by davidberenstein1957 almost 2 years ago

fast-sentence-transformers - resolved quantization bug

Published by davidberenstein1957 almost 2 years ago

Resolve AttributeError: 'str' object has no attribute 'SerializeToString' by removing SerializeToString() call.

fast-sentence-transformers - added support for M1 mac serialization

Published by davidberenstein1957 almost 2 years ago

allow for mac m1 serialization
https://github.com/microsoft/onnxruntime/pull/800#issuecomment-844326099
https://github.com/Pandora-Intelligence/classy-classification/issues/14

fast-sentence-transformers - resolved missing onnx dependency

Published by davidberenstein1957 about 2 years ago

fast-sentence-transformers - added classification Labels class to txtai legacy code

Published by davidberenstein1957 about 2 years ago

fast-sentence-transformers - resolved some issues to smoothen integration with classy-classification and resolve risky dependencies

Published by davidberenstein1957 about 2 years ago

added support for newer Python versions
removed risky package dependencies
removed dependency overhead txtai.

fast-sentence-transformers - resolved numpy and pillow security issues, and ensured proper onnx model caching

Published by davidberenstein1957 over 2 years ago

fast-sentence-transformers - added GPU support via onnruntime-gpu

Published by davidberenstein1957 over 2 years ago

fast-sentence-transformers - set normalize_embeddings to false

Published by davidberenstein1957 over 2 years ago

fast-sentence-transformers - added batch support

Published by davidberenstein1957 over 2 years ago

fast-sentence-transformers - added more lenient requirements

Published by davidberenstein1957 over 2 years ago

fast-sentence-transformers - added benchmarks

Published by davidberenstein1957 over 2 years ago

fast-sentence-transformers - testing auto-release

Published by davidberenstein1957 over 2 years ago

fast-sentence-transformers - Initial working version.

Published by davidberenstein1957 over 2 years ago

Badges

Extracted from project README

Code style: black

Related Projects

GPTune

Fine tuning experiments for the GPT-2 model by OpenAI.

simplerepresentations

Easy-to-use text representations extraction library based on the Transformers library.

accelerate

🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed conf...

30 Oct 2020 7,759

fast-transformer-pytorch

Implementation of Fast Transformer in Pytorch

23 Aug 2021 171

kanformer

Naively combining transformers and Kolmogorov-Arnold Networks to learn and experiment

TransformerEngine

A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating poin...

20 Sep 2022 1,482

starcoder2

Home of StarCoder2!

08 Dec 2023 1,732

plain-transformers

Transformer models implementation for training from scratch.

llm-inference-benchmark

LLM Inference benchmark

12 Dec 2023 341

starcoder

Home of StarCoder: fine-tuning & inference!

24 Apr 2023 7,267

TUPE

Transformer with Untied Positional Encoding (TUPE). Code of paper "Rethinking Positional Encoding...

24 Jun 2020 249

fastxtend

Train fastai models faster (and other useful tools)

transformer-deploy

Efficient, scalable and enterprise-grade CPU/GPU inference server for 🤗 Hugging Face transformer ...

31 Oct 2021 1,644