py-txi

A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.

APACHE-2.0 License

Downloads
552
Stars
31
View Code on GitHub
Ecosystems: Python
Package Rankings
Top 37.07% on Pypi.org
Badges
Extracted from project README
PyPI version PyPI - Python Version PyPI - Format Downloads PyPI - License Test
Related Projects
textsum

CLI & Python API to easily summarize text-based files with transformers

18 Dec 2022 122
starcoder

Home of StarCoder: fine-tuning & inference!

24 Apr 2023 7,267
IncognitoPilot

An AI code interpreter for sensitive data, powered by GPT-4 or Code Llama / Llama 2.

15 Jul 2023 397
towhee

Towhee is a framework that is dedicated to making neural data processing pipelines simple and fast.

13 Jul 2021 3,180
transformer-deploy

Efficient, scalable and enterprise-grade CPU/GPU inference server for 🤗 Hugging Face transformer ...

31 Oct 2021 1,644
localGPT

Chat with your documents on your local device using GPT models. No data leaves your device and 10...

24 May 2023 19,925
vertex-ai-huggingface-inference-toolkit

🤗 HuggingFace Inference Toolkit for Google Cloud Vertex AI (similar to SageMaker's Inference Tool...

01 Mar 2024 17
manga-image-translator

Translate manga/image 一键翻译各类图片内文字 https://cotrans.touhou.ai/

18 Feb 2021 3,799
languagemodels

Explore large language models in 512MB of RAM

07 May 2023 1,154
tfi

Use any TensorFlow model in a single line of code

12 Sep 2017 152
kotaemon

An open-source RAG-based tool for chatting with your documents.

25 Mar 2024 11,434
txtai

💡 All-in-one open-source embeddings database for semantic search, LLM orchestration and language ...

09 Aug 2020 6,914
instructor-embedding

[ACL 2023] One Embedder, Any Task: Instruction-Finetuned Text Embeddings

17 Dec 2022 1,844
Qwen

The official repo of Qwen (通义千问) chat & pretrained large language model proposed by Alibaba Cloud.

03 Aug 2023 11,522
llm-infer-bench

22 Aug 2023 11