vertex-ai-huggingface-inference-toolkit

🤗 HuggingFace Inference Toolkit for Google Cloud Vertex AI (similar to SageMaker's Inference Toolkit, but for Vertex AI and unofficial)

APACHE-2.0 License

Downloads
349
Stars
17
View Code on GitHub Visit Website View on X
Ecosystems: Python

Issue Statistics

Past Year

All Time

Total Pull Requests
1
1
Merged Pull Requests
1
1
Total Issues
0
0
Time to Close Issues
N/A
N/A
Package Rankings
Top 37.09% on Pypi.org
Related Projects
hmBench

hmBench: Fine-Tuning, Evaluating & Benchmarking of Historic Language Models on NER Datasets

05 Oct 2023 4
TransformerEngine

A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating poin...

20 Sep 2022 1,482
FastChat

An open platform for training, serving, and evaluating large language models. Release repo for Vi...

19 Mar 2023 36,628
llmware

Providing enterprise-grade LLM-based development framework, tools, and fine-tuned models.

29 Sep 2023 3,057
PixArt-alpha

PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesis

12 Oct 2023 2,138
aidapter

Adapter / facade for language models (OpenAI, Anthropic, Cohere, local transformers, etc)

23 May 2023 18
IF

DeepFloyd-IF (Imagen Free)

20 Jan 2023 7,656
grouphug

Multi-task modelling extensions for huggingface transformers

19 Jun 2022 12
starcoder

Home of StarCoder: fine-tuning & inference!

24 Apr 2023 7,267
longformer

Longformer: The Long-Document Transformer

31 Mar 2020 1,970
transformer-deploy

Efficient, scalable and enterprise-grade CPU/GPU inference server for 🤗 Hugging Face transformer ...

31 Oct 2021 1,644
video-transformers

Easiest way of fine-tuning HuggingFace video classification models

12 Aug 2022 131
mm-cot

Official implementation for "Multimodal Chain-of-Thought Reasoning in Language Models" (stay tune...

02 Feb 2023 3,760