batched-fn

🦀 Rust server plugin for deploying deep learning models with batched prediction

APACHE-2.0 License

Downloads
16.2K
Stars
18
Committers
2
View Code on GitHub Visit Website
Ecosystems: Rust

Commit Statistics

Past Year

All Time

Total Commits
0
58
Total Committers
0
2
Avg. Commits Per Committer
0.0
29.0
Bot Commits
4

Issue Statistics

Past Year

All Time

Total Pull Requests
1
19
Merged Pull Requests
1
16
Total Issues
1
7
Time to Close Issues
5 days
4 days
Package Rankings
Top 24.11% on Crates.io
Related Projects
text-embeddings-inference

A blazing fast inference solution for text embeddings models

13 Oct 2023 2,039
ort-batcher

Small crate to batch inferences of ONNX models using ort (onnxruntime)

17 Nov 2023 2
async-select

`select!` multiplex asynchronous futures simultaneously

09 May 2024 0
futures-batch

An adapter for futures, which chunks up elements and flushes them after a timeout — or when the b...

24 Oct 2017 76