FastMLX is a high performance production ready API to host MLX models.
OTHER License
Bot releases are visible (Hide)
Full Changelog: https://github.com/Blaizzy/fastmlx/compare/v0.2.0...v0.2.1
Published by Blaizzy 2 months ago
Environment Configuration (PR #15 by @SiddhantSadangi):
workers
through environment variablesTool Calling Support (PR #21 by @Blaizzy):
Refactor Vision Language Models stream_generate (PR #21 by @Blaizzy).
Full Changelog: https://github.com/Blaizzy/fastmlx/compare/v0.1.0...v0.2.0
Published by Blaizzy 3 months ago
Full Changelog: https://github.com/Blaizzy/fastmlx/compare/v0.0.1...v0.1.0
Published by Blaizzy 3 months ago
Full Changelog: https://github.com/Blaizzy/fastmlx/commits/v0.0.1