fastmlx

What's Changed

• Fix tools template loader (Jinja 2 Template not found error) by @Blaizzy in https://github.com/Blaizzy/fastmlx/pull/25

Full Changelog: https://github.com/Blaizzy/fastmlx/compare/v0.2.0...v0.2.1

What's New

1. Environment Configuration (PR #15 by @SiddhantSadangi):

   • Set workers through environment variables
   • Improved default settings

2. Tool Calling Support (PR #21 by @Blaizzy):

   • Added functionality for tool calling
   • Supports parallel tool calling mode
   • Models
     • Llama 3.1
     • Arcee Agent
     • Firefunction
     • xLAM
     • C4AI-Command-R-Plus
   • Modes
     • Standard (Without Streaming)
     • Parallel Tool Calling

3. Refactor Vision Language Models stream_generate (PR #21 by @Blaizzy).

New Contributors

• @SiddhantSadangi made their first contribution in https://github.com/Blaizzy/fastmlx/pull/15

Full Changelog: https://github.com/Blaizzy/fastmlx/compare/v0.1.0...v0.2.0

What's Changed

• Add support for token streaming and custom CORS by @Blaizzy in https://github.com/Blaizzy/fastmlx/pull/4
• Add support for Parallel calls by @Blaizzy in https://github.com/Blaizzy/fastmlx/pull/4
• Add Parallel calls usage by @Blaizzy in https://github.com/Blaizzy/fastmlx/pull/7

Fixes :

• Cross origin Support #2
• Max tokens not overriding #5

Full Changelog: https://github.com/Blaizzy/fastmlx/compare/v0.0.1...v0.1.0

What's Changed

• Setup FastMLX by @Blaizzy in https://github.com/Blaizzy/fastmlx/pull/1
• Add support for VLMs by @Blaizzy in https://github.com/Blaizzy/fastmlx/pull/1
• Add support for LMs by by @Blaizzy in https://github.com/Blaizzy/fastmlx/pull/1

New Contributors

• @Blaizzy made their first contribution in https://github.com/Blaizzy/fastmlx/pull/1

Full Changelog: https://github.com/Blaizzy/fastmlx/commits/v0.0.1