infinity

What's Changed

• docs update by @michaelfeil in https://github.com/michaelfeil/infinity/pull/315
• weakref-sync by @michaelfeil in https://github.com/michaelfeil/infinity/pull/318
• Update pyproject.toml by @michaelfeil in https://github.com/michaelfeil/infinity/pull/322

Full Changelog: https://github.com/michaelfeil/infinity/compare/0.0.52...0.0.53

What's Changed

• [Client] add initial client code by @michaelfeil in https://github.com/michaelfeil/infinity/pull/292
• Add a prefix to the openapi document by @wangm23456 in https://github.com/michaelfeil/infinity/pull/296
• update embed package by @michaelfeil in https://github.com/michaelfeil/infinity/pull/302
• Benchmark update with embed by @michaelfeil in https://github.com/michaelfeil/infinity/pull/311
• optimization onnx with optimum by @michaelfeil in https://github.com/michaelfeil/infinity/pull/310
• lock poetry by @michaelfeil in https://github.com/michaelfeil/infinity/pull/312
• Add flash_attn support (#306) by @michaelfeil in https://github.com/michaelfeil/infinity/pull/313

New Contributors

• @wangm23456 made their first contribution in https://github.com/michaelfeil/infinity/pull/296

Full Changelog: https://github.com/michaelfeil/infinity/compare/0.0.51...0.0.52

What's Changed

• Fix reading INFINITY_API_KEY from environment by @chiragjn in https://github.com/michaelfeil/infinity/pull/289

Full Changelog: https://github.com/michaelfeil/infinity/compare/0.0.50...0.0.51

What's Changed

• Fix auth when no token is passed + add auth to /models by @chiragjn in https://github.com/michaelfeil/infinity/pull/287
• Update tests for #287 by @chiragjn in https://github.com/michaelfeil/infinity/pull/288

Full Changelog: https://github.com/michaelfeil/infinity/compare/0.0.49...0.0.50

What's Changed

• Update skypilot-infinity.yaml by @michaelfeil in https://github.com/michaelfeil/infinity/pull/284
• Bump simpleinference by @michaelfeil in https://github.com/michaelfeil/infinity/pull/285
• api changes sync async by @michaelfeil in https://github.com/michaelfeil/infinity/pull/286

Full Changelog: https://github.com/michaelfeil/infinity/compare/0.0.48...0.0.49

What's Changed

• refactor sync engine by @michaelfeil in https://github.com/michaelfeil/infinity/pull/282

Full Changelog: https://github.com/michaelfeil/infinity/compare/0.0.47...0.0.48

What's Changed

• add nightly and pypi pull by @michaelfeil in https://github.com/michaelfeil/infinity/pull/274
• refactor modal webserver by @charlesfrye in https://github.com/michaelfeil/infinity/pull/275
• add sync array by @michaelfeil in https://github.com/michaelfeil/infinity/pull/277
• fix: vision unpin by @michaelfeil in https://github.com/michaelfeil/infinity/pull/279
• simplify-ci by @michaelfeil in https://github.com/michaelfeil/infinity/pull/278
• add easyinference by @michaelfeil in https://github.com/michaelfeil/infinity/pull/280

New Contributors

• @charlesfrye made their first contribution in https://github.com/michaelfeil/infinity/pull/275

Full Changelog: https://github.com/michaelfeil/infinity/compare/0.0.46...0.0.47

What's Changed

• add infra folder by @michaelfeil in https://github.com/michaelfeil/infinity/pull/272
• add CI/CD for infra by @michaelfeil in https://github.com/michaelfeil/infinity/pull/273

Full Changelog: https://github.com/michaelfeil/infinity/compare/0.0.45...0.0.46

What's Changed

• add new sigterm for preload-only flag by @michaelfeil in https://github.com/michaelfeil/infinity/pull/271

Full Changelog: https://github.com/michaelfeil/infinity/compare/0.0.44...0.0.45

What's Changed

• add pypi release by @michaelfeil in https://github.com/michaelfeil/infinity/pull/270

Full Changelog: https://github.com/michaelfeil/infinity/compare/0.0.43...0.0.44

What's Changed

• impove bettertransformer interface by @michaelfeil in https://github.com/michaelfeil/infinity/pull/260
• Add support to pass root_path to FastAPI app by @chiragjn in https://github.com/michaelfeil/infinity/pull/261
• Update on docs and poetry by @michaelfeil in https://github.com/michaelfeil/infinity/pull/265

Full Changelog: https://github.com/michaelfeil/infinity/compare/0.0.42...0.0.43

Full Changelog: https://github.com/michaelfeil/infinity/compare/0.0.41...0.0.42

fix for clip

What's Changed

• fix pytest, rename reranker model by @michaelfeil in https://github.com/michaelfeil/infinity/pull/248
• Clip embeddings parallel by @michaelfeil in https://github.com/michaelfeil/infinity/pull/251
• clip - server follow up by @michaelfeil in https://github.com/michaelfeil/infinity/pull/249
• Transformers 4.41 bump by @michaelfeil in https://github.com/michaelfeil/infinity/pull/257

PUBLIC API CHANGE in python (internal modules no longer exposed, exposing multi-model API)

Full Changelog: https://github.com/michaelfeil/infinity/compare/0.0.40...0.0.41

What's Changed

• add embedding quantization interface by @michaelfeil in https://github.com/michaelfeil/infinity/pull/247

Full Changelog: https://github.com/michaelfeil/infinity/compare/0.0.39...0.0.40

What's Changed

• update cli autoresolve by @michaelfeil in https://github.com/michaelfeil/infinity/pull/240

Full Changelog: https://github.com/michaelfeil/infinity/compare/0.0.38...0.0.39

What's Changed

• update poetry lock to latest by @michaelfeil in https://github.com/michaelfeil/infinity/pull/234
• Add auth and classify endpoint to openai server by @Rololi in https://github.com/michaelfeil/infinity/pull/237
• ENV-Manager update by @michaelfeil in https://github.com/michaelfeil/infinity/pull/238

New Contributors

• @Rololi made their first contribution in https://github.com/michaelfeil/infinity/pull/237

Full Changelog: https://github.com/michaelfeil/infinity/compare/0.0.37...0.0.38

What's Changed

• bump sentence-transformers to 3.0 by @michaelfeil in https://github.com/michaelfeil/infinity/pull/232
• Add einops as extra dependency by @chiragjn in https://github.com/michaelfeil/infinity/pull/233

Full Changelog: https://github.com/michaelfeil/infinity/compare/0.0.36...0.0.37

What's Changed

• add infinity server kwargs for device by @michaelfeil in https://github.com/michaelfeil/infinity/pull/230

Full Changelog: https://github.com/michaelfeil/infinity/compare/0.0.35...0.0.36

What's Changed

• update docs: v2 cli and async request handling by @michaelfeil in https://github.com/michaelfeil/infinity/pull/229

Full Changelog: https://github.com/michaelfeil/infinity/compare/0.0.34...0.0.35

What's Changed

• Add option to enable permissive CORS headers to allow api access from… by @kir-gadjello in https://github.com/michaelfeil/infinity/pull/214
• add v2 to CLI by @michaelfeil in https://github.com/michaelfeil/infinity/pull/227
• Add revision and trust_remote_code to from_pretrained calls by @chiragjn in https://github.com/michaelfeil/infinity/pull/224

New Contributors

• @kir-gadjello made their first contribution in https://github.com/michaelfeil/infinity/pull/214
• @chiragjn made their first contribution in https://github.com/michaelfeil/infinity/pull/224

Full Changelog: https://github.com/michaelfeil/infinity/compare/0.0.33...0.0.34