safetensors

What's Changed

• Updating minor after release 0.4.2 by @Narsil in https://github.com/huggingface/safetensors/pull/433
• Adding support for integer indexing [0, :2, -1]. by @Narsil in https://github.com/huggingface/safetensors/pull/440
• Updating doc. by @Narsil in https://github.com/huggingface/safetensors/pull/465
• Add support for device in safetensors.torch.load_model by @Wauplin in https://github.com/huggingface/safetensors/pull/449
• Upgrading pyo3 to 0.21. by @Narsil in https://github.com/huggingface/safetensors/pull/468

Full Changelog: https://github.com/huggingface/safetensors/compare/v0.4.2...v0.4.3

What's Changed

• Updating minor after release 0.4.2 by @Narsil in https://github.com/huggingface/safetensors/pull/433
• Adding support for integer indexing [0, :2, -1]. by @Narsil in https://github.com/huggingface/safetensors/pull/440
• Updating doc. by @Narsil in https://github.com/huggingface/safetensors/pull/465
• Add support for device in safetensors.torch.load_model by @Wauplin in https://github.com/huggingface/safetensors/pull/449
• Upgrading pyo3 to 0.21. by @Narsil in https://github.com/huggingface/safetensors/pull/468

Full Changelog: https://github.com/huggingface/safetensors/compare/v0.4.2...v0.4.3rc0

What's Changed

• Back on dev. by @Narsil in https://github.com/huggingface/safetensors/pull/313
• Clarify specification around endianness and header padding by @akx in https://github.com/huggingface/safetensors/pull/306
• Adding new target for m1 by @Narsil in https://github.com/huggingface/safetensors/pull/317
• Fixing macos 13 release script (by prebuilding). by @Narsil in https://github.com/huggingface/safetensors/pull/315
• Cache dir all the time. by @Narsil in https://github.com/huggingface/safetensors/pull/319
• Supporting whisper conversion. by @Narsil in https://github.com/huggingface/safetensors/pull/320
• add tensorshare to featured projects by @chainyo in https://github.com/huggingface/safetensors/pull/322
• Fix Bench GH action. by @Narsil in https://github.com/huggingface/safetensors/pull/323
• Yaml is nice. by @Narsil in https://github.com/huggingface/safetensors/pull/325
• Fixing big endian. by @Narsil in https://github.com/huggingface/safetensors/pull/327
• Fixing boolean + numpy > 1.20 by @Narsil in https://github.com/huggingface/safetensors/pull/326
• Add NumPy for all backends dependencies by @chainyo in https://github.com/huggingface/safetensors/pull/332
• impl View for TensorView by @coreylowman in https://github.com/huggingface/safetensors/pull/329
• Reworked the release script entirely by @Narsil in https://github.com/huggingface/safetensors/pull/334
• Preparing small patch release (Big Endian fix). by @Narsil in https://github.com/huggingface/safetensors/pull/335
• Temporary revert of the breaking change (keep it for 0.4.0). by @Narsil in https://github.com/huggingface/safetensors/pull/336
• Don't release rust versions on RC by @Narsil in https://github.com/huggingface/safetensors/pull/337
• Fixing release script. by @Narsil in https://github.com/huggingface/safetensors/pull/338
• Python 3.8 for arm by @Narsil in https://github.com/huggingface/safetensors/pull/339
• Win64. by @Narsil in https://github.com/huggingface/safetensors/pull/342
• win64 by @Narsil in https://github.com/huggingface/safetensors/pull/343
• Trying out maturin. by @Narsil in https://github.com/huggingface/safetensors/pull/344
• Reduce memory allocations by @cospectrum in https://github.com/huggingface/safetensors/pull/350
• [docs] Convert weights by @stevhliu in https://github.com/huggingface/safetensors/pull/345
• Update types for load_model filename by @kevinhu in https://github.com/huggingface/safetensors/pull/356
• Fixing release script for windows aarch64 and 3.12 by @Narsil in https://github.com/huggingface/safetensors/pull/348
• Minor docstring edit to flax.py by @paulbricman in https://github.com/huggingface/safetensors/pull/359
• Stop recreating the hashmap all the time. by @Narsil in https://github.com/huggingface/safetensors/pull/363
• fix: add py.typed by @b-kamphorst in https://github.com/huggingface/safetensors/pull/365
• Preparing a new release (0.4.0). by @Narsil in https://github.com/huggingface/safetensors/pull/366
• Supporting bfloat16 for tensorflow + jax (was failing because of intermediary numpy). by @Narsil in https://github.com/huggingface/safetensors/pull/382
• Fix typo by @cccntu in https://github.com/huggingface/safetensors/pull/377
• Support fp8_e4m3/fp8_e5m2 by @Narsil in https://github.com/huggingface/safetensors/pull/383
• Better convert. by @Narsil in https://github.com/huggingface/safetensors/pull/384
• Ignore closed PRs to avoid spam. by @Narsil in https://github.com/huggingface/safetensors/pull/385
• Adding support for Ascend NPU by @statelesshz in https://github.com/huggingface/safetensors/pull/372
• Fix convert. by @Narsil in https://github.com/huggingface/safetensors/pull/390
• Upgrade dev version. by @Narsil in https://github.com/huggingface/safetensors/pull/392
• Fix/errors for some models including Mistral-7b and Flan-ul2 by @lachlancahill in https://github.com/huggingface/safetensors/pull/388
• Releasing for python 3.12/3.13 and testing on 3.11. by @Narsil in https://github.com/huggingface/safetensors/pull/393
• Adding stale action. by @Narsil in https://github.com/huggingface/safetensors/pull/398
• Document huggingface_hub.get_safetensors_metadata by @Wauplin in https://github.com/huggingface/safetensors/pull/417
• [docs] Update list of projects using safetensors by @mishig25 in https://github.com/huggingface/safetensors/pull/418
• Adding MLX backend. by @Narsil in https://github.com/huggingface/safetensors/pull/419
• [docs, untested] Attempt to fix links to source by @pcuenca in https://github.com/huggingface/safetensors/pull/420
• [docs] Use hfoptions for metadata by @mishig25 in https://github.com/huggingface/safetensors/pull/424
• Fix path in version_tag_suffix by @pcuenca in https://github.com/huggingface/safetensors/pull/426
• Removing old doc. by @Narsil in https://github.com/huggingface/safetensors/pull/427
• Fix missing Apache-2.0 license file in the published crate by @musicinmybrain in https://github.com/huggingface/safetensors/pull/416
• Implement PyTorch support for float8 types (F8_E5M2 and F8_E4M3) by @zeux in https://github.com/huggingface/safetensors/pull/404
• Fix mispelling of dictionary. by @hayden-donnelly in https://github.com/huggingface/safetensors/pull/410
• Add "xpu" device tag to the device list to support Intel GPU by @Narsil in https://github.com/huggingface/safetensors/pull/428
• Skip MLX bench for the bench runner. by @Narsil in https://github.com/huggingface/safetensors/pull/429
• Remove py313 windows. by @Narsil in https://github.com/huggingface/safetensors/pull/432

New Contributors

• @akx made their first contribution in https://github.com/huggingface/safetensors/pull/306
• @chainyo made their first contribution in https://github.com/huggingface/safetensors/pull/322
• @coreylowman made their first contribution in https://github.com/huggingface/safetensors/pull/329
• @cospectrum made their first contribution in https://github.com/huggingface/safetensors/pull/350
• @stevhliu made their first contribution in https://github.com/huggingface/safetensors/pull/345
• @kevinhu made their first contribution in https://github.com/huggingface/safetensors/pull/356
• @paulbricman made their first contribution in https://github.com/huggingface/safetensors/pull/359
• @b-kamphorst made their first contribution in https://github.com/huggingface/safetensors/pull/365
• @cccntu made their first contribution in https://github.com/huggingface/safetensors/pull/377
• @statelesshz made their first contribution in https://github.com/huggingface/safetensors/pull/372
• @lachlancahill made their first contribution in https://github.com/huggingface/safetensors/pull/388
• @Wauplin made their first contribution in https://github.com/huggingface/safetensors/pull/417
• @pcuenca made their first contribution in https://github.com/huggingface/safetensors/pull/420
• @musicinmybrain made their first contribution in https://github.com/huggingface/safetensors/pull/416
• @zeux made their first contribution in https://github.com/huggingface/safetensors/pull/404
• @hayden-donnelly made their first contribution in https://github.com/huggingface/safetensors/pull/410

Full Changelog: https://github.com/huggingface/safetensors/compare/v0.3.2...v0.4.2

What's Changed

• Back on dev. by @Narsil in https://github.com/huggingface/safetensors/pull/313
• Clarify specification around endianness and header padding by @akx in https://github.com/huggingface/safetensors/pull/306
• Adding new target for m1 by @Narsil in https://github.com/huggingface/safetensors/pull/317
• Fixing macos 13 release script (by prebuilding). by @Narsil in https://github.com/huggingface/safetensors/pull/315
• Cache dir all the time. by @Narsil in https://github.com/huggingface/safetensors/pull/319
• Supporting whisper conversion. by @Narsil in https://github.com/huggingface/safetensors/pull/320
• add tensorshare to featured projects by @chainyo in https://github.com/huggingface/safetensors/pull/322
• Fix Bench GH action. by @Narsil in https://github.com/huggingface/safetensors/pull/323
• Yaml is nice. by @Narsil in https://github.com/huggingface/safetensors/pull/325
• Fixing big endian. by @Narsil in https://github.com/huggingface/safetensors/pull/327
• Fixing boolean + numpy > 1.20 by @Narsil in https://github.com/huggingface/safetensors/pull/326
• Add NumPy for all backends dependencies by @chainyo in https://github.com/huggingface/safetensors/pull/332
• impl View for TensorView by @coreylowman in https://github.com/huggingface/safetensors/pull/329
• Reworked the release script entirely by @Narsil in https://github.com/huggingface/safetensors/pull/334
• Preparing small patch release (Big Endian fix). by @Narsil in https://github.com/huggingface/safetensors/pull/335
• Temporary revert of the breaking change (keep it for 0.4.0). by @Narsil in https://github.com/huggingface/safetensors/pull/336
• Don't release rust versions on RC by @Narsil in https://github.com/huggingface/safetensors/pull/337
• Fixing release script. by @Narsil in https://github.com/huggingface/safetensors/pull/338
• Python 3.8 for arm by @Narsil in https://github.com/huggingface/safetensors/pull/339
• Win64. by @Narsil in https://github.com/huggingface/safetensors/pull/342
• win64 by @Narsil in https://github.com/huggingface/safetensors/pull/343
• Trying out maturin. by @Narsil in https://github.com/huggingface/safetensors/pull/344
• Reduce memory allocations by @cospectrum in https://github.com/huggingface/safetensors/pull/350
• [docs] Convert weights by @stevhliu in https://github.com/huggingface/safetensors/pull/345
• Update types for load_model filename by @kevinhu in https://github.com/huggingface/safetensors/pull/356
• Fixing release script for windows aarch64 and 3.12 by @Narsil in https://github.com/huggingface/safetensors/pull/348
• Minor docstring edit to flax.py by @paulbricman in https://github.com/huggingface/safetensors/pull/359
• Stop recreating the hashmap all the time. by @Narsil in https://github.com/huggingface/safetensors/pull/363
• fix: add py.typed by @b-kamphorst in https://github.com/huggingface/safetensors/pull/365
• Preparing a new release (0.4.0). by @Narsil in https://github.com/huggingface/safetensors/pull/366
• Supporting bfloat16 for tensorflow + jax (was failing because of intermediary numpy). by @Narsil in https://github.com/huggingface/safetensors/pull/382
• Fix typo by @cccntu in https://github.com/huggingface/safetensors/pull/377
• Support fp8_e4m3/fp8_e5m2 by @Narsil in https://github.com/huggingface/safetensors/pull/383
• Better convert. by @Narsil in https://github.com/huggingface/safetensors/pull/384
• Ignore closed PRs to avoid spam. by @Narsil in https://github.com/huggingface/safetensors/pull/385
• Adding support for Ascend NPU by @statelesshz in https://github.com/huggingface/safetensors/pull/372
• Fix convert. by @Narsil in https://github.com/huggingface/safetensors/pull/390
• Upgrade dev version. by @Narsil in https://github.com/huggingface/safetensors/pull/392
• Fix/errors for some models including Mistral-7b and Flan-ul2 by @lachlancahill in https://github.com/huggingface/safetensors/pull/388
• Releasing for python 3.12/3.13 and testing on 3.11. by @Narsil in https://github.com/huggingface/safetensors/pull/393
• Adding stale action. by @Narsil in https://github.com/huggingface/safetensors/pull/398
• Document huggingface_hub.get_safetensors_metadata by @Wauplin in https://github.com/huggingface/safetensors/pull/417
• [docs] Update list of projects using safetensors by @mishig25 in https://github.com/huggingface/safetensors/pull/418
• Adding MLX backend. by @Narsil in https://github.com/huggingface/safetensors/pull/419
• [docs, untested] Attempt to fix links to source by @pcuenca in https://github.com/huggingface/safetensors/pull/420
• [docs] Use hfoptions for metadata by @mishig25 in https://github.com/huggingface/safetensors/pull/424
• Fix path in version_tag_suffix by @pcuenca in https://github.com/huggingface/safetensors/pull/426
• Removing old doc. by @Narsil in https://github.com/huggingface/safetensors/pull/427
• Fix missing Apache-2.0 license file in the published crate by @musicinmybrain in https://github.com/huggingface/safetensors/pull/416
• Implement PyTorch support for float8 types (F8_E5M2 and F8_E4M3) by @zeux in https://github.com/huggingface/safetensors/pull/404
• Fix mispelling of dictionary. by @hayden-donnelly in https://github.com/huggingface/safetensors/pull/410
• Add "xpu" device tag to the device list to support Intel GPU by @Narsil in https://github.com/huggingface/safetensors/pull/428
• Skip MLX bench for the bench runner. by @Narsil in https://github.com/huggingface/safetensors/pull/429

New Contributors

• @akx made their first contribution in https://github.com/huggingface/safetensors/pull/306
• @chainyo made their first contribution in https://github.com/huggingface/safetensors/pull/322
• @coreylowman made their first contribution in https://github.com/huggingface/safetensors/pull/329
• @cospectrum made their first contribution in https://github.com/huggingface/safetensors/pull/350
• @stevhliu made their first contribution in https://github.com/huggingface/safetensors/pull/345
• @kevinhu made their first contribution in https://github.com/huggingface/safetensors/pull/356
• @paulbricman made their first contribution in https://github.com/huggingface/safetensors/pull/359
• @b-kamphorst made their first contribution in https://github.com/huggingface/safetensors/pull/365
• @cccntu made their first contribution in https://github.com/huggingface/safetensors/pull/377
• @statelesshz made their first contribution in https://github.com/huggingface/safetensors/pull/372
• @lachlancahill made their first contribution in https://github.com/huggingface/safetensors/pull/388
• @Wauplin made their first contribution in https://github.com/huggingface/safetensors/pull/417
• @pcuenca made their first contribution in https://github.com/huggingface/safetensors/pull/420
• @musicinmybrain made their first contribution in https://github.com/huggingface/safetensors/pull/416
• @zeux made their first contribution in https://github.com/huggingface/safetensors/pull/404
• @hayden-donnelly made their first contribution in https://github.com/huggingface/safetensors/pull/410

Full Changelog: https://github.com/huggingface/safetensors/compare/v0.3.2...v0.4.2rc0

What's Changed

• Back on dev. by @Narsil in https://github.com/huggingface/safetensors/pull/313
• Clarify specification around endianness and header padding by @akx in https://github.com/huggingface/safetensors/pull/306
• Adding new target for m1 by @Narsil in https://github.com/huggingface/safetensors/pull/317
• Fixing macos 13 release script (by prebuilding). by @Narsil in https://github.com/huggingface/safetensors/pull/315
• Cache dir all the time. by @Narsil in https://github.com/huggingface/safetensors/pull/319
• Supporting whisper conversion. by @Narsil in https://github.com/huggingface/safetensors/pull/320
• add tensorshare to featured projects by @chainyo in https://github.com/huggingface/safetensors/pull/322
• Fix Bench GH action. by @Narsil in https://github.com/huggingface/safetensors/pull/323
• Yaml is nice. by @Narsil in https://github.com/huggingface/safetensors/pull/325
• Fixing big endian. by @Narsil in https://github.com/huggingface/safetensors/pull/327
• Fixing boolean + numpy > 1.20 by @Narsil in https://github.com/huggingface/safetensors/pull/326
• Add NumPy for all backends dependencies by @chainyo in https://github.com/huggingface/safetensors/pull/332
• impl View for TensorView by @coreylowman in https://github.com/huggingface/safetensors/pull/329
• Reworked the release script entirely by @Narsil in https://github.com/huggingface/safetensors/pull/334
• Preparing small patch release (Big Endian fix). by @Narsil in https://github.com/huggingface/safetensors/pull/335
• Temporary revert of the breaking change (keep it for 0.4.0). by @Narsil in https://github.com/huggingface/safetensors/pull/336
• Don't release rust versions on RC by @Narsil in https://github.com/huggingface/safetensors/pull/337
• Fixing release script. by @Narsil in https://github.com/huggingface/safetensors/pull/338
• Python 3.8 for arm by @Narsil in https://github.com/huggingface/safetensors/pull/339
• Win64. by @Narsil in https://github.com/huggingface/safetensors/pull/342
• win64 by @Narsil in https://github.com/huggingface/safetensors/pull/343
• Trying out maturin. by @Narsil in https://github.com/huggingface/safetensors/pull/344
• Reduce memory allocations by @cospectrum in https://github.com/huggingface/safetensors/pull/350
• [docs] Convert weights by @stevhliu in https://github.com/huggingface/safetensors/pull/345
• Update types for load_model filename by @kevinhu in https://github.com/huggingface/safetensors/pull/356
• Fixing release script for windows aarch64 and 3.12 by @Narsil in https://github.com/huggingface/safetensors/pull/348
• Minor docstring edit to flax.py by @paulbricman in https://github.com/huggingface/safetensors/pull/359
• Stop recreating the hashmap all the time. by @Narsil in https://github.com/huggingface/safetensors/pull/363
• fix: add py.typed by @b-kamphorst in https://github.com/huggingface/safetensors/pull/365
• Preparing a new release (0.4.0). by @Narsil in https://github.com/huggingface/safetensors/pull/366
• Supporting bfloat16 for tensorflow + jax (was failing because of intermediary numpy). by @Narsil in https://github.com/huggingface/safetensors/pull/382
• Fix typo by @cccntu in https://github.com/huggingface/safetensors/pull/377
• Support fp8_e4m3/fp8_e5m2 by @Narsil in https://github.com/huggingface/safetensors/pull/383
• Better convert. by @Narsil in https://github.com/huggingface/safetensors/pull/384
• Ignore closed PRs to avoid spam. by @Narsil in https://github.com/huggingface/safetensors/pull/385
• Adding support for Ascend NPU by @statelesshz in https://github.com/huggingface/safetensors/pull/372
• Fix convert. by @Narsil in https://github.com/huggingface/safetensors/pull/390

New Contributors

• @akx made their first contribution in https://github.com/huggingface/safetensors/pull/306
• @chainyo made their first contribution in https://github.com/huggingface/safetensors/pull/322
• @coreylowman made their first contribution in https://github.com/huggingface/safetensors/pull/329
• @cospectrum made their first contribution in https://github.com/huggingface/safetensors/pull/350
• @stevhliu made their first contribution in https://github.com/huggingface/safetensors/pull/345
• @kevinhu made their first contribution in https://github.com/huggingface/safetensors/pull/356
• @paulbricman made their first contribution in https://github.com/huggingface/safetensors/pull/359
• @b-kamphorst made their first contribution in https://github.com/huggingface/safetensors/pull/365
• @cccntu made their first contribution in https://github.com/huggingface/safetensors/pull/377
• @statelesshz made their first contribution in https://github.com/huggingface/safetensors/pull/372

Full Changelog: https://github.com/huggingface/safetensors/compare/v0.3.2...v0.4.1

What's Changed

• Back on dev. by @Narsil in https://github.com/huggingface/safetensors/pull/313
• Clarify specification around endianness and header padding by @akx in https://github.com/huggingface/safetensors/pull/306
• Adding new target for m1 by @Narsil in https://github.com/huggingface/safetensors/pull/317
• Fixing macos 13 release script (by prebuilding). by @Narsil in https://github.com/huggingface/safetensors/pull/315
• Cache dir all the time. by @Narsil in https://github.com/huggingface/safetensors/pull/319
• Supporting whisper conversion. by @Narsil in https://github.com/huggingface/safetensors/pull/320
• add tensorshare to featured projects by @chainyo in https://github.com/huggingface/safetensors/pull/322
• Fix Bench GH action. by @Narsil in https://github.com/huggingface/safetensors/pull/323
• Yaml is nice. by @Narsil in https://github.com/huggingface/safetensors/pull/325
• Fixing big endian. by @Narsil in https://github.com/huggingface/safetensors/pull/327
• Fixing boolean + numpy > 1.20 by @Narsil in https://github.com/huggingface/safetensors/pull/326
• Add NumPy for all backends dependencies by @chainyo in https://github.com/huggingface/safetensors/pull/332
• impl View for TensorView by @coreylowman in https://github.com/huggingface/safetensors/pull/329
• Reworked the release script entirely by @Narsil in https://github.com/huggingface/safetensors/pull/334
• Preparing small patch release (Big Endian fix). by @Narsil in https://github.com/huggingface/safetensors/pull/335
• Temporary revert of the breaking change (keep it for 0.4.0). by @Narsil in https://github.com/huggingface/safetensors/pull/336
• Don't release rust versions on RC by @Narsil in https://github.com/huggingface/safetensors/pull/337
• Fixing release script. by @Narsil in https://github.com/huggingface/safetensors/pull/338
• Python 3.8 for arm by @Narsil in https://github.com/huggingface/safetensors/pull/339
• Win64. by @Narsil in https://github.com/huggingface/safetensors/pull/342
• win64 by @Narsil in https://github.com/huggingface/safetensors/pull/343
• Trying out maturin. by @Narsil in https://github.com/huggingface/safetensors/pull/344
• Reduce memory allocations by @cospectrum in https://github.com/huggingface/safetensors/pull/350
• [docs] Convert weights by @stevhliu in https://github.com/huggingface/safetensors/pull/345
• Update types for load_model filename by @kevinhu in https://github.com/huggingface/safetensors/pull/356
• Fixing release script for windows aarch64 and 3.12 by @Narsil in https://github.com/huggingface/safetensors/pull/348
• Minor docstring edit to flax.py by @paulbricman in https://github.com/huggingface/safetensors/pull/359
• Stop recreating the hashmap all the time. by @Narsil in https://github.com/huggingface/safetensors/pull/363
• fix: add py.typed by @b-kamphorst in https://github.com/huggingface/safetensors/pull/365
• Preparing a new release (0.4.0). by @Narsil in https://github.com/huggingface/safetensors/pull/366
• Supporting bfloat16 for tensorflow + jax (was failing because of intermediary numpy). by @Narsil in https://github.com/huggingface/safetensors/pull/382
• Fix typo by @cccntu in https://github.com/huggingface/safetensors/pull/377
• Support fp8_e4m3/fp8_e5m2 by @Narsil in https://github.com/huggingface/safetensors/pull/383

New Contributors

• @akx made their first contribution in https://github.com/huggingface/safetensors/pull/306
• @chainyo made their first contribution in https://github.com/huggingface/safetensors/pull/322
• @coreylowman made their first contribution in https://github.com/huggingface/safetensors/pull/329
• @cospectrum made their first contribution in https://github.com/huggingface/safetensors/pull/350
• @stevhliu made their first contribution in https://github.com/huggingface/safetensors/pull/345
• @kevinhu made their first contribution in https://github.com/huggingface/safetensors/pull/356
• @paulbricman made their first contribution in https://github.com/huggingface/safetensors/pull/359
• @b-kamphorst made their first contribution in https://github.com/huggingface/safetensors/pull/365
• @cccntu made their first contribution in https://github.com/huggingface/safetensors/pull/377

Full Changelog: https://github.com/huggingface/safetensors/compare/v0.3.2...v0.4.1rc1

Highlights

• Revamped the build pipeline to use maturin
• Reduced allocations (speedup for small safetensors files with many small tensors)

What's Changed

• Back on dev. by @Narsil in https://github.com/huggingface/safetensors/pull/313
• Clarify specification around endianness and header padding by @akx in https://github.com/huggingface/safetensors/pull/306
• Adding new target for m1 by @Narsil in https://github.com/huggingface/safetensors/pull/317
• Fixing macos 13 release script (by prebuilding). by @Narsil in https://github.com/huggingface/safetensors/pull/315
• Cache dir all the time. by @Narsil in https://github.com/huggingface/safetensors/pull/319
• Supporting whisper conversion. by @Narsil in https://github.com/huggingface/safetensors/pull/320
• add tensorshare to featured projects by @chainyo in https://github.com/huggingface/safetensors/pull/322
• Fix Bench GH action. by @Narsil in https://github.com/huggingface/safetensors/pull/323
• Yaml is nice. by @Narsil in https://github.com/huggingface/safetensors/pull/325
• Fixing big endian. by @Narsil in https://github.com/huggingface/safetensors/pull/327
• Fixing boolean + numpy > 1.20 by @Narsil in https://github.com/huggingface/safetensors/pull/326
• Add NumPy for all backends dependencies by @chainyo in https://github.com/huggingface/safetensors/pull/332
• impl View for TensorView by @coreylowman in https://github.com/huggingface/safetensors/pull/329
• Reworked the release script entirely by @Narsil in https://github.com/huggingface/safetensors/pull/334
• Preparing small patch release (Big Endian fix). by @Narsil in https://github.com/huggingface/safetensors/pull/335
• Temporary revert of the breaking change (keep it for 0.4.0). by @Narsil in https://github.com/huggingface/safetensors/pull/336
• Don't release rust versions on RC by @Narsil in https://github.com/huggingface/safetensors/pull/337
• Fixing release script. by @Narsil in https://github.com/huggingface/safetensors/pull/338
• Python 3.8 for arm by @Narsil in https://github.com/huggingface/safetensors/pull/339
• Win64. by @Narsil in https://github.com/huggingface/safetensors/pull/342
• win64 by @Narsil in https://github.com/huggingface/safetensors/pull/343
• Trying out maturin. by @Narsil in https://github.com/huggingface/safetensors/pull/344
• Reduce memory allocations by @cospectrum in https://github.com/huggingface/safetensors/pull/350
• [docs] Convert weights by @stevhliu in https://github.com/huggingface/safetensors/pull/345
• Update types for load_model filename by @kevinhu in https://github.com/huggingface/safetensors/pull/356
• Fixing release script for windows aarch64 and 3.12 by @Narsil in https://github.com/huggingface/safetensors/pull/348
• Minor docstring edit to flax.py by @paulbricman in https://github.com/huggingface/safetensors/pull/359
• Stop recreating the hashmap all the time. by @Narsil in https://github.com/huggingface/safetensors/pull/363
• fix: add py.typed by @b-kamphorst in https://github.com/huggingface/safetensors/pull/365
• Preparing a new release (0.4.0). by @Narsil in https://github.com/huggingface/safetensors/pull/366

New Contributors

• @akx made their first contribution in https://github.com/huggingface/safetensors/pull/306
• @chainyo made their first contribution in https://github.com/huggingface/safetensors/pull/322
• @coreylowman made their first contribution in https://github.com/huggingface/safetensors/pull/329
• @cospectrum made their first contribution in https://github.com/huggingface/safetensors/pull/350
• @stevhliu made their first contribution in https://github.com/huggingface/safetensors/pull/345
• @kevinhu made their first contribution in https://github.com/huggingface/safetensors/pull/356
• @paulbricman made their first contribution in https://github.com/huggingface/safetensors/pull/359
• @b-kamphorst made their first contribution in https://github.com/huggingface/safetensors/pull/365

Full Changelog: https://github.com/huggingface/safetensors/compare/v0.3.2...v0.4.0

Highlights

• Revamped entire build pipeline
• Fixed a bug on small files containing many small tensors allocating too much

What's Changed

• Back on dev. by @Narsil in https://github.com/huggingface/safetensors/pull/313
• Clarify specification around endianness and header padding by @akx in https://github.com/huggingface/safetensors/pull/306
• Adding new target for m1 by @Narsil in https://github.com/huggingface/safetensors/pull/317
• Fixing macos 13 release script (by prebuilding). by @Narsil in https://github.com/huggingface/safetensors/pull/315
• Cache dir all the time. by @Narsil in https://github.com/huggingface/safetensors/pull/319
• Supporting whisper conversion. by @Narsil in https://github.com/huggingface/safetensors/pull/320
• add tensorshare to featured projects by @chainyo in https://github.com/huggingface/safetensors/pull/322
• Fix Bench GH action. by @Narsil in https://github.com/huggingface/safetensors/pull/323
• Yaml is nice. by @Narsil in https://github.com/huggingface/safetensors/pull/325
• Fixing big endian. by @Narsil in https://github.com/huggingface/safetensors/pull/327
• Fixing boolean + numpy > 1.20 by @Narsil in https://github.com/huggingface/safetensors/pull/326
• Add NumPy for all backends dependencies by @chainyo in https://github.com/huggingface/safetensors/pull/332
• impl View for TensorView by @coreylowman in https://github.com/huggingface/safetensors/pull/329
• Reworked the release script entirely by @Narsil in https://github.com/huggingface/safetensors/pull/334
• Preparing small patch release (Big Endian fix). by @Narsil in https://github.com/huggingface/safetensors/pull/335
• Temporary revert of the breaking change (keep it for 0.4.0). by @Narsil in https://github.com/huggingface/safetensors/pull/336
• Don't release rust versions on RC by @Narsil in https://github.com/huggingface/safetensors/pull/337
• Fixing release script. by @Narsil in https://github.com/huggingface/safetensors/pull/338
• Python 3.8 for arm by @Narsil in https://github.com/huggingface/safetensors/pull/339
• Win64. by @Narsil in https://github.com/huggingface/safetensors/pull/342
• win64 by @Narsil in https://github.com/huggingface/safetensors/pull/343
• Trying out maturin. by @Narsil in https://github.com/huggingface/safetensors/pull/344
• Reduce memory allocations by @cospectrum in https://github.com/huggingface/safetensors/pull/350
• [docs] Convert weights by @stevhliu in https://github.com/huggingface/safetensors/pull/345
• Update types for load_model filename by @kevinhu in https://github.com/huggingface/safetensors/pull/356
• Fixing release script for windows aarch64 and 3.12 by @Narsil in https://github.com/huggingface/safetensors/pull/348
• Minor docstring edit to flax.py by @paulbricman in https://github.com/huggingface/safetensors/pull/359
• Stop recreating the hashmap all the time. by @Narsil in https://github.com/huggingface/safetensors/pull/363
• fix: add py.typed by @b-kamphorst in https://github.com/huggingface/safetensors/pull/365
• Preparing a new release (0.4.0). by @Narsil in https://github.com/huggingface/safetensors/pull/366

New Contributors

• @akx made their first contribution in https://github.com/huggingface/safetensors/pull/306
• @chainyo made their first contribution in https://github.com/huggingface/safetensors/pull/322
• @coreylowman made their first contribution in https://github.com/huggingface/safetensors/pull/329
• @cospectrum made their first contribution in https://github.com/huggingface/safetensors/pull/350
• @stevhliu made their first contribution in https://github.com/huggingface/safetensors/pull/345
• @kevinhu made their first contribution in https://github.com/huggingface/safetensors/pull/356
• @paulbricman made their first contribution in https://github.com/huggingface/safetensors/pull/359
• @b-kamphorst made their first contribution in https://github.com/huggingface/safetensors/pull/365

Full Changelog: https://github.com/huggingface/safetensors/compare/v0.3.2...v0.4.0rc1

What's Changed

Mostly fixes for big endian machines.

• Back on dev. by @Narsil in https://github.com/huggingface/safetensors/pull/313
• Clarify specification around endianness and header padding by @akx in https://github.com/huggingface/safetensors/pull/306
• Adding new target for m1 by @Narsil in https://github.com/huggingface/safetensors/pull/317
• Fixing macos 13 release script (by prebuilding). by @Narsil in https://github.com/huggingface/safetensors/pull/315
• Cache dir all the time. by @Narsil in https://github.com/huggingface/safetensors/pull/319
• Supporting whisper conversion. by @Narsil in https://github.com/huggingface/safetensors/pull/320
• add tensorshare to featured projects by @chainyo in https://github.com/huggingface/safetensors/pull/322
• Fix Bench GH action. by @Narsil in https://github.com/huggingface/safetensors/pull/323
• Yaml is nice. by @Narsil in https://github.com/huggingface/safetensors/pull/325
• Fixing big endian. by @Narsil in https://github.com/huggingface/safetensors/pull/327
• Fixing boolean + numpy > 1.20 by @Narsil in https://github.com/huggingface/safetensors/pull/326
• Add NumPy for all backends dependencies by @chainyo in https://github.com/huggingface/safetensors/pull/332
• impl View for TensorView by @coreylowman in https://github.com/huggingface/safetensors/pull/329
• Reworked the release script entirely by @Narsil in https://github.com/huggingface/safetensors/pull/334
• Preparing small patch release (Big Endian fix). by @Narsil in https://github.com/huggingface/safetensors/pull/335
• Temporary revert of the breaking change (keep it for 0.4.0). by @Narsil in https://github.com/huggingface/safetensors/pull/336
• Don't release rust versions on RC by @Narsil in https://github.com/huggingface/safetensors/pull/337
• Fixing release script. by @Narsil in https://github.com/huggingface/safetensors/pull/338

New Contributors

• @akx made their first contribution in https://github.com/huggingface/safetensors/pull/306
• @chainyo made their first contribution in https://github.com/huggingface/safetensors/pull/322
• @coreylowman made their first contribution in https://github.com/huggingface/safetensors/pull/329

Full Changelog: https://github.com/huggingface/safetensors/compare/v0.3.2...v0.3.3

What's Changed

• Back on dev. by @Narsil in https://github.com/huggingface/safetensors/pull/313
• Clarify specification around endianness and header padding by @akx in https://github.com/huggingface/safetensors/pull/306
• Adding new target for m1 by @Narsil in https://github.com/huggingface/safetensors/pull/317
• Fixing macos 13 release script (by prebuilding). by @Narsil in https://github.com/huggingface/safetensors/pull/315
• Cache dir all the time. by @Narsil in https://github.com/huggingface/safetensors/pull/319
• Supporting whisper conversion. by @Narsil in https://github.com/huggingface/safetensors/pull/320
• add tensorshare to featured projects by @chainyo in https://github.com/huggingface/safetensors/pull/322
• Fix Bench GH action. by @Narsil in https://github.com/huggingface/safetensors/pull/323
• Yaml is nice. by @Narsil in https://github.com/huggingface/safetensors/pull/325
• Fixing big endian. by @Narsil in https://github.com/huggingface/safetensors/pull/327
• Fixing boolean + numpy > 1.20 by @Narsil in https://github.com/huggingface/safetensors/pull/326
• Add NumPy for all backends dependencies by @chainyo in https://github.com/huggingface/safetensors/pull/332
• impl View for TensorView by @coreylowman in https://github.com/huggingface/safetensors/pull/329
• Reworked the release script entirely by @Narsil in https://github.com/huggingface/safetensors/pull/334
• Preparing small patch release (Big Endian fix). by @Narsil in https://github.com/huggingface/safetensors/pull/335
• Temporary revert of the breaking change (keep it for 0.4.0). by @Narsil in https://github.com/huggingface/safetensors/pull/336
• Don't release rust versions on RC by @Narsil in https://github.com/huggingface/safetensors/pull/337

New Contributors

• @akx made their first contribution in https://github.com/huggingface/safetensors/pull/306
• @chainyo made their first contribution in https://github.com/huggingface/safetensors/pull/322
• @coreylowman made their first contribution in https://github.com/huggingface/safetensors/pull/329

Full Changelog: https://github.com/huggingface/safetensors/compare/v0.3.2...v0.3.3.rc1

What's Changed

• Remove too many keywords. by @Narsil in https://github.com/huggingface/safetensors/pull/187
• Adding memmap example to read from file. by @Narsil in https://github.com/huggingface/safetensors/pull/189
• Making sure the safetensors existing PR is up-to-date. by @Narsil in https://github.com/huggingface/safetensors/pull/192
• Nicer error when failed to find tensor in Rust. by @Narsil in https://github.com/huggingface/safetensors/pull/191
• Adding commit description to convertion PR. by @Narsil in https://github.com/huggingface/safetensors/pull/198
• Python 2.0 added a warning on ByteStorage, so using UntypedStorage by @Narsil in https://github.com/huggingface/safetensors/pull/196
• Adding a minimal version for torch. by @Narsil in https://github.com/huggingface/safetensors/pull/204
• Minor improvements for README by @nickkolok in https://github.com/huggingface/safetensors/pull/201
• More badges. by @Narsil in https://github.com/huggingface/safetensors/pull/210
• Remove unwrap in prod code. by @Narsil in https://github.com/huggingface/safetensors/pull/209
• Upload codecov for main branch. by @Narsil in https://github.com/huggingface/safetensors/pull/211
• Upload codecov for main branch. by @Narsil in https://github.com/huggingface/safetensors/pull/212
• Fixing codecov rust tag. by @Narsil in https://github.com/huggingface/safetensors/pull/213
• Increase coverage on the error paths. by @Narsil in https://github.com/huggingface/safetensors/pull/214
• Deactivating codecov commenting. by @Narsil in https://github.com/huggingface/safetensors/pull/217
• Zero width shape are OK (0-rank tensors). They are simply a scalar. by @Narsil in https://github.com/huggingface/safetensors/pull/208
• Adding simple proptest. by @Narsil in https://github.com/huggingface/safetensors/pull/216
• Disallowing zero-width tensor. by @Narsil in https://github.com/huggingface/safetensors/pull/205
• Disallow erroneous buffer. by @Narsil in https://github.com/huggingface/safetensors/pull/206
• Overspecify a bit the format. by @Narsil in https://github.com/huggingface/safetensors/pull/215
• Adding arithmetic overflow checks (unchecked in release builds). by @Narsil in https://github.com/huggingface/safetensors/pull/207
• Add a safety warning in the convertion script. by @Narsil in https://github.com/huggingface/safetensors/pull/219
• Fixing empty shape test. by @Narsil in https://github.com/huggingface/safetensors/pull/218
• Remove the breaking change of disallowing zero sized tensors. by @Narsil in https://github.com/huggingface/safetensors/pull/221
• Adding last missing test for validate. by @Narsil in https://github.com/huggingface/safetensors/pull/225
• 0-sized tensors allowed. by @Narsil in https://github.com/huggingface/safetensors/pull/226
• Specify python versions. by @Narsil in https://github.com/huggingface/safetensors/pull/227
• Minor checks + proptest in python. by @Narsil in https://github.com/huggingface/safetensors/pull/228
• Committing Cargo.lock. by @Narsil in https://github.com/huggingface/safetensors/pull/233
• Fixing the logic to determine if PR is up-to-date. by @Narsil in https://github.com/huggingface/safetensors/pull/230
• Fixing alignment by @Narsil in https://github.com/huggingface/safetensors/pull/235
• Adding save_model and load_model to help with shared tensors with PyTorch. by @Narsil in https://github.com/huggingface/safetensors/pull/236
• Fixing shared detection logic. by @Narsil in https://github.com/huggingface/safetensors/pull/232
• New release candidate. by @Narsil in https://github.com/huggingface/safetensors/pull/224
• Prepare 0.3.2 by @Narsil in https://github.com/huggingface/safetensors/pull/239
• Fixing conda workflow. by @Narsil in https://github.com/huggingface/safetensors/pull/240
• Adding a banner to the README. by @Narsil in https://github.com/huggingface/safetensors/pull/244
• [doc] Add a doc page about (remote) Metadata parsing by @julien-c in https://github.com/huggingface/safetensors/pull/243
• [doc] Improve metadata parsing doc by @mishig25 in https://github.com/huggingface/safetensors/pull/245
• There should be .dev0 while on main by @mishig25 in https://github.com/huggingface/safetensors/pull/246
• [doc] Add logo img to index doc page by @mishig25 in https://github.com/huggingface/safetensors/pull/247
• [doc] featured projects by @mishig25 in https://github.com/huggingface/safetensors/pull/249
• Update to actions/checkout@v3 by @mfuntowicz in https://github.com/huggingface/safetensors/pull/251
• Added method len on SafeTensors by @mfuntowicz in https://github.com/huggingface/safetensors/pull/252
• [docs] Safetensors format by @mishig25 in https://github.com/huggingface/safetensors/pull/248
• Fixing the spec with mention about the buffer which cannot be non-contiguous. by @Narsil in https://github.com/huggingface/safetensors/pull/253
• Update metadata_parsing.mdx by @mishig25 in https://github.com/huggingface/safetensors/pull/261
• Add safejax in "Featured Projects" by @alvarobartt in https://github.com/huggingface/safetensors/pull/260
• Adding error checking, convertion can fail on schedulers. by @Narsil in https://github.com/huggingface/safetensors/pull/266
• Add BERTopic to Featured Projects by @davanstrien in https://github.com/huggingface/safetensors/pull/267
• Fix typos in documents by @kiszk in https://github.com/huggingface/safetensors/pull/257
• Adding issue templates. by @Narsil in https://github.com/huggingface/safetensors/pull/268
• Remove ISSUE links. by @Narsil in https://github.com/huggingface/safetensors/pull/269
• [doc build] Use secrets by @mishig25 in https://github.com/huggingface/safetensors/pull/270
• Make tensor identifier a bit more robust, and transformers compatible by @thomasw21 in https://github.com/huggingface/safetensors/pull/264
• Add a reference to tch-rs by @LaurentMazare in https://github.com/huggingface/safetensors/pull/274
• fix syntax error in import statement of safetensors pytorch api docs code example by @kaczmarj in https://github.com/huggingface/safetensors/pull/276
• Missing files. by @Narsil in https://github.com/huggingface/safetensors/pull/282
• Fix wrong docstring for SafeTensors' names method (#250) by @dirac3000 in https://github.com/huggingface/safetensors/pull/284
• Fixing uniform empty tensor handling by @Narsil in https://github.com/huggingface/safetensors/pull/283
• Superseed #279 by @Narsil in https://github.com/huggingface/safetensors/pull/285
• Fix failing doc build workflows by @mishig25 in https://github.com/huggingface/safetensors/pull/287
• Revert dev change by @mishig25 in https://github.com/huggingface/safetensors/pull/288
• Fix numpy.save(-file) docstring. by @amitani in https://github.com/huggingface/safetensors/pull/290
• Adding more control to the chosen weights saved on disk. by @Narsil in https://github.com/huggingface/safetensors/pull/292
• Autodoc for save_model and load_model by @wouterzwerink in https://github.com/huggingface/safetensors/pull/293
• Fix link to shared tensor page by @wouterzwerink in https://github.com/huggingface/safetensors/pull/294
• Support musicgen conversion. by @Narsil in https://github.com/huggingface/safetensors/pull/296
• Passing the token around. by @Narsil in https://github.com/huggingface/safetensors/pull/302
• Adding slice get_dtype() method to get the dtype directly on slices. by @Narsil in https://github.com/huggingface/safetensors/pull/303
• fix: typo in attacks/README.md by @bliutech in https://github.com/huggingface/safetensors/pull/305
• feat: Add filter for shared storage non overlapping tensors by @Narsil in https://github.com/huggingface/safetensors/pull/309
• feat: Supporting big endian architecture. by @Narsil in https://github.com/huggingface/safetensors/pull/310
• 0.3.2.rc1 by @Narsil in https://github.com/huggingface/safetensors/pull/311
• Fixes release scripts - Release ready version by @Narsil in https://github.com/huggingface/safetensors/pull/312

New Contributors

• @nickkolok made their first contribution in https://github.com/huggingface/safetensors/pull/201
• @mfuntowicz made their first contribution in https://github.com/huggingface/safetensors/pull/251
• @davanstrien made their first contribution in https://github.com/huggingface/safetensors/pull/267
• @kiszk made their first contribution in https://github.com/huggingface/safetensors/pull/257
• @LaurentMazare made their first contribution in https://github.com/huggingface/safetensors/pull/274
• @kaczmarj made their first contribution in https://github.com/huggingface/safetensors/pull/276
• @dirac3000 made their first contribution in https://github.com/huggingface/safetensors/pull/284
• @amitani made their first contribution in https://github.com/huggingface/safetensors/pull/290
• @wouterzwerink made their first contribution in https://github.com/huggingface/safetensors/pull/293
• @bliutech made their first contribution in https://github.com/huggingface/safetensors/pull/305

Full Changelog: https://github.com/huggingface/safetensors/compare/v0.3.0...v0.3.2

What's Changed

• Prepare 0.3.2 by @Narsil in https://github.com/huggingface/safetensors/pull/239
• Fixing conda workflow. by @Narsil in https://github.com/huggingface/safetensors/pull/240
• Adding a banner to the README. by @Narsil in https://github.com/huggingface/safetensors/pull/244
• [doc] Add a doc page about (remote) Metadata parsing by @julien-c in https://github.com/huggingface/safetensors/pull/243
• [doc] Improve metadata parsing doc by @mishig25 in https://github.com/huggingface/safetensors/pull/245
• There should be .dev0 while on main by @mishig25 in https://github.com/huggingface/safetensors/pull/246
• [doc] Add logo img to index doc page by @mishig25 in https://github.com/huggingface/safetensors/pull/247
• [doc] featured projects by @mishig25 in https://github.com/huggingface/safetensors/pull/249
• Update to actions/checkout@v3 by @mfuntowicz in https://github.com/huggingface/safetensors/pull/251
• Added method len on SafeTensors by @mfuntowicz in https://github.com/huggingface/safetensors/pull/252
• [docs] Safetensors format by @mishig25 in https://github.com/huggingface/safetensors/pull/248
• Fixing the spec with mention about the buffer which cannot be non-contiguous. by @Narsil in https://github.com/huggingface/safetensors/pull/253
• Update metadata_parsing.mdx by @mishig25 in https://github.com/huggingface/safetensors/pull/261
• Add safejax in "Featured Projects" by @alvarobartt in https://github.com/huggingface/safetensors/pull/260
• Adding error checking, convertion can fail on schedulers. by @Narsil in https://github.com/huggingface/safetensors/pull/266
• Add BERTopic to Featured Projects by @davanstrien in https://github.com/huggingface/safetensors/pull/267
• Fix typos in documents by @kiszk in https://github.com/huggingface/safetensors/pull/257
• Adding issue templates. by @Narsil in https://github.com/huggingface/safetensors/pull/268
• Remove ISSUE links. by @Narsil in https://github.com/huggingface/safetensors/pull/269
• [doc build] Use secrets by @mishig25 in https://github.com/huggingface/safetensors/pull/270
• Make tensor identifier a bit more robust, and transformers compatible by @thomasw21 in https://github.com/huggingface/safetensors/pull/264
• Add a reference to tch-rs by @LaurentMazare in https://github.com/huggingface/safetensors/pull/274
• fix syntax error in import statement of safetensors pytorch api docs code example by @kaczmarj in https://github.com/huggingface/safetensors/pull/276
• Missing files. by @Narsil in https://github.com/huggingface/safetensors/pull/282
• Fix wrong docstring for SafeTensors' names method (#250) by @dirac3000 in https://github.com/huggingface/safetensors/pull/284
• Fixing uniform empty tensor handling by @Narsil in https://github.com/huggingface/safetensors/pull/283
• Superseed #279 by @Narsil in https://github.com/huggingface/safetensors/pull/285
• Fix failing doc build workflows by @mishig25 in https://github.com/huggingface/safetensors/pull/287
• Revert dev change by @mishig25 in https://github.com/huggingface/safetensors/pull/288
• Fix numpy.save(-file) docstring. by @amitani in https://github.com/huggingface/safetensors/pull/290
• Adding more control to the chosen weights saved on disk. by @Narsil in https://github.com/huggingface/safetensors/pull/292
• Autodoc for save_model and load_model by @wouterzwerink in https://github.com/huggingface/safetensors/pull/293
• Fix link to shared tensor page by @wouterzwerink in https://github.com/huggingface/safetensors/pull/294
• Support musicgen conversion. by @Narsil in https://github.com/huggingface/safetensors/pull/296
• Passing the token around. by @Narsil in https://github.com/huggingface/safetensors/pull/302
• Adding slice get_dtype() method to get the dtype directly on slices. by @Narsil in https://github.com/huggingface/safetensors/pull/303
• fix: typo in attacks/README.md by @bliutech in https://github.com/huggingface/safetensors/pull/305
• feat: Add filter for shared storage non overlapping tensors by @Narsil in https://github.com/huggingface/safetensors/pull/309
• feat: Supporting big endian architecture. by @Narsil in https://github.com/huggingface/safetensors/pull/310
• 0.3.2.rc1 by @Narsil in https://github.com/huggingface/safetensors/pull/311

New Contributors

• @mfuntowicz made their first contribution in https://github.com/huggingface/safetensors/pull/251
• @davanstrien made their first contribution in https://github.com/huggingface/safetensors/pull/267
• @kiszk made their first contribution in https://github.com/huggingface/safetensors/pull/257
• @LaurentMazare made their first contribution in https://github.com/huggingface/safetensors/pull/274
• @kaczmarj made their first contribution in https://github.com/huggingface/safetensors/pull/276
• @dirac3000 made their first contribution in https://github.com/huggingface/safetensors/pull/284
• @amitani made their first contribution in https://github.com/huggingface/safetensors/pull/290
• @wouterzwerink made their first contribution in https://github.com/huggingface/safetensors/pull/293
• @bliutech made their first contribution in https://github.com/huggingface/safetensors/pull/305

Full Changelog: https://github.com/huggingface/safetensors/compare/v0.3.1rc1...v0.3.2.rc1

What's Changed

• Prepare 0.3.2 by @Narsil in https://github.com/huggingface/safetensors/pull/239
• Fixing conda workflow. by @Narsil in https://github.com/huggingface/safetensors/pull/240
• Adding a banner to the README. by @Narsil in https://github.com/huggingface/safetensors/pull/244
• [doc] Add a doc page about (remote) Metadata parsing by @julien-c in https://github.com/huggingface/safetensors/pull/243
• [doc] Improve metadata parsing doc by @mishig25 in https://github.com/huggingface/safetensors/pull/245
• There should be .dev0 while on main by @mishig25 in https://github.com/huggingface/safetensors/pull/246
• [doc] Add logo img to index doc page by @mishig25 in https://github.com/huggingface/safetensors/pull/247
• [doc] featured projects by @mishig25 in https://github.com/huggingface/safetensors/pull/249
• Update to actions/checkout@v3 by @mfuntowicz in https://github.com/huggingface/safetensors/pull/251
• Added method len on SafeTensors by @mfuntowicz in https://github.com/huggingface/safetensors/pull/252
• [docs] Safetensors format by @mishig25 in https://github.com/huggingface/safetensors/pull/248
• Fixing the spec with mention about the buffer which cannot be non-contiguous. by @Narsil in https://github.com/huggingface/safetensors/pull/253
• Update metadata_parsing.mdx by @mishig25 in https://github.com/huggingface/safetensors/pull/261
• Add safejax in "Featured Projects" by @alvarobartt in https://github.com/huggingface/safetensors/pull/260
• Adding error checking, convertion can fail on schedulers. by @Narsil in https://github.com/huggingface/safetensors/pull/266
• Add BERTopic to Featured Projects by @davanstrien in https://github.com/huggingface/safetensors/pull/267
• Fix typos in documents by @kiszk in https://github.com/huggingface/safetensors/pull/257
• Adding issue templates. by @Narsil in https://github.com/huggingface/safetensors/pull/268
• Remove ISSUE links. by @Narsil in https://github.com/huggingface/safetensors/pull/269
• [doc build] Use secrets by @mishig25 in https://github.com/huggingface/safetensors/pull/270
• Make tensor identifier a bit more robust, and transformers compatible by @thomasw21 in https://github.com/huggingface/safetensors/pull/264
• Add a reference to tch-rs by @LaurentMazare in https://github.com/huggingface/safetensors/pull/274
• fix syntax error in import statement of safetensors pytorch api docs code example by @kaczmarj in https://github.com/huggingface/safetensors/pull/276
• Missing files. by @Narsil in https://github.com/huggingface/safetensors/pull/282
• Fix wrong docstring for SafeTensors' names method (#250) by @dirac3000 in https://github.com/huggingface/safetensors/pull/284
• Fixing uniform empty tensor handling by @Narsil in https://github.com/huggingface/safetensors/pull/283
• Superseed #279 by @Narsil in https://github.com/huggingface/safetensors/pull/285
• Fix failing doc build workflows by @mishig25 in https://github.com/huggingface/safetensors/pull/287
• Revert dev change by @mishig25 in https://github.com/huggingface/safetensors/pull/288
• Fix numpy.save(-file) docstring. by @amitani in https://github.com/huggingface/safetensors/pull/290
• Adding more control to the chosen weights saved on disk. by @Narsil in https://github.com/huggingface/safetensors/pull/292
• Autodoc for save_model and load_model by @wouterzwerink in https://github.com/huggingface/safetensors/pull/293
• Fix link to shared tensor page by @wouterzwerink in https://github.com/huggingface/safetensors/pull/294
• Support musicgen conversion. by @Narsil in https://github.com/huggingface/safetensors/pull/296
• Passing the token around. by @Narsil in https://github.com/huggingface/safetensors/pull/302
• Adding slice get_dtype() method to get the dtype directly on slices. by @Narsil in https://github.com/huggingface/safetensors/pull/303
• fix: typo in attacks/README.md by @bliutech in https://github.com/huggingface/safetensors/pull/305
• feat: Add filter for shared storage non overlapping tensors by @Narsil in https://github.com/huggingface/safetensors/pull/309
• feat: Supporting big endian architecture. by @Narsil in https://github.com/huggingface/safetensors/pull/310

New Contributors

• @mfuntowicz made their first contribution in https://github.com/huggingface/safetensors/pull/251
• @davanstrien made their first contribution in https://github.com/huggingface/safetensors/pull/267
• @kiszk made their first contribution in https://github.com/huggingface/safetensors/pull/257
• @LaurentMazare made their first contribution in https://github.com/huggingface/safetensors/pull/274
• @kaczmarj made their first contribution in https://github.com/huggingface/safetensors/pull/276
• @dirac3000 made their first contribution in https://github.com/huggingface/safetensors/pull/284
• @amitani made their first contribution in https://github.com/huggingface/safetensors/pull/290
• @wouterzwerink made their first contribution in https://github.com/huggingface/safetensors/pull/293
• @bliutech made their first contribution in https://github.com/huggingface/safetensors/pull/305

Full Changelog: https://github.com/huggingface/safetensors/compare/v0.3.1rc1...v0.3.2.rc1

Notable changes

• Fix warning for PyTorch 2.0
• Fix alignment
• Overall hardened code + test suite

What's Changed

• Remove too many keywords. by @Narsil in https://github.com/huggingface/safetensors/pull/187
• Adding memmap example to read from file. by @Narsil in https://github.com/huggingface/safetensors/pull/189
• Making sure the safetensors existing PR is up-to-date. by @Narsil in https://github.com/huggingface/safetensors/pull/192
• Nicer error when failed to find tensor in Rust. by @Narsil in https://github.com/huggingface/safetensors/pull/191
• Adding commit description to convertion PR. by @Narsil in https://github.com/huggingface/safetensors/pull/198
• Python 2.0 added a warning on ByteStorage, so using UntypedStorage by @Narsil in https://github.com/huggingface/safetensors/pull/196
• Adding a minimal version for torch. by @Narsil in https://github.com/huggingface/safetensors/pull/204
• Minor improvements for README by @nickkolok in https://github.com/huggingface/safetensors/pull/201
• More badges. by @Narsil in https://github.com/huggingface/safetensors/pull/210
• Remove unwrap in prod code. by @Narsil in https://github.com/huggingface/safetensors/pull/209
• Upload codecov for main branch. by @Narsil in https://github.com/huggingface/safetensors/pull/211
• Upload codecov for main branch. by @Narsil in https://github.com/huggingface/safetensors/pull/212
• Fixing codecov rust tag. by @Narsil in https://github.com/huggingface/safetensors/pull/213
• Increase coverage on the error paths. by @Narsil in https://github.com/huggingface/safetensors/pull/214
• Deactivating codecov commenting. by @Narsil in https://github.com/huggingface/safetensors/pull/217
• Zero width shape are OK (0-rank tensors). They are simply a scalar. by @Narsil in https://github.com/huggingface/safetensors/pull/208
• Adding simple proptest. by @Narsil in https://github.com/huggingface/safetensors/pull/216
• Disallowing zero-width tensor. by @Narsil in https://github.com/huggingface/safetensors/pull/205
• Disallow erroneous buffer. by @Narsil in https://github.com/huggingface/safetensors/pull/206
• Overspecify a bit the format. by @Narsil in https://github.com/huggingface/safetensors/pull/215
• Adding arithmetic overflow checks (unchecked in release builds). by @Narsil in https://github.com/huggingface/safetensors/pull/207
• Add a safety warning in the convertion script. by @Narsil in https://github.com/huggingface/safetensors/pull/219
• Fixing empty shape test. by @Narsil in https://github.com/huggingface/safetensors/pull/218
• Remove the breaking change of disallowing zero sized tensors. by @Narsil in https://github.com/huggingface/safetensors/pull/221
• Adding last missing test for validate. by @Narsil in https://github.com/huggingface/safetensors/pull/225
• 0-sized tensors allowed. by @Narsil in https://github.com/huggingface/safetensors/pull/226
• Specify python versions. by @Narsil in https://github.com/huggingface/safetensors/pull/227
• Minor checks + proptest in python. by @Narsil in https://github.com/huggingface/safetensors/pull/228
• Committing Cargo.lock. by @Narsil in https://github.com/huggingface/safetensors/pull/233
• Fixing the logic to determine if PR is up-to-date. by @Narsil in https://github.com/huggingface/safetensors/pull/230
• Fixing alignment by @Narsil in https://github.com/huggingface/safetensors/pull/235
• Adding save_model and load_model to help with shared tensors with PyTorch. by @Narsil in https://github.com/huggingface/safetensors/pull/236
• Fixing shared detection logic. by @Narsil in https://github.com/huggingface/safetensors/pull/232
• New release candidate. by @Narsil in https://github.com/huggingface/safetensors/pull/224

New Contributors

• @nickkolok made their first contribution in https://github.com/huggingface/safetensors/pull/201

Full Changelog: https://github.com/huggingface/safetensors/compare/v0.3.0...v0.3.1

What's Changed

• Remove too many keywords. by @Narsil in https://github.com/huggingface/safetensors/pull/187
• Adding memmap example to read from file. by @Narsil in https://github.com/huggingface/safetensors/pull/189
• Making sure the safetensors existing PR is up-to-date. by @Narsil in https://github.com/huggingface/safetensors/pull/192
• Nicer error when failed to find tensor in Rust. by @Narsil in https://github.com/huggingface/safetensors/pull/191
• Adding commit description to convertion PR. by @Narsil in https://github.com/huggingface/safetensors/pull/198
• Python 2.0 added a warning on ByteStorage, so using UntypedStorage by @Narsil in https://github.com/huggingface/safetensors/pull/196
• Adding a minimal version for torch. by @Narsil in https://github.com/huggingface/safetensors/pull/204
• Minor improvements for README by @nickkolok in https://github.com/huggingface/safetensors/pull/201
• More badges. by @Narsil in https://github.com/huggingface/safetensors/pull/210
• Remove unwrap in prod code. by @Narsil in https://github.com/huggingface/safetensors/pull/209
• Upload codecov for main branch. by @Narsil in https://github.com/huggingface/safetensors/pull/211
• Upload codecov for main branch. by @Narsil in https://github.com/huggingface/safetensors/pull/212
• Fixing codecov rust tag. by @Narsil in https://github.com/huggingface/safetensors/pull/213
• Increase coverage on the error paths. by @Narsil in https://github.com/huggingface/safetensors/pull/214
• Deactivating codecov commenting. by @Narsil in https://github.com/huggingface/safetensors/pull/217
• Zero width shape are OK (0-rank tensors). They are simply a scalar. by @Narsil in https://github.com/huggingface/safetensors/pull/208
• Adding simple proptest. by @Narsil in https://github.com/huggingface/safetensors/pull/216
• Disallowing zero-width tensor. by @Narsil in https://github.com/huggingface/safetensors/pull/205
• Disallow erroneous buffer. by @Narsil in https://github.com/huggingface/safetensors/pull/206
• Overspecify a bit the format. by @Narsil in https://github.com/huggingface/safetensors/pull/215
• Adding arithmetic overflow checks (unchecked in release builds). by @Narsil in https://github.com/huggingface/safetensors/pull/207
• Add a safety warning in the convertion script. by @Narsil in https://github.com/huggingface/safetensors/pull/219
• Fixing empty shape test. by @Narsil in https://github.com/huggingface/safetensors/pull/218
• Remove the breaking change of disallowing zero sized tensors. by @Narsil in https://github.com/huggingface/safetensors/pull/221
• Adding last missing test for validate. by @Narsil in https://github.com/huggingface/safetensors/pull/225
• 0-sized tensors allowed. by @Narsil in https://github.com/huggingface/safetensors/pull/226
• Specify python versions. by @Narsil in https://github.com/huggingface/safetensors/pull/227
• Minor checks + proptest in python. by @Narsil in https://github.com/huggingface/safetensors/pull/228
• Committing Cargo.lock. by @Narsil in https://github.com/huggingface/safetensors/pull/233
• Fixing the logic to determine if PR is up-to-date. by @Narsil in https://github.com/huggingface/safetensors/pull/230
• Fixing alignment by @Narsil in https://github.com/huggingface/safetensors/pull/235
• Adding save_model and load_model to help with shared tensors with PyTorch. by @Narsil in https://github.com/huggingface/safetensors/pull/236
• Fixing shared detection logic. by @Narsil in https://github.com/huggingface/safetensors/pull/232
• New release candidate. by @Narsil in https://github.com/huggingface/safetensors/pull/224

New Contributors

• @nickkolok made their first contribution in https://github.com/huggingface/safetensors/pull/201

Full Changelog: https://github.com/huggingface/safetensors/compare/v0.3.0...v0.3.1rc1

Everything in this new release should be backward compatible.

The only thing which might not, is loading a file and saving it again might change it's layout.
Content will be the same, but the order and positions of tensors might be changed to improve the alignment of buffers which can enable much
faster loads on lower level languages. ( https://github.com/huggingface/safetensors/pull/148)

Major changes

• Fixing the fact that the context manager wasn't properly cleaning up after itself. by @Narsil in https://github.com/huggingface/safetensors/pull/166
• [Major Change] Enforcing tensor alignment by @Narsil in https://github.com/huggingface/safetensors/pull/148
• Faster GPU Loads ?? by @Narsil in https://github.com/huggingface/safetensors/pull/184
• Removed the need for SAFETENSORS_FAST_GPU=1 with a safe alternative that loads just as fast.

What's Changed

• Improve type hinting by @thomasw21 in https://github.com/huggingface/safetensors/pull/159
• New unreleased version. by @Narsil in https://github.com/huggingface/safetensors/pull/161
• Update README.md by @thomasw21 in https://github.com/huggingface/safetensors/pull/163
• Enabling 3.8 support for M1. by @Narsil in https://github.com/huggingface/safetensors/pull/162
• Added JSONSchema of the header. by @KOLANICH in https://github.com/huggingface/safetensors/pull/151
• Adding custom error type for users to properly catch. by @Narsil in https://github.com/huggingface/safetensors/pull/165
• Fixing the fact that the context manager wasn't properly cleaning up after itself. by @Narsil in https://github.com/huggingface/safetensors/pull/166
• Minor pydoc fixes for torch bindings by @jbn in https://github.com/huggingface/safetensors/pull/167
• Better error messages on outdated context manager. by @Narsil in https://github.com/huggingface/safetensors/pull/168
• Clippy fix. by @Narsil in https://github.com/huggingface/safetensors/pull/171
• Update README.md by @Narsil in https://github.com/huggingface/safetensors/pull/170
• Fixing error message for FileNotFound. by @Narsil in https://github.com/huggingface/safetensors/pull/175
• Add PaddlePaddle backend by @JunnYu in https://github.com/huggingface/safetensors/pull/176
• [Docs] add paddlepaddle docs by @JunnYu in https://github.com/huggingface/safetensors/pull/177
• [Major Change] Enforcing tensor alignment by @Narsil in https://github.com/huggingface/safetensors/pull/148
• README.md proposed clarity by @fdwr in https://github.com/huggingface/safetensors/pull/181
• Better Rust API (tch-rs) by @Narsil in https://github.com/huggingface/safetensors/pull/179
• Faster GPU Loads ?? by @Narsil in https://github.com/huggingface/safetensors/pull/184
• Preparing for release 0.3rc1. by @Narsil in https://github.com/huggingface/safetensors/pull/185
• Version 0.3.0 by @Narsil in https://github.com/huggingface/safetensors/pull/186

New Contributors

• @jbn made their first contribution in https://github.com/huggingface/safetensors/pull/167
• @JunnYu made their first contribution in https://github.com/huggingface/safetensors/pull/176
• @fdwr made their first contribution in https://github.com/huggingface/safetensors/pull/181

Full Changelog: https://github.com/huggingface/safetensors/compare/v0.2.8...v0.3.0

Everything in this new release should be backward compatible.

The only thing which might not, is loading a file and saving it again might change it's layout.
Content will be the same, but the order and positions of tensors might be changed to improve the alignment of buffers which can enable much
faster loads on lower level languages. ( https://github.com/huggingface/safetensors/pull/148)

Major changes

• Fixing the fact that the context manager wasn't properly cleaning up after itself. by @Narsil in https://github.com/huggingface/safetensors/pull/166
• [Major Change] Enforcing tensor alignment by @Narsil in https://github.com/huggingface/safetensors/pull/148
• Faster GPU Loads ?? by @Narsil in https://github.com/huggingface/safetensors/pull/184
• Removed the need for SAFETENSORS_FAST_GPU=1 with a safe alternative that loads just as fast.

What's Changed

• Improve type hinting by @thomasw21 in https://github.com/huggingface/safetensors/pull/159
• New unreleased version. by @Narsil in https://github.com/huggingface/safetensors/pull/161
• Update README.md by @thomasw21 in https://github.com/huggingface/safetensors/pull/163
• Enabling 3.8 support for M1. by @Narsil in https://github.com/huggingface/safetensors/pull/162
• Added JSONSchema of the header. by @KOLANICH in https://github.com/huggingface/safetensors/pull/151
• Adding custom error type for users to properly catch. by @Narsil in https://github.com/huggingface/safetensors/pull/165
• Fixing the fact that the context manager wasn't properly cleaning up after itself. by @Narsil in https://github.com/huggingface/safetensors/pull/166
• Minor pydoc fixes for torch bindings by @jbn in https://github.com/huggingface/safetensors/pull/167
• Better error messages on outdated context manager. by @Narsil in https://github.com/huggingface/safetensors/pull/168
• Clippy fix. by @Narsil in https://github.com/huggingface/safetensors/pull/171
• Update README.md by @Narsil in https://github.com/huggingface/safetensors/pull/170
• Fixing error message for FileNotFound. by @Narsil in https://github.com/huggingface/safetensors/pull/175
• Add PaddlePaddle backend by @JunnYu in https://github.com/huggingface/safetensors/pull/176
• [Docs] add paddlepaddle docs by @JunnYu in https://github.com/huggingface/safetensors/pull/177
• [Major Change] Enforcing tensor alignment by @Narsil in https://github.com/huggingface/safetensors/pull/148
• README.md proposed clarity by @fdwr in https://github.com/huggingface/safetensors/pull/181
• Better Rust API (tch-rs) by @Narsil in https://github.com/huggingface/safetensors/pull/179
• Faster GPU Loads ?? by @Narsil in https://github.com/huggingface/safetensors/pull/184
• Preparing for release 0.3rc1. by @Narsil in https://github.com/huggingface/safetensors/pull/185

New Contributors

• @jbn made their first contribution in https://github.com/huggingface/safetensors/pull/167
• @JunnYu made their first contribution in https://github.com/huggingface/safetensors/pull/176
• @fdwr made their first contribution in https://github.com/huggingface/safetensors/pull/181

Full Changelog: https://github.com/huggingface/safetensors/compare/python-v0.2.8...v0.3.0rc1

What's Changed

• Fixing torch version parsing. by @Narsil in https://github.com/huggingface/safetensors/pull/143
• Updating rust ergonomics. by @Narsil in https://github.com/huggingface/safetensors/pull/144
• Preparing next version. by @Narsil in https://github.com/huggingface/safetensors/pull/158
• Fix byte order detection for np.uint8 and other types for which byte order is not defined. by @Narsil in https://github.com/huggingface/safetensors/pull/160

Full Changelog: https://github.com/huggingface/safetensors/compare/v0.2.7...v0.2.8

What's Changed

• Fixing torch version parsing. by @Narsil in https://github.com/huggingface/safetensors/pull/143
• Updating rust ergonomics. by @Narsil in https://github.com/huggingface/safetensors/pull/144
• Preparing next version. by @Narsil in https://github.com/huggingface/safetensors/pull/158
• Fix byte order detection for np.uint8 and other types for which byte order is not defined. by @Narsil in https://github.com/huggingface/safetensors/pull/160

Full Changelog: https://github.com/huggingface/safetensors/compare/python-v0.2.7...python-v0.2.8

• Fixing SAFETENSORS_FAST_GPU=1 on Windows : https://github.com/huggingface/safetensors/pull/140