safetensors

• Fixing SAFETENSORS_FAST_GPU=1 on Windows : https://github.com/huggingface/safetensors/pull/140

First Rust release.

• Python 3.11 Linux support.

• [#102] Hotfix for Windows i32 overflow within PyO3
• Some quality of life (better error messages, improved convert.py to be more general.
• Python 3.11 prebuilt binary

Fast CPU load on Pytorch
Fast GPU load on Python (unsafe, need to use SAFETENSORS_FAST_GPU=1 environement variable to use.

Remove importib. This was bogus and it crashes on Python2.7.

• Adding device argument to safe_open to reduce overhead of sending tensors to GPU.

math.prod is not supported for Python < 3.8. Putting back np.prod in there.

Added safe_open.
Added __metadata__ special key in the format (ability to store layout information that could be useful to transformers.)
Removed some API surface.
Cleaned up TF to be actually TF and not jax anymore.

Very shallow changelog, this is still a lot in exploration mode.

Initial release with barebone features just to get a PoC running.

Main features missing:

• Lazy loading
• DOS protection.