keras

Deep Learning for humans

APACHE-2.0 License

Downloads
14M
Stars
60.9K
Committers
1.3K

Bot releases are visible (Hide)

keras - Keras 3.2.1 Latest Release

Published by fchollet 6 months ago

What's Changed

This is a minor bugfix release.

Full Changelog: https://github.com/keras-team/keras/compare/v3.2.0...v3.2.1

keras - Keras 3.2.0

Published by fchollet 6 months ago

What changed

  • Introduce QLoRA-like technique for LoRA fine-tuning of Dense and EinsumDense layers (thereby any LLM) in int8 precision.
  • Extend keras.ops.custom_gradient support to PyTorch.
  • Add keras.layers.JaxLayer and keras.layers.FlaxLayer to wrap JAX/Flax modules as Keras layers.
  • Allow save_model & load_model to accept a file-like object.
  • Add quantization support to the Embedding layer.
  • Make it possible to update metrics inside a custom compute_loss method with all backends.
  • Make it possible to access self.losses inside a custom compute_loss method with the JAX backend.
  • Add keras.losses.Dice loss.
  • Add keras.ops.correlate.
  • Make it possible to use cuDNN LSTM & GRU with a mask with the TensorFlow backend.
  • Better JAX support in model.export(): add support for aliases, finer control over jax2tf options, and dynamic batch shapes.
  • Bug fixes and performance improvements.

New Contributors

Full Changelog: https://github.com/keras-team/keras/compare/v3.1.1...v3.2.0

keras - Keras 3.1.1

Published by fchollet 7 months ago

This is a minor bugfix release over 3.1.0.

What's Changed

New Contributors

Full Changelog: https://github.com/keras-team/keras/compare/v3.1.0...v3.1.1

keras - Keras 3.1.0

Published by fchollet 7 months ago

New features

  • Add support for int8 inference. Just call model.quantize("int8") to do an in-place conversion of a bfloat16 or float32 model to an int8 model. Note that only Dense and EinsumDense layers will be converted (this covers LLMs and all Transformers in general). We may add more supported layers over time.
  • Add keras.config.set_backend(backend) utility to reload a different backend.
  • Add keras.layers.MelSpectrogram layer for turning raw audio data into Mel spectrogram representation.
  • Add keras.ops.custom_gradient decorator (only for JAX and TensorFlow).
  • Add keras.ops.image.crop_images.
  • Add pad_to_aspect_ratio argument to image_dataset_from_directory.
  • Add keras.random.binomial and keras.random.beta functions.
  • Enable keras.ops.einsum to run with int8 x int8 inputs and int32 output.
  • Add verbose argument in all dataset-creation utilities.

Notable fixes

  • Fix Functional model slicing
  • Fix for TF XLA compilation error for SpectralNormalization
  • Refactor axis logic across all backends and add support for multiple axes in expand_dims and squeeze

New Contributors

Full Changelog: https://github.com/keras-team/keras/compare/v3.0.5...v3.1.0

keras - Keras 3.0.5

Published by fchollet 8 months ago

This release brings many bug fixes and performance improvements, new linear algebra ops, and sparse tensor support for the JAX backend.

Highlights

  • Add support for sparse tensors with the JAX backend.
  • Add support for saving/loading in bfloat16.
  • Add linear algebra ops in keras.ops.linalg.
  • Support nested structures in while_loop op.
  • Add erfinv op.
  • Add normalize op.
  • Add support for IterableDataset to TorchDataLoaderAdapter.

New Contributors

Full Changelog: https://github.com/keras-team/keras/compare/v3.0.4...v3.0.5

keras - Keras 3.0.4

Published by fchollet 9 months ago

This is a minor release with improvements to the LoRA API required by the next release of KerasNLP.

Full Changelog: https://github.com/keras-team/keras/compare/v3.0.3...v3.0.4

keras - Keras 3.0.3 release

Published by fchollet 9 months ago

This is a minor Keras release.

What's Changed

  • Add built-in LoRA (low-rank adaptation) API to all relevant layers (Dense, EinsumDense, Embedding).
  • Add SwapEMAWeights callback to make it easier to evaluate model metrics using EMA weights during training.
  • All DataAdapters now create a native iterator for each backend, improving performance.
  • Add built-in prefetching for JAX, improving performance.
  • The bfloat16 dtype is now allowed in the global set_dtype configuration utility.
  • Bug fixes and performance improvements.

New Contributors

Full Changelog: https://github.com/keras-team/keras/compare/v3.0.2...v3.0.3

keras - Keras 3.0.2

Published by fchollet 10 months ago

Breaking changes

There are no known breaking changes in this release compared to 3.0.1.

API changes

  • Add keras.random.binomial and keras.random.beta RNG functions.
  • Add masking support to BatchNormalization.
  • Add keras.losses.CTC (loss function for sequence-to-sequence tasks) as well as the lower-level operation keras.ops.ctc_loss.
  • Add ops.random.alpha_dropout and layers.AlphaDropout.
  • Add gradient accumulation support for all backends, and enable optimizer EMA for JAX and torch

Full Changelog: https://github.com/keras-team/keras/compare/v3.0.1...v3.0.2

keras - Keras Release 2.15.0

Published by qlzh727 10 months ago

What's Changed

New Contributors

Full Changelog: https://github.com/keras-team/keras/compare/v2.14.0...v2.15.0

keras - Keras 3.0.1

Published by fchollet 11 months ago

This is a minor release focused on bug fixes and performance improvements.

What's Changed

  • Bug fixes and performance improvements.
  • Add stop_evaluating and stop_predicting model attributes for callbacks, similar to stop_training.
  • Add keras.device() scope for managing device placement in a multi-backend way.
  • Support dict items in PyDataset.
  • Add hard_swish activation and op.
  • Fix cuDNN LSTM performance on TensorFlow backend.
  • Add a force_download arg to get_file to force cache invalidation.

Full Changelog: https://github.com/keras-team/keras/compare/v3.0.0...v3.0.1

keras - Keras 3.0.0

Published by fchollet 11 months ago

Major updates

See the release announcement for a detailed list of major changes. Main highlights compared to Keras 2 are:

  • Keras can now be run on top of JAX, PyTorch, TensorFlow, and even NumPy (note that the NumPy backend is inference-only).
  • New low-level keras.ops API for building cross-framework components.
  • New large-scale model distribution keras.distribution based on JAX.
  • New stateless API for layers, models, optimizers, and metrics.

Breaking changes

See this thread for a complete list of breaking changes, as well as the Keras 3 migration guide.

keras - Keras Release 2.14.0

Published by qlzh727 about 1 year ago

What's Changed

New Contributors

Full Changelog: https://github.com/keras-team/keras/compare/v2.13.1...v2.14.0

keras - Keras Release 2.14.0 RC0

Published by qlzh727 about 1 year ago

What's Changed

New Contributors

Full Changelog: https://github.com/keras-team/keras/compare/v2.13.1...v2.14.0-rc0

keras - Keras Release 2.13.1

Published by qlzh727 over 1 year ago

What's Changed

New Contributors

Full Changelog: https://github.com/keras-team/keras/compare/v2.12.0...v2.13.1

keras - Keras Release 2.13.1 RC1

Published by qlzh727 over 1 year ago

What's Changed

New Contributors

Full Changelog: https://github.com/keras-team/keras/compare/v2.13.1-rc0...v2.13.1-rc1

keras - Keras Release 2.13.1 RC0

Published by qlzh727 over 1 year ago

What's Changed

New Contributors

Full Changelog: https://github.com/keras-team/keras/compare/v2.12.0...v2.13.1-rc0

keras - Keras Release 2.12.0

Published by qlzh727 over 1 year ago

Please see the release history at https://github.com/tensorflow/tensorflow/releases/tag/v2.12.0 for more details.

What's Changed

New Contributors

Full Changelog: https://github.com/keras-team/keras/compare/v2.11.0...v2.12.0

keras - Keras Release 2.12.0 RC1

Published by qlzh727 over 1 year ago

Please see the release history at https://github.com/tensorflow/tensorflow/releases/tag/v2.12.0-rc0 for more details.

What's Changed

New Contributors

Full Changelog: https://github.com/keras-team/keras/compare/v2.11.0...v2.12.0-rc1

keras - Keras Release 2.11.0

Published by qlzh727 almost 2 years ago

keras - Keras Release 2.11.0 RC3

Published by qlzh727 almost 2 years ago

What's Changed

Full Changelog: https://github.com/keras-team/keras/compare/v2.11.0-rc2...v2.11.0-rc3