nanodl
A Jax-based library for designing and training transformer models from scratch.
MIT License
Bot releases are hidden (Show)
Full Changelog: https://github.com/HMUNACHI/nanodl/compare/1.2.5dev1...v.0.0.0
Published by HMUNACHI 5 months ago
Full Changelog: https://github.com/HMUNACHI/nanodl/compare/1.2.4dev1...1.2.5dev1
Published by HMUNACHI 5 months ago
Published by HMUNACHI 7 months ago
What's Changed
- Dev by @HMUNACHI in https://github.com/HMUNACHI/nanodl/pull/19
- Syncing by @HMUNACHI in https://github.com/HMUNACHI/nanodl/pull/20
- Tokenizer by @HMUNACHI in https://github.com/HMUNACHI/nanodl/pull/21
- Merge pull request #21 from HMUNACHI/dev by @HMUNACHI in https://github.com/HMUNACHI/nanodl/pull/22
- Dev by @HMUNACHI in https://github.com/HMUNACHI/nanodl/pull/23
- minor bug fix -> Correct Use of dropout probability as Norm epsilon by @danny-1k in https://github.com/HMUNACHI/nanodl/pull/26
- IJEPA implementation by @danny-1k in https://github.com/HMUNACHI/nanodl/pull/28
- touched up Ijepa by @HMUNACHI in https://github.com/HMUNACHI/nanodl/pull/29
- added changes by @HMUNACHI in https://github.com/HMUNACHI/nanodl/pull/30
New Contributors
- @danny-1k made their first contribution in https://github.com/HMUNACHI/nanodl/pull/26
Full Changelog: https://github.com/HMUNACHI/nanodl/compare/1.2.1.dev1...1.2.2.dev1
What's Changed
- Dev by @HMUNACHI in https://github.com/HMUNACHI/nanodl/pull/19
- Syncing by @HMUNACHI in https://github.com/HMUNACHI/nanodl/pull/20
- Tokenizer by @HMUNACHI in https://github.com/HMUNACHI/nanodl/pull/21
- Merge pull request #21 from HMUNACHI/dev by @HMUNACHI in https://github.com/HMUNACHI/nanodl/pull/22
- Dev by @HMUNACHI in https://github.com/HMUNACHI/nanodl/pull/23
- minor bug fix -> Correct Use of dropout probability as Norm epsilon by @danny-1k in https://github.com/HMUNACHI/nanodl/pull/26
- IJEPA implementation by @danny-1k in https://github.com/HMUNACHI/nanodl/pull/28
- touched up Ijepa by @HMUNACHI in https://github.com/HMUNACHI/nanodl/pull/29
- added changes by @HMUNACHI in https://github.com/HMUNACHI/nanodl/pull/30
New Contributors
- @danny-1k made their first contribution in https://github.com/HMUNACHI/nanodl/pull/26
Full Changelog: https://github.com/HMUNACHI/nanodl/compare/1.2.1.dev1...1.2.2.dev1
Published by HMUNACHI 7 months ago
What's Changed
- Fix instructions to install dependencies in README.md by @afrendeiro in https://github.com/HMUNACHI/nanodl/pull/14
- patches in random by @HMUNACHI in https://github.com/HMUNACHI/nanodl/pull/16
- Fixed random by @HMUNACHI in https://github.com/HMUNACHI/nanodl/pull/17
- Some patches by @HMUNACHI in https://github.com/HMUNACHI/nanodl/pull/18
New Contributors
- @afrendeiro made their first contribution in https://github.com/HMUNACHI/nanodl/pull/14
Full Changelog: https://github.com/HMUNACHI/nanodl/compare/1.2.0.dev1...1.2.1.dev1
Published by HMUNACHI 7 months ago
What's Changed
- NanoDL 1.2.0.dev1 by @HMUNACHI in https://github.com/HMUNACHI/nanodl/pull/13
What's New in version 1.2.0.dev1
- Google's Gemma architecture.
- Reward model wrapper and data-parallel distributed reward trainer.
- True random number generators in Jax which do not need the verbose code (examples shown in next sections).
Full Changelog: https://github.com/HMUNACHI/nanodl/compare/v1.0.1dev1...1.2.0.dev1
Published by HMUNACHI 9 months ago
Dev pre-release
Full Changelog: https://github.com/HMUNACHI/nanodl/commits/v1.0.1dev1
Published by HMUNACHI 9 months ago
Fixed importation
Published by HMUNACHI 9 months ago
developer release
Full Changelog: https://github.com/HMUNACHI/nanodl/commits/v1.0.0.dev1
