sagemaker-training-toolkit

Bug Fixes and Other Changes

• Added p5 as a supported NCCL instance

Features

• Add support for py39 and py310

Bug Fixes and Other Changes

• typo in the run unit tests command
• run unit tests in sequence order for release process as well to prevent coverage conflicting issues
• chore: removing unnecessary logging information

Bug Fixes and Other Changes

• update the boto deps to use latest boto

Bug Fixes and Other Changes

• bypass DNS check for studio local exec

Bug Fixes and Other Changes

• use smddprun only if it is installed

Bug Fixes and Other Changes

• Add NCCL_PROTO=simple environment variable to handle the out-of-order data delivery from EFA
• toolkit build failure

Features

• support codeartifact for installing requirements.txt packages

Bug Fixes and Other Changes

• removed unused import statment
• forgot to run black on torch_distributed.py after updating my comments from last commit
• Modified my comment on line 98-103 in torch_distrbuted.py to comply with formatting standard.
• Revert "Ran black on entire sagemaker-trianing-toolkit directory"
• Ran black on entire sagemaker-trianing-toolkit directory
• Ran Black (python formatter) on the files with my code updates (torch_distributed.py and test_torch_distributed.py)
• Added test for neuron_parallel_compile in test_torch_distributed.py
• Updated comment syntax based on feedback in pull request as well as added full example of the neuron_parallel_compile command as it would appear in the command line
• added unit test for neuron_parallel_compile code change
• Updated torch_distributed.py

Features

• add smddp exception classes in mpi distribution

Features

• add NCCL_PROTO, NCCL_ALGO environments for modelparallel jobs

Bug Fixes and Other Changes

• unpin sagemaker version as the credential issue fixed

Bug Fixes and Other Changes

• increase worker waiting time for ORTE proc

Bug Fixes and Other Changes

• upagrade protobuf version for tensorflow 2.12

Bug Fixes and Other Changes

• Revert SMDDP collectives feature from smdataparallel runner

Bug Fixes and Other Changes

• Update libraries for SMDDP collectives validation

Bug Fixes and Other Changes

• Upgrade protobuf to prevent conflicts with smdebugger.

Bug Fixes and Other Changes

• Add support for p4de instances, update when FI_EFA_USE_DEVICE_RDMA flag is set to only p4d{e} instances.