sagemaker-training-toolkit

Bug Fixes and Other Changes

• missing args when shell script is used

Features

• add back FI_EFA_USE_DEVICE_RDMA=1 flag, revert 2936f22

Breaking Changes

• Add py38, dropped py36 and py2 support. Bump pypi to 4.0.0 (changes from PR #108)

Bug Fixes and Other Changes

• Fix logging issues

Bug Fixes and Other Changes

• Reverted -x FI_EFA_USE_DEVICE_RDMA=1 to fix a crash on PyTorch Dataloaders for Distributed training

Bug Fixes and Other Changes

• [smdataparallel] better messages to establish the SSH connection between workers

Features

• smdataparallel enable EFA RDMA flag

Features

• smdataparallel custom mpi options support

Bug Fixes and Other Changes

• Update Dockerfile to accomomdate Rust dependency.

Bug Fixes and Other Changes

• set btl_vader_single_copy_mechanism to none to avoid Read -1 Warning messages

Bug Fixes and Other Changes

• set btl_vader_single_copy_mechanism to none

Bug Fixes and Other Changes

• decode binary stderr string before dumping it out

Features

• add data parallelism support (#3)

Bug Fixes and Other Changes

• update tox to use sagemaker 2.18.0 for tests
• use format in place of f-strings and use comment style type annotations

Bug Fixes and Other Changes

• workaround to print stderr when capturing

Testing and Release Infrastructure

• use ECR-hosted image for ubuntu:16.04

Documentation Changes

• fix typo in ENVIRONMENT_VARIABLES.md

Bug Fixes and Other Changes

• propagate log level to aws services

Bug Fixes and Other Changes

• check for script entry point even if setup.py is present

Testing and Release Infrastructure

• pin sagemaker<2 in test dependencies