Install PyTorch distributions with computation backend auto-detection
BSD-3-CLAUSE License
Published by pmeier over 1 year ago
A lot of Nvidia packages as well as fsspec
made it onto the PyTorch indices. light-the-torch
now handles them correctly (#137)
Published by pmeier over 1 year ago
Published by pmeier over 1 year ago
Published by pmeier over 1 year ago
Published by pmeier almost 2 years ago
Published by pmeier almost 2 years ago
pip==22.3.1
(#105)Published by pmeier almost 2 years ago
This release is needed since pip==22.3
breaks previous light-the-torch
versions. Compatibility was fixed in #99.
Apart from that, this release brings a few other quality-of-life improvements:
Published by pmeier almost 2 years ago
pip==22.3
by (#99)If you want to install this version of light-the-torch
, use pip install --pre light-the-torch
Published by pmeier about 2 years ago
Published by pmeier about 2 years ago
Published by pmeier over 2 years ago
As noted in #40, the supported pip
versions before this release were quite outdated. A major blocker was the dependency resolver that pip==21
introduced. It changed a lot of the internals that we relied on. Thus, we needed to completely overhaul the project.
And we did in #60 🎉 As a result, we now support every pip
version starting from 22
with a few exceptions. Of course, given that we need to rely on pip
internals without any BC guarantees, there will be some breakages in future version. But we are confident, that the changes that needed to happen in light-the-torch
should be small.
In the process of rewriting, we also added support for other PyTorch distributions to be installed through light-the-torch
. Before it could only handle
torch
torchvision
torchtext
torchaudio
but now in addition we support:
torch
torch_model_archiver
torch_tb_profiler
torcharrow
torchcsprng
torchdata
torchdistx
torchserve
Unfortunately, overhauling the project also brings some BC breaking changes. Namely, ltt extract
and ltt find
and their API counterparts light_the_torch.extract_dists
and light_the_torch.find_links
were removed. This processing in stages, i.e. extracting the PyTorch distributions from the installation command, finding the correct link for them and only then installing them in a subsequent command is no longer possible with the new pip
dependency resolver.
Shout out to our contributors: @pmeier @tonyfast @jamesobutler
Published by pmeier over 2 years ago
Adds the following PyTorch distributions to be patched by light-the-torch
:
torch_model_archiver
torch_tb_profiler
torcharrow
torchcsprng
torchdata
torchdistx
torchserve
Published by pmeier over 2 years ago
If you want to install this version of light-the-torch
, use pip install --pre light-the-torch
.
Published by pmeier over 2 years ago
If you want to install this version of light-the-torch
, use pip install --pre light-the-torch
.
Published by pmeier over 2 years ago
If you want to install this version of light-the-torch
, use pip install --pre light-the-torch
.
Published by pmeier over 2 years ago
If you want to install this version of light-the-torch
, use pip install --pre light-the-torch
.
Published by pmeier over 2 years ago
If you want to install this version of light-the-torch
, use pip install --pre light-the-torch
.
Published by pmeier over 2 years ago
Cleans up the code and fixes some manual found bugs.
If you want to install this version of light-the-torch
, use pip install --pre light-the-torch
.
Published by pmeier over 2 years ago
This is the first step towards supporting newer versions of pip
in the backend. The major change is that instead of using pip
internals, light-the-torch
now actually wraps pip
.
If you want to install this version of light-the-torch
, use pip install --pre light-the-torch
.