shrimp

Simple program that reliably uploads large files to Amazon S3.

Stars
10
shrimp - v0.2.0 Latest Release

Published by stefansundin about 2 years ago

This release replaces the standard Go flag library with zflag. This brings shrimp's argument parsing very close to the aws cli. If you notice any discrepancies then please report it in an issue.

shrimp - v0.1.0

Published by stefansundin about 2 years ago

This is the first binary release of shrimp, many months after the initial announcement and release of the source code. I have continually improved shrimp since then, and now it has achieved almost complete feature parity with the aws cli. I have also reported issues and bugs in the SDK, and even bugs and inconsistencies that I have found in the S3 service itself.

Since shrimp's introduction, the most exciting new feature in S3 is the Additional Checksum Algorithms feature released in February 2022. It is now trivial to verify that shrimp is doing what it is supposed to, i.e. sending the bytes and parts in the correct order. Unfortunately, as is often the case, AWS has not published any tooling of their own that will help you perform this verification, so I had to make my own: s3verify. You can use it to verify that an object on S3 matches a file on your hard drive, without the need to download the object (this is great for data on Glacier!).

With this level of feature parity and the assurances that come with the new checksum feature, I can now say that shrimp is ready for prime time use. Please give it a try and report any issues you may have.

shrimp will soon adopt zflag to make shrimp's handling of command line arguments more compatible with the aws cli. I wanted to make a binary release with the current argument handling before this change happens. Please use v0.1.0 if you need compatibility with how arguments were processed in the pre-release version.