Ecosystems:
Go
- fix bug where it would only duplicate the first 1GiB of each match
- fix ENOMEM dedup errors
thunderdup
- v1.0.4
Published by Jorropo 6 months ago
- Fix bug in passing arguments to FileDedupRange making dedup faster, more efficient and avoid duplicate stats.
thunderdup
- v1.0.3
Published by Jorropo 6 months ago
- first discriminate files based on the size and lazily hash, this yielded ~31x performance improvement, will help a lot when you have many big and huge files.
thunderdup
- v1.0.2
Published by Jorropo 6 months ago
- hash function changed to xxh64 which lead to slight multicore performance improvements and ~2X single core (will depend on hardware).
- lowered default concurrency factor, I tested on NVME and SATA RAID1×2 arrays and I didn't saw any difference.
- Fixed bug where scanning would never complete when trying to open a named FIFO, thx @mhetzi for fixing this.
Package Rankings
Top 7.42% on Proxy.golang.org