JuiceFS is a distributed POSIX file system built on top of Redis and S3.
APACHE-2.0 License
Published by SandyXSD over 2 years ago
JuiceFS v1.0.0-beta2 is the second beta release for v1.0. It has 150+ commits from 16 contributors, thanks to @SandyXSD @zhijian-pro @yuhr123 @xiaogaozi @davies @sanwan @AIXjing @Suave @tangyoupeng @zwwhdls @201341 @zhexuany @chnliyong @liufuyang @rayw000 @fredchen2022 !
no-bgjob
for service commands to disable background jobs like clean-up, backup, etc. (#1472)META_PASSWORD
env and omit unnecessary characters (#1388)BackupMeta
in config (#1460)Published by davies almost 3 years ago
JuiceFS v1.0.0-beta1 is the first beta release for v1.0, arrived three months after v0.17. It has 300+ commits from 22 contributors, thanks to @SandyXSD @davies @xiaogaozi @yuhr123 @zhijian-pro @sanwan @zwwhdls @tangyoupeng @Suave @chiyutianyi @201341 @suzaku @reusee @tisonkun @chenjie4255 @dragonly @nature1995 @fredchen2022 @Shoothzj @nsampre @supermario1990 @sjp00556 !
JuiceFS v1.0.0-beta1 is released under the Apache License 2.0.
config
command to update configuration of an existing volume (#1137)destroy
command to clean up all data & metadata of a volume (#1164)--check-all
and --check-new
to verify data integrity (#1208)sync
command supports anonymous access to S3 (#1228)Published by chnliyong almost 3 years ago
JuiceFS v0.17.5 is a patch release for v0.17, which has the following changes:
df
(introduced in v0.17.2) (#1096).Thanks to @davies @SandyXSD @chiyutianyi for contributions!
Published by chnliyong almost 3 years ago
JuiceFS v0.17.2 is the second patch release for v0.17, which has the following changes:
Thanks to @SandyXSD @davies @chiyutianyi @zhijian-pro @nsampre for contributions!
Published by chnliyong almost 3 years ago
JuiceFS v0.17.1 is a patch release for v0.17, which has the following changes:
Thanks to contributions from @SandyXSD @tangyoupeng @davies @zhijian-pro @chiyutianyi !
Published by davies about 3 years ago
JuiceFS v0.17 arrived one month after 0.16, with 80+ commits from 9 contributors (@SandyXSD, @davies, @xiaogaozi, @yuhr123, @Suave @tangyoupeng @201341 @zwwhdls @allwefantasy), thanks to them!
This release improved the performance when JuiceFS is used for temporary data by using an in-memory meta engine (memkv) and delayed uploading. For example, we can use JuiceFS as the shuffle and spill disk without worrying about running out of space.
Linux Test Project was used to verify the compatibility of JuiceFS, please checkout the current results here.
This release introduced metadata cache for Java SDK and S3 gateway (similar to metadata cache in kernel), which could be turned to improve performance significantly.
.
and ..
(#842).gc
command (#746).Published by davies about 3 years ago
JuiceFS v0.16.2 is patched version for v0.16, is recommended to upgrade.
gc
command (#746).Published by chnliyong about 3 years ago
JuiceFS v0.16.1 arrived one month after 0.15.2, with 80+ commits from 11 contributors (@davies, @Sandy4999 , @xiaogaozi @tangyoupeng @zhijian-pro @chnliyong @Suave @themaxdavitt @xuhui-lu @201341 @zwwhdls ), thanks to them!
The biggest feature is supporting TiKV as the meta engine, which is a distributed transactional key-value database. With TiKV, JuiceFS can store trillions of files and exabytes of data, please .
The meaning of password in Redis Sentinel URL is changed from Sentinel password to Redis server password, please update the password in the URL if you use sentinel and their password are different.
stats
to watch performance metrics in realtime (#702 #721).writeback_cache
is used (#705).Published by chnliyong over 3 years ago
JuiceFS v0.15.2 arrived 1 month after v0.14.2, with more than 60+ changes from 8 contributors (@davies, @Sandy4999 , @xiaogaozi, @yuhr123, @Suave, @zzcclp , @tangyoupeng, @chnliyong, @yuhr123), thanks to them.
This release introduced new tool to backup and restore metadata, which can also be used to migrate metadata between different meta engines, check Backup and Restore Metadata for details.
This release also improved the performance significantly for read/write heavy workload by utilizing page cache in kernel.
This release is backward-compatible with previous releases, should be safe to upgrade.
dump
and load
to backup and restore metadata (#510, #521, #529, #535, #551).--read-only
) to mount as read-only (#520).-p N
) (#545).--subdir
) to mount a sub-directory (#550).-o writeback_cache
(#576).juicefs mount
(#517).Published by chnliyong over 3 years ago
JuiceFS v0.14.2 received 30+ contributions from @davies @xiaogaozi @tangyoupeng @Sandy4999 @chnliyong @yuhr123 @xyb @meilihao @frankxieke , thanks to them!
juicefs status
(#491).juicefs gc
(#494).juicefs.umask
for Java SDK (#462).Published by chnliyong over 3 years ago
JuiceFS v0.13.1 is a bugfix release for v0.13. We have created first release branch for 0.13, which will only have bugfix in future patch releases.
juicefs sync
in distributed mode (#424)Published by chnliyong over 3 years ago
JuiceFS v0.13 arrived 1 month after v0.12.1, with more than 80 changes from 9 contributors (@davies, @Sandy4999 , @xiaogaozi, @yuhr123, @polyrabbit, @suzaku, @tangyoupeng, @angristan, @chnliyong), thanks to them.
The biggest feature in v0.13 is using SQL database as meta engine, SQLite, MySQL and TiDB are supported right now, we will add others later. Using SQL database will be slower than using Redis, but they have better persistency and scalability than Redis, is better in the cases that data safety and number of files are more important than performance, for example, backup.
profile
to analyze access log (#344).status
to show the setting and status (#368).warmup
to build cache for files/directory (#409)./.stats
to show the internal metrics (#314).juicefs sync
(199b4d35b).Published by chnliyong over 3 years ago
JuiceFS v0.12.1 had fixed a few bugs and improvements on scalability.
juicefs gc
, which may overload redis on larger cluster (6358e388416c).Published by chnliyong over 3 years ago
JuiceFS v0.12 was arrived 1 month after v0.11, with more than 70 changes from 7 contributors (@davies @xiaogaozi @chnliyong @tangyoupeng @Arvintian @luohy15 @angristan), thanks to them.
juicefs gc
to collect garbage in object store (#248, #290).juicefs fsck
to check the consistency of file system (#253).juicefs info
to show internal information for file/directory (slow for large directory)(#288).juicefs_
) and labels (vol_name
and mp
) for exposed metrics.--verbose
as an alias to --debug
.juicefs rmr
by parallelizing it.--buffer-size
(slow down if it's above 100%).juicefs umount
in Linux (#242).juicefs rmr
with relative path.Published by davies over 3 years ago
juicefs rmr
to remove all files in a directory recursively (#207).Published by davies over 3 years ago
juicefs umount
to umount a volume.juicefs benchmark
to do simple benchmark (read/write on big/small files)juicefs sync
.Published by davies almost 4 years ago
This release includes BREAKING changes and a few bugfix:
New
Changes
Improvements
Bugfix
Published by chnliyong almost 4 years ago
This release addressed all the known issue reported from community since first public release.
-d
to mount in background.
and ..
when list a directory with -a
in Linux.--force
to overwrite existing format in Redis.