seaweedfs

What's Changed

• S3
  • Fix regression in 3.56: S3 didn't delete empty folder when delete all files in folder after upgrade to 3.66 https://github.com/seaweedfs/seaweedfs/issues/5565
• FUSE Mount
  • Fix deadlock in lock table locks by @Woellchen in https://github.com/seaweedfs/seaweedfs/pull/5566

Full Changelog: https://github.com/seaweedfs/seaweedfs/compare/3.66...3.67

This version has a regression on S3 deleting empty folder. Fixed in 3.67.

What's Changed

• Volume Server

  • rename VolumeServerVolumeGauge by @CodeRusher in https://github.com/seaweedfs/seaweedfs/pull/5504
  • fix: skip file size checking for volume with TTL by @kmlebedev in https://github.com/seaweedfs/seaweedfs/pull/5541

• Shell

  • fix "volume.fix.replication" move many replications only to one volumeServer by @kungf in https://github.com/seaweedfs/seaweedfs/pull/5522

• Filer

  • filer read chunk retry if status code 499 by @kmlebedev in https://github.com/seaweedfs/seaweedfs/pull/5528
  • feat: upload files directly without multipart/form-data by @KevinBLT in https://github.com/seaweedfs/seaweedfs/pull/5539

• S3

  • [s3] Put bucket lifecycle configuration by @kmlebedev in https://github.com/seaweedfs/seaweedfs/pull/5510

• Helm Charts

  • helm: Fix annotations parameters to be standard maps by @jessebot in https://github.com/seaweedfs/seaweedfs/pull/5543

• Minor

  • Migrates from disintegration/imaging c2019 to cognusion/imaging c2024. by @cognusion in https://github.com/seaweedfs/seaweedfs/pull/5533
  • Fixes race with unlocked setter. by @cognusion in https://github.com/seaweedfs/seaweedfs/pull/5532
  • Fixes unlocked read from logBuffer.LastTsNs that is racey. by @cognusion in https://github.com/seaweedfs/seaweedfs/pull/5536
  • Move file deletion logging to v2 verbisity by @sample in https://github.com/seaweedfs/seaweedfs/pull/5538
  • reduce ambiguity about use memory_sequencer by @shenxingwuying in https://github.com/seaweedfs/seaweedfs/pull/5555

New Contributors

• @cognusion made their first contribution in https://github.com/seaweedfs/seaweedfs/pull/5533
• @KevinBLT made their first contribution in https://github.com/seaweedfs/seaweedfs/pull/5539
• @shenxingwuying made their first contribution in https://github.com/seaweedfs/seaweedfs/pull/5555

Full Changelog: https://github.com/seaweedfs/seaweedfs/compare/3.65...3.66

What's Changed

• Helm Chart

  • Helm chart readme - clarify details about multiple filers and datastore by @tomeresk in https://github.com/seaweedfs/seaweedfs/pull/5384
  • helm chart: make s3 ingress annotations consistent by @mergwyn in https://github.com/seaweedfs/seaweedfs/pull/5463

• Filer

  • fix get file metadata bug by @jerebear12 in https://github.com/seaweedfs/seaweedfs/pull/5394
  • Add TLS support, initial etcd connection check, fix key_prefix handling for etcd backend meta storage by @sample in https://github.com/seaweedfs/seaweedfs/pull/5403
  • fix filer address parsing by @doc-sheet in https://github.com/seaweedfs/seaweedfs/pull/5415
  • Move ListDirectoryEntries logic to ListDirectoryPrefixedEntries in etcd meta storage backend by @sample in https://github.com/seaweedfs/seaweedfs/pull/5416
  • fix: adjust condition in prefixFilterEntries prevent infinite loop by @sample in https://github.com/seaweedfs/seaweedfs/pull/5440
  • fix: ensure complete gRPC stream consumption in doListFilerEntries to prevent context canceled errors. by @sample in https://github.com/seaweedfs/seaweedfs/pull/5441
  • fix: filer authenticate with with volume server by @hencoappel in https://github.com/seaweedfs/seaweedfs/pull/5480
  • fix append disorder by @kungf in https://github.com/seaweedfs/seaweedfs/pull/5492

• Filer Sync

  • fix: sync without dir /buckets/some/.uploads/hash_hash by @kmlebedev in https://github.com/seaweedfs/seaweedfs/pull/5402

• Filer Replication

  • fix: panic: assignment to entry in nil map on S3Sink.CreateEntry by @kmlebedev in https://github.com/seaweedfs/seaweedfs/pull/5406

• S3

  • Fix iam service response 500 by @zuzuviewer in https://github.com/seaweedfs/seaweedfs/pull/5405
  • fix s3api: delimeter properly takes prefixes into account by @adasauce in https://github.com/seaweedfs/seaweedfs/pull/5411
  • [tests] add action s3 tests by @kmlebedev in https://github.com/seaweedfs/seaweedfs/pull/5427
  • fix completed multiupload lost data by @kungf in https://github.com/seaweedfs/seaweedfs/pull/5460
  • fix: correctly form partNumber from new entry.Name format in "listObjectParts" by @sample in https://github.com/seaweedfs/seaweedfs/pull/5470
  • [s3] fix s3 test_multipart_resend_first_finishes_last by @kmlebedev in https://github.com/seaweedfs/seaweedfs/pull/5471
  • [s3] add s3 pass test_multipart_upload by @kmlebedev in https://github.com/seaweedfs/seaweedfs/pull/5474
  • [s3] add s3 pass test_multipart_upload_size_too_small by @kmlebedev in https://github.com/seaweedfs/seaweedfs/pull/5475
  • [s3] fix s3 test_multipart_get_part by @kmlebedev in https://github.com/seaweedfs/seaweedfs/pull/5476

• Mount

  • fix GetAttr blocks count by @wusongANKANG in https://github.com/seaweedfs/seaweedfs/pull/5409
  • fix git clone into fuse mount fails with inflate: data stream error https://github.com/seaweedfs/seaweedfs/pull/5412

• Misc

  • add basic support for sentry error reporting by @doc-sheet in https://github.com/seaweedfs/seaweedfs/pull/5410
  • chore: fix function names in comment by @clonefetch in https://github.com/seaweedfs/seaweedfs/pull/5478
  • chore: fix some typos in comments by @yudrywet in https://github.com/seaweedfs/seaweedfs/pull/5497

• Master

  • [master] add test for PickForWrite add metrics for volume layout by @kmlebedev in https://github.com/seaweedfs/seaweedfs/pull/5413
  • fix panic 5435 by @kmlebedev in https://github.com/seaweedfs/seaweedfs/pull/5436
  • [master] grow volumes if no writable volumes in current dataCenter by @kmlebedev in https://github.com/seaweedfs/seaweedfs/pull/5434
  • fix panic at isAllWritable by @kmlebedev in https://github.com/seaweedfs/seaweedfs/pull/5457

• Volume Server

  • fix: always close volume file (#4530) by @hencoappel in https://github.com/seaweedfs/seaweedfs/pull/5459
  • Correct type for volume logs and idx values by @mergwyn in https://github.com/seaweedfs/seaweedfs/pull/5462
  • fix(volume.fix.replication): adjust volume count, not free volume count by @CodeRusher in https://github.com/seaweedfs/seaweedfs/pull/5479
  • [volume] Reduce the number of buffers for uploading one chunk by @kmlebedev in https://github.com/seaweedfs/seaweedfs/pull/5458

New Contributors

• @tomeresk made their first contribution in https://github.com/seaweedfs/seaweedfs/pull/5384
• @zuzuviewer made their first contribution in https://github.com/seaweedfs/seaweedfs/pull/5405
• @doc-sheet made their first contribution in https://github.com/seaweedfs/seaweedfs/pull/5410
• @sample made their first contribution in https://github.com/seaweedfs/seaweedfs/pull/5403
• @mergwyn made their first contribution in https://github.com/seaweedfs/seaweedfs/pull/5462
• @clonefetch made their first contribution in https://github.com/seaweedfs/seaweedfs/pull/5478
• @CodeRusher made their first contribution in https://github.com/seaweedfs/seaweedfs/pull/5479
• @yudrywet made their first contribution in https://github.com/seaweedfs/seaweedfs/pull/5497

Full Changelog: https://github.com/seaweedfs/seaweedfs/compare/3.64...3.65

What's Changed

• Filer
  • Disable filer UI in configuration by @jerebear12 in https://github.com/seaweedfs/seaweedfs/pull/5297
  • [filer] replace an invalid methods in a metric with an invalid one by @kmlebedev in https://github.com/seaweedfs/seaweedfs/pull/5378
• Mount
  • Moved noapplexattr under runtime.GOARCH == "amd64" to resolve the fin… by @Bia3 in https://github.com/seaweedfs/seaweedfs/pull/5351
• Shell
  • [shell] fs log purge by @kmlebedev in https://github.com/seaweedfs/seaweedfs/pull/5344
• S3 API
  • feat: add support for S3 ListObjects and ListObjectsV2 by @adasauce in https://github.com/seaweedfs/seaweedfs/pull/5350
• Volume
  • Add deleted bytes to total_disk_size by @SmsS4 in https://github.com/seaweedfs/seaweedfs/pull/5161
• Filer Backup
  • [filer.backup] add param uploader_part_size for S3sink by @kmlebedev in https://github.com/seaweedfs/seaweedfs/pull/5352
• Minor
  • remove repetitive words by @rustrover in https://github.com/seaweedfs/seaweedfs/pull/5364
  • Document default method used by compact by @SystemZ in https://github.com/seaweedfs/seaweedfs/pull/5379

New Contributors

• @Bia3 made their first contribution in https://github.com/seaweedfs/seaweedfs/pull/5351
• @adasauce made their first contribution in https://github.com/seaweedfs/seaweedfs/pull/5350
• @rustrover made their first contribution in https://github.com/seaweedfs/seaweedfs/pull/5364
• @SystemZ made their first contribution in https://github.com/seaweedfs/seaweedfs/pull/5379

Full Changelog: https://github.com/seaweedfs/seaweedfs/compare/3.63...3.64

What's Changed

• Filer

  • [filer] avoid return http ok for not allowed methods by @kmlebedev in https://github.com/seaweedfs/seaweedfs/pull/5209
  • chore: filer healthz handler check filer store by @kmlebedev in https://github.com/seaweedfs/seaweedfs/pull/5208
  • Update the solution when a file cannot be located. by @LuuucasChen in https://github.com/seaweedfs/seaweedfs/pull/5223
  • filer: reduce delete entry ErrNotFound logs by @sberthier in https://github.com/seaweedfs/seaweedfs/pull/5301
  • fix: http range request return status 500 by @sberthier in https://github.com/seaweedfs/seaweedfs/pull/5251

• Helm Chart

  • Fix(k8s-chart-helm): helm upgrade statefulset error by @sberthier in https://github.com/seaweedfs/seaweedfs/pull/5207
  • fix: publish helm chart at new release by @sberthier in https://github.com/seaweedfs/seaweedfs/pull/5265
  • fix helm install error for No such file or directory by @cuisongliu in https://github.com/seaweedfs/seaweedfs/pull/5250
  • helm enable resource for template by @cuisongliu in https://github.com/seaweedfs/seaweedfs/pull/5268
  • helm using external master address by @cuisongliu in https://github.com/seaweedfs/seaweedfs/pull/5267
  • k8s-chart-helm: unify extraEnvironmentVars by @sberthier in https://github.com/seaweedfs/seaweedfs/pull/5327

• Shell

  • weed/shell: Fix volume.balance logic by @BenoitKnecht in https://github.com/seaweedfs/seaweedfs/pull/5238
  • weed/shell: Cleanup volume balance logic by @BenoitKnecht in https://github.com/seaweedfs/seaweedfs/pull/5241
  • weed/shell: Cluster check other disk types by @BenoitKnecht in https://github.com/seaweedfs/seaweedfs/pull/5245
  • fix: fs verify error counter by @kmlebedev in https://github.com/seaweedfs/seaweedfs/pull/5261

• S3

  • fix: skip s3 .uploads by @bernardx in https://github.com/seaweedfs/seaweedfs/pull/5216
  • fix: s3tests test_get_object_ifnonematch_good by @kmlebedev in https://github.com/seaweedfs/seaweedfs/pull/5237
  • Adapt S3 POST ContentType by @sxlehua in https://github.com/seaweedfs/seaweedfs/pull/5275
  • Add s3 postpolicy support header by @sxlehua in https://github.com/seaweedfs/seaweedfs/pull/5280
  • Fix/s3 config secret by @spastorclovr in https://github.com/seaweedfs/seaweedfs/pull/5302
  • fix: only admin auth can delete S3 bucket by @7y-9 in https://github.com/seaweedfs/seaweedfs/pull/5312
  • refactor: put the auth outside by @7y-9 in https://github.com/seaweedfs/seaweedfs/pull/5313

• Volume Server

  • Enable multiple disks per volume server. Also streamline the use of /logs & /idx by @spastorclovr in https://github.com/seaweedfs/seaweedfs/pull/5236
  • [volume] requests that were canceled by the client are not an internal server problem(500 => 499) by @kmlebedev in https://github.com/seaweedfs/seaweedfs/pull/5304
  • weed/storage: Fix volume info file permissions by @BenoitKnecht in https://github.com/seaweedfs/seaweedfs/pull/5246
  • avoid unexpected compact size by @kmlebedev in https://github.com/seaweedfs/seaweedfs/pull/5272

• Master

  • fix: clean metric MasterReplicaPlacementMismatch for unregister volume by @kmlebedev in https://github.com/seaweedfs/seaweedfs/pull/5239

• Mount

  • Fix/bad mount path better default value by @spastorclovr in https://github.com/seaweedfs/seaweedfs/pull/5253
  • fix unaligned 64-bit atomic operation in weed mount on arm when readi… by @chrislusf in https://github.com/seaweedfs/seaweedfs/pull/5308

• Minor

  • chore: fix typos in scaffold help output by @andrewazores in https://github.com/seaweedfs/seaweedfs/pull/5211
  • Update README.md by @eltociear in https://github.com/seaweedfs/seaweedfs/pull/5282
  • Fix Broken Links by @justindhillon in https://github.com/seaweedfs/seaweedfs/pull/5287

New Contributors

• @andrewazores made their first contribution in https://github.com/seaweedfs/seaweedfs/pull/5211
• @LuuucasChen made their first contribution in https://github.com/seaweedfs/seaweedfs/pull/5223
• @spastorclovr made their first contribution in https://github.com/seaweedfs/seaweedfs/pull/5236
• @BenoitKnecht made their first contribution in https://github.com/seaweedfs/seaweedfs/pull/5238
• @cuisongliu made their first contribution in https://github.com/seaweedfs/seaweedfs/pull/5250
• @sxlehua made their first contribution in https://github.com/seaweedfs/seaweedfs/pull/5275
• @eltociear made their first contribution in https://github.com/seaweedfs/seaweedfs/pull/5282
• @justindhillon made their first contribution in https://github.com/seaweedfs/seaweedfs/pull/5287
• @7y-9 made their first contribution in https://github.com/seaweedfs/seaweedfs/pull/5312

Full Changelog: https://github.com/seaweedfs/seaweedfs/compare/3.62...3.63

What's Changed

• Filer
  • Removed problematic if statement by @jerebear12 in https://github.com/seaweedfs/seaweedfs/pull/5180
  • chore: add status code for request_total metrics by @kmlebedev in https://github.com/seaweedfs/seaweedfs/pull/5188
• Volume Server
  • fix write volume over size MaxPossibleVolumeSize by @kungf in https://github.com/seaweedfs/seaweedfs/pull/5190
  • can vacuum volume when size mismatch by @kungf in https://github.com/seaweedfs/seaweedfs/pull/5200
  • factor in existing ec volume count when estimating max volume count #5191
• Filer.sync
  • Fix filer sync set offset by @kmlebedev in https://github.com/seaweedfs/seaweedfs/pull/5197
  • Fix doDeleteFiles deletes files by @kmlebedev in https://github.com/seaweedfs/seaweedfs/pull/5198

New Contributors

• @kungf made their first contribution in https://github.com/seaweedfs/seaweedfs/pull/5190

Full Changelog: https://github.com/seaweedfs/seaweedfs/compare/3.61...3.62

What's Changed

• Filer

  • Fix v3.60 bug : panic: runtime error: invalid memory address or nil pointer dereference #5153

• WebDAV

  • fix: return etag with md5 in webdav responses by @kmlebedev in https://github.com/seaweedfs/seaweedfs/pull/5158
  • fix: webdav avoid create empty files by @kmlebedev in https://github.com/seaweedfs/seaweedfs/pull/5160
  • chore: add maxMB option for webdav by @kmlebedev in https://github.com/seaweedfs/seaweedfs/pull/5165

• S3 API

  • Fix missing VersionConfiguration node in get-bucket-versioning response by @kmlebedev in https://github.com/seaweedfs/seaweedfs/pull/5162

• Filer Sync

  • chore: filer sync add doDeleteFiles option for create only mode by @kmlebedev in https://github.com/seaweedfs/seaweedfs/pull/5166

Full Changelog: https://github.com/seaweedfs/seaweedfs/compare/3.60...3.61

What's Changed

• FUSE Mount

  • Waiting for writes to complete with acquired lock may lead to deadlock by @kvaster in https://github.com/seaweedfs/seaweedfs/pull/
  • Fix OOM from increasing RSS memory usage on long term https://github.com/seaweedfs/seaweedfs/issues/5082

• Weed Fix

  • Fix weed fix by @SmsS4 in https://github.com/seaweedfs/seaweedfs/pull/5020

• Filer

  • Set allowed origins in config by @jerebear12 in https://github.com/seaweedfs/seaweedfs/pull/5109
  • chore: add dsn for connection to mysql by @kmlebedev in https://github.com/seaweedfs/seaweedfs/pull/5060
  • [filerstore] mysql falls back to update only if error contains msg "duplicate entry" by @kmlebedev in https://github.com/seaweedfs/seaweedfs/pull/5085
  • Add a way to use a JWT sent in an HTTP only cookie by @jerebear12 in https://github.com/seaweedfs/seaweedfs/pull/5077
  • verify content-md5 in header by @julor in https://github.com/seaweedfs/seaweedfs/pull/5016

• S3

  • [s3api] add default response for GetBucketVersioning by @kmlebedev in https://github.com/seaweedfs/seaweedfs/pull/4998

• Helm Charts

  • fix: k8s-chart-helm master metrics scraping by @sberthier in https://github.com/seaweedfs/seaweedfs/pull/5142
  • Fix: helm: remove deprecated values that caused helm template error for post install hook by @jessebot in https://github.com/seaweedfs/seaweedfs/pull/5108
  • Update helm_ci.yml - add ct flag --target-branch ${{ github.event.repository.default_branch }} by @jessebot in https://github.com/seaweedfs/seaweedfs/pull/5106
  • #5122 Add support for sidecar containers by @Davidsod in https://github.com/seaweedfs/seaweedfs/pull/5125
  • Always include volumes in statefulsets by @dzsibi in https://github.com/seaweedfs/seaweedfs/pull/5081
  • Helm: add post install hook to support creating default buckets by @cloudymax in https://github.com/seaweedfs/seaweedfs/pull/5048
  • Use global.serviceAccountName to populate ServiceAccount, ClusterRole, and ClusterRoleBinding by @jessebot in https://github.com/seaweedfs/seaweedfs/pull/5049
  • support tls in master-ingress by @Programmeris in https://github.com/seaweedfs/seaweedfs/pull/4946
  • Helm chart: Allow existing S3 config secret for the filer statefulset and the s3 deployment by @jessebot in https://github.com/seaweedfs/seaweedfs/pull/5039
  • Enable support for Restic-based tools (K8up, Velero) to perform backup and restore operations by @cloudymax in https://github.com/seaweedfs/seaweedfs/pull/5034
  • Update helm_chart_release.yml - run helm chart release on push to master on changes to k8s/chart files by @jessebot in https://github.com/seaweedfs/seaweedfs/pull/5035
  • helm chart: fix annotations templating for s3.ingress.annotations and document it and s3.ingress.tls in values.yaml by @jessebot in https://github.com/seaweedfs/seaweedfs/pull/5023
  • [helm] fix: use metricsPort correctly by @niuqg in https://github.com/seaweedfs/seaweedfs/pull/5010

• Shell

  • shell meta load add concurrency by @kmlebedev in https://github.com/seaweedfs/seaweedfs/pull/4529
  • Add modifyTimeAgo to volume.fsck by @SmsS4 in https://github.com/seaweedfs/seaweedfs/pull/5133
  • Fix cutoffTimeAgo in findMissingChunksInFiler by @SmsS4 in https://github.com/seaweedfs/seaweedfs/pull/5132
  • fs.mergeVolumes: Make a plan based on volumes size by @yeganemehr in https://github.com/seaweedfs/seaweedfs/pull/4999
  • fs.mergeVolumes: change dir to a named parameter by @yeganemehr in https://github.com/seaweedfs/seaweedfs/pull/5003

• Filer Backup

  • filer backup add option for exclude file names that match regexp to sync on filer by @kmlebedev in https://github.com/seaweedfs/seaweedfs/pull/5002
  • fix: add doDeleteFile option for filer backup by @kmlebedev in https://github.com/seaweedfs/seaweedfs/pull/5018

• Filer Remote Sync

  • Using filer.remote.sync concurrency in filer.remote.gateway by @itsfarbod in https://github.com/seaweedfs/seaweedfs/pull/5123
  • Remote gateway Bug fix by @itsfarbod in https://github.com/seaweedfs/seaweedfs/pull/5100
  • Fix wrong option https://github.com/seaweedfs/seaweedfs/pull/5102

• Filer Copy

  • Add option to filer.copy with public volume server url https://github.com/seaweedfs/seaweedfs/pull/5126

• Minor

  • Minor cleanup & gitignore update by @varunu28 in https://github.com/seaweedfs/seaweedfs/pull/5144
  • weed/server: remove unneeded err from streamReadOneVolume() signature by @alrs in https://github.com/seaweedfs/seaweedfs/pull/5143
  • weed/storage: fix dropped test errors by @alrs in https://github.com/seaweedfs/seaweedfs/pull/5083
  • logging PickForWrite error by @kmlebedev in https://github.com/seaweedfs/seaweedfs/pull/4920
  • fix TestMisplacedChecking() and add test-case by @zehweh in https://github.com/seaweedfs/seaweedfs/pull/5040
  • weed/command: fix dropped error by @alrs in https://github.com/seaweedfs/seaweedfs/pull/5027
  • Fix shell 'help' for all commands by @yeganemehr in https://github.com/seaweedfs/seaweedfs/pull/5000

New Contributors

• @niuqg made their first contribution in https://github.com/seaweedfs/seaweedfs/pull/5010
• @jessebot made their first contribution in https://github.com/seaweedfs/seaweedfs/pull/5023
• @julor made their first contribution in https://github.com/seaweedfs/seaweedfs/pull/5016
• @cloudymax made their first contribution in https://github.com/seaweedfs/seaweedfs/pull/5034
• @dzsibi made their first contribution in https://github.com/seaweedfs/seaweedfs/pull/5081
• @itsfarbod made their first contribution in https://github.com/seaweedfs/seaweedfs/pull/5100
• @Davidsod made their first contribution in https://github.com/seaweedfs/seaweedfs/pull/5125
• @vivekkoya made their first contribution in https://github.com/seaweedfs/seaweedfs/pull/5134
• @sberthier made their first contribution in https://github.com/seaweedfs/seaweedfs/pull/5142
• @varunu28 made their first contribution in https://github.com/seaweedfs/seaweedfs/pull/5144

Full Changelog: https://github.com/seaweedfs/seaweedfs/compare/3.59...3.60

What's Changed

• Volume Server

  • Add ErrorGetNotFound and ErrorGetInternal to volume server metrics by @SmsS4 in https://github.com/seaweedfs/seaweedfs/pull/4960
  • Fix twice increase metric counter by @SmsS4 in https://github.com/seaweedfs/seaweedfs/pull/4961
  • Replace an invalid method in a metric with an invalid one by @kmlebedev in https://github.com/seaweedfs/seaweedfs/pull/4987

• Helm Charts

  • Add podLabels & podAnnotations to all pods by @tehasdf in https://github.com/seaweedfs/seaweedfs/pull/4959

• S3 API

  • Pass correct Filer's gRPC port to S3 server. by @tired-engineer in https://github.com/seaweedfs/seaweedfs/pull/4972
  • chore(tests): update S3 compat tests by @t3hmrman in https://github.com/seaweedfs/seaweedfs/pull/4992

• WebDAV

  • refactor webdav subdirectory, fixes #4967 by @Cottand in https://github.com/seaweedfs/seaweedfs/pull/4969
  • weed/server: fix dropped webdav error by @alrs in https://github.com/seaweedfs/seaweedfs/pull/4990

• Shell

  • fix isMisplaced() in command_volume_fix_replication.go by @zehweh in https://github.com/seaweedfs/seaweedfs/pull/4988
  • ec.decode: mount the collected ec shards by @cctags in https://github.com/seaweedfs/seaweedfs/pull/4995

New Contributors

• @tehasdf made their first contribution in https://github.com/seaweedfs/seaweedfs/pull/4959
• @tired-engineer made their first contribution in https://github.com/seaweedfs/seaweedfs/pull/4972
• @cctags made their first contribution in https://github.com/seaweedfs/seaweedfs/pull/4995

Full Changelog: https://github.com/seaweedfs/seaweedfs/compare/3.58...3.59

What's Changed

• Volume

  • fix: make dev_tls with volume https by @kmlebedev in https://github.com/seaweedfs/seaweedfs/pull/4866
  • weed/replication/sub: fix dropped error by @alrs in https://github.com/seaweedfs/seaweedfs/pull/4865
  • fix: avoid error file name too long when writing a file by @kmlebedev in https://github.com/seaweedfs/seaweedfs/pull/4876
  • Erasure Coding: volumes created by foreign collection due to bug in ec balance by @wzrdtales in https://github.com/seaweedfs/seaweedfs/pull/4864

• S3

  • [s3acl] Step1: move s3account.AccountManager into to iam.S3ApiConfiguration by @kmlebedev in https://github.com/seaweedfs/seaweedfs/pull/4859
  • remove compare to fix #4668 issue by @lakeland1990 in https://github.com/seaweedfs/seaweedfs/pull/4924
  • [s3] do reload s3 static config by @kmlebedev in https://github.com/seaweedfs/seaweedfs/pull/4923
  • fix copying .vif file in VolumeCopy by @zehweh in https://github.com/seaweedfs/seaweedfs/pull/4943

• Shell

  • fix: avoid deleting more than one replica by @kmlebedev in https://github.com/seaweedfs/seaweedfs/pull/4873
  • fix: avoid deleting one replica without sync by @kmlebedev in https://github.com/seaweedfs/seaweedfs/pull/4875
  • fix: logger place msg by @kmlebedev in https://github.com/seaweedfs/seaweedfs/pull/4880
  • fix: skipping checking active volumes with the same number of files at the moment by @kmlebedev in https://github.com/seaweedfs/seaweedfs/pull/4893
  • add fs.mergeVolumes command into shell by @yeganemehr in https://github.com/seaweedfs/seaweedfs/pull/4907
  • fix has changes false if deleted result size eq zero by @kmlebedev in https://github.com/seaweedfs/seaweedfs/pull/4909

• Helm Charts

  • Allow override internalTrafficPolicy by @aronneagu in https://github.com/seaweedfs/seaweedfs/pull/4877
  • add ingress for seaweedfs s3 by @Programmeris in https://github.com/seaweedfs/seaweedfs/pull/4887
  • Helm chart jwt signing configuration by @yuvalyacoby in https://github.com/seaweedfs/seaweedfs/pull/4894
  • Helm use external certificates by @yuvalyacoby in https://github.com/seaweedfs/seaweedfs/pull/4913
  • Remove hardcoded podManagmentPolicy value in a helm chart by @Programmeris in https://github.com/seaweedfs/seaweedfs/pull/4941

• Misc

  • weed/operation: fix dropped error by @alrs in https://github.com/seaweedfs/seaweedfs/pull/4888
  • Fix filer.backup local sink to propagate file mode changes by @werdnum in https://github.com/seaweedfs/seaweedfs/pull/4896
  • golang up version to 1.21.3 by @kmlebedev in https://github.com/seaweedfs/seaweedfs/pull/4911
  • Add optional flags to enable mTLS with verification of client certificate by @jameskhedley in https://github.com/seaweedfs/seaweedfs/pull/4910
  • add make benchmark with WARP by @kmlebedev in https://github.com/seaweedfs/seaweedfs/pull/4914
  • see_dat add print name by @binbinshi in https://github.com/seaweedfs/seaweedfs/pull/4930

• Filer

  • added healthz endpoint to filer by @yuvalyacoby in https://github.com/seaweedfs/seaweedfs/pull/4899

• Filer Store

  • Fix: Filer's tikv filestore's prefix query error #4950 by @duanhongyi in https://github.com/seaweedfs/seaweedfs/pull/4952

New Contributors

• @yuvalyacoby made their first contribution in https://github.com/seaweedfs/seaweedfs/pull/4894
• @jameskhedley made their first contribution in https://github.com/seaweedfs/seaweedfs/pull/4910
• @lakeland1990 made their first contribution in https://github.com/seaweedfs/seaweedfs/pull/4924
• @zehweh made their first contribution in https://github.com/seaweedfs/seaweedfs/pull/4943

Full Changelog: https://github.com/seaweedfs/seaweedfs/compare/3.57...3.58

What's Changed

• S3 API
  • Fix s3 api object list with params max-keys and prefix by @annluda in https://github.com/seaweedfs/seaweedfs/pull/4834
  • [s3] optimization iam lookup for reducing algorithm complexity by @kmlebedev in https://github.com/seaweedfs/seaweedfs/pull/4857
  • [s3acl] Step 0: Put bucket ACL only responds success if the ACL is private. by @kmlebedev in https://github.com/seaweedfs/seaweedfs/pull/4856
  • [iam] Replace action read/write to readAcp/writeAcp for handlers with acl by @kmlebedev in https://github.com/seaweedfs/seaweedfs/pull/4858
• FUSE Mount
  • Fix mount write proxy filer by @zemul in https://github.com/seaweedfs/seaweedfs/pull/4840
  • Ordered read write locks for each file handle
• Helm Charts
  • Wrong default value for volume.resource by @armandleopold in https://github.com/seaweedfs/seaweedfs/pull/4855
• Minor
  • avoid pass lock by value by @wusongANKANG in https://github.com/seaweedfs/seaweedfs/pull/4839
  • fix: weed/storage: dropped error by @alrs in https://github.com/seaweedfs/seaweedfs/pull/4841

New Contributors

• @annluda made their first contribution in https://github.com/seaweedfs/seaweedfs/pull/4834

Full Changelog: https://github.com/seaweedfs/seaweedfs/compare/3.56...3.57

What's Changed

• Volume Server

  • Fix resource leaks by @Zamony in https://github.com/seaweedfs/seaweedfs/pull/4737
  • Save disk space metrics immediately by @Zamony in https://github.com/seaweedfs/seaweedfs/pull/4740
  • weed/storage/erasure_coding: Error Handling Fixes by @alrs in https://github.com/seaweedfs/seaweedfs/pull/4819

• Master

  • Implement SRV lookups for filer by @Cottand in https://github.com/seaweedfs/seaweedfs/pull/4767
  • Add stream API to assign file id to reduce connection overhead.

• Helm Chart

  • fix: replace volume.pvc_exists with master.pvc_exists by @togettoyou in https://github.com/seaweedfs/seaweedfs/pull/4762
  • fix bugs: seaweedfs master ingress host configuration do not work by @gfhe in https://github.com/seaweedfs/seaweedfs/pull/4781
  • [helm] add possibility to use array for imagePullSecrets by @tikhon-opsfleet in https://github.com/seaweedfs/seaweedfs/pull/4782
  • [helm] fix log to stderr and default host for ingress by @Dimonyga in https://github.com/seaweedfs/seaweedfs/pull/4787
  • [heml] complete redesign of labels by @Dimonyga in https://github.com/seaweedfs/seaweedfs/pull/4788
  • k8s: allow configuring serviceAccountName by @aviau in https://github.com/seaweedfs/seaweedfs/pull/4790
  • helm: allow setting master.toml config by @aviau in https://github.com/seaweedfs/seaweedfs/pull/4797
  • [heml] fix default affinity and allow owerride ingress annotations by @Dimonyga in https://github.com/seaweedfs/seaweedfs/pull/4799
  • improve k8s probes templating in helm chart by @Programmeris in https://github.com/seaweedfs/seaweedfs/pull/4805

• S3 API

  • Improve S3 request signing performance by @Woellchen in https://github.com/seaweedfs/seaweedfs/pull/4148
  • Fix s3.clean.uploads by @SmsS4 in https://github.com/seaweedfs/seaweedfs/pull/4766
  • Add time to first byte metric for s3 by @SmsS4 in https://github.com/seaweedfs/seaweedfs/pull/4768
  • ErrInvalidPart when completed parts has extra parts. https://github.com/seaweedfs/seaweedfs/discussions/4746

• Metrics

  • Add master servers to grafana dashboard by @ginn13 in https://github.com/seaweedfs/seaweedfs/pull/4801

• Java API

  • SeaweedOutputStream add option to pass in collection.

• Mount

  • add separate cache directory -cacheDirWrite for write buffers.

• Minor

  • minor by @wusongANKANG in https://github.com/seaweedfs/seaweedfs/pull/4723
  • Update weed fix description by @SmsS4 in https://github.com/seaweedfs/seaweedfs/pull/4745
  • weed/util: fix dropped errors by @alrs in https://github.com/seaweedfs/seaweedfs/pull/4803

New Contributors

• @Zamony made their first contribution in https://github.com/seaweedfs/seaweedfs/pull/4737
• @togettoyou made their first contribution in https://github.com/seaweedfs/seaweedfs/pull/4762
• @t3hmrman made their first contribution in https://github.com/seaweedfs/seaweedfs/pull/4769
• @dimm0 made their first contribution in https://github.com/seaweedfs/seaweedfs/pull/4736
• @gfhe made their first contribution in https://github.com/seaweedfs/seaweedfs/pull/4781
• @tikhon-opsfleet made their first contribution in https://github.com/seaweedfs/seaweedfs/pull/4782
• @Cottand made their first contribution in https://github.com/seaweedfs/seaweedfs/pull/4767
• @Dimonyga made their first contribution in https://github.com/seaweedfs/seaweedfs/pull/4787
• @aviau made their first contribution in https://github.com/seaweedfs/seaweedfs/pull/4790
• @alrs made their first contribution in https://github.com/seaweedfs/seaweedfs/pull/4803

Full Changelog: https://github.com/seaweedfs/seaweedfs/compare/3.55...3.56

What's Changed

• Mount
  • Fix large file chunks deleted by mistake by @wusongANKANG in https://github.com/seaweedfs/seaweedfs/pull/4678
• S3 API
  • s3api should return 500 code from filer by @SmoothDenis in https://github.com/seaweedfs/seaweedfs/pull/4699
• Helm Chart
  • Add variabilisation of RBAC by @armandleopold in https://github.com/seaweedfs/seaweedfs/pull/4692
• Go module
  • patch go-m1cpu to build with macOS < 12 by @chenrui333 in https://github.com/seaweedfs/seaweedfs/pull/4679

New Contributors

• @chenrui333 made their first contribution in https://github.com/seaweedfs/seaweedfs/pull/4679
• @armandleopold made their first contribution in https://github.com/seaweedfs/seaweedfs/pull/4692
• @SmoothDenis made their first contribution in https://github.com/seaweedfs/seaweedfs/pull/4699

Full Changelog: https://github.com/seaweedfs/seaweedfs/compare/3.54...3.55

What's Changed

• S3
  • Unix Socket listener for S3 server by @yeganemehr in https://github.com/seaweedfs/seaweedfs/pull/4621
  • Fix the segment fault from not setting s3 https port by @hencoappel in https://github.com/seaweedfs/seaweedfs/pull/4667
  • Fix S3 API multipart upload on Windows by @hencoappel in https://github.com/seaweedfs/seaweedfs/pull/4666
• Filer
  • Second filer bootstrap hanging https://github.com/seaweedfs/seaweedfs/issues/4639
• Volume Server
  • Fix DataBackend nil pointer by @wusongANKANG in https://github.com/seaweedfs/seaweedfs/pull/4641
  • refresh max volume count after adjust by @shichanglin5 in https://github.com/seaweedfs/seaweedfs/pull/4662
  • fix copying level db files during commit #4635
• Mount
  • Fix data racing: add lock for meta cache by @wusongANKANG in https://github.com/seaweedfs/seaweedfs/pull/4664
  • create mount root on filer https://github.com/seaweedfs/seaweedfs-csi-driver/issues/127
• filer.remote.gateway
  • Concurrency works better by @mervynzhang in https://github.com/seaweedfs/seaweedfs/pull/4663
• Shell
  • clone volume locations in case they are changed #4642
  • Custom gRPC ports not honored by master.peers and weed shell env vars https://github.com/seaweedfs/seaweedfs/issues/4607
• Minor
  • Fix buff use by @wusongANKANG in https://github.com/seaweedfs/seaweedfs/pull/4628
  • README.md: minor fixes by @natmaka in https://github.com/seaweedfs/seaweedfs/pull/4652
  • avoid logging nil error by @kmlebedev in https://github.com/seaweedfs/seaweedfs/pull/4659

New Contributors

• @yeganemehr made their first contribution in https://github.com/seaweedfs/seaweedfs/pull/4621
• @hencoappel made their first contribution in https://github.com/seaweedfs/seaweedfs/pull/4667

Full Changelog: https://github.com/seaweedfs/seaweedfs/compare/3.53...3.54

What's Changed

• Master

  • Fix no more writable volumes by delay judgment by @wusongANKANG in https://github.com/seaweedfs/seaweedfs/pull/4548
  • fix: deletes newly created volumes by @kmlebedev in https://github.com/seaweedfs/seaweedfs/pull/4551, https://github.com/seaweedfs/seaweedfs/pull/4561, https://github.com/seaweedfs/seaweedfs/pull/4573
  • Healthz check for deadlocks by @kmlebedev in https://github.com/seaweedfs/seaweedfs/pull/4558

• Volume Server

  • avoid data race read volume.IsEmpty by @bai-jie in https://github.com/seaweedfs/seaweedfs/pull/4574
  • doIsEmpty() return error if v.DataBackend is nil by @bai-jie in https://github.com/seaweedfs/seaweedfs/pull/4587

• Helm Chart

  • Helm chart fixes: by @werdnum in https://github.com/seaweedfs/seaweedfs/pull/4539
  • Fix Helm chart enableSecurity flag by @werdnum in https://github.com/seaweedfs/seaweedfs/pull/4537
  • chart with optional https port for s3 by @kmlebedev in https://github.com/seaweedfs/seaweedfs/pull/4507
  • Add secret support for filer environment variables. by @werdnum in https://github.com/seaweedfs/seaweedfs/pull/4538

• Filer

  • fix 404 not found by @wusongANKANG in https://github.com/seaweedfs/seaweedfs/pull/4536
  • avoid overwriting non-nil uploadReaderToChunks.uploadErr with nil value by @bai-jie in https://github.com/seaweedfs/seaweedfs/pull/4560
  • fix get file stats for IsEmpty by @kmlebedev in https://github.com/seaweedfs/seaweedfs/pull/4576

• S3

  • optional https port for s3 by @kmlebedev in https://github.com/seaweedfs/seaweedfs/pull/4482

• Dashboard

  • feat: Add datasource as variable by @achetronic in https://github.com/seaweedfs/seaweedfs/pull/4584

• Cloud-Tier Storage

  • Support templating name of files stored via Rclone backend by @dalbani in https://github.com/seaweedfs/seaweedfs/pull/4606

New Contributors

• @werdnum made their first contribution in https://github.com/seaweedfs/seaweedfs/pull/4539
• @bai-jie made their first contribution in https://github.com/seaweedfs/seaweedfs/pull/4560
• @agipson33 made their first contribution in https://github.com/seaweedfs/seaweedfs/pull/4572
• @achetronic made their first contribution in https://github.com/seaweedfs/seaweedfs/pull/4584

Full Changelog: https://github.com/seaweedfs/seaweedfs/compare/3.52...3.53

What's Changed

• Master
  • reduce the window size between unregistering a volume server and creating volumes on that server #4467
• Filer
  • add return for error handle by @wusongANKANG in https://github.com/seaweedfs/seaweedfs/pull/4502
  • fix deadlock for filer upload by @wusongANKANG in https://github.com/seaweedfs/seaweedfs/pull/4527
• S3
  • S3 TLS credentials Refreshing by @kmlebedev in https://github.com/seaweedfs/seaweedfs/pull/4506

Full Changelog: https://github.com/seaweedfs/seaweedfs/compare/3.51...3.52

What's Changed

• Filer Store
  • Etcd: support username/password authentication for etcd filer store s… by @mhameed in https://github.com/seaweedfs/seaweedfs/pull/4477
  • Etcd: etcd filer store keys should have customizable prefix by @mhameed in https://github.com/seaweedfs/seaweedfs/pull/4484
• Filer/S3
  • Use filerGroup for s3 buckets collection prefix by @SmsS4 in https://github.com/seaweedfs/seaweedfs/pull/4465
  • support swift by @mervynzhang in https://github.com/seaweedfs/seaweedfs/pull/4480
• Master
  • fix no more writables volumes while disk free space is sufficient by @wusongANKANG in https://github.com/seaweedfs/seaweedfs/pull/4491
• Other
  • Fix build binary for windows.

New Contributors

• @mhameed made their first contribution in https://github.com/seaweedfs/seaweedfs/pull/4477
• @mervynzhang made their first contribution in https://github.com/seaweedfs/seaweedfs/pull/4480

Full Changelog: https://github.com/seaweedfs/seaweedfs/compare/3.50...3.51

What's Changed

• Raft
  • Update to seaweedfs/raft v1.1.3 to fix index out-of-bounds issue https://github.com/seaweedfs/raft/pull/7
• Shell
  • fix shell volume.balance bug by @themarkchen in https://github.com/seaweedfs/seaweedfs/pull/4447

Full Changelog: https://github.com/seaweedfs/seaweedfs/compare/3.48...3.50

New Contributors

• @themarkchen made their first contribution in https://github.com/seaweedfs/seaweedfs/pull/4447

What's Changed

• Volume Server
  • Volume range read use sync.pool by @zemul in https://github.com/seaweedfs/seaweedfs/pull/4422
• Filer
  • allow deleting only older empty dir without recursion by @kmlebedev in https://github.com/seaweedfs/seaweedfs/pull/4430
  • Fix: http rename move dir to subdir by @wusongANKANG in https://github.com/seaweedfs/seaweedfs/pull/4432
  • [Filer] post add param:saveInside by @zemul in https://github.com/seaweedfs/seaweedfs/pull/4434

Full Changelog: https://github.com/seaweedfs/seaweedfs/compare/3.47...3.48

What's Changed

• Remote Volume Storage
  • Rclone storage backend by @dalbani in https://github.com/seaweedfs/seaweedfs/pull/4402
• Misc
  • use env for flags with dot in name by @SmsS4 in https://github.com/seaweedfs/seaweedfs/pull/4415
• FUSE mount
  • mount: add retry for read only case by @wusongANKANG in https://github.com/seaweedfs/seaweedfs/pull/4416
  • Writables inconsistency by @wusongANKANG in https://github.com/seaweedfs/seaweedfs/pull/4417
  • [mount]Fix copy file range by @zemul in https://github.com/seaweedfs/seaweedfs/pull/4407
• weed shell
  • ec.decode` fix decoding error when a volume server has multiple directories #4365
• Remote Object Store Gateway
  • reset local file content if remote file is updated #4289

New Contributors

• @dalbani made their first contribution in https://github.com/seaweedfs/seaweedfs/pull/4402
• @SmsS4 made their first contribution in https://github.com/seaweedfs/seaweedfs/pull/4415

Full Changelog: https://github.com/seaweedfs/seaweedfs/compare/3.46...3.47