minio

What's Changed

• retry and resume decom operation upon retriable failures by @harshavardhana in https://github.com/minio/minio/pull/15244
• remove unnecessary nAgreed value in partial() func by @harshavardhana in https://github.com/minio/minio/pull/15242
• fix: do not pass around sync.Map by @harshavardhana in https://github.com/minio/minio/pull/15250
• fix: rootdisk detection by not using cached value when GetDiskInfo() errors out by @vadmeste in https://github.com/minio/minio/pull/15249

Full Changelog: https://github.com/minio/minio/compare/RELEASE.2022-07-06T20-29-49Z...RELEASE.2022-07-08T00-05-23Z

Highlights

• Major scanner metrics overhaul now you can watch scanner metrics in realtime using mc admin top scanner #15161
• Multiple external IDP management simplification #15152
• Decommission now supports mutations such as delete, update of metadata on objects from an active decom pool.

What's Changed

• fix: decommission delete markers for non-current objects by @harshavardhana in https://github.com/minio/minio/pull/15225
• service port set to minioAPIPort in helm by @dormanze in https://github.com/minio/minio/pull/15223
• Cache disk metrics by @klauspost in https://github.com/minio/minio/pull/15229
• Fix missing whitespace in error message for IncompleteBody by @haslersn in https://github.com/minio/minio/pull/15227
• Add detailed scanner metrics by @klauspost in https://github.com/minio/minio/pull/15161
• Add external IDP management Admin API for OpenID by @donatello in https://github.com/minio/minio/pull/15152
• fix: calculate scanner metric paths for single drive by @harshavardhana in https://github.com/minio/minio/pull/15232
• fix: allow certain mutations on objects during decommissioning by @harshavardhana in https://github.com/minio/minio/pull/15231
• no 'replicate status' without replication config by @harshavardhana in https://github.com/minio/minio/pull/15233
• add NATS JetStream support by @harshavardhana in https://github.com/minio/minio/pull/15201
• Better reporting of total/free usable capacity of the cluster by @vadmeste in https://github.com/minio/minio/pull/15230

New Contributors

• @dormanze made their first contribution in https://github.com/minio/minio/pull/15223
• @haslersn made their first contribution in https://github.com/minio/minio/pull/15227

Full Changelog: https://github.com/minio/minio/compare/RELEASE.2022-07-04T21-02-54Z...RELEASE.2022-07-06T20-29-49Z

What's Changed

• Simplify Prometheus metrics gather by @harshavardhana in https://github.com/minio/minio/pull/15210
• site healing: Skip stale iam asset updates from peer. by @poornas in https://github.com/minio/minio/pull/15203
• return appropriate error under 'decom status' by @harshavardhana in https://github.com/minio/minio/pull/15213
• do not print errFileNotFound in entries.resolve() by @harshavardhana in https://github.com/minio/minio/pull/15216
• decom IAM, Bucket metadata properly by @harshavardhana in https://github.com/minio/minio/pull/15220

Full Changelog: https://github.com/minio/minio/compare/RELEASE.2022-06-30T20-58-09Z...RELEASE.2022-07-04T21-02-54Z

Highlights

• Supports parity configuration of '0', '1' enabling support for 2,3 drive setups for erasure coding.

What's Changed

• add license banner for GNU AGPLv3 by @harshavardhana in https://github.com/minio/minio/pull/15178
• save MinIO version with each version (8-bytes extra) by @harshavardhana in https://github.com/minio/minio/pull/15170
• Remove unnecessary code in WalkDir() by @vadmeste in https://github.com/minio/minio/pull/15168
• perform object sweep after equeue the latest CopyObject() by @harshavardhana in https://github.com/minio/minio/pull/15183
• Upgrade reedsolomon/compression packages by @klauspost in https://github.com/minio/minio/pull/15182
• Revert proxying requests with precondition errors by @vadmeste in https://github.com/minio/minio/pull/15180
• allow support for parity '0', '1' enabling support for 2,3 drive setups by @harshavardhana in https://github.com/minio/minio/pull/15171
• handle missing funcNames for handlers by @harshavardhana in https://github.com/minio/minio/pull/15188
• update banner to reflect the final agreed UI by @harshavardhana in https://github.com/minio/minio/pull/15192
• site healing: Skip stale bucket metadata updates from peer by @poornas in https://github.com/minio/minio/pull/15186
• de-couple caller context to avoid internal races by @harshavardhana in https://github.com/minio/minio/pull/15195
• Save minio version in xl.meta while healing in outdated disks by @vadmeste in https://github.com/minio/minio/pull/15181
• finalize startup-banner and remove unnecessary logs by @harshavardhana in https://github.com/minio/minio/pull/15202
• Make ReqInfo concurrency safe by @klauspost in https://github.com/minio/minio/pull/15204
• update banner with version+runtime by @harshavardhana in https://github.com/minio/minio/pull/15206

Full Changelog: https://github.com/minio/minio/compare/RELEASE.2022-06-25T15-50-16Z...RELEASE.2022-06-30T20-58-09Z

What's Changed

• remove gateway banner and some other TODO loggers by @harshavardhana in https://github.com/minio/minio/pull/15125
• s3-verify: Fix endpoint and missing comparison by @vadmeste in https://github.com/minio/minio/pull/15129
• Parallelize new disks healing of different erasure sets by @vadmeste in https://github.com/minio/minio/pull/15112
• fips: simplify TLS configuration by @aead in https://github.com/minio/minio/pull/15127
• fix: cant parse comment without '=' in environment file by @anoworl in https://github.com/minio/minio/pull/15130
• add go1.18 specific curve preferences by @harshavardhana in https://github.com/minio/minio/pull/15132
• s3/zip: extract metadata properly for Zipped objects by @harshavardhana in https://github.com/minio/minio/pull/15123
• replication: Avoid proxying when precondition failed by @poornas in https://github.com/minio/minio/pull/15134
• CopyObject: fix read/write err on closed pipe by @poornas in https://github.com/minio/minio/pull/15135
• fips: fix order of elliptic curves by @aead in https://github.com/minio/minio/pull/15141
• s3-verify: Add a flag to exclude younger than a certain age by @vadmeste in https://github.com/minio/minio/pull/15142
• use signature-v2 for 'object perf' tests to avoid CPU using sha256 by @harshavardhana in https://github.com/minio/minio/pull/15151
• heal: Include dir markers when healing a fresh disk by @vadmeste in https://github.com/minio/minio/pull/15158
• Add API's to import/export IAM data by @poornas in https://github.com/minio/minio/pull/15014
• reduce sha256 CPU usage by turning it off for speedtests by @harshavardhana in https://github.com/minio/minio/pull/15154
• Trace all http requests by @vadmeste in https://github.com/minio/minio/pull/15064
• Fix health client leak when calling UpdateAllTargets by @klauspost in https://github.com/minio/minio/pull/15167
• fix: change timedValue to return the previously cached value by @harshavardhana in https://github.com/minio/minio/pull/15169

New Contributors

• @anoworl made their first contribution in https://github.com/minio/minio/pull/15130

Full Changelog: https://github.com/minio/minio/compare/RELEASE.2022-06-20T23-13-45Z...RELEASE.2022-06-25T15-50-16Z

What's Changed

• Update gopsutil to v3.22.5 by @danieljakots in https://github.com/minio/minio/pull/15098
• fix: ignore printing io.EOF during WalkDir() on concurrently modified objects by @harshavardhana in https://github.com/minio/minio/pull/15100
• Avoid CompleteMultipart freeze with unexpected network issue by @vadmeste in https://github.com/minio/minio/pull/15102
• Add generic function to retrieve config value with metadata by @donatello in https://github.com/minio/minio/pull/15083
• fix typo in site replication version healing by @poornas in https://github.com/minio/minio/pull/15103
• Add import/export APIs to migrate bucket metadata by @poornas in https://github.com/minio/minio/pull/14929
• Update Console to v0.19.0 by @dvaldivia in https://github.com/minio/minio/pull/15109
• heal: Report correctly in multip-pools setup by @vadmeste in https://github.com/minio/minio/pull/15117
• debug/s3-verify: simplify the tool to use lower memory footprint by @harshavardhana in https://github.com/minio/minio/pull/15110
• cleanup site replication error handling by @harshavardhana in https://github.com/minio/minio/pull/15113
• fix: add 'mc support inspect' support for single drive deployment by @harshavardhana in https://github.com/minio/minio/pull/15122
• improve error message for bucket metadata export/import API by @poornas in https://github.com/minio/minio/pull/15120

Full Changelog: https://github.com/minio/minio/compare/RELEASE.2022-06-17T02-00-35Z...RELEASE.2022-06-20T23-13-45Z

What's Changed

• debug: Close object after check by @vadmeste in https://github.com/minio/minio/pull/15077
• kms: initialize after cli parsing by @vadmeste in https://github.com/minio/minio/pull/15076
• Support configuration of a session policy file by @rgcostea in https://github.com/minio/minio/pull/15078
• erasure-sd: Evaluate versioning Prefix in multi-delete objects by @vadmeste in https://github.com/minio/minio/pull/15081
• fix: simplify healthcheck code to freeze calls only once by @harshavardhana in https://github.com/minio/minio/pull/15082
• add bucket level S3 received/sent bytes by @harshavardhana in https://github.com/minio/minio/pull/15084
• fix: background local test also via channel by @harshavardhana in https://github.com/minio/minio/pull/15086
• add dataErrs for healing debug log by @harshavardhana in https://github.com/minio/minio/pull/15092
• update '-v' flag behavior to include copyRight and license by @harshavardhana in https://github.com/minio/minio/pull/15097
• Init site replication subsys after loading metadata by @poornas in https://github.com/minio/minio/pull/15099

New Contributors

• @rgcostea made their first contribution in https://github.com/minio/minio/pull/15078

Full Changelog: https://github.com/minio/minio/compare/RELEASE.2022-06-11T19-55-32Z...RELEASE.2022-06-17T02-00-35Z

What's Changed

• debug: verify diff on latest objects on source and target buckets by @harshavardhana in https://github.com/minio/minio/pull/15069
• fix: add missing minio_s3_requests_total by @harshavardhana in https://github.com/minio/minio/pull/15070
• Update dperf to 0.4.1 by @vadmeste in https://github.com/minio/minio/pull/15071
• sts: Avoid printing all STS errors by @vadmeste in https://github.com/minio/minio/pull/15065

Full Changelog: https://github.com/minio/minio/compare/RELEASE.2022-06-10T16-59-15Z...RELEASE.2022-06-11T19-55-32Z

What's Changed

• Include the entirety of vendor folder in .gitignore by @kaankabalak in https://github.com/minio/minio/pull/15046
• relax O_DIRECT in single drive mode if unsupported by @harshavardhana in https://github.com/minio/minio/pull/15045
• Bump Console v0.18.1 by @dvaldivia in https://github.com/minio/minio/pull/15051
• healthcheck cluster endpoint should honor write/readQuorum per pool by @harshavardhana in https://github.com/minio/minio/pull/15053
• fix: make metrics endpoint responsive by reducing the chatter by @harshavardhana in https://github.com/minio/minio/pull/15055
• prometheus: Add S3 4xx and 5xx S3 monitoring by @vadmeste in https://github.com/minio/minio/pull/15052
• fix: for frozen calls return if client disconnects by @harshavardhana in https://github.com/minio/minio/pull/15062
• support reading systemctl config automatically on baremetal setups by @harshavardhana in https://github.com/minio/minio/pull/15066

Full Changelog: https://github.com/minio/minio/compare/RELEASE.2022-06-07T00-33-41Z...RELEASE.2022-06-10T16-59-15Z

What's Changed

• do not print errors upon 'nil' err (06/06/22) (Minio Trusted)

Full Changelog: https://github.com/minio/minio/compare/RELEASE.2022-06-06T23-14-52Z...RELEASE.2022-06-07T00-33-41Z

What's Changed

• Fix a possible service freeze after perf object by @vadmeste in https://github.com/minio/minio/pull/15036
• honor canceled context and do not leak on mergeChannels by @harshavardhana in https://github.com/minio/minio/pull/15034
• allow single drive mode to run on root disk by @harshavardhana in https://github.com/minio/minio/pull/15037
• Add FIPS build to CI and add README.fips.md by @donatello in https://github.com/minio/minio/pull/15038
• Limit the number of parallel trace/bucket notifications listeners by @vadmeste in https://github.com/minio/minio/pull/14799
• reject resync start on misconfigured replication rules by @harshavardhana in https://github.com/minio/minio/pull/15041
• fix: resyncing 'null' version on pre-existing content by @harshavardhana in https://github.com/minio/minio/pull/15043
• fix: do not log concurrently when multiple disks return errors by @harshavardhana in https://github.com/minio/minio/pull/15044
• Add periodic callhome functionality by @anjalshireesh in https://github.com/minio/minio/pull/14918

Full Changelog: https://github.com/minio/minio/compare/RELEASE.2022-06-03T01-40-53Z...RELEASE.2022-06-06T23-14-52Z

Highlights

• Built with Go 1.18.3
• fix: site replication bucket heal to not panic if replication config by @poornas in https://github.com/minio/minio/pull/15025

What's Changed

• fix: site replication bucket heal to not panic if replication config by @poornas in https://github.com/minio/minio/pull/15025
• Bump up console to v0.18.0 by @donatello in https://github.com/minio/minio/pull/15031
• Update --version option behavior by @donatello in https://github.com/minio/minio/pull/15032

Full Changelog: https://github.com/minio/minio/compare/RELEASE.2022-06-02T16-16-26Z...RELEASE.2022-06-03T01-40-53Z

Highlights

• Updated Golang build version to 1.17.11 to include multiple security related bug fixes. Details here.

What's Changed

• Add defensive check for one stream message size by @vadmeste in https://github.com/minio/minio/pull/15029

Full Changelog: https://github.com/minio/minio/compare/RELEASE.2022-06-02T02-11-04Z...RELEASE.2022-06-02T16-16-26Z

Highlights

• feat: Single drive XL implementation by @harshavardhana in https://github.com/minio/minio/pull/14970

What's Changed

• Ignore disks with 0 total space by @klauspost in https://github.com/minio/minio/pull/14981
• Add --insecure flag to skip TLS verification in s3-md5-check tool by @Praveenrajmani in https://github.com/minio/minio/pull/14980
• site replication: heal missing/invalid replication config by @poornas in https://github.com/minio/minio/pull/14979
• Add support for Identity Management Plugin by @donatello in https://github.com/minio/minio/pull/14913
• use crypto/sha256 only for FIPS 140-2 compliance by @harshavardhana in https://github.com/minio/minio/pull/14983
• site-repl: Fix deadlock after an IAM loading error by @vadmeste in https://github.com/minio/minio/pull/14990
• Tighten enforcement of object retention by @poornas in https://github.com/minio/minio/pull/14993
• fix: add timeouts to avoid goroutine leaks in net/http by @harshavardhana in https://github.com/minio/minio/pull/14995
• feat: Single drive XL implementation by @harshavardhana in https://github.com/minio/minio/pull/14970
• fix: invalidate outdated disks appropriately during readAllXL by @harshavardhana in https://github.com/minio/minio/pull/15002
• test: Add GetObjectNInfo test with some outdated disks by @vadmeste in https://github.com/minio/minio/pull/15004
• fix: for unexpected errors in reading versioning config panic by @harshavardhana in https://github.com/minio/minio/pull/14994
• handle IPv6 sourceIPs properly by @harshavardhana in https://github.com/minio/minio/pull/15005
• Make isIndexedMetaV2 return errors by @klauspost in https://github.com/minio/minio/pull/15012
• Fix typo in fips sha256 by @donatello in https://github.com/minio/minio/pull/15024

Full Changelog: https://github.com/minio/minio/compare/RELEASE.2022-05-26T05-48-41Z...RELEASE.2022-06-02T02-11-04Z

What's Changed

• replication healing: Fix typo when healing bucket quota info by @vadmeste in https://github.com/minio/minio/pull/14966
• Do not use inline data size in xl.meta quorum calculation by @vadmeste in https://github.com/minio/minio/pull/14831
• hash-set: Add file input for debug tool by @klauspost in https://github.com/minio/minio/pull/14965
• site replication: Allow replication rule edit by @poornas in https://github.com/minio/minio/pull/14969
• fix: copyObject on versioned bucket when updating metadata by @harshavardhana in https://github.com/minio/minio/pull/14971
• Compensate for different server pool sizes by @klauspost in https://github.com/minio/minio/pull/14968
• Disallow deletion of arn when active replication config by @poornas in https://github.com/minio/minio/pull/14972
• Add server pool reserved space by @klauspost in https://github.com/minio/minio/pull/14974
• do not heal outdated disks > parityBlocks by @harshavardhana in https://github.com/minio/minio/pull/14976
• Fix listing of service and sts accounts by @donatello in https://github.com/minio/minio/pull/14977
• fix: some races when accessing ldap/openid config globally by @harshavardhana in https://github.com/minio/minio/pull/14978

Full Changelog: https://github.com/minio/minio/compare/RELEASE.2022-05-23T18-45-11Z...RELEASE.2022-05-26T05-48-41Z

What's Changed

• mrf: Fix stale MRF data showed in heal info by @vadmeste in https://github.com/minio/minio/pull/14953
• Relax site replication syncing of service accounts by @poornas in https://github.com/minio/minio/pull/14955
• Fix WalkDir fallback hot loop by @klauspost in https://github.com/minio/minio/pull/14961
• fetch bucket replication stats across peers in single call by @harshavardhana in https://github.com/minio/minio/pull/14956

Full Changelog: https://github.com/minio/minio/compare/RELEASE.2022-05-19T18-20-59Z...RELEASE.2022-05-23T18-45-11Z

What's Changed

• tests: Add localLocker RUnlock test by @klauspost in https://github.com/minio/minio/pull/14882
• pools: GetObjectNInfo should cover locking during object read by @vadmeste in https://github.com/minio/minio/pull/14887
• tracing: Add disk path to storage tracing by @vadmeste in https://github.com/minio/minio/pull/14883
• Add support for Access Management Plugin by @donatello in https://github.com/minio/minio/pull/14875
• If decom of an object fails, retry for 3 times by @krishnasrinivas in https://github.com/minio/minio/pull/14861
• update new name for MINIO_POLICY_OPA_URL by @itsericqiu in https://github.com/minio/minio/pull/14898
• add support for extra Prometheus labels by @harshavardhana in https://github.com/minio/minio/pull/14899
• use BadRequest HTTP status instead of Conflict for certain errors by @harshavardhana in https://github.com/minio/minio/pull/14900
• lifecycle: Set opts.VersionSuspended when expiring objects by @krisis in https://github.com/minio/minio/pull/14902
• logger lock should be more granular by @harshavardhana in https://github.com/minio/minio/pull/14901
• Update documentation for /minio/health/cluster by @krishnasrinivas in https://github.com/minio/minio/pull/14889
• allow bucket to be listed when GetBucketLocation is enabled by @harshavardhana in https://github.com/minio/minio/pull/14903
• Add tests for Access Management Plugin by @donatello in https://github.com/minio/minio/pull/14909
• tests: Fix sporadic failure of TestXLStorageDeleteFile by @vadmeste in https://github.com/minio/minio/pull/14911
• Add Access Management Plugin tests with OpenID by @donatello in https://github.com/minio/minio/pull/14919
• lifecycle: Support tags with special characters by @vadmeste in https://github.com/minio/minio/pull/14906
• disable connectDisks loop under testing by @harshavardhana in https://github.com/minio/minio/pull/14920
• Add PVC annotations to StatefulSet PVC templates by @Sea-you in https://github.com/minio/minio/pull/14915
• Cancel old logger/audit targets outside lock by @vadmeste in https://github.com/minio/minio/pull/14927
• fix: when logger queue is full exit quickly upon doneCh by @harshavardhana in https://github.com/minio/minio/pull/14928
• audit/kafka: Fix quitting early after first logging by @vadmeste in https://github.com/minio/minio/pull/14932
• allow IAM cache load to be granular and capture missed state by @harshavardhana in https://github.com/minio/minio/pull/14930
• fix: timer usage across codebase by @harshavardhana in https://github.com/minio/minio/pull/14935
• Avoid calling .Reset() on active timer by @donatello in https://github.com/minio/minio/pull/14941
• make sure to ignore expected errors and dirname deletes by @harshavardhana in https://github.com/minio/minio/pull/14945
• Merge LDAP STS policy evaluation with the generic STS code by @vadmeste in https://github.com/minio/minio/pull/14944

New Contributors

• @itsericqiu made their first contribution in https://github.com/minio/minio/pull/14898

Full Changelog: https://github.com/minio/minio/compare/RELEASE.2022-05-08T23-50-31Z...RELEASE.2022-05-19T18-20-59Z

What's New

• MinIO extension on versioned buckets to avoid certain prefixes and folders from versioning, meant to
  improve performance for applications such as Spark S3A connector - refer #14828
• OPA is not deprecated anymore will be officially supported by MinIO - refer #14863

What's Changed

• Fix missing annotations for PVCs by @Sea-you in https://github.com/minio/minio/pull/14793
• Add OPA doc and remove deprecation marking by @donatello in https://github.com/minio/minio/pull/14863
• avoid concurrent reads and writes to opts.UserDefined by @harshavardhana in https://github.com/minio/minio/pull/14862
• Add "enable" to config help by @klauspost in https://github.com/minio/minio/pull/14866
• Reorganize OpenID config by @donatello in https://github.com/minio/minio/pull/14871
• fix: console log peer API from its broken implementation by @harshavardhana in https://github.com/minio/minio/pull/14873
• Fix site removal API error handling by @poornas in https://github.com/minio/minio/pull/14870
• return kubernetes info in health report by @anjalshireesh in https://github.com/minio/minio/pull/14865
• Prefix-level versioning exclusion by @krisis in https://github.com/minio/minio/pull/14828
• allow versioning config changes under site replication by @harshavardhana in https://github.com/minio/minio/pull/14876
• fix: multiple fixes in prefix exclude the implementation by @harshavardhana in https://github.com/minio/minio/pull/14877
• avoid replication proxy on version excluded paths by @harshavardhana in https://github.com/minio/minio/pull/14878

Full Changelog: https://github.com/minio/minio/compare/RELEASE.2022-05-04T07-45-27Z...RELEASE.2022-05-08T23-50-31Z

What's Changed

• Add audit log for decommissioning by @vadmeste in https://github.com/minio/minio/pull/14858

Full Changelog: https://github.com/minio/minio/compare/RELEASE.2022-05-03T20-36-08Z...RELEASE.2022-05-04T07-45-27Z

What's Changed

• fix: panic in browser redirect handler for unexpected r.Host by @harshavardhana in https://github.com/minio/minio/pull/14844
• fix: reject invalid r.Host headers by @harshavardhana in https://github.com/minio/minio/pull/14846
• fix: disallow newer policies, users & groups with space characters by @harshavardhana in https://github.com/minio/minio/pull/14845
• Check error status codes by @klauspost in https://github.com/minio/minio/pull/14850
• Log Range Header by @klauspost in https://github.com/minio/minio/pull/14851
• fix: remove embedded-policy as requested by the user by @harshavardhana in https://github.com/minio/minio/pull/14847
• Update console to v0.16.2 by @donatello in https://github.com/minio/minio/pull/14857
• Decom: Easily restart decommissioning after it is done by @vadmeste in https://github.com/minio/minio/pull/14855

Full Changelog: https://github.com/minio/minio/compare/RELEASE.2022-04-30T22-23-53Z...RELEASE.2022-05-03T20-36-08Z