Improvements

Rook v1.10.12 is a patch release limited in scope and focusing on feature additions and bug fixes to the Ceph operator.

• osd: Handle device name change and device removal correctly (#11567, @satoru-takeuchi)
• object: Update object store user caps (#11716, @microyahoo)
• csi: Add missing node access to CephFS driver (#11697, @Madhu-1)
• object: Handle RGW metadata PG count reduction on 16.2.11 (#11673, @travisn)
• osd: Ensure rook version label is not set on OSD pod (#11674, @travisn)
• rbdmirror: set log rotation for rbd mirroring daemon to 28 rotations (#11594, @subhamkrai)

Improvements

Rook v1.10.11 is a patch release limited in scope and focusing on feature additions and bug fixes to the Ceph operator.

• rgw: Handle insecure flag skip for object bucket notification in the tls config (#11630, @microyahoo)
• operator: Fix webhook logging during deletion (#11593, @subhamkrai)
• helm: Add labels and annotations to config overrides configmap (#11616, @travisn)
• ci: Change ceph version of osd on pvc canary test to avoid failures (#11646, @satoru-takeuchi)
• mds: Support the Shared filesystem with multus (#11611, @subhamkrai)
• docs: Add glossary page (#11525, @gauravsitlani)
• docs: Add export path example for NFS CSI (#11601, @BlaineEXE)
• file: Retry CephFS Status updates (#11453, @aruniiird)
• csi: add default version to images if it is missing (#11577, @Rakshith-R)
• external: Skip RGW validation for python version 2 (#11579, @parth-gr)
• mgr: Add patch verb to RBAC for completing ceph requests in orch module (#11538, @gaord)

Improvements

Rook v1.10.10 is a patch release limited in scope and focusing on feature additions and bug fixes to the Ceph operator.

• core: Fix regression in v1.10.9 causing PVC mounts to fail in clusters with older kernels where encryption is not enabled (#11554, @Madhu-1)
• csi: Enable custom ceph.conf overrides for csi pods that was being ignored (#11556, @Madhu-1)
• docs: Correctly indent ceph cluster crd list items (#11546, @galexrt)
• docs: Remove obsolete health checker related option in object-external.yaml (#11543, @thotz)

Improvements

Rook v1.10.9 is a patch release limited in scope and focusing on feature additions and bug fixes to the Ceph operator.

This release is not recommended due to #11541, which is fixed in v1.10.10.

• webhook: Disable the admission controller by default and move its setting to the operator configmap (#11532, @subhamkrai)
• ceph: Set rbd_default_map_options for encryption (#11523, @Madhu-1)
• helm: Process the namespace in the storage classes to be the same as the release namespace (#11517, @jouve)
• csi: Update sidecar images to the latest release versions (#11510, @Madhu-1)
• helm: Use the Ceph image instead of the Rook image for the toolbox spec (#11127, @LoicGombeaud)
• external: Skip reporting telemetry if the cluster is external (#11493, @parth-gr)
• osd: Enable device expansion for OSDs in a host-based cluster (#11483, @cupnes)
• docs: Recommended memory limits for the osd prepare job when limits are required (#11512, @anthonyeleven)
• docs: Fix grafana dashboard links (#11506, @TimJones)

Improvements

Rook v1.10.8 is a patch release limited in scope and focusing on feature additions and bug fixes to the Ceph operator.

• helm: Allow to specify allowed topologies for storage class (#11377, @steache)
• docs: Auto generate helm docs (#11346, @zalsader)
• ci: Build with Go 1.19 in the CI (#11427, @Rajpratik71)
• operator: Debug logging admission controller deletion (#11448, @subhamkrai)
• core: Allow ceph.conf to be updated if it already exists (#11399, @travisn)
• osd: Create OSDs without overriding with the /dev/mapper alias (#11301, @ausias-armesto)
• osd: Replace dot with dash in device set names since used as volume names (#11414, @travisn)
• core: Read mon secret from file instead of an env var in the mgr, osd prepare, and toolbox (#11434, @travisn)
• core: Remove unnecessary env vars from pod specs (#11331, @travisn)
• operator: Clean up webhook when disabled (#11432, @subhamkrai)
• docs: Import external K8s cluster on existing cluster (#11405, @parth-gr)
• csi: Add missing update RBAC for CephFS and NFS (#11468, @Madhu-1)
• ci: upgrade minikube action to latest version (#11439, @subhamkrai)
• osd: Allow mpath_member FSType for mpath disks (#11413, @travisn)
• osd: Remove stale dm device during osd-prepare-job (#11387, @Rakshith-R)

Improvements

Rook v1.10.7 is a patch release limited in scope and focusing on feature additions and bug fixes to the Ceph operator.

• rgw: Set the number of RGW metadata pool PGs to 8 even for Ceph v17.2.2 or newer (#11024, @thotz)
• core: Set env var for ceph msgr to always use random nonce for OSD reliability after restart (#11373, @travisn)
• osd: Re-open encrypted disk during osd-prepare-job if closed (#11338, @Rakshith-R)
• osd: Improve log on specifying lv and loop device as osd (#11361, @satoru-takeuchi)
• core: Parse peer pool output with --out-file flag in case debug logging is enabled (#11337, @sp98)
• csi: Add a parameter maxUnavailable to the RBD daemonset. (#11334, @peng225)
• object: Update to latest OBC controller to fix the OB status (#11342, @BlaineEXE)

Improvements

Rook v1.10.6 is a patch release limited in scope and focusing on feature additions and bug fixes to the Ceph operator.

• crash: Crash collectors in wrong namespaces were deleted (#11322, @haslersn)
• helm: Allow setting DISCOVER_DAEMON_UDEV_BLACKLIST (#11303, @JensErat)
• docs: Add additional RBD image features to docs and YAML files (#10652, @anthonyeleven)
• core: Include userID/userKey to secret generated from CephClient (#11280, @avanthakkar)
• mon: Remove out of quorum mons from ceph.conf for improved connectivity during failover or partial quorum (#10887, @travisn)
• object: Mark endpoint as a optional field (#11300, @iamniting)
• osd: Support loop devices for test clusters (#11268, @peng225)
• core: Allow setting resources on the discovery daemon (#11278, @parth-gr)
• object: Do not create service for external object stores (#11202, @BlaineEXE)
• mon: Apply mon store settings more efficiently with the assimilate conf (#11241, @travisn)
• docs: Clarify in docs and readme that Rook focuses on Ceph (#11290, @travisn)
• docs: Set CRD page titles to the CRD name (#11289, @travisn)
• docs: Clarification for NixOS deployment properties (#11269, @yajo)

Improvements

Rook v1.10.5 is a patch release limited in scope and focusing on feature additions and bug fixes to the Ceph operator.

• security: Run the crash collector as ceph user (#11219, @travisn)
• security: Update s5cmd to v2.0.0 (#11223, @Rajpratik71)
• core: Validate object store CR name length in admission controller (#11233, @parth-gr)
• osd: Add deviceClass label to an OSD (#11159, @parth-gr)
• docs: Update disaster recovery guide to disable the webhook (#11256, @subhamkrai)
• docs: Added steps to collect coredump and perf troubleshooting info (#11213, @gauravsitlani)
• pool: Add timeout to rbd init cmd (#10721, @zhucan)
• mon: The mon daemons maintain host network settings to allow change in config (#11211, @travisn)
• core: Retry when removing finalizers from cluster resources during cluster deletion (#11179, @travisn)
• core: Upgrade ceph to latest release v17.2.5 (#11198, @subhamkrai)
• docs: Improve troubleshooting docs on restoring CRDs after deletion (#11154, @alexander-bauer)

Improvements

Rook v1.9.13 is a patch release limited in scope and focusing on feature additions and bug fixes to the Ceph operator.

• security: Run the crash collector as ceph user (#11219, @travisn)
• security: Update s5cmd to v2.0.0 (#11223, @Rajpratik71)
• ci: Update mon_data_avail_warn to a valid percentage for test clusters (#11131, @parth-gr)

Improvements

Rook v1.10.4 is a patch release limited in scope and focusing on feature additions and bug fixes to the Ceph operator.

• build: Update the go modules to the latest versions (#11170, @travisn)
• core: Enabling logCollector by default for coredump collection (#11163, @gauravsitlani)
• docs: Use Krew restore-quorum command for mon quorum disaster scenario (#11184, @travisn)
• csi: Update Ceph-CSI to v3.7.2 (#11178, @Madhu-1)
• operator: Remove obsolete flex driver properties (#11182, @travisn)
• csi: Add setmetadata and clustername flag to omap (#11165, @Madhu-1)
• external: Fix endpoint_dial check for rgw endpoint (#11090, @parth-gr)
• osd: During OSD purge mark the osd out before other checks (#11138, @subhamkrai)
• core: Increase liveness probe timeout to 5s (#10986, @randymtz)
• operator: Don't remove existing pools for mgr/prometheus/rbd_stats_pools (#11099, @avanthakkar)
• docs: Add point about physical disks visualization in dashboard (#11122, @jmolmo)
• docs: Document expectations for releases (#11136, @travisn)
• ci: Set mon_data_avail_warn percentage in test cluster to 10% (#11131, @parth-gr)
• object: Fix logic for rgw period commit detection (#11183, @BlaineEXE)
• ci: Enable more NFS tests in the CI (#10510, @Rakshith-R)

Improvements

Rook v1.10.3 is a patch release limited in scope and focusing on feature additions and bug fixes to the Ceph operator.

• helm: Remove memory limits from osd prepare job to prevent provisioning failure of large disks (#11109 #11103, @travisn)
• nfs: Fix nfs grace period when multus is enabled (#11110, @BlaineEXE)
• mgr: Set the public dashboard port differently from the target port (#11104, @travisn)
• csi: Default to ceph-csi v3.7.1 for csi driver deployment (#11083, @humblec)
• docs: Update troubleshoot docs and add krew uses (#11017, @subhamkrai)
• docs: Explain specific nixos configurations (#11029, @yajo)
• rgw: Handle insecure flag skip for obc in the tls config (#11018, @thotz)
• osd: Use 256 as cryptographicLength for keys using kmip kms (#11079, @Rakshith-R)
• csi: Update sidecars to latest in CSI deployment (#11085, @humblec)
• operator: Customizable imagePullPolicy for csi driver and ceph pods (#10966, @avanthakkar)
• examples: CephBlockPool should not have spec.annotations (#11071, @nixpanic)
• osd: Clarify lv is not picked by filters (#11069, @satoru-takeuchi)

Improvements

Rook v1.9.12 is a patch release limited in scope and focusing on feature additions and bug fixes to the Ceph operator.

• helm: Remove memory limits from osd prepare job to prevent provisioning failure of large disks (#11109 #11103, @travisn)
• mgr: Set the public dashboard port differently from the target port (#11104, @travisn)

Improvements

Rook v1.10.2 is a patch release limited in scope and focusing on feature additions and bug fixes to the Ceph operator.

• nfs: Allow users to include additional files in the SSSD sidecar (#11042, @BlaineEXE)
• osd: Allow raw partitions to be picked up by discover daemon (#11048, @dkeven)
• nfs: Fix nfs if multus is enabled (#10898, @parth-gr)
• csi: Ensure CSI settings are applied with each update to configmap (#11030, @pkalever)
• operator: Silence verbose watcher debug messages (#11012, @jhoblitt)
• csi: Customize plugin volumes and volumemounts (#10942, @Madhu-1)
• core: Use assimilate-conf command to run commands (#10934, @subhamkrai)
• external: Fix import errors for python2 (#10909, @subhamkrai)
• osd: Disallow to create encrypted osd on partition (#10968, @satoru-takeuchi)
• build: Stop printing verbose rbac generation details (#10975, @travisn)
• monitoring: Fix pool growth warning grouping (#10700, @jdloft)
• build: Update goceph module to v0.17 (#10965, @thotz)
• nfs: Add kerberos client security support (#10950, @BlaineEXE)
• ci: Disallow to create encrypted osd on lv and osd on lv with metadata device (#10969, @satoru-takeuchi)
• pool: Initialize only rbd application pools (#10963, @Rakshith-R)
• csi: Add topology provisioning support (#10943, @Rakshith-R)
• external: Do not add info=read cap if ceph version doesn't support it (#10931, @parth-gr)
• rgw: Delete zone/pools for multisite configuration (#10728, @thotz)
• osd: Add kmip encryption support (#10889, @Rakshith-R)
• ci: Move to ubuntu 20.04 runner completely (#11004, @satoru-takeuchi)
• ci: Fix intermittent gen-rbac failure (#10991, @travisn)

Improvements

Rook v1.9.11 is a patch release limited in scope and focusing on feature additions and bug fixes to the Ceph operator.

• osd: Allow raw partitions to be picked up by discover daemon (#11048, @dkeven)
• operator: Silence verbose watcher debug messages (#11012, @jhoblitt)
• docs: Add logical volume to storage options (#10992, @satoru-takeuchi)
• docs: Clarify storage prereqs in quickstart guide (#10951, @travisn)
• osd: Disallow to create encrypted osd on partitions (#10968, @satoru-takeuchi)
• osd: Disallow to create osd on lv with metadata device (#10855, @satoru-takeuchi)
• ci: Disallow to create encrypted osd on lv and osd on lv with metadata device (#10969, @satoru-takeuchi)
• monitoring: Fix pool growth warning grouping (#10700, @jdloft)
• external: Do not add info=read cap if ceph version doesn't support it (#10931, @parth-gr)
• ci: ubuntu 18.04 is deprecated upgrade to ubuntu 20.04 (#10876, @subhamkrai)
• operator: Improve ProbeHandler error message (#10776, @motorailgun)
• helm: Set OBC storageclass name to correct namespace (#10904, @BlaineEXE)
• csi: Trigger CSI driver reconcile every time configmap settings are updated (#10906, @Madhu-1)
• osd: Simple code refactor (#10858, @satoru-takeuchi)
• csi: Fix holder pod creation in openshift multus cluster (#10875, @Madhu-1)
• object: gateway.port partially ignored when hostNetwork disabled (#10804, @zhucan)
• osd: Fix osd detection logic for old lsblk (#10779, @taki-d)
• rbdmirror: Rotate all rbd mirroring logs (#10821, @travisn)

Improvements

Rook v1.10.1 is a patch release limited in scope and focusing on feature additions and bug fixes to the Ceph operator.

• nfs: Add support for NFS snapshots, restore clone & resize (#10892, @Rakshith-R)
• docs: Warn to upgrade Helm chart to 1.9.10 before upgrading to K8s 1.25 (#10937, @travisn)
• operator: Improve ProbeHandler error message (#10776, @motorailgun)
• helm: Set OBC storageclass name to correct namespace. If the operator is in a different namespace from the cluster, will require deleting the OBC storage class before upgrade. (#10904, @BlaineEXE)
• manifest: Fix unexpected end of stream (#10899, @khrisrichardson)
• rbd-mirror: Move volume replication sidecar to CSI-Addons (#10777, @yati1998)
• csi: Trigger CSI driver reconcile for every update to the configmap rook-ceph-operator-config (#10906, @Madhu-1)
• csi: Use cephcsi image for nfs nodeserver + holder design (#10791, @Rakshith-R)
• osd: Small refactor for maintainability (#10858, @satoru-takeuchi)
• csi: Change the default fsgroup policy for CSI driver object to File (#10854, @humblec)
• csi: Fix holder pod creation in openshift multus cluster (#10875, @Madhu-1)
• docs: Sharing a CephFS PVC across namespaces (#10381, @guimou)
• docs: Add example for configuring pg_num and pgp_num (#10781, @ideepika)
• osd: Disallow to create OSDs on an LV with metadata device (#10855, @satoru-takeuchi)
• docs: Add missed sssdConfigFile params for NFS CRD (#10861, @BlaineEXE)

Upgrade Guide

To upgrade from previous versions of Rook, see the Ceph upgrade guide.

Breaking Changes

• Remove support for Ceph Octopus (v15). Before upgrading to v1.10 please confirm you are running on at least v16.
• Minimum K8s version supported is v1.19.

Features

• The Ceph-CSI driver v3.7 is the default driver configured with Rook. See all the new CSI features in the v3.7 release notes.
• Added support for AWS Server Side Encryption with AWS-SSE:S3 for RGW.
• Added customEndpoints setting to specify a list of custom endpoint list for Object Multi-site connections in the CephObjectZone CR.
• Support OSDs on logical volumes in host-based clusters in addition to raw volumes and partitions.
• The toolbox pod now uses the Ceph image directly instead of the Rook image. This allows the same version of Ceph to be available in the toolbox as in your cluster.

Krew Plugin v0.2

See the new tools in the Rook Krew Plugin released recently in v0.2 as well:

• Show the health of the Rook cluster: kubectl rook-ceph health
• Connect to a Mon or OSD pod in debug mode: kubectl rook-ceph debug rook-ceph-osd-0

Improvements

Rook v1.9.10 is a patch release limited in scope and focusing on feature additions and bug fixes to the Ceph operator. Support for K8s 1.25 is added.

• build: Remove psp from common.yaml generation (#10816, @BlaineEXE)
• docs: Move PSPs from common.yaml to psp.yaml (#10797, @BlaineEXE)
• mon: Improve mon failover reliability to better handle failure and topology (#10717, @travisn)
• core: Improve logrotate bash check and periodicity logic (#10751, @subhamkrai)
• object: hostNetwork setting moved under spec.gateway from the main spec in the ObjectStore CRD (#10750, @zhucan)
• external: Fix cluster id naming in import-external-cluster script (#10677, @parth-gr)
• core: No need to delete v1beta cronJob during v1 deletion (#10726, @subhamkrai)
• core: Only log errors with v1beta1 cron job deletion (#10822, @travisn)
• rgw: Update lib-bucket-provisioner version (#10708, @degorenko)

Improvements

Rook v1.9.9 is a patch release limited in scope and focusing on feature additions and bug fixes to the Ceph operator.

• core: Skip ceph upgrade check in external cluster (#10701, @jclab-joseph)
• core: Operator to skip reconcile of mons and osds in debug mode (#10585, @travisn)
• docs: CephF mirroring documentation added (#10657, @gauravsitlani)
• csi: Introduce new log level for sidecars (#10639, @yati1998)
• test: Increase timeout waiting for file deletion status (#10668, @travisn)
• monitoring: Correct indentation level for pool alert (#10654, @solacelost)
• core: Add support to rotate log based on logfile size (#10528, @subhamkrai)
• csi: Disable liveness sidecar by default (#10647, @Madhu-1)
• docs: CephFS mirroring updates around Peer Tokens (#10580, @gauravsitlani)
• Improve descriptions in localrules.yaml (#10626, @anthonyeleven)

Improvements

Rook v1.9.8 is a patch release limited in scope and focusing on feature additions and bug fixes to the Ceph operator.

• osd: Support OSDs on logical volumes in host-based clusters (#7967, @satoru-takeuchi)
• Report rbd pool stats properly (#10575, @shalevpenker97)
• helm: Add labels and annotations to the Prometheus rule (#10583, @sathieu)
• build: Set default Ceph version to v16.2.10 (#10632, @travisn)
• docs: Clarify PG count actions and update pgcalc URL (#10610, @anthonyeleven)
• core: Fix stuck reconciler with more checkpoints for cancelled context (#10523, @leseb)
• docs: Add telemetry section to quickstart guide (#10602, @travisn)
• core: Fix numerous spelling errors (#10484, @jsoref)
• object: Network mode can be set separately for cephcluster and rgw (#10491, @zhucan)
• osd: Add udev path support for a metadata device (#10494, @microyahoo)
• csi: Set leader election timeouts for the csi driver (#10570, @subhamkrai)
• mgr: Ensure service selector is initialized for services with label app=rook-ceph-mgr (#10577, @travisn)
• helm: Add missing port for webhook in the helm chart (#10569, @subhamkrai)
• external: Correctly name variables in import-external-cluster.sh script (#10590, @der-ali)

Improvements

Rook v1.9.7 is a patch release limited in scope and focusing on feature additions and bug fixes to the Ceph operator.

• helm: Use recommended value for helm managed-by label (#10558, @galexrt)
• manifest: Use Recreate strategy for operator upgrade (#10547, @sp98)
• external: Add support for subvolumegroup and rados namespace (#10459, @parth-gr)
• docs: Refactor cluster crd doc for subtopics (#10506, @travisn)
• helm: use correct namespace for provisioner in cephobjectstore template (#10154, @bitfisher)
• mon: Disable insecure global ids immediately for new deployments (#10505, @travisn)
• csi: Update staging path to support K8s 1.24+ (#10490, @pkalever)