Changelog

NOTES

Dashboards have been added to Grafana for application level metrics/monitoring #297
New Zenko options for CRR parallelism #303
Values files with default storage, pdb, and resources requests/limits have been added #289

Known Issues:

Upgrading from 1.0.0-RC4 requires a specific upgrade procedure for close to seamless upgrades:
- helm upgrade <release-name> ./zenko --set redis-ha.enabled=false --timeout 600 && helm upgrade <release-name> ./zenko --set redis-ha.enabled=true
- This can take several minutes because helm is waiting on the removal of the old redis-ha chart. On larger deployments, it's suggested to increase the timeout to prevent early termination of the upgrade.
- This procedure is necessary because of the drastic changes in the redis-ha that fixes high availability issues along with default stateful options
Sometimes upgrades result in one MongoDB pod to be stuck during the Init:2/3 process. While functionality is still present, it's necessary to resolve this manually
- This requires to manually exec into the stuck pod and run /work-dir/peer-finder -on-start=/init/on-start.sh -service=<release-name>-mongodb-replicaset

Merges

Merge branch 'feature/ZENKO-1065-crr-parallelism' into q/0.9
Merge branch 'bugfix/ZENKO-1004/mark-one-to-many-tests-flaky' into q/0.9
ZENKO-1065 [zenko]: add crrParallelism anchor
ZENKO-1065 [backbeat]: add replicaFactor
ZENKO-1065 [zenko-queue]: add partition count and factor
bugfix: ZENKO-1004 Tag one-to-many tests as flaky
Bump versions to RC6
ZENKO-1055 bugfix: bump grafana sidecar version
ZENKO-965 bugfix: incorrect Grafana password
ZENKO-1059 refactor: cloudserver dashboard
ZENKO-511 feat: add mongodb-replicaset dashboard
ZENKO-513 feat: add backbeat dashboard
bugfix: Prometheus datasource port
Merge branch 'bugfix/ZENKO-1051_Change_to_sentinel_redis_config' into q/0.9
Bump cloudserver and backbeat images
ZENKO-1051 Add support for redis sentinels
ft: retain s3-data pvc on helm delete
ft: set default mongodb pdb for Zenko
ft: Add storage, resources, and disruption options files

Zenko - 1.0.0-RC5

Published by ssalaues about 6 years ago

Changelog

NOTES:

Folder restructure: Zenko helm chart can now be found in the kubernetes/zenko folder #278
Sub charts can be found in kubernetes/zenko/charts
- Because of the restructuring, helm dependency build is no longer a necessary part of the installation
Prometheus metrics are enabled in MongoDB #249
Prometheus has been converted to a highly available stateful set #267
- Because of these changes previous Prometheus data will not automatically transfer to the new statefulset and will be lost after upgrades
Improved HA capabilities with new redis-ha chart #264
HA support for Prometheus with StatefulSets. Default number of replicas is now 2 #267

Known Issues:

Upgrading from 1.0.0-RC4 requires a specific upgrade procedure for close to seamless upgrades:
- helm upgrade <release-name> ./zenko --set redis-ha.enabled=false --timeout 600 && helm upgrade <release-name> ./zenko --set redis-ha.enabled=true
- This can take several minutes because helm is waiting on the removal of the old redis-ha chart. On larger deployments, it's suggested to increase the timeout to prevent early termination of the upgrade.
- This procedure is necessary because of the drastic changes in the redis-ha that fixes high availability issues along with default stateful options
Sometimes upgrades result in one MongoDB pod to be stuck during the Init:2/3 process. While functionality is still present, it's necessary to resolve this manually
- This requires to manually exec into the stuck pod and run /work-dir/peer-finder -on-start=/init/on-start.sh -service=<release-name>-mongodb-replicaset

Merges

Merge branch 'feature/ZENKO-1029-prometheus-soft-anti-affinity' into q/0.9
Merge branch 'bugfix/ZENKO-1032_Fix_redis_ha_PodDisruptionBudget' into q/0.9
ZENKO-1029 feature: prometheus soft anti-affinity
ft: update CI values to add cloudserver replicas
ft: take out manager from service rotation
flaky-test: Azure replication
Add more specific label
ft: update CI values to add cloudserver replicas
ft: take out manager from service rotation
flaky-test: Storage Location quota
chore: bump mongodb chart
bf: mongo init failure
bf: update replicaset var name
ZENKO-1027 bugfix: redis-ha volume node affinity conflict
add link to ticket
fix test-latest target to run all node tests
update package.json scripts to include tag support
Add flaky tags
add support for mocha tags to Makefile
Add mocha-tags dependency
Bump Zenko chart to 1.0.0-RC5
Bump cloudserver and s3-data to 8.0.10-RC5
Bump backbeat to 8.0.8-RC5
bugfix: Disable push stats
ZENKO-1010 chore: delete outdated Makefile
ZENKO-1010 docs: update for new chart structure
ZENKO-1010 ci: updates for new structure
ZENKO-1010 chore: update redis-ha to be disabled
ZENKO-1010 chore: update zenko-nfs to be optional
ZENKO-1010 refactor: update core chart structure
chore: update single node values
bump redis-ha chart version
bugfix: fixes upgrades with persistence disabled
feature: default to Parallel pod management
bugfix: fixes upgradablity of the redis chart
Merge branch 'bugfix/ZENKO-1007-mongodb-upgrades' into q/0.9
bump mongo versions for bugfix
bugfix: Fixes mongodb getting stuck on upgrades
Merge branch 'improvement/Update_python_e2e_requirements' into q/0.9
Merge branch 'bugfix/ZENKO-1003_Move_dump-logs_to_seperate_stage' into q/0.9
Update python requirements
Merge branch 'improvement/ZENKO-987-zenko-charts-refactor' into q/0.9
ZENKO-987 chore: rename kafka and zookeeper
ZENKO-987 feat: import upstream zookeeper chart
ZENKO-987 feat: import upstream kafka chart
ZENKO-987 feat: import upstream grafana chart
Merge branch 'bugfix/ZENKO-1001-prometheus-upgrades' into q/0.9
Merge branch 'bugfix/ZENKO-933-redis-chart' into q/0.9
bf(ZENKO-1003): Move dump-logs to seperate ShellCommand
bugfix: fix identation for options.yml code snippet
chore: update redis links
rf: Improve init script
feat: add Prometheus test for mongodb
ZENKO-1001 bugfix: Prometheus upgrades from RC4
bugfix: productize redis chart
Import stable/redis-ha chart v2.2.1
ft: update docs with new repo
ft: enable mongodb prometheus metrics
Bump mongodb version
ft: preserve ability to upgrade from 3.4 to 3.6
ft: Revert chart to 3.4 compatibility
import mongodb from upstream stable/charts
Merge branch 'feature/ZENKO-949-prometheus-chart' into q/0.9
feat(ZENKO-949): update default replicaCount for Prometheus
feat(ZENKO-949): update Prometheus chart to use StatefulSets
feat(ZENKO-949): add prometheus chart
Merge branch 'improvement/ZENKO-934_Refactor_E2E_Makefile' into q/0.9
ref(ZENKO-934): Refactor E2E main.yml and Makefile
bf: ZENKO-968 expose NO_PROXY in values.yml
chore: bump cloudserver and s3-data images
bf: ZENKO-916 modify ACL replication test case
Revert "bf: ZENKO-916 modify ACL replication test case"
Merge branch 'bugfix/ZENKO-916-doNotReplicateACLChange' into q/0.9
Merge branch 'improvement/ZENKO-628_Bump_charts_to_1.0.0' into q/0.9
bf: ZENKO-916 modify ACL replication test case
Merge branch 'improvement/ZENKO-944-grafana-readme-instructions' into q/0.9
Merge branch 'bugfix/ZENKO-915/one-to-many-flakiness' into q/0.9
Merge branch 'bugfix/ZENKO-799-drop-commit' into q/0.9
bugfix: ZENKO-915 One-to-many CRR test flakiness
Merge branch 'feature/ZENKO-449-single-node' into q/0.9
ZENKO-628 Bump chart versions to 1.0.0
ft: Update single node values
ZENKO-944 docs: add instructions to expose Grafana
Revert "[drop] orbit sim"
Merge branch 'bugfix/ZENKO-915/one-to-many-flakiness' into q/0.9
bugfix: ZENKO-915 One-to-many CRR test flakiness
[drop] orbit sim
ft: ZENKO 799 location quota e2e tests
chore: create node_tests folder
changes to Installation/Install_guide.rst (#240)

Zenko - 1.0.0-RC4

Published by ssalaues about 6 years ago

Changelog

NOTES:

NEW: Please be sure to run a helm repo add scality https://scality.github.io/charts/ before building/rebuilding any helm dependencies [#246]
When upgrading, be sure to clean up the old tarballs in Zenko/charts/zenko/charts and rebuild using helm dependency build zenko as there may be conflicts that occur from charts that have been removed. See #232 #246

Notable Fixes/Updates:

Race conditions that were causing installation problems because of the redis-ha chart have been fixed #246
Offline configuration options #150
CI stabilization and increased test coverage #245 #235 #227 #231 #228 #214
Removes "localCache" redis in favor of redis-ha #232
More detailed install documentation #135

Merges

Full changelog for Zenko and dependencies changes from 1.0.0-RC3 to 1.0.0-RC4 can be found here.

Merge pull request #247 from scality/bugfix/ZENKO-897-s3data
bf: revert to default storage values
Merge pull request #233 from scality/feature/ZENKO-846/add-retry-test
bugfix: ZENKO-881 Delete blobs before source
feature: ZENKO-846 Add retry test
Merge pull request #232 from scality/ft/ZENKO-759
ft: remove redis local cache
feat: update backbeat to 8.0.7-RC4
Merge pull request #239 from scality/feature/ZENKO-788-crrMetricE2E
feat: update cloudserver to 8.0.8-RC4
ft: ZENKO-788 update crr metrics e2e tests
Merge pull request #234 from scality/feature/ZENKO-805/CRR-one-to-many
Merge pull request #246 from scality/ft/ZENKO-875
ft: update ci with scality repo
ft: use zenko redis image
chore: update requirements for new redis-ha
feature: ZENKO-805 CRR one-to-many
docs: update docs for scality helm repo
Merge pull request #245 from scality/bugfix/ZENKO-888_Fix_GCP_object_deletion_bug
Merge pull request #150 from scality/feature/ZENKO-562-orbit-disabled
Merge pull request #221 from scality/feature/ZENKO-845/object-monitor-throughput-route
bf(ZENKO-888): Fixd GCP object deletion bug
Merge pull request #135 from scality/DocReview
feat: extend support without orbit
feature: ZENKO-845 Object monitor throughput test
feat: add zenko tools Dockerfile
Merge pull request #237 from scality/bugfix/ZENKO-884_Honor_PUSH_STATS_in_push_mode
Merge pull request #235 from scality/bugfix/ZENKO-881_Reduce_Azure_E2E_Flakiness
Doc: New RST files, extensive rework
bf(ZENKO-881): Reduce Azure Test Flakiness add a prefix checking to cleanup_azure_bucket, similar to cleanup_bucket
Merge pull request #230 from scality/improvement/ZENKO-865-e2e-setup-documentation
bf(ZENKO-884): Honor PUSH_STATS in push management mode
ZENKO-865 - clarify setup for e2e CRR tests
Merge pull request #227 from scality/bugfix/ZENKO-763-objectTagsAreNotReplicated
Merge pull request #229 from scality/feature/ZENKO-782
Merge pull request #231 from scality/feature/ZENKO-850-Enable_GCP_CRR_Tests
bf: ZENKO-763 re-enable tags replication tests
Merge pull request #226 from scality/feature/ZENKO-855_Enable_one_to_many_tests_in_eve
feat(ZENKO-850): Enable GCP CRR test in eve
ft: add replication factor to cloud server
feature(ZENKO-855): Enable one to many replication tests in eve
Merge pull request #228 from scality/bugfix/ZENKO-862-ci-timeout
bf: Fix timeout not correctly being set
Merge pull request #218 from scality/improvement/https-proxy-note
chore: add note about http(s) proxies
Merge pull request #224 from scality/bugfix/ZENKO-853_Prevent_CI_name_clash
bf(ZENKO-853): Prevent CI object name conflicts
Merge pull request #223 from scality/feature/ZENKO-841_Enable_pause_resume_tests_in_eve
Merge pull request #222 from scality/feature/ZENKO-767_Add_MPU_TESTING_flag
Merge pull request #202 from scality/feature/ZENKO-781-scaleOutBackbeatServices
ft: increase install timeout
Merge pull request #215 from scality/bugfix/remove-bad-cloudserver-dashboard-stat
feat(ZENKO-841): Enable Backbeat CRR pause/resume tests
Add MPU_TESTING flag to ci-values.yml
Merge pull request #219 from scality/feature/ZENKO-367_Backbeat_tests_in_eve
feat(zenko-367): Enable Backbeat AWS & Azure tests in eve
ft: ZENKO-781 scale out backbeat services
Merge pull request #220 from scality/improvement/ZENKO-834
rf: remove wait flags and programatically wait
Merge pull request #214 from scality/improvement/ci-secrets-update
Merge pull request #217 from scality/feature/ZENKO-822-fix-e2e-backbeat-api-env
ZENKO-822: fix env for backbeat api e2e test
bugfix: remove bad cloudserver dashboard stat
ci: update method to fetch secrets

Zenko - 1.0.0-RC3

Published by ssalaues about 6 years ago

Changelog

NOTES:

When upgrading, be sure to clean up the old tarballs in Zenko/charts/zenko/charts and rebuild using helm dependency build zenko as there may be conflicts that occur because of the changes in #205.

Known Issues:

The dependency on the stable/redis-ha chart can some times have issues due to a race-condition that causes multiple redis-servers to be set to master. This can be remedied by running kubectl get pod -L redis-role to get the list of redis-servers with the master role. Then delete any duplicate master pod therefore leaving only 1 redis-server pod with the master label.

Full changelog for Zenko and dependencies changes from 1.0.0-RC2 to 1.0.0-RC3 can be found here.

Merge pull request #212 from scality/improvement/bump-nfs-rc3
chore: bump nfs to rc3
Merge pull request #189 from scality/improvement/ZENKO-744-renameLifecycleProducerAndConsumer
Merge pull request #211 from scality/feature/ZENKO-814-soft-anti-affinity
ft: cloudserver soft anti-affinity
feat: update backbeat image tag to 8.0.6-RC3
rf: ZENKO-744 rename lifecycle producer and consumer
Merge pull request #205 from scality/feature/ZENKO-779-cloudserver-refactor
chore: move storage limit to orbit context
chore: update ci values with updated orbit mode
chore: update requirements.lock
chore: rename cloudserver-front to cloudserver
ft: add cloudserver manager
chore: remove optional mongodb
Merge pull request #209 from scality/feature/ZENKO-695-helm-lint-on-ci
Merge pull request #210 from scality/improvement/bump-cloudserver-image
chore: bump cloudserver to rc3
Merge pull request #207 from scality/bugfix/ZENKO-795-authenticateTestHTTPRequests
ci: add helm lint step
bugfix: helm lint errors
bugfix: ZENKO-795 auth backbeat api requests
Merge pull request #206 from scality/feature/ZENKO-367/backbeat-end-to-end-tests-gcp
Merge pull request #204 from scality/feature/ZENKO-737-CRR-Pause-Resume-tests
ZENKO-737: CRR Pause Resume e2e tests
feature: ZENKO-367 CRR to GCP end-to-end tests
Merge pull request #203 from scality/bugfix/ZENKO-789-re-enable-grafana-tests
Merge pull request #199 from scality/feature/ZENKO-367/backbeat-end-to-end-tests-azure
ci: re-enable grafana tests
feature: ZENKO-367 CRR to Azure end-to-end tests
Merge pull request #154 from scality/feature/ZENKO-466-add-grafana-chart
ci: disable grafana tests
feat: optional prometheus chart
feat: add grafana chart
Merge pull request #200 from scality/feature/ZENKO-740-crrMetricE2ETests
ft: add e2e tests crr metrics/healthcheck
Merge pull request #198 from scality/feature/ZENKO-704/crr-object-monitor
feature: ZENKO-704 Backbeat object monitor tests
Merge pull request #197 from scality/bugfix/ZENKO-772_Improve_CI_flakiness
add retries to MPUs
Merge pull request #196 from scality/feature/ZENKO-605_Transient_source_endend_tests
Merge pull request #195 from scality/feature/ZENKO-367/backbeat-end-to-end-tests
feat(zenko-739): Add Transient source test
bf(zenko-772): Improve CI Flakiness
feature: ZENKO-367 CRR to AWS end-to-end tests
Merge pull request #192 from scality/bugfix/ZENKO-566-re-enable-prometheus-tests
bugfix: re-enable prometheus tests
Merge pull request #194 from scality/improvement/ZENKO-758-renameBackbeatReplicationPods
Merge pull request #188 from scality/improvement/ZENKO-738-rename-filer-to-nfs
rf: ZENKO-758 rename replication pods
Merge pull request #191 from scality/bugfix/E2ETestMarkTypo
bf: typo in wasabi 1-1 replication test mark
Merge pull request #193 from scality/bugfix/ZENKO-755_Fix_CRR_Creds
bf(zenko-755): Fix crr credentials
chore: rename zenko-filer to zenko-nfs
Merge pull request #187 from scality/bugfix/ZENKO-723_Explicit_MPU
bugfix(zenko-723): Explicitly define when MPUs happen
Merge pull request #185 from scality/feature/ZENKO-702_Add_MPU_to_CRR
feat(zenko-702) Add MPU to CRR tests

Zenko - 1.0.0-RC2

Published by ssalaues over 6 years ago

Changelog

Full changelog for Zenko and dependencies changes from 1.0.0-beta to 1.0.0-RC2 can be found here.

Merge pull request #186 from scality/bugfix/ZENKO-710-https-proxy
bf: allow optional proxy certs
Merge pull request #184 from scality/improvement/ZENKO-709-delete-cert-configuration
chore: delete unnecessary cert configuration var
Merge pull request #183 from scality/bugfix/ZENKO-709-fix-azure-https-proxy
Merge pull request #170 from scality/DOC/discourse
DOC: adding template to show Zenko forums in pages
Merge pull request #182 from scality/bugfix/ZENKO-699_Fix_Lifecycle_Test
bugfix: azure behind an https proxy
bug(zenko-699): Fix Lifecycle Test
Merge pull request #180 from scality/bugfix/ZENKO-696_Fix_E2E_CRR_Tests
bug(zenko-696): Fix CRR Tests
Merge pull request #181 from scality/feature/rc2-bump
chore: bump zenko filer to rc2
chore: bump backbeat to rc2
chore: bump cloudserver and s3-data to rc2
Merge pull request #179 from scality/feature/ZENKO-679-storage-limit
chore: cloudserver image bump
ft: add options for storage limits
Merge pull request #178 from scality/bugfix/ZENKO-652-hide-ci-configuration
Merge pull request #176 from scality/feature/ZENKO-691-basic-upgrade-procedure
docs: Add info on upgrading Zenko
Merge pull request #177 from scality/improvement/zenko-filer-node-port
ci: remove configuration from user-observable part
chore: zenko-filer NodePort service
Merge pull request #175 from scality/chore/ZENKO-651_enable_e2e_linting
chore(zenko-651): Fix formatting and enable linting for e2e tests
Merge pull request #174 from scality/feature/ZENKO-596-add-redis-ha-option
Merge pull request #173 from scality/feature/ZENKO-637-add-proxy-cert-config
feat: add support for https proxy certificate
Merge pull request #172 from scality/feature/ZENKO-633-update-redis-ha
Merge pull request #171 from scality/feature/ZENKO-645/addOrbitManagementConfigurables
ft: Update redis-ha to latest version
ft: change README endpoint
ft: ZENKO-645 add additional orbit managment vars
feature: add redis ha connectivity to cloudserver