Commit Graph

13 Commits

Author SHA1 Message Date
Sergiy Markin c1da28f637 [backups] Add throttlling of remote etcd backups
This PS adds a possibility to limit (to throttle) the number of
simultaneously uploaded backups while keeping the logic on the client
side using flag files on remote side.

Change-Id: I753faab8f3d934346d54e38bfc94cec3a8f79385
2023-12-19 16:14:43 +00:00
Sergiy Markin 748dfc535d [backups] Update staggered backups
This PS updates yaml tree of values getting aligned with similar changes
in osh-infra project.

Change-Id: I9a5fc987bea7b4cb1214e329e5f77a0e26011d8d
2023-12-05 04:17:10 +00:00
Sergiy Markin d1c4a54bf7 [backups] Added staggered backups
This PS adds staggered backups possibility by adding anti-affinity rules
to backups cronjobs that can be followed across several namespaces to
decrease load on remote backup destination server making sure that at
every moment in time there is only one backup upload is in progress.

Change-Id: I320c6ce6370b45c602114189819a4225e479f680
2023-12-04 22:03:29 +00:00
Markin, Sergiy (sm515x) d316409fbd [CPID-354] Improve MariaDB Backup/Restore validation process
Updating etcd chart with added backup validation function empty implementation(subject for future realization). This has to be done because helm-toolkit chart in openstack-helm-infra is now calling that function verify_databases_backup_archives() as part of backup_databases() function implementation:
https://review.opendev.org/c/openstack/openstack-helm-infra/+/853027

Changed apiVersion of etcd cronjob from batch/v1beta to batch/v1 and fixed securityContext for etcd_backup.

Also bumping up HTK version to 0.2.48 from a commit id obtained from merge of https://review.opendev.org/c/openstack/openstack-helm-infra/+/853027 and set proper commit id in this file: tools/helm_tk.sh

Change-Id: Ie047dd0e6a2aae6483ace89cad22d6720890cdfc
2022-09-09 12:24:03 -05:00
Sophie Huang 91c21ce14e Enhance ETCD backup
Pick up the helm-toolkit DB backup enhancement in etcd
to add capability to retry uploading backup to remote server.

Change-Id: If6ea347a4c2c55f14f35d95681aaf482d0a6103c
2022-01-25 22:04:25 +00:00
Phil Sphicas e4d9d99c13 Update charts to use stable Kubernetes APIs
Update applicable charts to use non-deprecated APIs [0], specifically
addressing the following resource types:
* ClusterRole
* ClusterRoleBinding
* Role
* Rolebinding

The APIs being migrated to are available in v1.19 or earlier. As of this
change, v1.19 is the oldest supported Kubernetes version, slated for EOL
on 2021-10-28. [1]

0: https://kubernetes.io/docs/reference/using-api/deprecation-guide/
1: https://kubernetes.io/releases/
Change-Id: I134b201d9ae01a8d74e34ee14f3bfe3b960cb5aa
2021-10-18 18:59:34 +00:00
KHIYANI, RAHUL (rk0850) fffb57109d Add security context template for etcd-backup chart
This change also removes etcd-perms container which is not required

Change-Id: Ia6c38424e0c2d177e35fc904a9551d601a31ac3b
2020-07-27 16:29:53 +00:00
anthony.bellino 95c1689e03 ETCD remote backup enhancements
1) Include framework for remote etcd backups.
2) Use porthole etcdctl utility image for backups.
3) Move helm-toolkit pin to latest commit.
4) Add a keystone user for RGW.
5) Add a secret for Swift API access.
6) Add a secret for backup/restore configuration.

Change-Id: Ica549c3b6bc00ca55540b8ffedd4c46af0d8d25e
2020-06-29 23:34:50 +00:00
KHIYANI, RAHUL (rk0850) b51eb9802d Add apparmor profile to apiserver and etcd jobs
Change-Id: I8bed3213868b45a438e5ae5929bca8bef699a503
2020-05-28 13:04:12 -05:00
Doug Aaser 4cd75e26a0 Uplift etcd to v3.4.2
Uplift etcd to v3.4.2
Also uplifts calico in the gate so that it works with etcd v3

Change-Id: Iac93cadfad813223f9364e513fae00afa178113e
2019-11-25 17:12:00 +00:00
Sreejith Punnapuzha eefdbe0581 [fix] etcd backup to use different filename
- Changed backup path to /var/backups/etcd
- Chanded backup filename to service name to support multiple releases
- Removed additional etcd from cronjob name

Change-Id: I1fabdfe1dccd8e170090eec0a69b2598e1e3e422
Signed-off-by: Sreejith Punnapuzha <Sreejith.Punnapuzha@outlook.com>
2019-04-17 19:16:52 +00:00
Scott Hussey 8f43897fe2 [fix] etcd backup support for multiple releases
- Name the resoruces for etcd backup so that the chart
  can be deployed into multiple releases.

Change-Id: I8a9f82d556eb61d01bdb08ca4e17ed064ff47190
2019-03-12 19:30:19 +00:00
Sreejith Punnapuzha b65752d7c5 Implements: etcd backup
This is an effort to impletment etcd backup.
This will create a k8s cron job to take a regular backup.

Change-Id: If2c89ac01540c0f13f9b57a6833a8ea770379717
Signed-off-by: Sreejith Punnapuzha <Sreejith.Punnapuzha@outlook.com>
2019-02-25 14:58:46 +00:00