Commit Graph

267 Commits

Author SHA1 Message Date
SPEARS, DUSTIN (ds443n) 7f15516372 Update k8s to v1.29.2
Change-Id: I8d8d38e62fd13884afb0d0c4d027d81879cbe313
2024-03-07 16:41:50 -05:00
SPEARS, DUSTIN (ds443n) 7ce7301476 Update ETCD to v3.5.11
Since after v3.5.6 etcd-io switched to a
distroless base image. Etcd anchor pods
are now using etcd-utility and etcd is
running a sidecar for health checks.

Change-Id: I198dca1209097de4d60a53a7568f0c4790679599
2024-02-08 10:35:33 -05:00
Ritchie, Frank (fr801x) 6ae2bcf4ba Update helm toolkit reference
Update helm toolkit ref so that ingress will be created with a pathType
of Prefix.

https: //review.opendev.org/c/openstack/openstack-helm-infra/+/905757
Change-Id: I4b655daccdc613902f66c35615c1369e15001344
2024-01-25 17:00:40 -05:00
SPEARS, DUSTIN (ds443n) 89d9d907b7 Upgrade kubernetes to v1.29.0
Change-Id: I2d62dac82d6b9d738c3aa71e541e89eddeb5ae87
2024-01-08 13:39:28 -05:00
Sergiy Markin 4e96a3ee3e Helm toolkit uplift
This PS uplifts HTK version 0.2.59 and updates helm version to v3.13.2

Change-Id: I631d8c21a016e6cc54a70e4450794fffceefc5cf
2023-12-19 18:37:53 +00:00
SPEARS, DUSTIN (ds443n) 903b1363db Update k8s to v1.28.4
Change-Id: I300aa19f78206712b08d246cabbe5043b8abf509
2023-11-30 13:42:20 -05:00
Ruslan Aliev a5a7931d65 Change operator image tags to airshipit space
Signed-off-by: Ruslan Aliev <raliev@mirantis.com>
Change-Id: I7529e338266a45872875362546130ce02df1c735
2023-11-21 11:28:33 -06:00
Ruslan Aliev 29405cec00 Add configurable support for armada-operator
Signed-off-by: Ruslan Aliev <raliev@mirantis.com>
Change-Id: I22cf48839ccfd62a6ed293080fd8b90a2f31a5f9
2023-11-20 17:18:15 -06:00
Sergiy Markin 69a74590e7 Airflow stable 2.6.2
This PS updates python modules and code to match Airflow 2.6.2:

- bionic py36 gates  were removed
- python code corrected to match new modules versions
- selection of python modules versions was perfoemed based on
  airflow-2.6.2 constraints

Change-Id: I9c3e139b3437414a61af7e7c0b7d7e533fadefda
2023-08-29 21:12:11 +00:00
SPEARS, DUSTIN (ds443n) f806f8983a Update k8s to 1.27.4
Change-Id: I782762508f5fa8206751d7b9f719bcea448efe09
2023-07-31 13:55:03 -04:00
SPEARS, DUSTIN (ds443n) 3c68fb2281 Update k8s to 1.27.2
Bump k8s from 1.27.1 to 1.27.2

Change-Id: If171853f06d970a8bcfaa83098e407de9b4bc041
2023-06-02 15:28:33 -04:00
Sergiy Markin 2f2455f0d1 Restored ubuntu_bionic image build
This PS restores image build for ubuntu_bionic and adds appropriate
gates to keep it tested by appropriate functional and integrational
tests.

Change-Id: I8ef524a1f66f1a88593a18334b8c37c4db0175c6
2023-05-25 22:53:15 +00:00
SPEARS, DUSTIN (ds443n) 1717ed84e5 k8s upgrade to 1.27.1
upgrades kubernetes client to v1.27.1
upgrade etcd to v3.5.6

Change-Id: Iaf287353425aa6263a81617890a2ca3c2f2e4281
2023-05-17 10:32:04 -04:00
Sergiy Markin 32ad8a96b0 [focal] Python modules sync with Airship project
- uplifted/downgraded some python modules
- fixed falcon.API deprecation - -> falcon.App
- uplifted deckhand reference for python deps
- fixed formatting style  using yapf linter
- added bindep role and bindep.txt file with required deps
- fixed quai docker image publishing
- re-enabled openstack-tox-py38 gate job

Change-Id: I0e248182efad75630721a1291bc86a5edc79c22a
2023-04-21 06:09:14 +00:00
SPEARS, DUSTIN (ds443n) 70dd0c8599 Remove deprecated controller-manager flag
Additionally update all images from k8s.gcr.io to registry.k8s.io

Change-Id: I0240ee0bf5d23d035126a81318f57b240f5af402
2023-04-18 15:02:30 -04:00
Zuul 2125b61b57 Merge "k8s upgrade to 1.26.0" 2023-03-20 18:46:21 +00:00
SPEARS, DUSTIN (ds443n) 27a8b0d798 k8s upgrade to 1.26.0
upgrades kubernetes client to v1.26.0
remove installation of containerd during genesis.sh to prevent containerd downgrade
update bitnami kubectl image to image with curl installed for readiness check

Change-Id: I3afd5a7e7211bae3f52263167a62a012da0619a0
2023-03-20 13:16:48 -04:00
Sergiy Markin a2f614e733 [htk] Helm toolkit uplift
This PS uplifts helm toolkit chart version 0.2.52 that has improved
database backup functions.

https://review.opendev.org/c/openstack/openstack-helm-infra/+/875975

Change-Id: I4d1464d72f860be2787b5007497962a338e0f41f
2023-03-02 22:57:36 +00:00
Wahlstedt, Walter (ww229g) 8ce937a9f7 updates for focal
add focal dockerfile
update zuul jobs for focal
update tox for tox4 changes
update all requirements to latest and match deckhand
update cfssl from R1.2 to v1.6.3
fixed local gates for focal
updated examples promenade manifests to run on focal

Change-Id: I2af4043784766d36588c6f738053ad66e7b89a90
2023-02-27 12:11:07 -05:00
Wahlstedt, Walter (ww229g) 3ba747bb48 CoreDNS: uplift to 1.9.4
* Uplift the CoreDNS image to 1.9.4 (From mirantis product)

Change-Id: I3e272761b802cd2cc227c9877cecab1d19cda486
2022-09-23 14:51:06 -04:00
Ruslan Aliev c10165c144 K8S upgrade 1.24
Signed-off-by: Ruslan Aliev <raliev@mirantis.com>
Change-Id: Iaa0c5f57ac621f2b91f525da423db0acd9d8ea99
2022-09-14 19:34:02 -05:00
Wahlstedt, Walter (ww229g) c60ea37cc3 CoreDNS: uplift to 1.8.6
* Uplift the CoreDNS image to 1.8.6 (aligning to k8s v1.23) [0]
* Add support for endpointslices

0: https://github.com/coredns/deployment/blob/master/kubernetes/CoreDNS-k8s_version.md
Change-Id: I06f43d6152de2347ba056139429f09222def8d5f
2022-09-14 14:33:28 -05:00
Markin, Sergiy (sm515x) d316409fbd [CPID-354] Improve MariaDB Backup/Restore validation process
Updating etcd chart with added backup validation function empty implementation(subject for future realization). This has to be done because helm-toolkit chart in openstack-helm-infra is now calling that function verify_databases_backup_archives() as part of backup_databases() function implementation:
https://review.opendev.org/c/openstack/openstack-helm-infra/+/853027

Changed apiVersion of etcd cronjob from batch/v1beta to batch/v1 and fixed securityContext for etcd_backup.

Also bumping up HTK version to 0.2.48 from a commit id obtained from merge of https://review.opendev.org/c/openstack/openstack-helm-infra/+/853027 and set proper commit id in this file: tools/helm_tk.sh

Change-Id: Ie047dd0e6a2aae6483ace89cad22d6720890cdfc
2022-09-09 12:24:03 -05:00
Ruslan Aliev e207bbe966 k8s upgrade to v1.23.7
Address changes and deprecations in Kubernetes v1.21=>v1.23

controller-manager:
* --authorization-kubeconfig and --authentication-kubeconfig must be set
* liveness/readiness probes must use HTTPS
* the default port has been changed to 10257

kubelet:
* --dynamic-config-dir has been deprecated, will not move to GA
* --cni-bin-dir has been deprecated, will be removed with dockershim
* --cni-conf-dir has been deprecated, will be removed with dockershim
* --network-plugin has been deprecated, will be removed with dockershim

https: //github.com/kubernetes/kubernetes/blob/master/CHANGELOG/CHANGELOG-1.23.md#deprecation
https: //kubernetes.io/docs/tasks/administer-cluster/reconfigure-kubelet/
https: //github.com/kubernetes/enhancements/tree/master/keps/sig-node/281-dynamic-kubelet-configuration
Change-Id: Ia996d7c14d81d1d8b8067f11c02ffb4ce90eb49a
2022-06-29 00:21:45 -05:00
Phil Sphicas 0f9818eccc Use bitnami kubectl
Update the anchor pods to use a regularly patched and updated kubectl
image that contains the necessary components (bash, jq, curl, etc.) in
addition to kubectl: https://hub.docker.com/r/bitnami/kubectl

Change-Id: Ia3e75dc334c3c1a88abfec10fb0367447e79a538
2022-04-25 14:28:59 -07:00
Lo, Chi (cl566n) dc60ef8454 Removing set -x from function
Removing set -x from within the dump_databases_to_directory function.
The set -x from within the function is causing all the code that
follows the function call to have debug tracing on. This in turns
causing multiple identical logs for the same event. Looking at this
function, there should be enough logging to aid debugging.

Reference ps:  https://review.opendev.org/c/openstack/openstack-helm-infra/+/830533
               (commit 2fc1ce4a142e605a9fc6c90dceabbf7c4bfb81e3)

Change-Id: Id442972bbcca983afab7c4f3c29f3686e9e0b481
2022-02-24 18:54:54 +00:00
Sophie Huang 257ed54ddb Uplift HTK stable commit (db-backup-restore)
1) Uplift helm-toolkit to include db-backup-restore error log string
   prefixes for the generation of alert

   https://review.opendev.org/c/openstack/openstack-helm-infra/+/823867

2) Error log string prefixes are added to etcd backup-restore as well

Change-Id: Iad51a3e55567d0861140a97c17a1b7d859e13938
2022-01-12 21:23:06 +00:00
francisy 3cac5cbde0 Promenade Enhancement
Update charts in Promenade to Kubernetes version 1.21

Change-Id: Iab6d10b384a8be3a4b4d2357a51b35ab93a797b0
2022-01-10 14:04:15 -05:00
Phil Sphicas e14854bb3e Update HTK stable commit (Ingress)
Update helm-toolkit to include updated Ingress templates that use
current API versions (i.e. networking.k8s.io/v1)

https://review.opendev.org/c/openstack/openstack-helm-infra/+/813115

Change-Id: I5e1cfae7bffb6d061ecc319e6a6ffa5f777ec866
2021-10-18 11:53:58 -07:00
Sean Eagan 2f823c69d2 Helm 3: Fix Job labels
See the dependency below for details.

Depends-On: https://review.opendev.org/c/openstack/openstack-helm-infra/+/811826
Change-Id: Ib7730c5cbcaa95dab615baac1efda310e5a52fcc
2021-10-06 13:18:43 +00:00
Sean Eagan 53d0ecb7f9 Remove Tiller
Depends-On: https://review.opendev.org/c/airship/armada/+/812047
Signed-off-by: Sean Eagan <seaneagan1@gmail.com>
Change-Id: Ic1eddda3639d629a94bb39f93bf48da54445469f
2021-10-06 13:16:34 +00:00
Sean Eagan 1017536b9f Move to helm 3 CLI in cluster
Signed-off-by: Sean Eagan <seaneagan1@gmail.com>
Change-Id: I3c385547d30796aecb67aaa6482da34765052c47
2021-10-01 12:23:12 -05:00
Sean Eagan 9d696ca0a4 Use helm 3 in chart build
`helm serve` is removed in helm 3 so this moves
to using local `file://` dependencies [0] instead.

[0]: https://helm.sh/docs/chart_best_practices/dependencies/#repository-urls

Signed-off-by: Sean Eagan <seaneagan1@gmail.com>
Change-Id: Ia45c57e0cccac477f6ff59a254d03d6fcec14bef
2021-09-30 16:57:05 -05:00
Neely, Travis (tn720x) 41813cc110 Update HTK commit ID for etcd backup/restore framework
Include the fix in [0] for db backup/restore for automatic retries

[0] https://review.opendev.org/c/openstack/openstack-helm-infra/+/811038

Change-Id: I1d40113913390cb1a3aa60cefb3442c5463c5f92
2021-09-27 11:22:38 -05:00
anthony.bellino e79323f5e1 Uplift tiller and helm install script to v2.17.0
Uplifting tiller image to ghcr.io/helm/tiller:v2.17.0 since
v2.16.1 is not available anymore

Update the helm installation script to download and install v2.17.0

Change-Id: I92a7fe096a32377e155a298dc258bc2f4b93a2c1
2021-08-09 09:37:48 -07:00
Ansuman Bebarta 10daabee73 Uplift HTK to latest
The purpose of uplift to include fix related to backup/restore
retry to send to remote.

Change-Id: Ie6eb2b350163c2856459a16381d6ba3daf3cc8a2
2021-07-28 14:24:02 +00:00
Thirunavukkarasu Palani 9cd261294b Update airship images to bionic versions
Update example manifests to use latest bionic based armada and deckhand images to fix the zuul gates.

Change-Id: Ic70b7269a73a3b34608442ee71620358fa8785c2
2021-06-10 18:10:32 +00:00
Phil Sphicas 06254b36ed CoreDNS: Uplift to 1.7.0
* Uplift the CoreDNS image to 1.7.0 (aligning to k8s v1.20) [0]
* Update the Corefile based on corefile-tool migration [1]

Note that the previously-deprecated "upstream" option is removed in
1.7.0 [2], and if not removed from the Corefile, will cause the pods to
crashloop.

0: https://github.com/coredns/deployment/blob/master/kubernetes/CoreDNS-k8s_version.md
1: https://github.com/coredns/corefile-migration/tree/master/corefile-tool
2: https://github.com/coredns/coredns/pull/3737

Change-Id: I03882240e8335f09956e412345e783e9a897ed9a
2021-05-03 17:30:48 +00:00
Phil Sphicas ae6782b452 Kubernetes: Uplift to v1.20.5
Uplift Kubernetes images and binaries from v1.19.7 to v1.20.5. No config
changes.

Change-Id: If2a8c9169c831a001205e8aa947df7fc00a1e658
2021-05-03 17:21:30 +00:00
Phil Sphicas 9533be32a1 Add required apiserver serviceaccount flags
In v1.20, TokenRequest and TokenRequestProjection become GA features,
and the following flags are required by the API server:
* --service-account-issuer
* --service-account-key-file
* --service-account-signing-key-file

This change ensures that the flags are set, and that the required keys
are in the right places.

Change-Id: I6606c5b1c9ff005d1943b424e3e7ad4d20b68408
2021-04-30 22:45:43 +00:00
Phil Sphicas 5bb58863b6 Uplift Kubernetes to v1.19.7
Change-Id: I2ac28e2383cb9c4d84d09c23c02a087db714803e
2021-02-11 17:23:32 +00:00
Phil Sphicas 023e7d4d7d Uplift etcd to v3.4.13
Change-Id: I1e4452f3bd9ff434b0b68ddbbdc63c9d600f6932
2021-02-11 17:23:32 +00:00
Phil Sphicas e2324e7db8 Remove remaining hyperkube references
This change eliminates all remaining references to hyperkube, as it is
no longer supported.

Change-Id: Id0a4c142b1dc76561f7d2c18fb76edfc5a60267a
2021-02-11 17:23:32 +00:00
Phil Sphicas 5323ca2710 Deploy with standalone kubernetes images
Replace all usages of the hyperkube image with standalone container
images for apiserver, controller, scheduler, and proxy.

Change-Id: I44392c7900a72edd35bc5afa1c50bec8e04f927f
2021-02-11 17:23:32 +00:00
Phil Sphicas c7e72942a9 Remove hyperkube extraction functionality
The extraction of the monolithic hyperkube binary from its container
image to be used as kubelet was last relevant in Kubernetes 1.16. Since
then, the hyperkube image has been deprecated, the structure of the
image has been changed, and it has ultimately been eliminated in
Kubernetes 1.19.

This change cleans up promenade accordingly.

Reverts the following commits:
* 886007b New CLI option to extract hyperkube
* 32a6c15 hyperkube image in promenade init
* 955deed New source for hyperkube binary definition

Change-Id: Ib62ecdf1af13abe8202a4ba4f86c39b9042ed13f
2021-02-11 17:23:32 +00:00
Phil Sphicas 030739114f Update cleanup.sh developer script
Modifies the script that cleans up the local environment between runs to
allow the removal of /var/lib/kubelet/pods. The previous script hung up
on volume-subpaths (in addition to io~secret and empty-dir, which were
explicitly handled). This just unmounts everything before the files are
removed in remove_files.

Change-Id: I52cbe7d0f493336c1362ca3d3988038a1a15bcef
2021-02-11 17:23:32 +00:00
Chris Wedgwood 630e504e3e Update to container image repo k8s.gcr.io
gcr.io/google_containers/ no longer contains some of the image
versions we require, use the new location.

Change-Id: I8f9a976a35ca632d785dd4d05f2a55713bde8c3e
2021-01-11 17:42:31 +00:00
Phil Sphicas f29d6df68f Ignore upstream chart repos when installing Helm
The upstream Helm chart repos have moved permanently, causing a failure
when running "make helm-serve": 'Error: error initializing: Looks like
"https://kubernetes-charts.storage.googleapis.com" is not a valid chart
repository or cannot be reached'.

This change skips the chart refresh, since the upstream charts are not
used anyway.

Change-Id: Ia55b7f48ce03d1ecf9a26181fea0ab159e99c8a5
2021-01-07 19:09:26 +00:00
Parsons, Cliff (cp769u) 922e3b2ecf Uplift HTK for etcd backup/restore delete archive capability
This patch includes the upstream helm toolkit change below which adds
the capability to delete an archive from the local or remote data stores.

https://review.opendev.org/#/c/758859/
(commit 2d1fe882bb751c03ee741a6166c9c8a5fad8f926)

Change-Id: Iec3f234f5be780bd90d233b1cba58d11127d5d28
2020-10-28 20:35:10 +00:00
Huang, Sophie (sh879n) d365ab873b Uplift HTK for etcd backup/restore framework
Include below patchset to make database backups work with
openstack Train release.

https://review.opendev.org/#/c/754831

Change-Id: I8004ac8320f02bb0acbf0edd9caa9520a94aada1
2020-09-30 14:04:02 +00:00