Commit Graph

98 Commits

Author SHA1 Message Date
SPEARS, DUSTIN (ds443n) 7c1865b7db Update helm to v3.14.2
Change-Id: I6952261625d74a7a2205b34b3fe08b02afab6089
2024-03-15 14:04:42 -04:00
Sergiy Markin 03a55bbc31 Kubeadm based Airskiff gate
This PS replaces old airskiff integration gate
with new kubeadm based airskiff integration gate.
The main goal of this gate is to test new Armada
image and chart together with other Airship
components.

Change-Id: I2351b55fa136453a0a6a27a2875208c5e18e579e
2024-03-13 15:11:30 +00:00
Ritchie, Frank (fr801x) 410d110c1a Update helm toolkit reference
Update helm toolkit reference

Update helm toolkit ref so that ingress will be created with a pathType
of Prefix.

https: //review.opendev.org/c/openstack/openstack-helm-infra/+/905757
Change-Id: I64c6ec08c6f454bd09c200174d8709afd6cda416
2024-01-23 17:27:24 -05:00
SPEARS, DUSTIN (ds443n) ea56249752 Update helm to v3.13.2
Change-Id: I6f235d1fba8d9c1c47a1dcf655e35b97e0382763
2023-11-15 09:27:52 -05:00
Anselme, Schubert (sa246v) 5df69442b0 Deprecating the Ingress Class Annotation
Upgrading htk to version 0.2.55, which deprecates the ingress class
annotation (kubernetes.io/ingress.class) with .spec.ingressClassName

https://review.opendev.org/c/openstack/openstack-helm-infra/+/891720

Change-Id: I304b3239f6d9f1951de03bd821c8ba4c0a5b9a60
Signed-off-by: Anselme, Schubert (sa246v) <sa246v@att.com>
2023-10-05 22:55:39 +00:00
Sergiy Markin cdcdbd292d Airflow stable 2.6.2
This PS updates python modules and code to match Airflow 2.6.2:

- bionic py36 gates  were removed
- python code corrected to match new modules versions
- selection of python modules versions was perfoemed based on
  airflow-2.6.2 constraints
- airskiff deploy pipeline was aligned with latest in treasuremap v1.9

Change-Id: If6f57325339995216d2553c7a5ff56e7673b5acc
2023-08-19 00:37:37 +00:00
Sergiy Markin 25c3d621d6 Armada updates
This PS makes the following changes:

- makes sure the airskiff-deploy playbook is using 80Gb partition if
  available
- adds available security updates to docker images

Change-Id: I405743f9ae69194407bcc49a736b63e9993655c3
2023-08-18 21:53:29 +00:00
SPEARS, DUSTIN (ds443n) 4f43e2cc55 Update helm to 3.12.2
Also this PS updates airskiff deployment playbook based on the latest
treasuremap changes and makes sure the airskiff deployment uses freshly
built armada image.

Change-Id: I913f93d695e4068199e193a5839bf27e257a535e
2023-08-03 16:29:51 +00:00
Sergiy Markin 812546c875 Update armada image run test
This PS improves armada image run test by enriching it with config
generator. Also this test was removed from make images section of
Makefile. Build images zuul gate has make run_images task to test
the freshly built image now.

Change-Id: I87e089e5d268d248cda1dad1cd417694d166fdfb
2023-05-24 20:14:32 +00:00
Sergiy Markin 275dc4506f Updates to armada
- update github.com ssh host key
- fix bionic image upload to Quay.io
- fix armada_image_run.sh script
- fix armada config presense

Change-Id: I2af589baabb9e76e2e1a29ff266d6c3b7ae412e3
2023-05-22 21:37:16 +00:00
Sergiy Markin 966742ec74 Restored ubuntu_bionic image build
This PS restores image build for ubuntu_bionic and adds appropriate
gates to keep it tested by appropriate functional and integratinal
tests.

Also the latest osh-infra commit was used with kubernetes 1.27.1 or
integration tests.

Make images section of Makefile was enriched with run_armada step in
order to quicktest the freshly built images - this is vital for focal
and bionic images differences.

Change-Id: Ida43eebd4aa51fff6261ac9cf5f8259359bc99a9
2023-05-19 13:52:30 +00:00
Yuvraj Singh (ys542d) 3c3a20addb 111596: [CPDEFECT-4365] helm binary to v3.11.1
Change-Id: I078e995d5f1ef794b106e196d37f49fce519fcfd
2023-05-15 11:05:11 -07:00
Sergiy Markin b778f9faf8 Update airskiff deployment gate
This PS updates armada to use new reliable airskiff site manifests for
testing armada.

Change-Id: I5c07f19755731b6df678aad0c066cfe588c79a80
2023-05-09 13:50:15 +00:00
Sergiy Markin 09f207f257 Re-add missed paste module
This PS adds Paste module that was lost during py38/focal upgrade. Also airskiff gate has been altered to use focal image of armada as bionic to cover ubuntu releases change. Airskiff in treasuremap is still pointed to bionic while here we want to test focal in airskiff.

Change-Id: I3cb1eb6232a332707a1440d33d8908ae83603487
2023-05-03 14:17:40 +00:00
Sergiy Markin 386a686e69 [focal] Python modules sync with Airship project
- armada-airskiff-deploy is voting gate again
- fixed falcon.API deprecation - -> falcon.App
- fixed collections.abc.defaultdict not found error
- fixed tox4 requirements
- implemented requirements-frozen.txt approach to make allike as other
  Airship projects
- uplifted docker version in the image building and publishing gate

Change-Id: I337ec07cd6d082acabd9ad65dd9eefb728a43b12
2023-04-21 23:49:14 +00:00
SPEARS, DUSTIN (ds443n) 0e9d828fe6 Update armada to focal
Update kubernetes client to v26.1.0
Updating armada to focal base image
Remove xenial and opensuse dockerfiles
Update tox python from py35 to py38
Add apparmor for docker build
Uplift HTK chart version 0.2.52
Bumping up some python dependencies to get in sync with shipyard
Added clear-firewall role for airskiff-deploy playbook

Change-Id: If06a3f60466702d05a21c24a7cb8041bed41507a
2023-03-20 11:30:37 -04:00
Ruslan Aliev 379c88d619 Bump helm to v3.9.4 and k8s client to 24.2.0
Signed-off-by: Ruslan Aliev <raliev@mirantis.com>
Change-Id: I55d7b34e7525fe6359157d0fa042332a91ac9c95
2022-09-19 11:21:50 -05:00
Ruslan Aliev ef0ac2f252 Bump helm version from 3.6.3 to 3.8.2
Also bump k8s dependency to v1.23.

Signed-off-by: Ruslan Aliev <raliev@mirantis.com>
Change-Id: I188788a41419184cc3dd9172f54ab3a290cabe83
2022-06-30 22:19:56 -05:00
Phil Sphicas 7c432fdcb4 Update HTK stable commit (Ingress)
Update helm-toolkit to include updated Ingress templates that use
current API versions (i.e. networking.k8s.io/v1)

https://review.opendev.org/c/openstack/openstack-helm-infra/+/813115

Change-Id: I3cb054714f17d462550c89d15e3eb0ec2011177c
2021-10-18 11:49:58 -07:00
Sean Eagan 34ebac542b Helm 3: Fix Job labels
See the dependency below for details.

Depends-On: https://review.opendev.org/c/openstack/openstack-helm-infra/+/811826
Change-Id: Id1638ff32d134a598e9c1a73a4ea2532ca9785b8
2021-10-05 02:41:39 +00:00
Sean Eagan a5730f8db8 Remove Tiller
For now we leave the tiller status enpdpoint, until
Shipyard has had a release to stop depending on it [0].

[0]: https://review.opendev.org/c/airship/shipyard/+/802718

Signed-off-by: Sean Eagan <seaneagan1@gmail.com>
Change-Id: If8a02d7118f6840fdbbe088b4086aee9a18ababb
2021-10-05 02:41:32 +00:00
Sean Eagan f3842f9fe1 Use helm 3 in chart build
`helm serve` is removed in helm 3 so this moves
to using local `file://` dependencies [0] instead.

[0]: https://helm.sh/docs/chart_best_practices/dependencies/#repository-urls

Signed-off-by: Sean Eagan <seaneagan1@gmail.com>
Change-Id: I2282e231591a89073e65d9db3f59e1baea707380
2021-10-05 02:41:21 +00:00
Sean Eagan 5f1ffbbbbe Revert "Airship 2 support features"
This reverts commit c75898cd6a.

Airship 2 ended up using the Flux helm-controller instead:
https://github.com/fluxcd/helm-controller

So this is no longer needed. Removing it to get rid of tech
debt to ease introduction of Helm 3 support.

This retains the part of the commit which extracts the
chart download logic to its own handler as this is still useful.

Change-Id: Icb468be2d4916620fd78df250fd038ab58840182
2021-09-30 17:22:16 -05:00
Sean Eagan b37417253f Gate fixes
- Fix helm CLI download URL, the previous URL is no longer available,
  and is superceded by get.helm.sh
- Fix jsonschema dependency spec, 4.x alpha versions were causing the
  unit tests to fail for python 3.5
- Remove oslo.db dependency as it was not used and one of its recursive
  dependencies (tempita) was failing during setup

Change-Id: I03e8a738bb8aad620903119638210077d211770c
2021-09-30 17:21:33 -05:00
anthony.bellino 84edebc470 Gate fixes for Armada
* airskiff gate fixes
  - Pin treasuremap to v1.9 branch
  - Pin openstack-helm-infra to master
  - Remove openstack client setup as it's not used
* Pin typing-extensions to 3.7.2

Change-Id: I52bf733fb1d2b9164378729e17660ec401fbb89a
2021-06-02 14:45:14 -07:00
Phil Sphicas 77c0e6a7d4 Fix gates (helm install, xenial image)
* skip the repository update when running 'helm init'
* install pip < 21 in xenial dockerfile

Change-Id: I0ab40dc371b5632d8d4c11899b6340ade2b82455
2021-02-28 06:35:16 +00:00
Rick Bartra a5c9dc2194 fix: Docker image build jobs
Update the deb-docker path to fix the docker image build jobs

Change-Id: I494c31957d0a102f17e911c281015af0892fb70b
2020-09-22 14:08:22 +00:00
KAVVA, JAGAN MOHAN REDDY (jk330k) 36efc4828d Move Tiller version to 2.16.9
Update Helm chart for Armada to use Tiller version 2.16.9.

depends on: https://review.opendev.org/#/c/749497/

Change-Id: I16f7a5e8e571f067154e79a5f2ceb18be7d8db2d
2020-09-17 10:48:44 -05:00
Phil Sphicas 49d510cb69 Update HTK stable commit
Update helm-toolkit stable commit to merge of this change:
https://review.opendev.org/#/c/734702/

Change-Id: I43080b55f4938e3b1b3b5d33d0917f2be99768b4
2020-07-28 16:32:11 +00:00
DODDA, PRATEEK REDDY (PD2839) 70dfcae20a Ensure Pip3 is installed.
Use apt to install python3-pip, and use pip3 in event system has
both pip2 and pip3 installed.

Change-Id: I5a0eea3e06e2e9d135bb63cc35c3d281abd1ca10
2020-06-30 17:44:43 +00:00
Alexander Hughes c2d924aed0 Fix image build checks missing setuptools
Use apt to install python3-pip, and use pip3 in event system has
both pip2 and pip3 installed. Use apt to install setuptools for
Ansible's consumption.

Change-Id: I3a41426c2a4702f2efd4028c85f3680da275106f
Signed-off-by: Alexander Hughes <Alexander.Hughes@pm.me>
2020-06-17 08:39:45 -04:00
Sean Eagan c75898cd6a Airship 2 support features
Airship 2 is using Argo for workflow management, rather
than the builtin Armada workflow functionality. Hence, this
adds an apply_chart CLI command to apply a single chart at
a time, so that Argo can manage the higher level orchestration.

Airship 2 is also using kubernetes as opposed to Deckhand as the
document store. Hence this adds an ArmadaChart kubernetes CRD,
which can be consumed by the apply_chart CLI command. The chart
`dependencies` feature is intentionally not supported by the CRD,
as there are additional complexities to make that work, and ideally
this feature should be deprecated as charts should be building in
there dependencies before consumption by Armada.

Functional tests are included to excercise these features
against a minikube cluster.

Change-Id: I2bbed83d6d80091322a7e60b918a534188467239
2020-03-25 13:56:32 -05:00
Prateek Dodda 0b8b56bd21 Upadting the prefix numbering to match treasuremap
Change-Id: I5317aa8a4ad1a3106500aac6cb380fbb10862d29
2020-02-12 17:10:52 -06:00
Prateek Dodda 825e123fb9 Add Docker default AppArmor profile to armada
Change-Id: Iee43dfd56ecf5e4d18f93872b58359851c73d55f
2020-02-06 20:12:30 +00:00
Drew Walters 6d6bdf76bd CI: Use Ubuntu Bionic in jobs
Many of the supporting infrastructure used to run Armada jobs, adopted
form OpenStack-Helm infra, no longer supports Ubuntu Xenial. This change
changes the default job distribution to Bionic in order to consume new
infrastructure code changes.

Change-Id: I3a2f1f95eae98cacc08641dc64ba7afbee628284
Signed-off-by: Drew Walters <andrew.walters@att.com>
2020-02-06 13:22:04 -06:00
Samuel Pilla 50384e47c7 Upgrade Tiller to v2.16.1
This leaves support in Armada for tiller 2.13+ as
we don't use any new features since then, so don't
need to require a newer version.

Change-Id: I6e5343fe942794987bec140e23208dd04fcbfd44
2019-12-05 18:44:25 +00:00
Zuul 5fae57d179 Merge "Allow configuration of armada-api/tiller probes" 2019-10-11 14:33:38 +00:00
Itxaka d90eb125ed
Allow configuration of armada-api/tiller probes
Allows to configure the probes via values.yaml in both
the armada charts, which includes armada and tiller
containers, and in the standalone tiller chart

Also bumps the osh sha in tools/helm_tk.sh to latest
22ef25ab295d6b7c6797cfffaa77cf181c673e9b

Change-Id: I0bb0acf00ecc0b61f8d324fe9b6a8507c361e9fc
2019-10-07 20:49:26 +02:00
Drew Walters 19c2b1e299 CI: Build image after Docker installed in airskiff
The airskiff pipeline attempts to build the Armada Docker image before
Docker is installed. This change moves the order of the airskiff
pipeline tasks to build the Armada image AFTER Docker has been installed
by the OpenStack-Helm minikube script.

Change-Id: I3d531213c4787b7bbbc875a0257738a299359b1f
Signed-off-by: Drew Walters <andrew.walters@att.com>
2019-10-02 16:30:02 -05:00
Drew Walters 54406d8f96 CI: Remove call to deleted Airskiff script
Airskiff dependencies are installed from a script in the OpenStack-Helm
repository now, so the script was removed from treasuremap [0]. This
change removes a call to the deleted "000-install-packages.sh" script
that causes the Airskiff job to fail on changes submitted to the Armada
repository.

[0] https://review.opendev.org/672540

Change-Id: I21fb1370794b77435cdd53542ede339016b654e7
Signed-off-by: Drew Walters <andrew.walters@att.com>
2019-09-20 15:24:37 -05:00
Drew Walters 78eca357ac CI: Update Airskiff full-site manifest location
The location of the Airskiff site recently changed [0], causing the
Airskiff job to fail. This change updates the "reduce site" playbook to
match the job in treasuremap, thereby avoiding the directory which no
longer exists.

[0] https://review.opendev.org/674963

Change-Id: I660a02f43aff8c346df5229397353951d49986e7
Signed-off-by: Drew Walters <andrew.walters@att.com>
2019-08-21 20:47:20 +00:00
Michael Beaver fd0c7875ef Remove required-projects from Airskiff gate
This removes several of the the required-projects from the Airskiff
gate as the scripts for the gate can already clone down the necessary
repositories and the required-projects can overwrite and pins that may
have been included in the Airskiff scripts.

Change-Id: I065bdfd66a09c8515b6e55355d5282523699f9c4
2019-06-10 12:01:28 -05:00
Sean Eagan e51db14add Revert "Move to helm 2.14"
There is a breaking change in helm 2.14.0 [0]. This is expected to be fixed in helm 2.14.1, reverting until we can update to that.

[0]: https://github.com/helm/helm/issues/5750

This reverts commit 89d98fb827.

Change-Id: Ica6d51b5c67a26c356804fd69d466e88ad5c216b
2019-06-05 20:11:53 +00:00
Sean Eagan 89d98fb827 Move to helm 2.14
Change-Id: I6439650076b289d3983e119c06181baf6562ccc3
2019-05-17 11:50:19 -05:00
rajdharwadkar 2d82080249 Support armada to run on opensuse image leap15
Added Dockerfile for opensuse so it builds leap15 image
Modified to support multiple distros for image building.

Change-Id: Iffa7d0dbe4bc301e78a0bba1adc927d8aa2cbdcc
2019-05-06 10:06:46 -07:00
Drew Walters b881e176f5 CI: Update jobs for OpenDev
On April 19, OpenStack completed the migration from openstack.org to
opendev.org [0]. During this migration, Airship projects moved from the
"openstack" namespace to the "airship" namespace. This change removes
the "armada-" prefix from all jobs to reflect the new repository name
and fixes the Airskiff check job to use the correct OSH-infra relative
path.

[0] http://lists.openstack.org/pipermail/openstack-discuss/2019-April/005011.html

Change-Id: I7f261bb36676be9b8039778d87758186bfc94c65
2019-04-23 19:29:04 +00:00
OpenDev Sysadmins 567a7f992b OpenDev Migration Patch
This commit was bulk generated and pushed by the OpenDev sysadmins
as a part of the Git hosting and code review systems migration
detailed in these mailing list posts:

http://lists.openstack.org/pipermail/openstack-discuss/2019-March/003603.html
http://lists.openstack.org/pipermail/openstack-discuss/2019-April/004920.html

Attempts have been made to correct repository namespaces and
hostnames based on simple pattern matching, but it's possible some
were updated incorrectly or missed entirely. Please reach out to us
via the contact information listed at https://opendev.org/ with any
questions you may have.
2019-04-19 19:52:21 +00:00
Zuul fe8ad58605 Merge "CI: Add Airskiff check" 2019-04-17 21:56:35 +00:00
Zuul 1ff93d7fca Merge "CI: Add chart build job for latest Helm toolkit" 2019-04-17 16:19:05 +00:00
Drew Walters febf0d43a9 CI: Add Airskiff check
This commit adds a non-voting Zuul job that deploys Memcached using the
Airship-Treasuremap airskiff site and submitted Armada changes.

[0] https://airship-treasuremap.readthedocs.io/en/latest/airskiff.html

Change-Id: I597bef0f9cd7352c66ababa56ce7f396f6da88b0
2019-04-15 14:53:22 +00:00