Commit Graph

52 Commits

Author SHA1 Message Date
SPEARS, DUSTIN (ds443n) 7c1865b7db Update helm to v3.14.2
Change-Id: I6952261625d74a7a2205b34b3fe08b02afab6089
2024-03-15 14:04:42 -04:00
Sergiy Markin 03a55bbc31 Kubeadm based Airskiff gate
This PS replaces old airskiff integration gate
with new kubeadm based airskiff integration gate.
The main goal of this gate is to test new Armada
image and chart together with other Airship
components.

Change-Id: I2351b55fa136453a0a6a27a2875208c5e18e579e
2024-03-13 15:11:30 +00:00
Anselme, Schubert (sa246v) 5df69442b0 Deprecating the Ingress Class Annotation
Upgrading htk to version 0.2.55, which deprecates the ingress class
annotation (kubernetes.io/ingress.class) with .spec.ingressClassName

https://review.opendev.org/c/openstack/openstack-helm-infra/+/891720

Change-Id: I304b3239f6d9f1951de03bd821c8ba4c0a5b9a60
Signed-off-by: Anselme, Schubert (sa246v) <sa246v@att.com>
2023-10-05 22:55:39 +00:00
Sergiy Markin cdcdbd292d Airflow stable 2.6.2
This PS updates python modules and code to match Airflow 2.6.2:

- bionic py36 gates  were removed
- python code corrected to match new modules versions
- selection of python modules versions was perfoemed based on
  airflow-2.6.2 constraints
- airskiff deploy pipeline was aligned with latest in treasuremap v1.9

Change-Id: If6f57325339995216d2553c7a5ff56e7673b5acc
2023-08-19 00:37:37 +00:00
Sergiy Markin 25c3d621d6 Armada updates
This PS makes the following changes:

- makes sure the airskiff-deploy playbook is using 80Gb partition if
  available
- adds available security updates to docker images

Change-Id: I405743f9ae69194407bcc49a736b63e9993655c3
2023-08-18 21:53:29 +00:00
SPEARS, DUSTIN (ds443n) 4f43e2cc55 Update helm to 3.12.2
Also this PS updates airskiff deployment playbook based on the latest
treasuremap changes and makes sure the airskiff deployment uses freshly
built armada image.

Change-Id: I913f93d695e4068199e193a5839bf27e257a535e
2023-08-03 16:29:51 +00:00
Sergiy Markin 812546c875 Update armada image run test
This PS improves armada image run test by enriching it with config
generator. Also this test was removed from make images section of
Makefile. Build images zuul gate has make run_images task to test
the freshly built image now.

Change-Id: I87e089e5d268d248cda1dad1cd417694d166fdfb
2023-05-24 20:14:32 +00:00
Sergiy Markin 966742ec74 Restored ubuntu_bionic image build
This PS restores image build for ubuntu_bionic and adds appropriate
gates to keep it tested by appropriate functional and integratinal
tests.

Also the latest osh-infra commit was used with kubernetes 1.27.1 or
integration tests.

Make images section of Makefile was enriched with run_armada step in
order to quicktest the freshly built images - this is vital for focal
and bionic images differences.

Change-Id: Ida43eebd4aa51fff6261ac9cf5f8259359bc99a9
2023-05-19 13:52:30 +00:00
Sergiy Markin b778f9faf8 Update airskiff deployment gate
This PS updates armada to use new reliable airskiff site manifests for
testing armada.

Change-Id: I5c07f19755731b6df678aad0c066cfe588c79a80
2023-05-09 13:50:15 +00:00
Sergiy Markin 09f207f257 Re-add missed paste module
This PS adds Paste module that was lost during py38/focal upgrade. Also airskiff gate has been altered to use focal image of armada as bionic to cover ubuntu releases change. Airskiff in treasuremap is still pointed to bionic while here we want to test focal in airskiff.

Change-Id: I3cb1eb6232a332707a1440d33d8908ae83603487
2023-05-03 14:17:40 +00:00
Sergiy Markin 386a686e69 [focal] Python modules sync with Airship project
- armada-airskiff-deploy is voting gate again
- fixed falcon.API deprecation - -> falcon.App
- fixed collections.abc.defaultdict not found error
- fixed tox4 requirements
- implemented requirements-frozen.txt approach to make allike as other
  Airship projects
- uplifted docker version in the image building and publishing gate

Change-Id: I337ec07cd6d082acabd9ad65dd9eefb728a43b12
2023-04-21 23:49:14 +00:00
SPEARS, DUSTIN (ds443n) 0e9d828fe6 Update armada to focal
Update kubernetes client to v26.1.0
Updating armada to focal base image
Remove xenial and opensuse dockerfiles
Update tox python from py35 to py38
Add apparmor for docker build
Uplift HTK chart version 0.2.52
Bumping up some python dependencies to get in sync with shipyard
Added clear-firewall role for airskiff-deploy playbook

Change-Id: If06a3f60466702d05a21c24a7cb8041bed41507a
2023-03-20 11:30:37 -04:00
Sean Eagan 5f1ffbbbbe Revert "Airship 2 support features"
This reverts commit c75898cd6a.

Airship 2 ended up using the Flux helm-controller instead:
https://github.com/fluxcd/helm-controller

So this is no longer needed. Removing it to get rid of tech
debt to ease introduction of Helm 3 support.

This retains the part of the commit which extracts the
chart download logic to its own handler as this is still useful.

Change-Id: Icb468be2d4916620fd78df250fd038ab58840182
2021-09-30 17:22:16 -05:00
anthony.bellino 84edebc470 Gate fixes for Armada
* airskiff gate fixes
  - Pin treasuremap to v1.9 branch
  - Pin openstack-helm-infra to master
  - Remove openstack client setup as it's not used
* Pin typing-extensions to 3.7.2

Change-Id: I52bf733fb1d2b9164378729e17660ec401fbb89a
2021-06-02 14:45:14 -07:00
Rick Bartra a5c9dc2194 fix: Docker image build jobs
Update the deb-docker path to fix the docker image build jobs

Change-Id: I494c31957d0a102f17e911c281015af0892fb70b
2020-09-22 14:08:22 +00:00
DODDA, PRATEEK REDDY (PD2839) 70dfcae20a Ensure Pip3 is installed.
Use apt to install python3-pip, and use pip3 in event system has
both pip2 and pip3 installed.

Change-Id: I5a0eea3e06e2e9d135bb63cc35c3d281abd1ca10
2020-06-30 17:44:43 +00:00
Alexander Hughes c2d924aed0 Fix image build checks missing setuptools
Use apt to install python3-pip, and use pip3 in event system has
both pip2 and pip3 installed. Use apt to install setuptools for
Ansible's consumption.

Change-Id: I3a41426c2a4702f2efd4028c85f3680da275106f
Signed-off-by: Alexander Hughes <Alexander.Hughes@pm.me>
2020-06-17 08:39:45 -04:00
Sean Eagan c75898cd6a Airship 2 support features
Airship 2 is using Argo for workflow management, rather
than the builtin Armada workflow functionality. Hence, this
adds an apply_chart CLI command to apply a single chart at
a time, so that Argo can manage the higher level orchestration.

Airship 2 is also using kubernetes as opposed to Deckhand as the
document store. Hence this adds an ArmadaChart kubernetes CRD,
which can be consumed by the apply_chart CLI command. The chart
`dependencies` feature is intentionally not supported by the CRD,
as there are additional complexities to make that work, and ideally
this feature should be deprecated as charts should be building in
there dependencies before consumption by Armada.

Functional tests are included to excercise these features
against a minikube cluster.

Change-Id: I2bbed83d6d80091322a7e60b918a534188467239
2020-03-25 13:56:32 -05:00
Prateek Dodda 0b8b56bd21 Upadting the prefix numbering to match treasuremap
Change-Id: I5317aa8a4ad1a3106500aac6cb380fbb10862d29
2020-02-12 17:10:52 -06:00
Prateek Dodda 825e123fb9 Add Docker default AppArmor profile to armada
Change-Id: Iee43dfd56ecf5e4d18f93872b58359851c73d55f
2020-02-06 20:12:30 +00:00
Drew Walters 6d6bdf76bd CI: Use Ubuntu Bionic in jobs
Many of the supporting infrastructure used to run Armada jobs, adopted
form OpenStack-Helm infra, no longer supports Ubuntu Xenial. This change
changes the default job distribution to Bionic in order to consume new
infrastructure code changes.

Change-Id: I3a2f1f95eae98cacc08641dc64ba7afbee628284
Signed-off-by: Drew Walters <andrew.walters@att.com>
2020-02-06 13:22:04 -06:00
Drew Walters 19c2b1e299 CI: Build image after Docker installed in airskiff
The airskiff pipeline attempts to build the Armada Docker image before
Docker is installed. This change moves the order of the airskiff
pipeline tasks to build the Armada image AFTER Docker has been installed
by the OpenStack-Helm minikube script.

Change-Id: I3d531213c4787b7bbbc875a0257738a299359b1f
Signed-off-by: Drew Walters <andrew.walters@att.com>
2019-10-02 16:30:02 -05:00
Drew Walters 54406d8f96 CI: Remove call to deleted Airskiff script
Airskiff dependencies are installed from a script in the OpenStack-Helm
repository now, so the script was removed from treasuremap [0]. This
change removes a call to the deleted "000-install-packages.sh" script
that causes the Airskiff job to fail on changes submitted to the Armada
repository.

[0] https://review.opendev.org/672540

Change-Id: I21fb1370794b77435cdd53542ede339016b654e7
Signed-off-by: Drew Walters <andrew.walters@att.com>
2019-09-20 15:24:37 -05:00
Drew Walters 78eca357ac CI: Update Airskiff full-site manifest location
The location of the Airskiff site recently changed [0], causing the
Airskiff job to fail. This change updates the "reduce site" playbook to
match the job in treasuremap, thereby avoiding the directory which no
longer exists.

[0] https://review.opendev.org/674963

Change-Id: I660a02f43aff8c346df5229397353951d49986e7
Signed-off-by: Drew Walters <andrew.walters@att.com>
2019-08-21 20:47:20 +00:00
Michael Beaver fd0c7875ef Remove required-projects from Airskiff gate
This removes several of the the required-projects from the Airskiff
gate as the scripts for the gate can already clone down the necessary
repositories and the required-projects can overwrite and pins that may
have been included in the Airskiff scripts.

Change-Id: I065bdfd66a09c8515b6e55355d5282523699f9c4
2019-06-10 12:01:28 -05:00
rajdharwadkar 2d82080249 Support armada to run on opensuse image leap15
Added Dockerfile for opensuse so it builds leap15 image
Modified to support multiple distros for image building.

Change-Id: Iffa7d0dbe4bc301e78a0bba1adc927d8aa2cbdcc
2019-05-06 10:06:46 -07:00
Drew Walters b881e176f5 CI: Update jobs for OpenDev
On April 19, OpenStack completed the migration from openstack.org to
opendev.org [0]. During this migration, Airship projects moved from the
"openstack" namespace to the "airship" namespace. This change removes
the "armada-" prefix from all jobs to reflect the new repository name
and fixes the Airskiff check job to use the correct OSH-infra relative
path.

[0] http://lists.openstack.org/pipermail/openstack-discuss/2019-April/005011.html

Change-Id: I7f261bb36676be9b8039778d87758186bfc94c65
2019-04-23 19:29:04 +00:00
OpenDev Sysadmins 567a7f992b OpenDev Migration Patch
This commit was bulk generated and pushed by the OpenDev sysadmins
as a part of the Git hosting and code review systems migration
detailed in these mailing list posts:

http://lists.openstack.org/pipermail/openstack-discuss/2019-March/003603.html
http://lists.openstack.org/pipermail/openstack-discuss/2019-April/004920.html

Attempts have been made to correct repository namespaces and
hostnames based on simple pattern matching, but it's possible some
were updated incorrectly or missed entirely. Please reach out to us
via the contact information listed at https://opendev.org/ with any
questions you may have.
2019-04-19 19:52:21 +00:00
Zuul fe8ad58605 Merge "CI: Add Airskiff check" 2019-04-17 21:56:35 +00:00
Zuul 1ff93d7fca Merge "CI: Add chart build job for latest Helm toolkit" 2019-04-17 16:19:05 +00:00
Drew Walters febf0d43a9 CI: Add Airskiff check
This commit adds a non-voting Zuul job that deploys Memcached using the
Airship-Treasuremap airskiff site and submitted Armada changes.

[0] https://airship-treasuremap.readthedocs.io/en/latest/airskiff.html

Change-Id: I597bef0f9cd7352c66ababa56ce7f396f6da88b0
2019-04-15 14:53:22 +00:00
Scott Hussey f8bc1ccb85 [fix] Fix post pipeline image publish
- Set defaults so the Post Pipeline can successfully build images

Change-Id: I4d50e503b888c140433635090bddae96700fec0b
2019-04-03 12:56:57 -05:00
Drew Walters c6fb131022 CI: Add chart build job for latest Helm toolkit
This commit introduces a non-voting job to lint Helm charts against the
latest version of Helm toolkit from OpenStack-Helm Infra. This job
should serve as an indicator of when it's safe to advance the version of
Helm toolkit used by Airship.

Additionally, this commit modifies all Helm chart lint jobs to run on
each commit, regardless of the files modified by a change. This should
not introduce a noticeable difference in CI runtime, as these jobs
execute quicker than the tox jobs.

Change-Id: I6c205d983a9556120ec9ce7ed70a44e7286eb6dd
2019-04-03 14:24:21 +00:00
Thomas Bechtold ed0b94da64 Use python3 when creating the docker image tags
python2 will be gone away soon so switch to python3.

Change-Id: If0511db6fbd97fe72184b3fa1ef92f29f8cae4c7
2019-04-01 16:52:12 +00:00
Michael Beaver 3625acc1aa Fix gate failures for Docker and Pep8
- Zuul updated ansible to 2.7, no longer uses missing variables.
- Using an if to try and address.
- Fixes a few formatting problems that are causing the gates to fail

Docker fix based on Aaron Sheffield's PS for Pegleg:
https://review.openstack.org/#/c/645631/

Change-Id: I14e8f3aac0af7a3abc4e2b6c4ece292a24bc4c6a
2019-03-22 13:46:32 -05:00
Drew Walters 3abea31a1f CI: Add chart build gate
This commit introduces a chart build gate that triggers when changes are
made to charts in the charts/ directory.

Change-Id: Ieec10c36adfd0538e70ac47ad30ce314f24f712f
2019-01-28 11:35:58 -06:00
Drew Walters 0d65744779 CI: Remove OpenStack-Helm-Infra CI job
Currently, the airship-armada-ubuntu job deploys K8s using outdated
playbooks. The job fails due to a change [0] that introduced an AppArmor
requirement to Calico. This change removes the failing job, as its
success does not depend on changes in Armada. In the future, jobs
requiring K8s should be deployed using playbooks from
Airship-Treasuremap [1].

[0] https://review.openstack.org/614805
[1] https://git.openstack.org/cgit/openstack/airship-treasuremap/tree/tools/deployment/airskiff/developer/010-deploy-k8s.sh

Change-Id: I40dc1e0ccfd956c157a6bef60f106eb9c5e9ca04
2019-01-17 09:52:58 -06:00
Felipe Monteiro 501d1e13b3 Remove redundant pep8 job from .zuul.yaml
This patch set drops a redundant pep8 job from .zuul.yaml.
openstack-tox-pep8 is already as a job, so
airship-armada-lint-pep8 can be dropped.

Change-Id: Iaaa0c8d34a2de93b7f105f7c686951df4e3b6824
2018-10-17 09:13:58 -04:00
Felipe Monteiro 0aa0935c7c chore: Combine pep8 with whitespace linter
This patch set combines whitespace linter and pep8 together
(as both do code linting) into the same job by dropping the
.zuul.yaml whitespace-linter job and rolling it up into the
same pep8 tox.ini check, just like Deckhand [0].

[0] 0462b7b929/tox.ini (L106)

Change-Id: I31ed60adfd431157ffc96a0f4d5d77d54af37352
2018-10-14 17:52:32 -04:00
Zuul 7c1d81f86c Merge "Fix: git commit id labels on images" 2018-09-25 16:45:38 +00:00
Roman Gorshunov eee43c42a8 Unify publishing of docs
Unified publishing to the readthedocs with other Airship projects.

Change-Id: Ibce2e138abbc9b3c08d213dcfa6358ca8134c898
2018-09-24 17:10:29 +02:00
Roman Gorshunov 09f099e5b2 Fix: various documentation and URL fixes
1) UCP -> Airship
2) readthedocs.org -> readthedocs.io (there is redirect)
3) http -> https
4) attcomdev -> airshipit (repo on quay.io)
5) att-comdev -> openstack/airship-* (repo on github/openstack git)
6) many URLs have been verified and adjusted to be current
7) no need for 'en/latest/' path in URL of the RTD
8) added more info to some setup.cfg and setup.py files
9) ucp-integration docs are now in airship-in-a-bottle
10) various other minor fixes

Change-Id: I1e2d133a701dc2dade5bfcbdab5c0950cbe7eed5
2018-09-24 12:53:27 +02:00
Roman Gorshunov b6358d24b9 Fix: git commit id labels on images
1) Use OCI Image Specs for labels instead of custom 'commit-id=xxxxx'
   or legacy "Label Schema"
2) Fix missing git commit id labels on images (.revision)
3) Add human-readable title (.title) of the image, URL (.url), and
   a few other properties (annotations) according to the latest Specs

Change-Id: I7029d7caf521c7f56c1046fff9ecdd4e81090618
2018-09-21 03:31:12 +02:00
Jerome Brette da408ff145 Update Dockerfile to allow override of FROM variable
1. The first goal is to let user customize the base image of the component
by passing FROM=myimage during the build process. This would let any
project leveraging Airship ensure that the base image is matching the
security requirements for that project. This will also ease the control of
the /etc/apt/source.list and thereby the result of apt-get update/upgrade
procedure.
2. The above goal is achievable by using docker-ce feature such as:
ARG FROM="defaultbaseimage:xx"
FROM ${FROM}
For this reason, the installation of docker.io in the Zuul gating is beeing
replaced by docker-ce.
3. Third Goal is to bring consistency with the other compoenents leveraging
Helm such as the openstack-helm and potentially use bindep the same way
the LOCI images are to ensure
4. The new syntax in the Dockerfile is still commented out until the associated
image builder have been updated to use docker-ce as they have been for the LOCI
images.

Change-Id: Id91284433d6e4c3560ce5b261f29cc5f2e8e6048
2018-07-17 13:07:12 -05:00
Felipe Monteiro aff6a8723e Job fix: update osh-infra-deploy-docker.yaml to align with osh
This patchset updates osh-infra-deploy-docker.yaml playbook
to align with role rename change in osh-infra causing pre-run
to fail: https://review.openstack.org/#/c/578703/6

Change-Id: Ifa06777ca762d8b8bcca86d62b620ec784f9c7ad
2018-07-02 22:14:20 -04:00
Tin Lam 1ffdf2ef57 refactor(gate): refactor rtd trigger
This patch set uses the same mechanism as airship-deckhand to trigger
the readthedoc publish job in the post pipeline.

Change-Id: If750baebef23bf84c7ccf5d8e3ab6335f97bdfb6
Signed-off-by: Tin Lam <tin@irrational.io>
2018-06-28 19:05:49 +00:00
Tin Lam c17f14f058 chore(rtd): add a rtd publish trigger
This patch set adds in a trigger on post to trigger a RTD job to start
building the documentation merged.

Change-Id: I6ffcaeced19d75e39055e73770070d3388238bd5
Signed-off-by: Tin Lam <tin@irrational.io>
2018-06-20 18:05:45 +00:00
Tin Lam 7bf09083f9 chore(gate): remove redundant job
Now that py35 unit test is being managed by openstack-infra we should
no longer maintain a separate and duplicate job within the project.

Change-Id: Id4aba529179434ad18b54772d425754162579b13
Signed-off-by: Tin Lam <tin@irrational.io>
2018-06-14 00:22:49 -05:00
Scott Hussey 3a97f2c9e7 (zuul) Add docker image publishing
- Add check and gate jobs for image building
- Add post jobs for image building and publishing

Change-Id: I7ac79bb3640d0cf07c6bb4d50013472cf5c144c4
2018-06-07 16:29:52 -05:00
Tin Lam 333f4ba284 chore(bandit): add bandit
This patch set puts the bandit check as part of the pep8 gating job
for airship-armada and remove the separate bandit gate.

Change-Id: I3871bb20f04aedb80a1ffca4038e94a156156a14
Signed-off-by: Tin Lam <tin@irrational.io>
2018-06-03 20:31:24 -05:00