This PS replaces old airskiff integration gate
with new kubeadm based airskiff integration gate.
The main goal of this gate is to test new Armada
image and chart together with other Airship
components.
Change-Id: I2351b55fa136453a0a6a27a2875208c5e18e579e
Upgrading htk to version 0.2.55, which deprecates the ingress class
annotation (kubernetes.io/ingress.class) with .spec.ingressClassName
https://review.opendev.org/c/openstack/openstack-helm-infra/+/891720
Change-Id: I304b3239f6d9f1951de03bd821c8ba4c0a5b9a60
Signed-off-by: Anselme, Schubert (sa246v) <sa246v@att.com>
This PS updates python modules and code to match Airflow 2.6.2:
- bionic py36 gates were removed
- python code corrected to match new modules versions
- selection of python modules versions was perfoemed based on
airflow-2.6.2 constraints
- airskiff deploy pipeline was aligned with latest in treasuremap v1.9
Change-Id: If6f57325339995216d2553c7a5ff56e7673b5acc
This PS makes the following changes:
- makes sure the airskiff-deploy playbook is using 80Gb partition if
available
- adds available security updates to docker images
Change-Id: I405743f9ae69194407bcc49a736b63e9993655c3
Also this PS updates airskiff deployment playbook based on the latest
treasuremap changes and makes sure the airskiff deployment uses freshly
built armada image.
Change-Id: I913f93d695e4068199e193a5839bf27e257a535e
This PS improves armada image run test by enriching it with config
generator. Also this test was removed from make images section of
Makefile. Build images zuul gate has make run_images task to test
the freshly built image now.
Change-Id: I87e089e5d268d248cda1dad1cd417694d166fdfb
This PS restores image build for ubuntu_bionic and adds appropriate
gates to keep it tested by appropriate functional and integratinal
tests.
Also the latest osh-infra commit was used with kubernetes 1.27.1 or
integration tests.
Make images section of Makefile was enriched with run_armada step in
order to quicktest the freshly built images - this is vital for focal
and bionic images differences.
Change-Id: Ida43eebd4aa51fff6261ac9cf5f8259359bc99a9
This PS adds Paste module that was lost during py38/focal upgrade. Also airskiff gate has been altered to use focal image of armada as bionic to cover ubuntu releases change. Airskiff in treasuremap is still pointed to bionic while here we want to test focal in airskiff.
Change-Id: I3cb1eb6232a332707a1440d33d8908ae83603487
- armada-airskiff-deploy is voting gate again
- fixed falcon.API deprecation - -> falcon.App
- fixed collections.abc.defaultdict not found error
- fixed tox4 requirements
- implemented requirements-frozen.txt approach to make allike as other
Airship projects
- uplifted docker version in the image building and publishing gate
Change-Id: I337ec07cd6d082acabd9ad65dd9eefb728a43b12
Update kubernetes client to v26.1.0
Updating armada to focal base image
Remove xenial and opensuse dockerfiles
Update tox python from py35 to py38
Add apparmor for docker build
Uplift HTK chart version 0.2.52
Bumping up some python dependencies to get in sync with shipyard
Added clear-firewall role for airskiff-deploy playbook
Change-Id: If06a3f60466702d05a21c24a7cb8041bed41507a
This reverts commit c75898cd6a.
Airship 2 ended up using the Flux helm-controller instead:
https://github.com/fluxcd/helm-controller
So this is no longer needed. Removing it to get rid of tech
debt to ease introduction of Helm 3 support.
This retains the part of the commit which extracts the
chart download logic to its own handler as this is still useful.
Change-Id: Icb468be2d4916620fd78df250fd038ab58840182
Use apt to install python3-pip, and use pip3 in event system has
both pip2 and pip3 installed. Use apt to install setuptools for
Ansible's consumption.
Change-Id: I3a41426c2a4702f2efd4028c85f3680da275106f
Signed-off-by: Alexander Hughes <Alexander.Hughes@pm.me>
Airship 2 is using Argo for workflow management, rather
than the builtin Armada workflow functionality. Hence, this
adds an apply_chart CLI command to apply a single chart at
a time, so that Argo can manage the higher level orchestration.
Airship 2 is also using kubernetes as opposed to Deckhand as the
document store. Hence this adds an ArmadaChart kubernetes CRD,
which can be consumed by the apply_chart CLI command. The chart
`dependencies` feature is intentionally not supported by the CRD,
as there are additional complexities to make that work, and ideally
this feature should be deprecated as charts should be building in
there dependencies before consumption by Armada.
Functional tests are included to excercise these features
against a minikube cluster.
Change-Id: I2bbed83d6d80091322a7e60b918a534188467239
Many of the supporting infrastructure used to run Armada jobs, adopted
form OpenStack-Helm infra, no longer supports Ubuntu Xenial. This change
changes the default job distribution to Bionic in order to consume new
infrastructure code changes.
Change-Id: I3a2f1f95eae98cacc08641dc64ba7afbee628284
Signed-off-by: Drew Walters <andrew.walters@att.com>
The airskiff pipeline attempts to build the Armada Docker image before
Docker is installed. This change moves the order of the airskiff
pipeline tasks to build the Armada image AFTER Docker has been installed
by the OpenStack-Helm minikube script.
Change-Id: I3d531213c4787b7bbbc875a0257738a299359b1f
Signed-off-by: Drew Walters <andrew.walters@att.com>
Airskiff dependencies are installed from a script in the OpenStack-Helm
repository now, so the script was removed from treasuremap [0]. This
change removes a call to the deleted "000-install-packages.sh" script
that causes the Airskiff job to fail on changes submitted to the Armada
repository.
[0] https://review.opendev.org/672540
Change-Id: I21fb1370794b77435cdd53542ede339016b654e7
Signed-off-by: Drew Walters <andrew.walters@att.com>
The location of the Airskiff site recently changed [0], causing the
Airskiff job to fail. This change updates the "reduce site" playbook to
match the job in treasuremap, thereby avoiding the directory which no
longer exists.
[0] https://review.opendev.org/674963
Change-Id: I660a02f43aff8c346df5229397353951d49986e7
Signed-off-by: Drew Walters <andrew.walters@att.com>
This removes several of the the required-projects from the Airskiff
gate as the scripts for the gate can already clone down the necessary
repositories and the required-projects can overwrite and pins that may
have been included in the Airskiff scripts.
Change-Id: I065bdfd66a09c8515b6e55355d5282523699f9c4
Added Dockerfile for opensuse so it builds leap15 image
Modified to support multiple distros for image building.
Change-Id: Iffa7d0dbe4bc301e78a0bba1adc927d8aa2cbdcc
On April 19, OpenStack completed the migration from openstack.org to
opendev.org [0]. During this migration, Airship projects moved from the
"openstack" namespace to the "airship" namespace. This change removes
the "armada-" prefix from all jobs to reflect the new repository name
and fixes the Airskiff check job to use the correct OSH-infra relative
path.
[0] http://lists.openstack.org/pipermail/openstack-discuss/2019-April/005011.html
Change-Id: I7f261bb36676be9b8039778d87758186bfc94c65
This commit introduces a non-voting job to lint Helm charts against the
latest version of Helm toolkit from OpenStack-Helm Infra. This job
should serve as an indicator of when it's safe to advance the version of
Helm toolkit used by Airship.
Additionally, this commit modifies all Helm chart lint jobs to run on
each commit, regardless of the files modified by a change. This should
not introduce a noticeable difference in CI runtime, as these jobs
execute quicker than the tox jobs.
Change-Id: I6c205d983a9556120ec9ce7ed70a44e7286eb6dd
- Zuul updated ansible to 2.7, no longer uses missing variables.
- Using an if to try and address.
- Fixes a few formatting problems that are causing the gates to fail
Docker fix based on Aaron Sheffield's PS for Pegleg:
https://review.openstack.org/#/c/645631/
Change-Id: I14e8f3aac0af7a3abc4e2b6c4ece292a24bc4c6a
This commit introduces a chart build gate that triggers when changes are
made to charts in the charts/ directory.
Change-Id: Ieec10c36adfd0538e70ac47ad30ce314f24f712f
This patch set drops a redundant pep8 job from .zuul.yaml.
openstack-tox-pep8 is already as a job, so
airship-armada-lint-pep8 can be dropped.
Change-Id: Iaaa0c8d34a2de93b7f105f7c686951df4e3b6824
This patch set combines whitespace linter and pep8 together
(as both do code linting) into the same job by dropping the
.zuul.yaml whitespace-linter job and rolling it up into the
same pep8 tox.ini check, just like Deckhand [0].
[0] 0462b7b929/tox.ini (L106)
Change-Id: I31ed60adfd431157ffc96a0f4d5d77d54af37352
1) UCP -> Airship
2) readthedocs.org -> readthedocs.io (there is redirect)
3) http -> https
4) attcomdev -> airshipit (repo on quay.io)
5) att-comdev -> openstack/airship-* (repo on github/openstack git)
6) many URLs have been verified and adjusted to be current
7) no need for 'en/latest/' path in URL of the RTD
8) added more info to some setup.cfg and setup.py files
9) ucp-integration docs are now in airship-in-a-bottle
10) various other minor fixes
Change-Id: I1e2d133a701dc2dade5bfcbdab5c0950cbe7eed5
1) Use OCI Image Specs for labels instead of custom 'commit-id=xxxxx'
or legacy "Label Schema"
2) Fix missing git commit id labels on images (.revision)
3) Add human-readable title (.title) of the image, URL (.url), and
a few other properties (annotations) according to the latest Specs
Change-Id: I7029d7caf521c7f56c1046fff9ecdd4e81090618
1. The first goal is to let user customize the base image of the component
by passing FROM=myimage during the build process. This would let any
project leveraging Airship ensure that the base image is matching the
security requirements for that project. This will also ease the control of
the /etc/apt/source.list and thereby the result of apt-get update/upgrade
procedure.
2. The above goal is achievable by using docker-ce feature such as:
ARG FROM="defaultbaseimage:xx"
FROM ${FROM}
For this reason, the installation of docker.io in the Zuul gating is beeing
replaced by docker-ce.
3. Third Goal is to bring consistency with the other compoenents leveraging
Helm such as the openstack-helm and potentially use bindep the same way
the LOCI images are to ensure
4. The new syntax in the Dockerfile is still commented out until the associated
image builder have been updated to use docker-ce as they have been for the LOCI
images.
Change-Id: Id91284433d6e4c3560ce5b261f29cc5f2e8e6048
This patchset updates osh-infra-deploy-docker.yaml playbook
to align with role rename change in osh-infra causing pre-run
to fail: https://review.openstack.org/#/c/578703/6
Change-Id: Ifa06777ca762d8b8bcca86d62b620ec784f9c7ad
This patch set uses the same mechanism as airship-deckhand to trigger
the readthedoc publish job in the post pipeline.
Change-Id: If750baebef23bf84c7ccf5d8e3ab6335f97bdfb6
Signed-off-by: Tin Lam <tin@irrational.io>
This patch set adds in a trigger on post to trigger a RTD job to start
building the documentation merged.
Change-Id: I6ffcaeced19d75e39055e73770070d3388238bd5
Signed-off-by: Tin Lam <tin@irrational.io>
Now that py35 unit test is being managed by openstack-infra we should
no longer maintain a separate and duplicate job within the project.
Change-Id: Id4aba529179434ad18b54772d425754162579b13
Signed-off-by: Tin Lam <tin@irrational.io>
This patch set puts the bandit check as part of the pep8 gating job
for airship-armada and remove the separate bandit gate.
Change-Id: I3871bb20f04aedb80a1ffca4038e94a156156a14
Signed-off-by: Tin Lam <tin@irrational.io>