This PS bumps up Airflow version to the latest
2.8.2 and also bumps up openstack dependences to
Antelope 2023.1
Change-Id: I1ab801527dacb7c667caf1d459d71f9df522cef6
This PS updates python modules and code to match Airflow 2.6.2
- bionic py36 gates were removed
- python code corrected to match new modules versions
- selection of python modules versions was performed based on
airflow-2.6.2 constraints
- a new pegleg validation gate was created based on airskiff deploy
pipeline from treasuremap v1.9
Change-Id: Icc96deb0b745eaab7a19d83b00aad909dcd28c25
This PS restores image build for ubuntu_bionic and adds appropriate
gates to keep it tested by appropriate functional and integrational
tests.
Change-Id: Id31d97ced8732d823937fb1f218e7ad8760d735c
This PS delivers focal version of Pegleg image and has the following updates:
- removed release-notes-jobs-python3 gate job because of incompartibility with Sphinx from current requirements
- added focal gate node and switched gates to use it
- added bindep.txt file into project root
- added bindep role into gate jobs
- added ubuntu_focal dockerfile for building focal pegleg image
- switched tox profiles to py38
- uplifted references to shipyard_client, promenade and deckhand projects
- resolved required dependencies conflicts by weakening constraints in Pipfile
- updated tox profile update-requirements for generate requirements.txt and test-requirements.txt
- generated new Pipfile.lock, requirements.txt and test-requirements.txt from Pipfile
- switched tox profiles to use requirements.txt and test-requirements.txt instead of pipenv because of upstream zuul nodes Pypi mirrorring issue
- updated reference to seaworthy site certificates in treasuremap repo
- fixed unit tests issues caused by pytest/mock updates and new openssl version
- fixed focal docker image publishing issue
- added multiprocessing into coverage tests running process
- made unit and coveraget tests more verbosive
Change-Id: I5c4c519dc725cfb8c7b4e14756347c9336028aff
* disable python 35, leave only 36
* switch to bionic nodeset only
* update requirements.txt, Pipfile and lock
Signed-off-by: Ruslan Aliev <raliev@mirantis.com>
Change-Id: Ia3c4df9d1f39f0f2cebf8ba0d89aebc5eec6f674
This commit updates the Pegleg pep8 gate to use Ubuntu 18.04 (bionic) as
the base Ubuntu image for the job. Upstream CI has a community goal to
use Ubuntu 20.04 (focal) which defaults to python3.8. By moving to
python3.8, some of the pip packages need to be updated but until pip
conflicts are resolved, it is difficult to do so. Aside from that, the
functional gates are continuing to use Ubuntu 18.04.
Additionally, update the deb-docker path.
Change-Id: I599d8b8973a893a2112ff1219e10c19534c2c962
This change makes zuul jobs configurable on project level using variables.
That allows to reuse same jobs in other zuul setup with different base images,
docker registry and proxy settings.
Change-Id: I301ea09f42bc1498d3cba45eede075e0d5a6f8fa
Upgrades Deckhand to revision supporting six 1.12.0
https://review.opendev.org/#/c/677272/
Installs python3 and overrides python3-six version in OpenSUSE image
Reenables OpenSUSE image build gate
Change-Id: Id72dad8e3668d77b06aa8af4278fcdff0cb678eb
Opensuse leap 15.1 image was updated recently, and is causing
failures when trying to build. Making gate non voting until it is
resolved.
Change-Id: I9d046cf57a66efdee255352242b26fd12c29362d
Pipenv is a tool that brings better package dependency management to
python. It can automatically create and manage virtualenv as well as
managing package dependencies using Pipfile and Pipfile.lock. Adding
this dependency manager into Airship projects will decrease package
version conflicts between projects and help increase security through
hash validation of packages and vulnerability scans.
Changes:
- Imports requirements.txt type files into Pipfile
- Pipenv dependency management in tox
- Switches Safety package for "pipenv check", an implementation of
Safety
- Adds `-e` flag on VCS dependencies to resolve good versions on all
packages
- Unpins or loosens pins on "dev"-type packages
Pipenv Docs: https://docs.pipenv.org/en/latest/
Helpful Pipenv Guide: https://realpython.com/pipenv-guide/
Change-Id: I47e7e7b440d76103b4984499e6ffce4482a59353
Fixes dependency-vulnerability-check from [0] with pegleg prefix as I
didn't realize job names cannot overlap between projects.
[0] https://review.opendev.org/#/c/671860/
Change-Id: I124ac66a48ce52ef940b8838a80914b6e09ac52d
Moves safety checks from pep8 linting to a new Zuul job. This allows
voting to be disabled on the job when the safety check database is down.
Changes basepython to python3 for safety job.
Change-Id: I29af8af244d45fbbe008c5efc341c1407c809539
I hvae not noticed any instability with OpenSUSE build jobs in the
last week, re-adding these as voting jobs.
Change-Id: I937a453c3c3c39a1e55ee337dcd8a661fc681cf0
OpenSuse mirrors are down blocking development work. This happens
fairly frequently. Making OpenSuse build gates non-voting until
OpenSuse mirrors become stable.
Change-Id: Ie2b4b075c0eed21bf484b6d66c25c2dd61de818f
From community meeting on 04-June-2019 Ubuntu Xenial is the default
image for Airship projects, but a desire was voiced to also add support
for Ubuntu Bionic at the convenience of the contributors for each
project.
This patch:
1. Adds a new dockerfile specific to ubuntu:18.04 (bionic)
2. Updates gates to be specific about which ubuntu image is being
checked.
3. Add to .zuul.yaml checks/gates/post jobs for bionic
Change-Id: Ib10641656f48baffec5b03ec48bf864d67209289
This patch brings Pegleg in line with other Airship projects in their
method of updating documentation. This is achieved by:
1. Adding docs-on-readthedocs job
2. Adding readthedocs webhook and project name vars used for Pegleg
3. Removing airship-pegleg-doc-build
4. Removing doc-build playbook
Change-Id: Iaa4139ccb1cd9d7ca20a6b502ef2a152908147d0
Add DISTRO parameter to support multiple distros
Add Dockerfile for opensuse to build leap 15 image.
Change-Id: I7a529476937494e042a4801117489325aa6621c7
This allows Pegleg unit tests to be run against py37 interpreter
as py37 is the latest version of Python supported under OpenStack
and eventually most projects, including Pegleg, will likely use
it as its default interpreter.
Change-Id: I6bfe5b10a73b29edaed0a58e563c14aefb5dc043
The openstack-python36-jobs template already exists; thus there
is no need for airship-pegleg-tox-py36. Since airship-pegleg-tox-py36
installs cfssl as a prerequisite for unit tests, move the install-cfssl.sh
command to tox.ini prior to unit test execution, allowing for the
airship-pegleg-tox-py36 Zuul job and its associated playbook to be
removed.
Change-Id: I66de957a1a57ef246476c1a81954cd0f822cb8be
This patch set adds releasenotes (reno) to the airship-pegleg repository.
Change-Id: I1ed98460f40eb851ca53f8a5b68ab17f8272a2e2
Signed-off-by: Tin Lam <tin@irrational.io>
Consolidating all the linting to a single job rather than having a one-off
just to lint for trailing whitespaces. As most of this projects are python,
this should already be covered by PEP8, but will be scanning for yamls with
trailing whitespaces.
Change-Id: Iee33a69ff234d21c08217faa33a19e11dfef0ad9
Signed-off-by: Tin Lam <tin@irrational.io>
As the default Docker image support for Pegleg is using py36 as a base
image, this patch set simply removes the support for py35. This allows
us to use py36 features such as secrets and f-strings without needing to
cope with backward compatibility.
Change-Id: Ic156ca67d2a0fe6fdc74c2c9da253a1cb8a3f456
Signed-off-by: Tin Lam <tin@irrational.io>
This patch set adds in a python coverage job for pegleg using pytest.
Change-Id: Ice0332cc454f488e0372d5ab03e8b0a37db9efd1
Signed-off-by: Tin Lam <tin@irrational.io>
This patch set standardizes the Pegleg directory
structure because of the following reasons:
1) src/bin/pegleg is not necessary and only makes
building (e.g. documentation building) and running
of tox targets unnecessarily difficult.
2) src/bin/pegleg is a Java-like standard that
bears no relevance to Python.
Change-Id: I37d39d3d6186b92f8fbfe234221c9e44da48cf10
This is a mechanically generated patch to add a unit test job running
under Python 3.6 as part of the python3-first goal.
See the python3-first goal document for details:
https://governance.openstack.org/tc/goals/stein/python3-first.html
Change-Id: Ie2187958a3090e05902c51d1aa5d9acacf508c2c
Story: #2002586
This renames docs/ => doc/ in .zuul.yaml ignore-files
stanza as Pegleg documentation directory was renamed to doc/
Change-Id: Ice37901d3a4fbb1f5978a847a83320873a451e82
This change adds the global zuul pep8 tox job, which runs both
bandit and pep8 using tox. This also removes the two other airship
specific lint-pep8 and bandit zuul jobs since they are both covered
by the default openstack global one.
Also cleaned up the tox.ini by moving the requirements into the
test-requirements.txt file.
Change-Id: Iab37a8090515936732e390b1f7c6d281e014e31c
This patchset either expands on existing entries in irrelevant-files
or adds irrelevant-files to various jobs to save on resources
in Zuul.
Change-Id: I6a3c052c3982a70160a6bee9a07975201eee1f0a
This PS adds the skeleton for a set of zuul checks and gates for
Airship, using the framework from OpenStack-Helm.
Change-Id: I4cc071d0076e265e5c34f15616ccf40c0b3a83a8
Sergiy Markin