Commit Graph

36 Commits

Author SHA1 Message Date
Sergiy Markin f99abfa433 Airflow stable 2.6.2
This PS updates python modules and code to match Airflow 2.6.2:

- bionic py36 gates  were removed
- python code corrected to match new modules versions
- selection of python modules versions was perfrmed based on
  airflow-2.6.2 constraints
- postgresql image updated to 14.8

Change-Id: Ibdcc75e600166c20b842508aa5539587cca466f0
2023-08-29 00:50:54 +00:00
Sergiy Markin 73d22a488f Restored ubuntu_bionic image build
This PS restores image build for ubuntu_bionic and adds appropriate
gates to keep it tested by appropriate functional and integrational
tests.

Change-Id: I695fb42efff29aeda737f2b9c1eaeb84b95aa57c
2023-05-24 18:37:21 +00:00
Sergiy Markin d00eaf0303 Drydock focal related upgrades
This PS implements the following changes:
- switches freeze approach to requirements-direct.txt and
  requirements-frozen.txt files
- adjusts code tabulation style according to  yapf recommendations
- replaces deprecated usage of responce.body attribute with
  responce.text
- fixes integration tests in controlled by Makefile + tox
- uplifts Helm to v3.9.4

Change-Id: I751db72eb8f670825382f11a36657112faeb169a
2023-04-26 22:32:49 +00:00
Sergiy Markin 415a8b52c5 [focal] Python modules sync with Airship project
- uplifted some python modules
- fixed tox4 requirements
- added focal build node as a default one
- added bindep.txt and bindep role to playbooks and docker image build process
- changes Makefile to reflect GoLang and dependency management changes
- upgraded Helm to v3 for chart build process
- uplifted postgresql version to 14.6
- fixed deprecated falcon.API - replaced with falcon.APP
- fixed upstream docker image publishing process

Change-Id: I307d72bb7680f6f5c71e42ad30666cf786420460
2023-04-08 08:20:22 +00:00
Markin, Sergiy (sm515x) b431f7a2cf [NIC Card Auto-Detect] NIC Card Auto-Detect
This patch is an addition to this patchset:

https://review.opendev.org/c/airship/drydock/+/850579

It adds more debug messages.

Change-Id: I01061934f5584276e461ef7a7f4c7a87c30755af
2022-08-02 14:54:27 +00:00
Markin, Sergiy (sm515x) afdfa33099 [NIC Card Auto-Detect] NIC Card Auto-Detect
This patch adds an ability to match several NIC addresses by one
hardware profile by using regex as the address. The regex expression has
to have regex: prefix in order to be recognized.

Change-Id: I0bb067fb1783725e4ac485683eb898d5fc2d7bf2
2022-07-20 20:09:43 +00:00
Phil Sphicas caa7f22b50 Accelerate YAML operations with LibYAML
Patch PyYAML (via the pylibyaml library) to automatically enable the
LibYAML parser and emitter, which are faster than the Python versions.

https://pypi.org/project/pylibyaml/

Change-Id: Iaddc0f30ed99b1f9a999f5365e9e8bf43349b82f
2020-09-25 08:07:49 +00:00
Phil Sphicas 93f593f568 Support binary prefixes for node storage size
This change allows node storage sizes to be specified using binary
prefixes (MiB, GiB, TiB) in addition to the existing supported formats
(MB, GB, TB).

Change-Id: Idef88b648a75bad87625acf1d73af011480cc0b9
2020-06-02 07:11:13 +00:00
Alexander Hughes 1755930331 Address PEP8 Failures in Drydock
Flake8 version recently updated to include new PEP8 rules. Some of
the codebase is not compliant with the new rules.

Change-Id: I0f5b3d41ee54ff0d9ffa05f733f98c7e34f0f258
Signed-off-by: Alexander Hughes <Alexander.Hughes@pm.me>
2020-05-12 18:27:06 +00:00
BARTRA, RICK fdb6dcaca6 Add CIDR validation for MAAS
MAAS only accepts CIDR IPs that do not have host bits set otherwise
MAAS sees the CIDR as a second network. This commit adds a Drydock
validation that checks if the CIDR has host bits and also suggests
which CIDR to use if the provided one is not acceptable to MAAS.

Change-Id: Ib6d4d8277d0e1634524426a08e138e39fb37f14b
2019-04-16 21:34:10 +00:00
Smruti Soumitra Khuntia d12aa27712 End user logging for audit traceabilty
Changes for Client to support new end user header
and add end user name to logs.

Change-Id: Iea1e42eafa573960735415ce337a1558b864edfc
2019-04-01 10:07:34 +00:00
Zuul c76fda6ac4 Merge "Validate mountpoint in a HostProfile" 2018-12-26 15:28:40 +00:00
Zuul 485f919822 Merge "(fix) Use endpoint for MAAS URL" 2018-12-04 14:25:20 +00:00
Scott Hussey a2418241ce (fix) Use endpoint for MAAS URL
- Instead of forcing a user to provide the full URL for the MAAS API,
  instead use the endpoints pattern and render the URI via HTK templates.
- Add secret name to chart to support HTK ingress
- Install libyaml to take advantage of faster parsing by pyyaml
- Add exception logging when node compiling fails.
- Add caching of parsed design to gain efficiency
- Add TLS certificate secret for use by the ingress document

Change-Id: I5a2dbc415483c336d38d67edcebdfc5812f7bb0c
2018-11-27 12:04:38 -06:00
zhouxinyong 8e8b7d6c7b delete the duplicate words in networkLink3.yaml
Change-Id: I21315ec670cc6f4d68e6dfef41e9676541cde47a
2018-11-13 09:58:59 +08:00
zhouxinyong 314921f7c9 remove the repetition words in fullsite_networks.yaml
Change-Id: I2abb2bed6dc418bcf23c7a0c1dbaed027763ca37
2018-11-13 09:56:42 +08:00
zhouxinyong d73f6cbf73 remove the repetition words in multidoc.yaml
Change-Id: Ida718c82ca57eb7b995019fc7aa7676201d74a04
2018-11-13 09:55:09 +08:00
zhouxinyong 807a9c875c omit the twice occured words in fullsite.yaml
Change-Id: I9c67d03f6745d30c035c8ab618ad956333042cef
2018-11-13 09:52:39 +08:00
zhouxinyong 3c97e0be89 delete the duplicate words in hostprof.yaml
Change-Id: Iec982af9735116ae159330e462f8267499ee6df6
2018-11-13 09:52:31 +08:00
Zuul 1090c62f08 Merge "(fix) Support node filter by rack name" 2018-11-07 09:28:15 +00:00
Roman Gorshunov d5c54eab68 Fix: pep8 airship-drydock-omni-test fix
Fixes for pep8 test.

Change-Id: Id2b7a187ffe56a47a184314d1a19507a78f7d88a
2018-11-05 18:35:36 +01:00
Zuul 756a063c30 Merge "Support multiple rack controllers" 2018-10-23 18:52:25 +00:00
skovaleff 04ab7a6a90 Trivial typo fix in fullsite.xml comment
Change-Id: Ia6a1a9a33a2a29f5d8715f505a502e3730c8d4f6
2018-10-18 18:12:39 -07:00
Scott Hussey 357cf7e455 Support multiple rack controllers
- Update the maasdriver to support two concurrent
  rack controllers when configuring networking.
- Identify a baremetal node from both the MAAS node and
  rack controller collections
- Relax validation to only require at least one healthy
  rack controller

Change-Id: I04beb56a8212b65061840021b13b412fbb37ae81
2018-10-18 17:04:00 -05:00
Dimitrios Markou 4a4e6cc6ef Validate mountpoint in a HostProfile
This patch fixes the issue that a reverted patch was causing [0].
In this patch we add a check for partitions which are not having
mountpoints and propably was causing the problem in airship-seaworthy.

[0] https://review.openstack.org/#/c/610594/

Story: #2002951

Change-Id: Ic3055ebdcf37461f52391cf564c29f8283637684
Signed-off-by: Dimitrios Markou <mardim@intracom-telecom.com>
2018-10-17 17:14:51 +03:00
Scott Hussey 860ec66aca (fix) Support node filter by rack name
- Add unit tests for node filtering based on rack name,
  node tag and node label.
- Code updates to get all unit tests passing.

Change-Id: I79e7a8b35c5635364c37e22153b26687a684bfed
2018-10-16 12:27:01 -05:00
Scott Hussey e6ab0743a4 Revert "Validate mountpoints in a HostProfile"
This reverts commit 1466835626.

Change-Id: I9d9df1c5b8c9d905836d3d3c111e507f71bef0ce
2018-10-15 14:48:10 +00:00
Dimitrios Markou 1466835626 Validate mountpoints in a HostProfile
Prevent the partitions and logical volumes to
use the same mount point on the same baremetal
node

Story: #2002951

Change-Id: Ie936b5b20859d511e4cb858202c4ed50378bb72d
Signed-off-by: Dimitrios Markou <mardim@intracom-telecom.com>
2018-10-11 13:54:36 +00:00
Dimitrios Markou 3a09522ac7 Fix invalid comments and class names in unit tests
Change-Id: I68cb5c2b4b8e59d36d7d13c06da5bf27cbff5674
Signed-off-by: Dimitrios Markou <mardim@intracom-telecom.com>
2018-10-08 13:52:29 +03:00
Zuul c1a5adc1ca Merge "(fix) Fix two integration tests" 2018-10-05 21:31:27 +00:00
Scott Hussey 6ca7aa4bff Catchup YAPF formatting
Change-Id: Ic54f77b4b0bdd9199fbc10dfdfc43d3af8f0bfd1
2018-09-26 08:57:51 -05:00
Scott Hussey 2c9ec2503a (fix) Fix missing parameter for node pkg list
- When compiling a list of packages to be installed on deploying nodes
  the function call to render all bootactions was missing a parameter
  introduced in [0] to secure the bootaction.
- Add unit testing for this flow

Change-Id: I9f59819d6b79290a9f72db2a5a4c3422f2c79739
2018-09-26 08:57:10 -05:00
Scott Hussey 53407c3691 (fix) Fix two integration tests
- Two integration tests broke with the addition of the Kubernetes
  driver test. Fix them.

Change-Id: I461be4dac08272b634c3921cde223df60cc40f21
2018-09-25 21:23:45 -05:00
Soumitra Khuntia f879e3a88d Update node-labels through Kubernetes Provisioner
Blueprint: https://airshipit.readthedocs.io/projects/specs/en/latest/specs/approved/k8s_update_node_labels_workflow.html

This commit adds:

1. A new task action ''relabel_nodes'' added to update
nodes labels
2.A new Kubernetes driver added for Kubernetes cluster
interaction through Promenade.

Change-Id: I37c2d7bfda4966d907556036bc2b343df451994c
2018-09-25 17:54:59 +05:30
Scott Hussey 9a52dca199 Bootaction cleanup
- Clean up the docs and code around bootactions to support the
  baclient work

- Update the Jinja2 environment in the bootaction rendering
- Refactor authentication of bootaction signal API calls

Change-Id: Ic64f0c7ee09a487be750188953013f1ed3cd99cb
2018-09-06 16:33:11 -05:00
Scott Hussey 0f39a55942 Refactor build to include Go
Adding the baclient code to Drydock requires a refactor
of the build automation to support multiple languages
and multiple artifacts included in a single Docker image

NOTE: the go source here is a placeholder 'hello world' sample

Change-Id: I1b4883f018b33b3d4fcd7cbcb6cba660fcdc93de
2018-09-04 13:13:21 -05:00