Commit Graph

10 Commits

Author SHA1 Message Date
Bryan Strassner 6b75c7119a Move airflow scheduler to worker statefulset
Moves the airflow sceduler to a container in the airflow-worker
statefulset so that its version lifecycle matches that of the worker.
Leaves the stand-alone scheduler in place to support upgradability from
prior installations that included a standalone scheduler. New
installations are advised to turn off the scheduler template from
rendering using the values.yaml flag.

This is an attempt to make disruptive upgrades to airflow less impactful
to a "update_site" action from Shipyard.

Additionally this removes the template for airflow-flower, which is not in use.

Change-Id: I0608793ee6aba1eb3ce0f5e9567655287014a0ca
2019-01-29 09:41:16 -06:00
Matt McEuen ae688e7fb4 Add release uuid to pods and rc objects (shipyard)
This PS adds the ability to attach a release uuid to pods and rc
objects as desired.  This can be used, for example, to force an
artificial manifest change in CICD scenarios, for upgradability
testing purposes.

Change-Id: I75fc7516e0d32e7e0df0fecf1f9bec0e234adfcc
2018-09-14 15:55:04 -05:00
Bryan Strassner 2651f6e831 Separate source of node_selector_key and values
Provides different fields in the values.yaml to use for the node
selector keys/values used in deployments vs jobs.

Change-Id: I12d7c6257aea0ac00cd77cd3f6331a2b7380b589
2018-07-06 04:22:38 +00:00
anthony.lin c7a9c65c88 Update Shipyard Chart - HTK OSH Infra
Updated configurations to point to openstack-helm-infra
for reference to helm-toolkit as helm-toolkit has been
removed from the openstack-helm repo [0]

Also aligned with changes to the keystone user set up in
OSH using Helm ToolKit so as to get pass Helm Lint.

Updated Makefile targets to install helm dynamically

[0] https://review.openstack.org/#/c/558065/

Change-Id: I0a0813516f9ad176ff005b4693e6b933013a99fd
2018-06-25 17:14:28 -05:00
Bryan Strassner fa105e6da8 Change banners to restore attribution
Restores the historical attribution in the top-of-file banners.

Change-Id: I0bd673e18f0b6c6831c648d00474b1192d03b935
2018-03-15 16:57:20 -05:00
Anthony Lin 80210df387 Remove airflow config template
This patch set removes the (pre)generated config ini file from
airflow. The configuration will now be pulled directly from
values.yaml which will be inline with OpenStack-Helm's approach.

This will do away with the need to maintain the verbose .conf.tpl
in the repository as mentioned by Tin in his comments for [0].

[0] https://review.gerrithub.io/#/c/400925/

Change-Id: I5a9766e52536ac9b143b397faa3563e69dfb6bf3
2018-02-27 10:18:25 -05:00
Anthony Lin eb23a5a0d2 Update Shipyard/Airflow Chart - Database Configurability
- Support configured Postgres admin password
- Use secrets for database job environment setup

This patch set also updates a bunch of banners

Change-Id: I238cfd123b5aad31c9cb93864cff7641f719f3df
2018-01-30 10:26:50 -05:00
Anthony Lin b379477236 RBAC: Update serviceaccount and k8s rbac for Airflow
This patch set brings the airflow/shipyard chart to be
inline with OSH* RBAC approach used in [0] and [1]

[0] https://review.openstack.org/#/c/526464/52
[1] https://review.openstack.org/#/c/529378/

Change-Id: Id2ff9f59028474601933196e1722b46c95f3a8ac
2018-01-22 16:47:47 +00:00
Anthony Lin 251bfff83e Update Shipyard Helm Chart
This patch set removes the shipyard config, policy and paste.ini
template from the existing Shipyard Helm Chart.  This is done to
align with the current approach in OpenStack Helm.

1) Remove shipyard config template
2) Remove shipyard policy.yaml template
3) Remove shipyard api-paste.ini template
4) Update related template files

There has also been a recent change to the Helm Toolkit which will
break the current implementation of the Shipyard Chart

The changes in Helm Toolkit were made to the 'images' definition
in values.yaml to facilitate adding the option to prefix image
name etc

This P.S. will also update the Shipyard Chart to align with the
recent changes in Helm Toolkit

Change-Id: Ie79fd9da2c9a577027dd0dddbcca6b7f7b3b4f6f
2017-10-24 15:23:15 +00:00
Anthony Lin b002bd58fd Move Shipyard Chart
This PS migrates the Shipyard Chart into this repo

Change-Id: I2cf037ab662886a94c8439f43d248da9295a83b3
2017-10-20 02:34:03 +00:00