135 Commits

Author SHA1 Message Date
Gage Hugo
b412d729fd Unpin ansible version in start script
We previously pinned the version of ansible we deployed in order
to avoid issues when upgrading which would cause gate failures.

This change removes the pinnned version since it appears to be
more stable now.

Change-Id: Iabe516273bb68444340f06ad652d007d707cf888
2022-05-16 20:48:26 +00:00
Schubert Anselme
753a32c33d Migrate CronJob resources to batch/v1 and PodDisruptionBudget resources to policy/v1
This change updates the following charts to migrate CronJob resources to the batch/v1 API version, available since v1.21. [0]
and to migrate PodDisruptionBudget to the policy/v1 API version, also available since v1.21. [1]

This also uplift ingress controller to 1.1.3

- ceph-client (CronJob)
- cert-rotation (CronJob)
- elasticsearch (CronJob)
- mariadb (CronJob & PodDisruptionBudget)
- postgresql (CronJob)

0: https://kubernetes.io/docs/reference/using-api/deprecation-guide/#cronjob-v125
1: https://kubernetes.io/docs/reference/using-api/deprecation-guide/#poddisruptionbudget-v125

Change-Id: Ia6189b98a86b3f7575dc4678bb3a0cce69562c93
2022-05-10 15:12:53 -04:00
Dustin Specker
980d92e6b4 pin containerd to 1.5.11-1
containerd 1.6.4-1 changes something about cgroups.procs file
(need to investigate) and this causes libvirt's
readiness probes to fail with an error like:

Readiness probe failed: OCI runtime exec failed: exec failed: unable to
start container process: error adding pid 7366 to cgroups: failed to
write 7366: open
/sys/fs/cgroup/unified/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc2658f11_e579_435c_aab8_d7359f88968f.slice/docker-8cb51ac90cc54e6333028634c4a16592c093ceb0944964e344dcfce9e93f3ed3.scope/cgroup.procs:
no such file or directory: unknown

Change-Id: Icd860b4360d8547480780b271954a20e79d5a4cd
2022-05-06 16:14:42 -05:00
Gage Hugo
fe3e47aff0 Update Makefile for helm v3 scripts
With the removal of helm v2, the Makefile still points to the old
playbooks that try to deploy helm v2. Since we have moved to using
shell scripts to deploy helm v3, this change updates the Makefile
to point to the new scripts.

Change-Id: I6e363f3ce92a228da1301a45c754e68a859325ea
2022-04-04 20:37:07 +00:00
Gage Hugo
79d75267ea Move osh-infra jobs to use helm3
This change updates many of the deployment scripts to properly
handle deploying each service via helm 3 and updates each job
to use the helm v3 install script.

Change-Id: I90a7b59231376b9179439c2554e46449d59b9c15
2022-03-24 13:05:42 -05:00
Graham Steffaniak
8e3c97714b Updated chart naming for subchart compatibility
CHG: - reno-check script to ignore subchart
     - .Release.Name to match .Chart.Name instead:
       - mariadb
       - rabbitmq
       - memcached

Change-Id: Ieaecd5537c2843357b2787f6f59405b672ce8b8a
2022-03-23 17:24:05 -05:00
Anderson, Craig (ca846m)
feeab3291c Add DNS sanity checks to k8s deploy script
Check that k8s DNS is working, and terminate at the beginning if this is
not the case.

Change-Id: I30867671f39dd9d80f46f5a4381adc9d34df7ab7
2022-02-18 00:15:59 -08:00
Gupta, Sangeet (sg774j)
6c044362d9 Add gate script to deploy kubernetes using kubeadm.
Change-Id: I164d0aa03f420cf263832e31c30807e9fccd8495
2021-10-29 01:05:29 +00:00
Gage Hugo
e3203bd7fe Improve osh-infra-deploy helm v3 job
This change improves the osh-infra-deploy job to
successfully deploy minikube with helm v3 along with
the necessary namespaces. Future changes will modify
the install scripts for each job to make them helm
v3 compatible.

Change-Id: I08a94046f86f7c92be7580fbf10751150d2fcecc
2021-10-11 17:02:06 +00:00
Gage Hugo
21ada44f59 Add base helm3 job
This change adds a new script and job to deploy minikube with
helm3. This job will be improved upon in later changes as
part of the movement to helm3.

Change-Id: Ia7ef30a4e2af77508ad95191e5241d2c1b83a7c4
2021-09-02 04:54:52 +00:00
Gage Hugo
67ac5da9ed Update helm repo url
The googleapi repo has been causing issues and the latest
one is giving an unauthorized error when trying to download
helm tarball.

This change moves the repo to use the official helm one.

Change-Id: I52607b0ca6d650d5f5e4a95045389970faa08cfb
2021-08-11 16:18:44 +00:00
Tin Lam
00052793dd chore(openssl): updates cert generation
This patch removes the dependency on cfssl to generate certificates and
removes unused constructs in the script.

Change-Id: Ia933420157f456bf99a6ec5416e6dbb63bfa5258
Signed-off-by: Tin Lam <t@lam.wtf>
2021-06-27 06:10:04 +00:00
Zuul
0189967a25 Merge "Unpin cmd2 package in pip" 2021-05-24 22:47:13 +00:00
Gage Hugo
724c6e126b Deploy newer ansible version
We previously pinned the version of ansible that was ran at the gate
due to issues that are no longer impacting us. This change updates
the version of ansible that is deployed in the gate to something
more recent.

Change-Id: I47773eb385ef1b290d1548e8512fda1fec3cac60
2021-05-03 22:26:25 +00:00
Gage Hugo
62ef04afb1 Unpin cmd2 package in pip
The cmd2 package was pinned in order to maintain compatability,
however quite a bit of time has passed since doing so. This change
unpins cmd2 to use the latest version.

Change-Id: I2b9c8d4c1da91b55301d818861d29cccb64b28cd
2021-05-03 16:25:59 -05:00
Gage Hugo
b243a1e829 Track release note changes on chart change
This change adds in the script to eventually enforce release note
updates when a chart version is bumped. It will currently be set
to ignore if it fails, however once all of the charts are updated,
this should be removed to hard-enforce.

Change-Id: If3b3b26619f7288b723c0d4e6e1b97d6cfe1cf74
2021-02-08 22:36:50 +00:00
Meghan
0e66ef972a Update Grafana version
This brings the Grafana version up to the current version
and fixes the selenium helm and gate test for the new login
dashboard.

Change-Id: I0b65412f4689c763b3f035055ecbb4ca63c21048
2021-01-19 12:36:59 -08:00
KAVVA, JAGAN MOHAN REDDY (jk330k)
dc58ef9ddd Move Tiller version to 2.16.9
Update Helm chart for Armada to use Tiller version 2.16.9.

Change-Id: I6556a6e2a1fad3946a92da5e8dd97e0da5803c62
2020-09-02 08:05:00 -05:00
Andrii Ostapenko
ecb58b85be Fix ara installation
Using the latest ara supporting ansible 2.5.5

Change-Id: Id44948986609093b709e23e0d9f9eddd690fa2b8
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-07-01 23:56:03 -05:00
Zuul
eaaf0062e4 Merge "(fix) Changed pip to pip3" 2020-06-18 15:47:03 +00:00
Ahmad Mahmoudi
b7d3311649 (fix) Changed pip to pip3
Changed pip to pip3 to address zuul gate issues.

Change-Id: Id265b405b293af5b51b4774ca4c7465c9e9457b6
2020-06-17 18:15:07 +00:00
Andrii Ostapenko
dfb32ccf60 Enable yamllint rules for templates
- braces
- brackets
- colons
- commas
- comments
- comments-indentation
- document-start
- hyphens
- indentation

With corresponding code changes.

Also idempotency fix for lint script.

Change-Id: Ibe5281cbb4ad7970e92f3d1f921abb1efc89dc3b
2020-06-17 13:13:53 -05:00
Andrii Ostapenko
8f24a74bc7 Introduces templates linting
This commit rewrites lint job to make template linting available.
Currently yamllint is run in warning mode against all templates
rendered with default values. Duplicates detected and issues will be
addressed in subsequent commits.

Also all y*ml files are added for linting and corresponding code changes
are made. For non-templates warning rules are disabled to improve
readability. Chart and requirements yamls are also modified in the name
of consistency.

Change-Id: Ife6727c5721a00c65902340d95b7edb0a9c77365
2020-06-11 23:29:42 -05:00
Gage Hugo
d14d826b26 Remove OSH Authors copyright
The current copyright refers to a non-existent group
"openstack helm authors" with often out-of-date references that
are confusing when adding a new file to the repo.

This change removes all references to this copyright by the
non-existent group and any blank lines underneath.

Change-Id: I1882738cf9757c5350a8533876fd37b5920b5235
2020-05-07 02:11:15 +00:00
Zuul
eb5bccc4be Merge "Fix Kibana Selenium tests" 2020-03-23 16:18:10 +00:00
dmyrhorodskyi
49b50d632b Fix Kibana Selenium tests
XPath to expected element was changed after
Kibana upgrade, this commit changes XPath
according chnges in new Kibana.

Change-Id: I501de225e1226991db9c263cedf38397cda7b51f
2020-03-17 17:33:37 +02:00
dmyrhorodskyi
0d2f62a3ed Fix Grafana Selenium tests
Since grafana values_overrides were added we need
to align Selenium tests as well.

Change-Id: Ib2e16e08ec20d24924c14fe80927d8180ede06d0
2020-03-06 14:41:58 +02:00
Gage Hugo
30c66126ee Add bandit check to osh-infra
This change adds a non-voting bandit check to openstack-helm-infra
similar to what is ran in the openstack-helm repo.

This check will be made voting in a future change once the current
failures are addressed.

Similarly this check will be modified in a future change to
only be ran when affected python files are changed.

Change-Id: I177940f7b050fbe8882d298628c458bbd935ee89
2019-12-31 18:29:01 +00:00
Steve Wilkerson
1bfa091203 Grafana: Update version
This updates the Grafana version deployed by default from 5.0.0 to
6.2.0

Change-Id: I39b5405cc3f3fe7754ed6544a8388ff912a4ef58
Signed-off-by: Steve Wilkerson <sw5822@att.com>
2019-11-18 08:49:38 -06:00
Steven Fitzpatrick
c2f3486ca4 OSH-Infra Selenium Tests Refactor
This change would update the LMA selenium tests to share a more similar
structure. Additional logging is introduced, and the scripts will fail
gracefully if the targeted service cannot be reached.

Change-Id: Ief7f69b952b2f0e33b7b738bb76083247766f662
2019-10-17 18:23:42 +00:00
Tin Lam
1b0190765d Ensure python scripts are py3 compatible
This patch set is one of many to migrate existing code/script to be
python-3 compatible as python-2 is sunsetting in January 2020.

Change-Id: I4a8fa4c07fd36583716b5ccfdcb0bcdc008db3e7
Signed-off-by: Tin Lam <tin@irrational.io>
2019-10-14 21:26:02 +00:00
Anderson, Craig (ca846m)
ab8c81f2ee Restore overrides functionality after regression
Revert 833d426da8

https://review.opendev.org/#/c/667022 introduced a regression in the
overrides functionality, which caused the corresponding gate test to
fail. This "fixed" a problem by breaking the override capability.

This patchset reverts the previous to restore override functionality and
make gates green again. Deep copy is added in order to resolve the
original problem that 667022 attempted to resolve.

Change-Id: I6c052c0fabe0067612d6a3d9d3bfac4df59202d7
2019-07-24 12:18:44 +00:00
Kabanov, Dmitrii (dk370c)
1db1ddf0ba [Kibana] Add improvements to Selenium tests for Kibana
This PS adds several fixes to Selenium tests (for Kibana) and adds
role which allows to collect the results.

Change-Id: If9fb5f50e395379fdd3ccc46e945a93606dcbabe
2019-06-25 20:51:01 -07:00
Steve Wilkerson
2c11798c65 Update airship-divingbell check job
This updates the airship-divingbell repository defined in the
single node check job to use the correct repository namespace.

This also updates the divingbell check job to use the standard
osh-infra-gate-runner playbook as well as the minikube based
kubernetes deployment

Change-Id: Iff53279b3e09058deb323d092955cbf87230b5e5
2019-04-23 10:09:27 -05:00
Meg Heisler
1bf24051c5 Add exception handling to Kibana Selenium test
This adds exception handling to the Kibana Selenium tests
to address the test failures due to TimeoutExceptions when
the dashboard loads slowly. Only TimeoutExceptions are handled
so if there is an issue with the page itself an error will still
cause the gate to fail as intended. When a TimeoutException
occurs an error message is logged and a screenshot is taken
of the current page.

Change-Id: I16cd3a61ffce2e5fdc39bd7731cc068b8a6ec41f
2019-01-21 13:26:43 -06:00
Meg Heisler
9289cd0987 Additional Selenium tests for Kibana dashboard
This helps verify Kibana is working properly by using
Selenium Webdriver to navigate to different index dashboards
and takes screenshot of each one. It also add the scripts to
the gates for single and multinode deployments.

Change-Id: Ic2c91734d1eaac0ea4e7985bf69082942166715d
2019-01-17 11:24:19 -06:00
Meg Heisler
c3bef9e88f Selenium Tests for OSH Infra
This adds scripts using Selenium Webdriver to verify
the dashboards for Gafana, Nagios, and Prometheus are
reachable and functioning as expected. The scripts
create screenshots of each dashboard as well as
pages that can be navigated to.

It also adds the scripts to the gates for the single
and multinode deployments.

Change-Id: I1699e0ba8ff82ce8f59342cc71aad10cff7d2516
2019-01-07 15:59:42 -06:00
Chris Wedgwood
d4ac063163 [gate] allow pip caching
The pip cache is useful for repeat operations and doesn't seem to have
any real downsides.

Change-Id: Iadb21a118f8d725911a9baa6a9264b8644012af9
2018-10-22 00:11:25 +00:00
Pete Birley
feeeed4d5d Gate: Remove unused helm chart deployment role and playbook
This PS removes the unused helm chart deployment role and playbook.

Change-Id: I01c58a628589ec35af2557c8cc93ea47fe084089
Signed-off-by: Pete Birley <pete@port.direct>
2018-10-05 01:43:33 +00:00
Pete Birley
96703649a5 Helm-Toolkit: TLS cert generator
This PS adds a function to generate tls certificates from a
CA. It also adds a script to generate a snakeoil ca for dev
and future gating work.

Change-Id: Ic94a9ab5fa3ebb912b507008a6b2f78e16dade67
Signed-off-by: Pete Birley <pete@port.direct>
2018-08-29 11:26:44 -05:00
Jean-Philippe Evrard
bf069b2311 Revert "Update OSH Author copyrights to OSF"
This reverts commit 178aa271a4.

Change-Id: I38a52d866527dfff2689b618e055f439bc248c13
2018-08-28 17:25:54 +00:00
Matt McEuen
178aa271a4 Update OSH Author copyrights to OSF
This PS updates the "Openstack-Helm Authors" copyright attribution
to be the "OpenStack Foundation", as decided in the 2018-03-20
team meeting:
http://eavesdrop.openstack.org/meetings/openstack_helm/2018/openstack_helm.2018-03-20-15.00.log.html

No other copyright attributions were changed.

Change-Id: I1137dee2ae5728771835f4b33fcaff60fcc22ca9
2018-08-26 17:17:06 -05:00
Nicholas Jones
4932e6ce50 Add curl to install script for ubuntu
Missing curl dependency can cause unclear errors

Change-Id: I8f86a51c9947b460a5003a7a4713dedeaca19837
2018-07-02 12:36:18 -05:00
Steve Wilkerson
80c1ff4071 Gate: Fix version of ansible deployed via dev-deploy
This pins the version of ansible deployed via the makefile
dev-deploy directives to the version used in zuul.  This was
causing issues with docker, as make dev-deploy setup-host was
deploying ansible 2.6. Ansible 2.6 introduces a new flag to the
docker_container module (init) that is incompatible with our
current roles, which resulted in observed failures in osh-infra
and osh

Change-Id: Ibc885b53bce77eb36817024b21efb0e99865f690
2018-06-29 15:39:58 +00:00
chenlx
49da0d0bb3 Remove dupliate osh-infra-docker.yaml file
We only need keep one of osh-infra-deploy-docker.yaml and
osh-infra-docker.yaml, because the content is almost the same.

Change-Id: I27854c0b9492853f7c4edf130b6533c33292dc89
2018-06-28 14:18:07 +08:00
Pete Birley
ce21f6e96d Gate: Add support for testing fqdn over-rides in zuul
This PS adds support for testing fqdn over-rides in zuul gates.
When enabled it will direct requests to a configurable domain to
the default ip of the primary node.

Change-Id: I3d9a4a0bf06532caf0f544d44027493622f4ae5b
Signed-off-by: Pete Birley <pete@port.direct>
2018-06-25 02:42:09 +00:00
Tin Lam
cb1c376ad2 Fix pip package version
The python "cmd2" package installs version 0.9+ on Python 2.7, which only
support Python 3.4+. This causes a dependency error in the gate due to
issue outlined in [0].  We will pre-install a capped version of "cmd2"
that would work with Python 2.7.

This patch set also temporarily make the keystone webhook non-voting as
this bug is causing a circular dependencies with patch [1]. Once this is
fixed, a new patch will be submitted to make this voting again.

[0] https://github.com/python-cmd2/cmd2/issues/421
[1] https://review.openstack.org/#/c/571093/

Change-Id: I34cbde65b74efc2805bd7785f84878783d2badbf
2018-05-30 01:50:22 -05:00
Pete Birley
be3f300623 Gate: place role default vars within the role
This PS places the role default vars within the appropriate role,
in addition it exposes kubeadm's selfhosted param and deploys the
kubeadm binary to master nodes.

This PS exposes the selfhosted param, and deploys kubeadm to master
nodes.

Change-Id: I5ad1b593a711ffe353b012394d54044dede0691d
2018-05-14 03:28:31 +00:00
Steve Wilkerson
b492ee54c3 OSH-infra multinode gate rework
This moves to using bash scripts for deploying the charts for the
multinode gates in osh-infra as opposed to using the ansible
chart builder

Change-Id: I2951ccf57250a5e6e272872f2d6f7a81bd11f184
2018-05-10 00:06:04 +00:00
Pete Birley
39ab1c3b5d Gate: Improve centos support
This PS updates the CentOS Gate.

Change-Id: Ic29b9e5949fb3fb3433802f7933208f3cabfef72
2018-04-20 11:28:36 -05:00