165 Commits

Author SHA1 Message Date
Gage Hugo
6be6d638b3 Update ubuntu nodesets to focal
The openstack-single-node nodeset still is using ubuntu-bionic,
which is nearly 4 years old now. This change updates it to use
the newer ubuntu focal release.

Depends-on: https://review.opendev.org/c/openstack/openstack-helm-infra/+/839996
Depends-on: https://review.opendev.org/c/openstack/openstack-helm-infra/+/840370

Change-Id: Ia43cb31e13bc059541116064aa2092526186b831
2022-05-03 19:57:15 +00:00
Gage Hugo
d37fd936bf Remove keystone-auth job
The kubernetes-keystone-auth check job has not been ran in a long
time and has not been maintained. This change removes it from the
list of jobs defined and jobs ran in the osh-infra project.

Change-Id: If0275524fda92d8fd8baa689521e2e841210ce51
2022-03-31 17:00:16 -05:00
Gage Hugo
ddb377df6d Test linting osh on helm-toolkit changes
Since most of the charts in both openstack-helm and
this repo use helm-toolkit, changes in helm-toolkit
have the possibility of impacting charts in the
openstack-helm repo and will not be caught in testing
here.

This change adds a conditional linter to lint the
charts in the openstack-helm repo if any changes
to helm-toolkit are made.

Change-Id: I0f6a935eca53d966c01e0902e546ea132a636a9d
2021-11-02 22:46:43 +00:00
Zuul
6fedc626da Merge "Add gate script to deploy kubernetes using kubeadm." 2021-11-01 16:45:23 +00:00
Gage Hugo
57c452154e Remove fedora and centos jobs
The fedora and centos jobs have not been used or maintained for
quite some time. This change removes them and the related notes.

Also removed an outdate note about disabling all the experimental
and periodic jobs.

Change-Id: Ic8eb628e21c49957bdcd10a8d69d850ec921b6d6
2021-11-01 00:48:27 +00:00
Gupta, Sangeet (sg774j)
6c044362d9 Add gate script to deploy kubernetes using kubeadm.
Change-Id: I164d0aa03f420cf263832e31c30807e9fccd8495
2021-10-29 01:05:29 +00:00
Gage Hugo
e3203bd7fe Improve osh-infra-deploy helm v3 job
This change improves the osh-infra-deploy job to
successfully deploy minikube with helm v3 along with
the necessary namespaces. Future changes will modify
the install scripts for each job to make them helm
v3 compatible.

Change-Id: I08a94046f86f7c92be7580fbf10751150d2fcecc
2021-10-11 17:02:06 +00:00
Tin Lam
5f75ffa180 fix(ssl): fixes libvirt ssl job
Changes the override to use dynamically generated certs for the
libvirt-ssl jobs so they don't expire in the future. Also, changes it so
it is voting again like before.

Signed-off-by: Tin Lam <t@lam.wtf>
Change-Id: If7215961b0b9a7cad75afd7f78592515b74a7b58
2021-09-27 12:45:29 -05:00
Tin Lam
418143f3e4 fix(gate): disable ssl job
This patch sets temporary disables the ssl gate job and makes the check
job non-voting to unblock osh-infra. The certificate hardcoded in [0]
has expired.

Certificate:
    Data:
        Version: 3 (0x2)
        Serial Number:
            5f:61:31:9d:0f:ff:99:81:ba:6d:50:1a
        Signature Algorithm: sha256WithRSAEncryption
        Issuer: CN = libvirt.org
        Validity
            Not Before: Sep 15 21:26:53 2020 GMT
            Not After : Sep 15 21:26:53 2021 GMT

This will need to be updated or better, unhardcode this at the gate.

[0] https://opendev.org/openstack/openstack-helm-infra/src/branch/master/tools/deployment/openstack-support/051-libvirt-ssl.sh#L27-L51

Signed-off-by: Tin Lam <t@lam.wtf>
Change-Id: I5ea58490c4fe4b65fec7bd3f11b4684cdc1a3e8b
2021-09-24 12:31:17 -05:00
Gage Hugo
9030ff05da Remove unused jobs and related files
This change removes a bunch of unused and unmaintained files
and job declarations related to deploying osh-infra with armada.

Change-Id: I158a255132cd6b02607b6e1e77b8b9525cc8a3d5
2021-09-06 22:23:33 -05:00
Gage Hugo
21ada44f59 Add base helm3 job
This change adds a new script and job to deploy minikube with
helm3. This job will be improved upon in later changes as
part of the movement to helm3.

Change-Id: Ia7ef30a4e2af77508ad95191e5241d2c1b83a7c4
2021-09-02 04:54:52 +00:00
Gage Hugo
2cc86d4bed Update all jobs to at least Train
With the removal of official support of all openstack releases
older than T, this change updates each job to at least use the
Train release.

Change-Id: I6b41d79495a74b1072995ae5036f56bfbf585c25
2021-04-30 14:44:26 -05:00
Gage Hugo
14636aa776 Remove releasenotes from irrelevant files for linter
This change removes the releasenotes directory from the
irrelevant-files list in the zuul linter since the linter actually
checks those files, so for issues with the releasenotes it may
be difficult to test fixes when charts become out of date.

Change-Id: I3c4f95a5bc5fb8d9a0ec8dbb8d2f9560f1e46f9a
2021-04-15 15:01:05 -05:00
Steven Fitzpatrick
6de864110e Elasticsearch S3 Update
This change updates how the Elasticsearch chart handles
S3 configuration and snapshot repository registration.

This allows for
  - Multiple snapshot destinations to be configued
  - Repositories to use a specific placement target
  - Management of multiple account credentials

Change-Id: I12de918adc5964a4ded46f6f6cd3fa94c7235112
2021-04-06 15:12:34 +00:00
Gupta, Sangeet (sg774j)
d64c5fea64 TLS gates from infra monitoring
Change-Id: If41dae31763abac8c9c65b1650556438a9b6b0df
2021-03-02 16:10:24 +00:00
jinyuanliu
5c6d281b62 Remove zookeeper residue
About zookeeper chart,It's been removed,But there are still some related scripts that have not been completely deleted,we should remove them.

Change-Id: Iae20717482ad6c7a40f54174eef120d094abbd59
2021-03-01 14:31:03 +08:00
Steven Fitzpatrick
558a4b5b2c [RFC] Remove Kafka and Zookeeper from osh-infra
These charts have not been used or maintained in quite a while

Change-Id: Ia5778a7a7e74e4938d5f0a1cf17102fc2b5cc779
2021-02-23 14:18:23 +00:00
Xiaoguang(William) Zhang
567e4703e9 Remove Alerta from openstack-helm-infra repository
There is no significant value been added from Alerta base on current user story.

Change-Id: I274263e3dfefd7b9ec8ff84d03504d194225d693
2021-02-18 12:02:18 -05:00
Gage Hugo
2a1677a36a Add reno job to openstack-helm-infra repo
With OSH now publishing charts regularly with each change, there
needs to be a way to track these changes in order to track the
changes between chart versions.

This proposed change adds in a reno check job to publish notes
based from the changes to each chart by version as a way to
track and document all the changes that get made to OSH-infra
and published to tarballs.o.o.

Change-Id: I5e6eccc4b34a891078ba816249795b2bf1921a62
2021-01-21 14:36:59 +00:00
Gage Hugo
3182b01d82 Remove divingbell job
This change removes the non-voting divingbell job from
openstack-helm-infra checks due to not really being used to
test much functionality.

Change-Id: I343b4cdc98d637522ac854211a974cc86d49cae6
2020-10-30 13:29:22 -05:00
Andrii Ostapenko
22cfea81d0 Split deployment script sets to improve stability
Change-Id: I848d6ad0ce52863bf4a13b96b2afbf79bfaf70fc
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-10-28 15:01:45 +00:00
Tin Lam
e5c776e5c4 chore(pkg): updates the chart packaging
This patch set updates the ability to package (and subsequent publish)
of the charts in the OpenStack-Helm-Infra repository.

Change-Id: I6175325b0e7a668c22a7ec3ab08cae51ad4f9ab8
Signed-off-by: Tin Lam <tin@irrational.io>
2020-10-17 08:42:53 +00:00
Tin Lam
3a2d0f83b4 chore(charts): addresses issues with chart publish
This changes attempts to address the chart publish issue. Also makes
the job periodic.

Change-Id: I806da82a7eb07ce8e83ae8c023a014fa3b917193
Signed-off-by: Tin Lam <tin@irrational.io>
2020-10-16 15:15:35 +00:00
Andrii Ostapenko
825d0a5f3d Switch back to openstack-helm-single-node for support job
Jobs running on current node label does not seem to be stable.

Also fixes ssl support job name duplication.

Change-Id: I1b9a3b674818fb7a322d05b4f849188f1484e47b
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-10-15 07:03:14 -05:00
Andrii Ostapenko
3e52027702 Adds vexxhost based nodeset
Adds ubuntu-bionic-expanded nodeset based on ubuntu-bionic-expanded-vexxhost
that is 16c/~32GB
Switches long running support job to new nodeset to reduce build time.

Change-Id: Iec27c00bf54efa7d686b3176998fc8ad6c9f287e
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-10-09 10:32:06 -05:00
okozachenko
3bcb347a5b Realize libvirt SSL
Motivation: libvirt 127.0.0.1 listen is terrible for live migration.
To resolve that, we can use 0.0.0.0 but it is not secure so tried
to realize SSL.
Once create secrets for cacert, client&server cert and keys then it will
 mounted on libvirt daemonset.
It means all instances use the same key and cert. This is not ideal
 but can be considered as the first stage.

Change-Id: Ic3407e484039afaf98495e0f6028254c4c2a0a78
2020-09-25 16:36:42 +03:00
Mohammed Naser
887327aff8 Publish Helm charts into tarballs.openstack.org
This will start publishing all of the charts into tarballs.openstack.org
which should allow for easier public consumption of these charts.  This
patch covers adding publishing for openstack-helm-infra first.

Change-Id: Iaa14629c0d0c36b98c2295119af3008f14c0cd39
2020-09-11 19:13:22 +00:00
diwakar thyagaraj
6dd08e84ca Add Zuul Jobs for apparmor to alerta and Prometheus black-box
1)Moved Apparmor changes to overides so as to use experimental Jobs.
2)Changed Numerical Convention to openstack exporterw

Change-Id: I9ac1f6399c09fc54fcdb98eb0c6cf91912bc93c1
Signed-off-by: diwakar thyagaraj <diwakar.chitoor.thyagaraj@att.com>
2020-09-03 13:28:24 +00:00
Andrii Ostapenko
9e993caf2b Remove race condition for monitoring job
Alerta depends on postgresql. Since no dependency is specified on chart
level, move alerta to the next parallel script set.

Change-Id: Ia368444b6216010cb43b4d4dd817123a02338641
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-08-27 08:19:37 -05:00
Xiaoguang(William) Zhang
83a55fd19e Add Alerta feature to osh-infra
Change-Id: Id8dc3f86b8d6754df4ba3c0c720a78731e3f54d5
2020-08-19 13:35:40 +00:00
Vipul Jain
628186f05e prometheus exporter to monitor health check for web URL
1) A separate prometheus job need to provide target and scrap metrics
2) it is based on https://github.com/prometheus/blackbox_exporter

Adding script file for deployment and job under zuul.d
Resolving conflict
Change-Id: Ia15ab7d8ef882886fe0e37cc2599e6815d7bcc6c
2020-08-11 22:39:54 +05:30
Andrii Ostapenko
fdcbd03784 Allow parallelization in gate runner
Change-Id: I393a22cfcaecb00d14d8ac643bd4b7ffbba03b12
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-08-06 00:51:11 +00:00
Zuul
e292b356b5 Merge "Use precreated minikube-aio image" 2020-08-04 22:01:04 +00:00
Zuul
3d76931e55 Merge "Fluentd: Remove Deployment Option" 2020-08-04 21:06:26 +00:00
Andrii Ostapenko
10019004da Use precreated minikube-aio image
With this commit minikube is installed using contents of precreated
minikube-aio image containing installation script, all required binaries
and images inside. Pulling a single image from dockerhub via opendev
dockerhub proxy and loading images allows to save up to 6 minutes in
minikube installation.

Change-Id: I5936f440eb0567b8dcba2fdae614e4c5e88a7b9a
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-08-04 19:46:43 +00:00
Steven Fitzpatrick
959417f321 Fluentd: Remove Deployment Option
This chart could deploy fluentd either as a Deployment
or a Daemonset. Both options would use the deployment-fluentd
template with various sections toggled off based on values.yaml

I'd like to know - Does anyone run this chart as a Deployment?
We can simplify the chart, and zuul gates, by changing the chart
to deploy a Daemonset specifically.

Change-Id: Ie88ceadbf5113fc60e5bb0ddef09e18fe07a192c
2020-08-04 19:06:37 +00:00
Chinasubbareddy Mallavarapu
4358251073 [CEPH] OSH-INFRA: Update ceph scripts to create loopback devices
This is to update ceph scripts to create loopback devices
in single script and also to update gate scripts.

Change-Id: Id6e3c09dca20d98fcbcc434e65f790c06b6272e8
2020-07-29 10:05:37 -05:00
Andrii Ostapenko
553af32beb Add openstack-helm-infra to required projects for infra jobs
Required to run osh-infra jobs from another projects.

Change-Id: Iba1deb6ff4c6e7c3582d90f9175b2d3953bfd4d8
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-07-22 17:17:31 +00:00
Andrii Ostapenko
6fa7dae7af Add proper osh_params to jobs deploying openstack charts
Change-Id: I44fdc1ef730c697adc8f97499b4208a99f09013e
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-07-21 11:50:33 -05:00
Andrii Ostapenko
06ad7cc7f6 Inherit playbook from common osh-infra parent for fuctional jobs
Change-Id: I7e7d090312ee577314509cd848adf76cabda6aad
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-07-12 03:08:54 +00:00
Andrii Ostapenko
32a860072a Explicitly specify a script directory for jobs run
Required to support reusing of a job in another project.

Change-Id: I1c5968ea3d785c4902c7ab011f7538877b10ce24
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-07-11 01:00:18 -05:00
Zuul
b15d9a103b Merge "Add openstack-helm-single-16GB-node nodeset" 2020-07-08 21:11:08 +00:00
Zuul
1a70211147 Merge "Add Apparmor for prometheus os exporter ks-user Job" 2020-07-08 14:18:26 +00:00
Andrii Ostapenko
0242d97437 Add openstack-helm-single-16GB-node nodeset
Based on 8 CPU 16GB memory ubuntu-bionic-expanded label

Change-Id: I1ef27858b5b02d367eea1c24447aefa2b6712458
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-07-08 07:18:20 -05:00
Andrii Ostapenko
824f168efc Undo octal-values restriction together with corresponding code
Unrestrict octal values rule since benefits of file modes readability
exceed possible issues with yaml 1.2 adoption in future k8s versions.
These issues will be addressed when/if they occur.

Also ensure osh-infra is a required project for lint job, that matters
when running job against another project.

Change-Id: Ic5e327cf40c4b09c90738baff56419a6cef132da
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-07-07 15:42:53 +00:00
diwakar thyagaraj
cc020bdfca Add Apparmor for prometheus os exporter ks-user Job
1) Updated docker image for heat to point to Stein and Bionic
 2) Enabled Apparmor Job for prometheus-openstack exporter.

Change-Id: I1ee8acb848ece3c334b087309d452d5137ea0798
Signed-off-by: diwakar thyagaraj <diwakar.chitoor.thyagaraj@att.com>
2020-07-07 00:23:18 +00:00
Chinasubbareddy Mallavarapu
3bde9f5b90 [CEPH] OSH-INFRA: use loopback devices for ceph osds
- This is to make use of loopback devices for ceph osds since
support for directory backed osds going to deprecate.

- Move to bluestore from filestore for ceph-osds.
- Seperate DB and WAL partitions from data so that gates will validate
  the scenario where we will have fast storage disk for DB and WAL.

Change-Id: Ief6de17c53d6cb57ef604895fdc66dc6c604fd89
2020-06-29 14:09:32 +00:00
Luna Das
594645ce39 Add more fields with verbose description to CompositeController.
Change-Id: Ib6d9db5a8b1be9c3fa6b4cb988c576a71599a274
2020-06-27 00:15:09 +05:30
Zuul
9655817eae Merge "Remove duplicate lint job entry and script" 2020-06-25 04:11:51 +00:00
Steve Wilkerson
a31bb2b049 Add node-problem-detector chart
This adds a chart for the node problem detector. This chart
will help provide additional insight into the status of the
underlying infrastructure of a deployment.

Updated the chart with new yamllint checks.

Change-Id: I21a24b67b121388107b20ab38ac7703c7a33f1c1
Signed-off-by: Steve Wilkerson <sw5822@att.com>
2020-06-22 13:00:55 -05:00