Commit Graph

521 Commits

Author SHA1 Message Date
Pete Birley
cede6c0d48 Gate: Simpler multiple distro/over-ride support
This PS indroduces a simpler way to incorp over-rides into gate
runs, and also ensures that they are scoped to a single chart, rather
than all of the charts deployed within a gate run.

Depends-On: https://review.opendev.org/666957

Change-Id: I49edf52cc1fc5ec60ee9754c28880c9c0c54492e
Signed-off-by: Pete Birley <pete@port.direct>
2019-06-25 13:16:37 +00:00
Pete Birley
9bcf0df94c Messaging: use htk function to directly hit RabbitMQ servers
This PS updates the charts to use the htk function recently introduced
to allow oslo.messaging clients ans servers to directly hit their
backends rather than using either DNS or K8S svc based routing.

Depends-On: I5150a64bd29fa062e30496c1f2127de138322863

Change-Id: I458b4313c57fc50c8181cedeca9919670487926a
Signed-off-by: Pete Birley <pete@port.direct>
2019-06-18 21:47:45 +00:00
Pete Birley
c9f425f269 Gate/Dev: enable compute kit to be deployed from outwidth the cluster
This PS updates the deplyment script for the compute-kit to allow use
from outside the k8s cluster.

Change-Id: Ie758b3c3c6b36c1882030c9a1be1b2ba6cc13ed4
Signed-off-by: Pete Birley <pete@port.direct>
2019-06-17 17:07:32 +00:00
Steve Wilkerson
0e1c296101 Horizon helm tests
This adds a helm test for Horizon, the helm test
runs a selenium webdriver check to verify the dashboard
is up

Change-Id: I3616c05596b2bd94931c39fb774333bf65453d52
Signed-off-by: Steve Wilkerson <sw5822@att.com>
2019-06-05 12:41:21 -05:00
Zuul
2132a98956 Merge "Add missing passwords to armada-osh manifest" 2019-06-04 16:41:43 +00:00
Gage Hugo
4f35570a46 Remove network-policy overrides default scripts
This change removes the network policy overrides from the default
developer deployment scripts now that there is a set of
designated scripts that provide this functionality.

Change-Id: I788845e85314b3a8a9c860fbc77de536113781e0
2019-06-04 14:52:16 +00:00
Zuul
4ec3d501b3 Merge "Armada: Remove logging overrides from OSH manifest" 2019-06-04 07:30:54 +00:00
Zuul
10f3ae3c93 Merge "Change set variable in openstack helm gate job" 2019-06-03 21:30:37 +00:00
Steve Wilkerson
77fa02b655 Armada: Remove logging overrides from OSH manifest
This removes the logging overrides for using the oslo log
fluentd handler and formatter from the armada-osh manifest. As
the armada jobs in the openstack-helm repo no longer deploy the
lma components, there's no fluentd instance for the openstack
services to log to

Change-Id: I6aed11871046a2caf705a3c444d169d1d977bdee
Signed-off-by: Steve Wilkerson <sw5822@att.com>
2019-06-03 12:35:39 -05:00
Zuul
1292da06d5 Merge "Set the execution flag for 085-horizon.sh script" 2019-05-30 14:13:40 +00:00
John Haan
41ad002419 Change set variable in openstack helm gate job
The volume variables is changed in mariadb chart.

It affects openstack helm gating job of mariadb, so we need to
change varible to
volume.use_local_path_for_single_pod_cluster.enabled.

Enable the local host path for mariadb data so if the container
is restarted during the gate jobs it can recover successfully.

Story: 2004702
Task: 33462
Depends-on: https://review.opendev.org/661955

Change-Id: Ib55779ddcbe7033da1900f5cd21de46543392d11
2019-05-29 23:25:08 +09:00
Jiří Suchomel
5add8df532 Set the execution flag for 085-horizon.sh script
Change-Id: I9b98874ba943f5afb3de5d5bed779daa92e22b4f
2019-05-29 14:39:10 +02:00
Sreejith Punnapuzha
ed392356f9 [Fix] Add Prometheus mysql exporter label to network policy
Prometheus mysql exporter is failing because of missing label in
network policy for mysql. This is to add the label to the override
yaml

Change-Id: Ic5e2613303f04d2bfab1229d3818a2fc9b4263bc
Signed-off-by: Sreejith Punnapuzha <Sreejith.Punnapuzha@outlook.com>
2019-05-28 14:20:01 +00:00
Jiří Suchomel
bd6e5f9bd9 Added multinode version of horizon deployment script
Does not require node port values assignment

Change-Id: I6e443636d423e31a5504b3e1f74fe5aedc4fe672
2019-05-23 15:17:11 +00:00
Zuul
aca516f3a2 Merge "Extend OpenSUSE Leap15 testing" 2019-05-16 13:31:26 +00:00
Steve Wilkerson
735271af71 Add missing passwords to armada-osh manifest
This adds missing passwords to the armada-osh manifest. These
passwords include: passwords for the test users used for the
openstack chart helm tests, the password for the mariadb sst user
deployed in the openstack namespace, and the mariadb exporter
user for the openstack mariadb instance

Change-Id: Ia04ab3d83d1967c4ab65915adaec53d488f451fb
2019-05-08 08:30:35 -05:00
Jiří Suchomel
79dce5eec5 Provide release specific overrides file for Neutron
Create the overrides file necessary for Rocky release:
 - api-paste entrypoint neutron.api.versions:Versions.factory deprecated

Deployment script needs to be executed with OSH_OPENSTACK_RELEASE value.

Change-Id: If0d3553bd004426d8e97e1fa62ee9b99f4a895a9
2019-05-08 02:47:13 +00:00
Jiří Suchomel
5bb58ebf02 Extend OpenSUSE Leap15 testing
Added more non-voting jobs targeted at OpenSUSE + Rocky.

Depends-On: https://review.opendev.org/#/c/651491/
Depends-On: https://review.opendev.org/#/c/651250/
Depends-On: https://review.opendev.org/#/c/653687/
Depends-On: https://review.opendev.org/#/c/656489/

Change-Id: I679ec679498c896c00b861b945d4f8780f03ec2e
2019-04-30 15:12:18 +02:00
Zuul
5361c3282a Merge "Add OpenSUSE Leap15 testing" 2019-04-26 16:44:16 +00:00
jh629g
0afa508f06 Fix results of openstack volume type list --default
Currently openstack volume type list --default
returns 404 if the openstack environment is
deployed using openstack-helm. The value
default_volume_type was previously unimplemented
in values.yaml for cinder.

Change-Id: Ifb6d54d875d5cbaffc8330d15d999ef830010177
2019-04-20 03:36:09 +00:00
Zuul
283f3a2d63 Merge "Remove remaining test pods before new test run" 2019-04-19 00:41:54 +00:00
Jean-Philippe Evrard
a828d38316 Add OpenSUSE Leap15 testing
There is currently no testing of the Leap 15 images in OSH.

This addresses it by:
- Using the values_overrides folder according to the multi-os
  spec, creating value override files there for changes that
  needs to happen on Leap 15 images.
- Point to the right images using the previously created folder,
  to allow using those in CI easily.
- Change CI to use previously created overrides.

Depends-On: https://review.openstack.org/#/c/651501
Change-Id: I520d3676195c62b253a19397c86b0d0fbabee710
2019-04-15 11:15:35 +02:00
Steve Wilkerson
0e1dec39d1 Add heat to compute kit and apparmor jobs
This adds the deployment of heat to the compute kit and apparmor
job in order to provide a simple mechanism for booting vms to
validate a functional cloud deployment

Change-Id: I1a0b0fd4fd708a045e82781cfe3990e23d2af581
2019-04-11 20:46:10 +00:00
Zuul
d544a556db Merge "Add nonvoting apparmor check job to openstack-helm" 2019-04-11 15:39:29 +00:00
Zuul
27f667066f Merge "Add Aodh Chart" 2019-04-09 23:01:52 +00:00
Zuul
72829f71fa Merge "Add network policy ingress rule to mariadb" 2019-04-08 17:37:26 +00:00
Steve Wilkerson
0abf9d2b20 Add nonvoting apparmor check job to openstack-helm
This adds a nonvoting apparmor check job to openstack-helm, which
allows for the removal of default apparmor profiles from the nova
chart. This job also includes overrides for using the default
docker apparmor profile for the neutron chart

Change-Id: I8f407f24b7f10c5d7cf10f21f73671f7e6c72767
2019-04-07 06:42:42 +00:00
Steve Wilkerson
96e521fdf6 Armada job: Add upgrade options to rabbitmq chart
This adds the force and recreate_pods upgrade options to the
rabbitmq chart in the armada manifest to allow for successful
rotation of user secrets on upgrades

Change-Id: I8268300845c665abc1b8b139a81f339e5d66a10c
2019-04-03 09:20:57 -05:00
Angie Wang
d9e179a607 Add Aodh Chart
This commit adds a helm chart to deploy aodh.
The default deployment for aodh is ocata.

Change-Id: Id0312d90f079bd36daa1c80d2a9ecaa5fbfed7cd
Story: 2005022
Task: 29501
Signed-off-by: Angie Wang <angie.wang@windriver.com>
2019-04-02 23:36:42 -04:00
Koffi Nogbe
e6b970eeb0 Add network policy ingress rule to mariadb
* enable ingress for mariadb-backup pod

Change-Id: I6db63bc3cbc3d02e9061237acf71eb4137789d5a
Signed-off-by: Koffi Nogbe <kn4078@att.com>
2019-04-02 15:33:41 +00:00
Zuul
19a9026d67 Merge "Add preliminary support for standalone ironic" 2019-03-30 19:21:26 +00:00
Angie Wang
6186995745 Add Panko Chart
This commit adds a helm chart to deploy panko.
The default deployment for panko is ocata.

Change-Id: I01f447fe0170be64e318885e307b013e30fd4762
Story: 2005021
Task: 29500
Signed-off-by: Angie Wang <angie.wang@windriver.com>
2019-03-29 10:02:07 -04:00
Pavlo Shchelokovskyy
f3b1be7bde Add preliminary support for standalone ironic
currently ironic chart is quite entangled with the presense of
other openstack services (Glance, Neutron, Swift).

Ironic is capable of running completely standalone, and while
the keystone and some neutron-related pieces are implemented as jobs
and can be turned off in manifests and dependencies sections of values,
others are scripts running as initContainers and are not the easy to
switch off.

This patch adds more key/values to the bootstrap key,
which allows to turn off Neutron-, Swift- and Glance-related pieces
while keeping possibility that some other networking, image or
object_store actions appropriate for standalone case may be needed.

Change-Id: Icccbdbce81ca350042f33f5e86bb942064839267
2019-03-22 17:04:08 +02:00
Zuul
46ff6c3037 Merge "Gate: Permit ceph deployment from outside the cluster" 2019-03-22 01:32:10 +00:00
Zuul
7373425d2a Merge "Rabbit: Add netpolicy to allow clustering and rabbit clients to connect" 2019-03-21 16:39:45 +00:00
Pete Birley
e500334130 Gate: Permit ceph deployment from outside the cluster
This PS extends the gate scripts to allow ceph to be deployed from
a workstation external to the k8s cluster.

Change-Id: I4940de18a53fb79c905fd307a04a1d19833e79b7
Signed-off-by: Pete Birley <pete@port.direct>
2019-03-21 09:30:21 -05:00
Pete Birley
a2a5d15dca Rabbit: Add netpolicy to allow clustering and rabbit clients to connect
This PS allows rabbit compoents, eg other rabbit servers, tests, and jobs
to connect to rabbit.

Change-Id: I61cca52072940e31c093e4895a1c6406b15456bf
Signed-off-by: Pete Birley <pete@port.direct>
2019-03-20 22:32:01 +00:00
Steve Wilkerson
31f403bbcc OSH: Add/Update Armada timeouts, update config overrides
This adds the test timeout field to all charts with helm tests
defined in the OSH Armada manifest, and also updates the release
timeouts for releases known to take longer than usual

This also updates chart overrides to achieve parity between the
standard multinode job and the Armada periodic jobs to reduce the
potential for issues arising from configuration deltas

Change-Id: Id9ba223fbd35ee213db346bbc230a844632e15d2
2019-03-20 10:59:06 -05:00
Steve Wilkerson
2277902726 Armada: Fix openstack-helm update password job
The armada update password job was attempting to invoke a script
that didn't exist for sourcing the passwords. This updates the
path appropriately

Change-Id: Ieb0b85c18ed4f2a589ee3a3ba251317350dc4b81
2019-03-15 10:55:47 -05:00
Jiří Suchomel
9e5cb57148 Remove remaining test pods before new test run
If the test pod still exists, new run of "helm test"
fails with ERROR: pods "xy-test" already exists

Change-Id: I8551d8d115142187512cea4042c50e9c9e5c5400
2019-03-15 10:33:30 +01:00
Chinasubbareddy M
ff146ea9fd OSH: Add ingress netpol for ceph-rgw pods
This is to enable ingress netpol for ceph-rgw pods

Depends-On: https://review.openstack.org/#/c/632567/

Change-Id: I542a38a08101b031633bfcb0810e00904ae58df5
2019-03-06 19:57:06 +00:00
leledashenqi
52aac83b44 Add the CentOS system to Ceph related configuration file.
To use RBD devices with CentOS system, multinode deployment script has
already been modifed.

Change-Id: I8a1ac13b0ec124b14b2bdd06ea3b0a9c081d468c
Story:2004640
Task:28577
2019-03-06 03:10:03 +00:00
Zuul
01cb93c471 Merge "Report the reason why the script hits a timeout." 2019-03-05 01:44:10 +00:00
Jiří Suchomel
295475481f Report the reason why the script hits a timeout.
Also small code cleanup and bit more consistency to the commands
and variables.

Change-Id: I7bb1a9e3bafc105c17010dc145adfb3a166e945e
2019-03-04 15:53:58 +01:00
Pavlo Shchelokovskyy
55645c7e73 Explicitly set datefmt for logging
the defaults in Python [0] and oslo.log [1] are such that when using
separate config file for logging configuration (log-config-append)
the log fomat of dates containes miliseconds twice (as in sec,ms.ms)
which is exactly what is currently seen in logs of OpenStack services
deployed by openstack-helm.

When not provided with datefmt log formatter option, Python effectively
uses '%Y-%m-%d %H:%M:%S,%f' [0] as a default time formatting string to
render `%(asctime)s`, but the defaults in oslo.log add another `.%f`
to it [1].

Since `log-date-format` oslo.log option has no effect when using
log-config-append, we need to explicitly set date format to avoid double
miliseconds rendering in date of log entries.

[0] 6ee41793d2/Lib/logging/__init__.py (L427-L428)
[1] http://git.openstack.org/cgit/openstack/oslo.log/tree/oslo_log/_options.py?id=7c5f8362b26313217b6c248e77be3dc8e2ef74a5#n148

Change-Id: I47aa7ce96770d94b905b56d6fe4abad428f01047
2019-02-21 08:28:35 +00:00
Zuul
710db97513 Merge "Add Armada job for testing update of chart passwords" 2019-02-16 00:59:19 +00:00
Steve Wilkerson
61ddb2d87a Add Armada job for testing update of chart passwords
This adds both a periodic and experimental job for deploying Ceph
and the OSH components via Armada. This job will then generate new
passphrases for the OSH components, render an updated manifest for
the OSH components including the new passphrases, then applies the
updated OSH manifest to validate the ability for all deployed
charts to update those passphrases successfully
Change-Id: I42d19bbf8161b60311c4b8101217cdcfbdf6b568
2019-02-06 16:20:16 -06:00
Matthew Heler
edee4245eb [CEPH] Enable helm tests for RGW gate job
Enable the RGW helm tests for the multinode gate job

Depends-On: https://review.openstack.org/#/c/635192/
Change-Id: I899a945487032bdfafa1cf91156d40dac794a5a9
2019-02-06 14:31:03 -06:00
Steve Wilkerson
7c283e7b5d OSH: Add Armada job for testing update of release uuids
This adds both a periodic and experimental job for deploying Ceph
and the OSH components via Armada. This job will then generate a
new release uuid, render an updated manifest for all previously
deployed releases, then apply that manifest to validate the
ability for all deployed charts to update successfully with the
new release uuid annotation

Change-Id: I6f2125f3505904c4714688e7a9900b8d6bea49b4
2019-02-05 08:32:22 -06:00
Steve Wilkerson
99b3062315 Armada manifest: Add timeout to nova and neutron
This adds wait timeouts to nova and neutron to circumvent timeout
issues with deploying those two releases

Change-Id: I3fcc9ef5f16ecbc6dc33fc52df22c2d5ff504fb7
2019-02-05 08:31:41 -06:00