84 Commits

Author SHA1 Message Date
Gage Hugo
db79e79788 Remove OSH Authors copyright
The current copyright refers to a non-existent group
"openstack helm authors" with often out-of-date references that
are confusing when adding a new file to the repo.

This change removes all references to this copyright by the
non-existent group and any blank lines underneath.

Change-Id: Ia035037e000f1bf95202fc07b8cd1ad0fc019094
2020-04-03 20:53:32 +00:00
Steve Wilkerson
2f89afa384 Add rabbitmq statefulset name to Armada chart overrides
This adds the rabbitmq statefulset name override to the values
for each openstack service chart in the Armada manifest, as this
is required to support communicating with the rabbitmq backends
directly

Change-Id: I4a2fabf491c6607bec80f37a8d1236c55ec8430a
Signed-off-by: Steve Wilkerson <sw5822@att.com>
2019-08-27 10:04:39 -05:00
Steve Wilkerson
955edfdb28 Disable cephfs provisioner in multinode jobs
This disables the cephfs provisioner in the multinode
periodic jobs. It seems the helm tests for the ceph
provisioner chart that test cephfs fail more often than
not in the multinode jobs while passing reliably in the
single node check and gate jobs. As cephfs is still
gated, disabling the cephfs provisioner in the periodic
jobs allows for further investigation into this issue
without causing potential regressions

Change-Id: Id4cf7d6571855413be4b67a440423445af3270e3
Signed-off-by: Steve Wilkerson <sw5822@att.com>
2019-08-14 10:13:48 -05:00
Renis Makadia
092d7103ab Ceph-RGW - Update chart install scripts
- As part of PS 634782, Ceph-rgw chart was updated. We need to update
Ceph chart install script as per new changes.

Change-Id: Ieede912272903ed251693879f17a821cb2a4e7bb
2019-07-04 14:15:10 +00:00
Zuul
2d6b643396 Merge "Add wait.resources.type to armada manifest" 2019-06-26 09:54:02 +00:00
Gage Hugo
1a9929c5c3 Add wait.resources.type to armada manifest
This change adds various wait.resources.type to the armada
manifest for each openstack service.

Change-Id: I6015344c9fcf175bab076fc5c81dfe7778d421ee
2019-06-10 17:30:23 +00:00
Zuul
2132a98956 Merge "Add missing passwords to armada-osh manifest" 2019-06-04 16:41:43 +00:00
Steve Wilkerson
77fa02b655 Armada: Remove logging overrides from OSH manifest
This removes the logging overrides for using the oslo log
fluentd handler and formatter from the armada-osh manifest. As
the armada jobs in the openstack-helm repo no longer deploy the
lma components, there's no fluentd instance for the openstack
services to log to

Change-Id: I6aed11871046a2caf705a3c444d169d1d977bdee
Signed-off-by: Steve Wilkerson <sw5822@att.com>
2019-06-03 12:35:39 -05:00
Steve Wilkerson
735271af71 Add missing passwords to armada-osh manifest
This adds missing passwords to the armada-osh manifest. These
passwords include: passwords for the test users used for the
openstack chart helm tests, the password for the mariadb sst user
deployed in the openstack namespace, and the mariadb exporter
user for the openstack mariadb instance

Change-Id: Ia04ab3d83d1967c4ab65915adaec53d488f451fb
2019-05-08 08:30:35 -05:00
Steve Wilkerson
96e521fdf6 Armada job: Add upgrade options to rabbitmq chart
This adds the force and recreate_pods upgrade options to the
rabbitmq chart in the armada manifest to allow for successful
rotation of user secrets on upgrades

Change-Id: I8268300845c665abc1b8b139a81f339e5d66a10c
2019-04-03 09:20:57 -05:00
Steve Wilkerson
31f403bbcc OSH: Add/Update Armada timeouts, update config overrides
This adds the test timeout field to all charts with helm tests
defined in the OSH Armada manifest, and also updates the release
timeouts for releases known to take longer than usual

This also updates chart overrides to achieve parity between the
standard multinode job and the Armada periodic jobs to reduce the
potential for issues arising from configuration deltas

Change-Id: Id9ba223fbd35ee213db346bbc230a844632e15d2
2019-03-20 10:59:06 -05:00
Steve Wilkerson
2277902726 Armada: Fix openstack-helm update password job
The armada update password job was attempting to invoke a script
that didn't exist for sourcing the passwords. This updates the
path appropriately

Change-Id: Ieb0b85c18ed4f2a589ee3a3ba251317350dc4b81
2019-03-15 10:55:47 -05:00
Pavlo Shchelokovskyy
55645c7e73 Explicitly set datefmt for logging
the defaults in Python [0] and oslo.log [1] are such that when using
separate config file for logging configuration (log-config-append)
the log fomat of dates containes miliseconds twice (as in sec,ms.ms)
which is exactly what is currently seen in logs of OpenStack services
deployed by openstack-helm.

When not provided with datefmt log formatter option, Python effectively
uses '%Y-%m-%d %H:%M:%S,%f' [0] as a default time formatting string to
render `%(asctime)s`, but the defaults in oslo.log add another `.%f`
to it [1].

Since `log-date-format` oslo.log option has no effect when using
log-config-append, we need to explicitly set date format to avoid double
miliseconds rendering in date of log entries.

[0] 6ee41793d2/Lib/logging/__init__.py (L427-L428)
[1] http://git.openstack.org/cgit/openstack/oslo.log/tree/oslo_log/_options.py?id=7c5f8362b26313217b6c248e77be3dc8e2ef74a5#n148

Change-Id: I47aa7ce96770d94b905b56d6fe4abad428f01047
2019-02-21 08:28:35 +00:00
Steve Wilkerson
61ddb2d87a Add Armada job for testing update of chart passwords
This adds both a periodic and experimental job for deploying Ceph
and the OSH components via Armada. This job will then generate new
passphrases for the OSH components, render an updated manifest for
the OSH components including the new passphrases, then applies the
updated OSH manifest to validate the ability for all deployed
charts to update those passphrases successfully
Change-Id: I42d19bbf8161b60311c4b8101217cdcfbdf6b568
2019-02-06 16:20:16 -06:00
Steve Wilkerson
7c283e7b5d OSH: Add Armada job for testing update of release uuids
This adds both a periodic and experimental job for deploying Ceph
and the OSH components via Armada. This job will then generate a
new release uuid, render an updated manifest for all previously
deployed releases, then apply that manifest to validate the
ability for all deployed charts to update successfully with the
new release uuid annotation

Change-Id: I6f2125f3505904c4714688e7a9900b8d6bea49b4
2019-02-05 08:32:22 -06:00
Steve Wilkerson
99b3062315 Armada manifest: Add timeout to nova and neutron
This adds wait timeouts to nova and neutron to circumvent timeout
issues with deploying those two releases

Change-Id: I3fcc9ef5f16ecbc6dc33fc52df22c2d5ff504fb7
2019-02-05 08:31:41 -06:00
Steve Wilkerson
dc1ef4c138 Update openstack-helm Armada job
This updates the openstack-helm Armada job to instead deploy
only Ceph, the OpenStack service charts, and their dependencies.
This is dependent on the addition of the Armada job for Ceph and
the LMA components to openstack-helm-infra. This also updates the
jobs definition to use the osh-gate-runner playbook instead, as
well as sets the job both to a periodic and experimental job

Depends-On: https://review.openstack.org/#/c/634676/
Depends-On: https://review.openstack.org/#/c/633067/
Change-Id: I7e191a153f123e04e123acc33fb691d8117062a9
2019-02-04 16:46:22 +00:00
Steve Wilkerson
47d9c8a72c Armada Check: Add release uuid value to charts
This simply adds the release uuid value to the chart overrids in
the Armada manifests, which allows for validation that the release
uuid is appropriately added as an annotation to the resulting pods

Change-Id: I53dc31ed9849ea321064184817549c0e90c34378
2019-01-30 08:50:58 -06:00
Evgeny L
b5803ad5a8 Neutron parameter min_l3_agents_per_router was removed in Ocata
This parameter has been deprecated in Newton and removed [1]
in Ocata.

[1] https://review.openstack.org/#/c/385604/

Change-Id: Ib80cc6634d0fba8ddd2a8e5c9d26a6a0524164b8
2019-01-18 22:50:17 +00:00
Chinasubbareddy M
13277440d7 OSH: Ceph charts cleanup
This is  to clean ceph charts for unused variables and left over from
ceph chart split

Change-Id: If5c8a5a2cf590154ff712695d409ca83d81e8197
2019-01-16 21:06:46 +00:00
Steve Wilkerson
f915a85f2b Armada: Update LMA configuration overrides in manifest
This updates the Armada LMA manifest to include overrides for
recent changes to the LMA services in osh-infra

Change-Id: Ib1ec2c23570a86d63df35a9f0d690d9e625f1dd0
2019-01-08 13:31:22 -06:00
Steve Wilkerson
4822aa729c Armada: Manifest updates for Ocata release
This patchset updates the chart configuration overrides to account
for functionality supported with the move to Ocata over Newton.
This includes updating the OpenStack service logging configuration
to leverage the fluent handler/formatter that was introduced in the
Ocata release, updating Fluentd's configuration to filter out
duplicate logs, tagging logged events with their log level, and
creating separate indexes for the different log types created by
the elasticsearch templates. This also adds support for leveraging
ceph-radosgw's s3 API for Elasticsearch snapshots.

This also removes the barbican chart deployment from the
armada gate, to help alleviate resource consumption.

Change-Id: I45128bf102909e1762b832fc16ad04bedcfe4f00
2018-12-17 10:14:51 -06:00
Steve Wilkerson
eb0fa9f7a4 Armada: Add Elasticsearch admin password to nagios chart
This adds the Elasticsearch admin password to the nagios chart
document overrides to account for the Elasticsearch plugin for
alerting on queries to Elasticsearch for particular logged events

Change-Id: I589fabf94a537730c3bfe86a6aa2af2c6fc3c88a
2018-10-09 15:56:36 +00:00
Steve Wilkerson
821256da3a Armada: Use single rabbitmq deployment
This moves to use a single rabbitmq deployment for the openstack
services in the armada gate to reduce the resources required for
this check to run.

Change-Id: I81bba3c9a4d9cdaad6ddcaa066441a70f1908415
2018-10-08 13:45:36 +00:00
Steve Wilkerson
f97e644aa6 Glance: Disable registry service template in manifests
This updates the glance chart to disable the service for the
glance registry by default, as we disable the other glance
registry templates by default. This updates the gates to enable
the service when newton is deployed

Change-Id: I453d28d9c552754b66e94d9da2e2b9ea6549a5aa
2018-10-01 09:17:30 -05:00
Steve Wilkerson
2a390de7ea Libvirt: Move chart to openstack-helm-infra
This moves the libvirt chart to openstack-helm-infra as part of
the effort to move charts to their appropriate repositories

Depends-On: https://review.openstack.org/#/c/599715/
Change-Id: I50850725604c3fc9d5dfd04a40c95d3346ccae34
Story: 2002204
Task: 21723
2018-09-10 09:46:47 -06:00
Steve Wilkerson
da4f79cf2e Openvswitch: Move chart to openstack-helm-infra
This moves the openvswitch chart to openstack-helm-infra as part of
the effort to move charts to their appropriate repositories

Depends-On: https://review.openstack.org/#/c/599723/
Change-Id: I248ad2dd24f4ab101839f05070f1f6f022f93715
Story: 2002204
Task: 21730
2018-09-07 15:48:07 +00:00
Steve Wilkerson
e2f690b7cc MariaDB: Move chart to openstack-helm-infra
This moves the mariadb chart to openstack-helm-infra as part of
the effort to move charts to the appropriate repositories

Depends-On: https://review.openstack.org/#/c/599651/
Change-Id: I9835da54aa4dd323b841f9605b688857ecf3a123
Story: 2002204
Task: 21725
2018-09-04 10:59:32 -05:00
Steve Wilkerson
3bc8f96c68 Ceph: Remove ceph charts from openstack-helm
This follows the patchset for adding the ceph charts to
openstack-helm-infra, and is part of the effort of removing
infrastructure related charts out of openstack-helm

Depends-On: https://review.openstack.org/596880
Change-Id: Iaa1404d873d38e8403a061548d055c379239c504
2018-08-31 15:46:23 +00:00
Jean-Philippe Evrard
05d0e2b4b8 Revert "Update OSH Author copyrights to OSF"
This reverts commit b1755c3993.

Change-Id: I215a172f2ff4220340292b95f5323847944baeb7
2018-08-28 17:25:13 +00:00
Matt McEuen
b1755c3993 Update OSH Author copyrights to OSF
This PS updates the "Openstack-Helm Authors" copyright attribution
to be the "OpenStack Foundation", as decided in the 2018-03-20
team meeting:
http://eavesdrop.openstack.org/meetings/openstack_helm/2018/openstack_helm.2018-03-20-15.00.log.html

No other copyright attributions were changed.

Change-Id: I167ceedab8fadee28c19514fad6f125d0a521caf
2018-08-26 17:17:41 -05:00
Pete Birley
d4d99cf9fc Split out RGW from ceph client charts
Co-Authored-By: Chinasubbareddy Mallavarapu<cr3938@att.com>

Change-Id: I8b091493bb79c7eab525fbaf7801028398772c5d
Signed-off-by: Pete Birley <pete@port.direct>
2018-08-21 17:36:18 -05:00
Steve Wilkerson
cad26be06e Armada: Add prometheus generated password to nagios chart doc
This adds the password generated for the Prometheus admin user to
the nagios chart document, as it was overlooked with the change to
add prometheus basic auth to the manifest

Change-Id: Id51e07a17df91154585ca659356b37c0042a2407
2018-08-15 09:10:09 -05:00
Steve Wilkerson
e73c90c8e6 Add Prometheus auth to armada multinode deployment
This adds a dynamically generated password for Prometheus to
build on the inclusion of basic auth for Prometheus in osh-infra

Depends-On: https://review.openstack.org/543553
Change-Id: I344b8326829c7816a5ce79529aa1a0f74df52dbd
2018-08-03 02:58:30 +00:00
Steve Wilkerson
fe8c56e778 Armada: Add Nagios to armada-lma manifest
This adds nagios to the armada-lma manifest and includes it in
the monitoring chart group

Depends-On: https://review.openstack.org/#/c/587972/
Change-Id: Id4c8f805dbc4472f9b49d19d2e0307d722dd7196
2018-08-02 18:58:33 +00:00
Pete Birley
beda7f7748 RabbitMQ: move RabbitMQ chart to OSH-Infra
This PS moves the RabbitMQ chart to OSH-Infra

Story: 2002204
Task: 585554
Depends-On: https://review.openstack.org/#/c/585746

Change-Id: Ia57e63bbfb7d4266d58711cfb5644ecad34e2280
Signed-off-by: Pete Birley <pete@port.direct>
2018-07-30 15:08:05 -05:00
Zuul
6ecd0bd133 Merge "Glance: disable V1 API and registry" 2018-07-30 15:39:02 +00:00
Pete Birley
664bdc8a1e Glance: disable V1 API and registry
This PS disables the depreciated glance V1 API and registry
by default. For newton gates the registry is enabled, as newton
heat still used it.

Change-Id: Ia6bd4382750bde1b0a0e4db174d2de11626a1826
Signed-off-by: Pete Birley <pete@port.direct>
2018-07-29 17:14:05 -05:00
Pete Birley
460b1cea29 Memcached: move Memcached chart to OSH-Infra
This PS moves the Memcached chart to OSH-Infra

Story: 2002204
Task: 21727
Depends-On: https://review.openstack.org/#/c/585553

Change-Id: Iabf15db6d14df7e6b7246f8abb9d2e97f6d96172
Signed-off-by: Pete Birley <pete@port.direct>
2018-07-29 15:00:49 +00:00
Pete Birley
2eb18629a9 Ingress: move ingress chart to OSH-Infra
This PS moves the ingress chart to OSH-Infra

Story: 2002204
Task: 21733
Depends-On: https://review.openstack.org/585550
Change-Id: Ie5b511def55dcd481eb291c6b309af61c66e0416
Signed-off-by: Pete Birley <pete@port.direct>
2018-07-26 13:28:22 +00:00
Marshall Margenau
5f6c501f28 Armada wait labels without timeout
Adding the Armada wait labels back, without a timeout specified. This
will allow the circular dependency of nova-neutron-libvirt to be
handled in Armada's ChartGroup processing flow, to install all 3
releases and then test them after they're all installed.

Change-Id: Ie00f3bd26a0991f01fed9452336a34767adecbd7
2018-07-19 12:57:42 -05:00
Steve Wilkerson
2840259fb8 Armada check: Add test directive to charts
This adds support for executing helm tests via the armada test
directive. It enables theses tests for all services, except for
nova and neutron as executing tests with armada force a chart to
wait. Forcing nova and neutron to wait effectively sequences the
charts, which will result in a failure to deploy past those
services

Depends-On: https://review.openstack.org/#/c/581148

Change-Id: I6ac845c82d744e2f5fd79c3e2ff3c1479dd1ddab
2018-07-11 13:34:58 +00:00
Pete Birley
a5e5556e46 Ceph: Split out ceph provsioners from client chart
This PS splits out the ceph provisioners from the client chart
allowing OSH to be used with external (and multiple) cephs more
simply.

Change-Id: I0c5d516c7a9a10bc8435e2423eb1dc05460d2c92
Signed-off-by: Pete Birley <pete@port.direct>
2018-07-06 20:54:19 +00:00
Pete Birley
d2434c26bd Gate: Update armada manifests to delete all release jobs on upgrade
This PS updates the armada manifests to delete all jobs for a release
via the `release_group` label. It also extends this to cover charts that
do not currently have jobs contained, to allow simple future expansion
of services.

Change-Id: I28bd9e2c2ebc22ca9c4319970c657298281e28d2
Signed-off-by: Pete Birley <pete@port.direct>
2018-07-03 09:22:38 +00:00
Pete Birley
0bb0cf1b31 Gate: use swift for glance in armada gate
This PS updates the armada gate to use swift.

Change-Id: Ib42aea461415aa298ec7cfb648f3d72de9417742
Signed-off-by: Pete Birley <pete@port.direct>
2018-07-02 13:52:39 +01:00
Zuul
861b6dc1bd Merge "Add cpu_mode in nova.conf" 2018-06-27 03:53:26 +00:00
Pete Birley
f9df30acbd Ceph: use ingress controller for RGW
This PS updates the ceph chart to use the ingress controller for
the radosgw.

Change-Id: Ie0ff4d9dd91d8228170e0ed4f2793599132077a7
Signed-off-by: Pete Birley <pete@port.direct>
2018-06-25 18:50:35 -05:00
Steve Wilkerson
aca30bb14c Update armada multinode manifests
This updates the values in the armada LMA and OSH manifests to
include similar overrides for ceph to those used in the standard
multinode gates

Change-Id: I435ae0ad761da626591fa45486764d71566fd966
2018-06-25 14:16:04 -05:00
caoyuan
27e18daea7 Add cpu_mode in nova.conf
With libvirt 2.0, when using qemu cpu mode is not properly
evaluated and need to be set to cpu_mode = none.

Add this option when kvm is not supported, otherwise user
will still facing errors when launching instances over qemu.

Change-Id: Ib00fa257fb33fd3281f484a47a945640da8dda56
2018-06-21 17:22:50 +08:00
Zuul
ef03612edf Merge "Add fluentbit sidecars to ceph mon and ceph osd charts" 2018-06-19 23:53:24 +00:00