244 Commits

Author SHA1 Message Date
Schubert Anselme
8d5ddc9035 Migrate CronJob resources to batch/v1 and PodDisruptionBudget resources to policy/v1
This change updates the following charts to migrate CronJob resources to the batch/v1 API version, available since v1.21. [0]
and to migrate PodDisruptionBudget to the policy/v1 API version, also available since v1.21. [1]

- aodh (CronJob & PodDisruptionBudget)
- barbican (PodDisruptionBudget)
- ceilometer (PodDisruptionBudget)
- cinder (CronJob & PodDisruptionBudget)
- cyborg (PodDisruptionBudget)
- designate (PodDisruptionBudget)
- glance (PodDisruptionBudget)
- heat (CronJob & PodDisruptionBudget)
- horizon (PodDisruptionBudget)
- Ironic (PodDisruptionBudget)
- Keystone (CronJob & PodDisruptionBudget)
- magnum (PodDisruptionBudget)
- masakari (PodDisruptionBudget)
- mistral (PodDisruptionBudget)
- neutron (PodDisruptionBudget)
- nova (CronJob & PodDisruptionBudget)
- octavia (PodDisruptionBudget)
- placement (PodDisruptionBudget)
- rally (PodDisruptionBudget)
- senlin (CronJob & PodDisruptionBudget)

0: https://kubernetes.io/docs/reference/using-api/deprecation-guide/#cronjob-v125
1: https://kubernetes.io/docs/reference/using-api/deprecation-guide/#poddisruptionbudget-v125

Change-Id: I2fc0692e1c8e2c4fa4d4ca1da96b5c6a832343fa
2022-05-19 10:08:18 -04:00
Phil Sphicas
3e63be0682 Allow cinder v1/v2 endpoint creation if needed
An earlier change [0] removed the older cinder v1 and v2 endpoint
definitions from values.yaml. If older APIs are required, they can be
enabled using overrides, but the ks-service job only creates a volumev3
endpoint.

This change updates the ks-service job to create all endpoints defined
in .Values.endpoints that have "volume" in their name. Note that several
settings are hardcoded to use volumev3, so this change would mostly
useful in enabling v2 in addition to v3.

0: https://review.opendev.org/c/openstack/openstack-helm/+/817310

Change-Id: I26594668ff26ed3f28e207f341b28a139b514e1c
2022-05-04 10:03:20 -07:00
Vladimir Sigunov (vs422h)
48625ad984 [Cinder] Add visibilty settings to volume types
This is to add public/private  visibility option
and project level access list to a volume type while creating.

Change-Id: Id33c8c9f10e60fcdb4b6c49e69f3b5d8f11850c6
2022-05-03 12:34:06 -04:00
josebb
9d7bd69147 Add helm hook in cinder bootstrap job
Change-Id: I3a556d6deb57dc1b4c374fa997b0d37c22f1b066
2022-04-20 10:17:07 +03:00
Thiago Brito
a9987be64c Enable taint toleration for cinder
This changes use the helm-toolkit template for toleration
in openstack services

Signed-off-by: Lucas Cavalcante <lucasmedeiros.cavalcante@windriver.com>
Story: 2009276
Task: 43531
Depends-On: I168837f962465d1c89acc511b7bf4064ac4b546c
Change-Id: Id63d0950fd8b7ff9592cbfe196b95739dc0b1380
2022-03-22 18:47:23 +00:00
Nafiz Haider
6ec2773c95 Remove cinder v1/v2 defaults
This change removes the cinder v1 and v2 endpoint definitions
from the default values in the cinder chart.

Change-Id: I0ee35ad71c76df157e2c670a7899e4b6c1b91e46
2021-11-15 15:59:06 +00:00
Gage Hugo
1e651dc3c3 Helm 3 - Fix Job Labels
If labels are not specified on a Job, kubernetes defaults them
to include the labels of their underlying Pod template. Helm 3
injects metadata into all resources [0] including a
`app.kubernetes.io/managed-by: Helm` label. Thus when kubernetes
sees a Job's labels they are no longer empty and thus do not get
defaulted to the underlying Pod template's labels. This is a
problem since Job labels are depended on by
- Armada pre-upgrade delete hooks
- Armada wait logic configurations
- kubernetes-entrypoint dependencies

Thus for each Job template this adds labels matching the
underlying Pod template to retain the same labels that were
present with Helm 2.

[0]: https://github.com/helm/helm/pull/7649

Change-Id: Ib5a7eb494fb776d74e1edc767b9522b02453b19d
2021-10-06 13:54:58 -05:00
Darren DeJaeger
e783450071 Add rabbitmq secret volume + mount for audit usage cronjob
This PS adds the rabbitmq secret volume + mount for the audit
usage cronjob, as it was previously missing and the job's command(s)
were failing when run.

In addition, add labels to the CronJob's metadata, so that it can
be picked up for pre-delete hooks.

Change-Id: I0a2ed0655702b4e41cc12d3908b9aed141e6f0d2
2021-09-28 13:43:51 -05:00
Sophie Huang
8ea0e27892 Add logic to Cinder bootstrap to handle timing issue
During upgrade, the Cinder pods go through the upgrade
process. Sometimes, the pods are unavailable to handle
the requests in bootstrap even the Cinder services are
up. This patchset gives the bootstrap job additional
attempt to finish the tasks

Change-Id: Ie7bd8909f1c93b76b2242748318f892a6ff9c53d
2021-08-24 21:04:47 +00:00
Susanta Gautam
3c9cf1539b Added post-install and post-upgrade hook for jobs.
Chart upgrading was failing due to some immutable fields are needed to upgrade before the jobs can be upgraded. For solving this issue, we
have added the helm.sh/hook annotations with post-install and post-upgrade values.
As for hook-weight annotations, we have added these to control the flow of the jobs with hook creation as the jobs are dependent. Like,
db-init jobs need to run before db-sync and so on.
helm3_hook values is added so that hook can be disabled from the values files.

Change-Id: Idfcc0479d152286ecd144502d80732094c9e43ea
2021-07-20 17:58:46 +05:45
Sophie Huang
a711de8195 Add volume QoS support
In this patchset, volume QoS creation and association are added
to the bootstrap if configured.

Change-Id: I8c4bd4909f06e9db4fbc6a6daad0932babe94bcf
2021-07-16 13:59:16 +00:00
Gupta, Sangeet (sg774j)
5028aa8de1 Mount rabbitmq TLS secret
Mount rabbitmq TLS secret to openstack services which support internal
TLS. Once internal TLS support is added to other service, the TLSed 
rabbitmq support should be added.

Depends-on: https://review.opendev.org/c/openstack/openstack-helm-infra/+/795188

Change-Id: I9aa272e365f846746f2e06aa7b7010db730e17df
2021-06-10 14:12:57 +00:00
Haider, Nafiz (nh532m)
c900712f30 feat(tls): Make openstack services compatible with rabbitmq TLS
Depends-on: https://review.opendev.org/c/openstack/openstack-helm-infra/+/770678

Co-authored-by: Sangeet Gupta <sg774j@att.com>

Change-Id: I11e9ad3f4079b0e12e498f9ed57e5b87ae9dc66a
2021-05-21 01:27:18 +00:00
Chinasubbareddy Mallavarapu
2002b9368d [CEPH] Fix the ceph pool creations for openstack services
This is to fix the ceph version checks for enabling the applications
on newly created pools for openstack services like cinder and glance.

Change-Id: I2c007f728180cf7753255463ebf2f8dc5dc6fa5b
2021-05-05 13:14:07 +00:00
jinyuan
3fee85324b Fix the problem in hostNetwork mode
If ClusterFirstWithHostNet does not exist, it will cause the communication between services to fail.

Change-Id: Iadac1d570e0aac1aee3361792319d825bcadc83c
2021-04-15 16:29:10 +08:00
Karl Kloppenborg
d2e2d58a5f Add ISCSI Multipath support when enable_iscsi true
When using iscsi in both cinder and nova multipath tooling access is not
currently available. This commit provides the host system access to
configure and control multipath.
This commit has been tested in our own production systems however this
is my first commit into Openstack-Helm so please review carefully and
provide me guidance on what I might be able to do better.

Change-Id: I4f017f67a5d80b9c931e2ee1653062aa503a7fd9
2021-04-12 08:28:56 +00:00
Huang, Sophie (sh879n)
f6e153fd3d Update volume type creation bootstrap logic
Verification is added to Cinder volume type creation logic
under Values.bootstrap to make sure the volume_backend_name is
configured in Values.conf.backends.

Change-Id: I1b9b1eaac8df861d28d4121477de148dba6a2dbf
2021-03-03 14:59:41 +00:00
jinyuanliu
566e1cb669 Update rbac api version for cinder
When using a helm3 to deploy , it fails. Helm3 no more support rbac.authorization.k8s.io/v1beta1 , but v1 can support helm2 and helm3.

Change-Id: Ie4e1c79c2b2513318d1b7d6a13712921a6c2a6cb
2021-02-27 11:44:20 +08:00
Chris Wedgwood
61c167d359 [nova,cinder] Use HostToContainer mount propagation
Bidirectional mount propagation doesn't work as expected,
HostToContainer does and is the safer option for now.

Change-Id: Ia0b0ab1a74991745cd74d3629d23f86bd8ff5296
2021-02-02 12:19:57 +00:00
Huang, Sophie (sh879n)
0a1d6aeb94 [cinder] Enable volume backup for iSCSI based volumes
This patchset added the necessary hostPath, hostIpc and
hostNetwork to enable the volume backup for iSCSI based
Cinder volumes.

Change-Id: Ief3cc723650a6c42e24dfd6159c0de6f81e56fce
2021-01-08 23:38:03 +00:00
Neely, Travis (tn720x)
f75208290f Resolves mount issue with termination-log
[0] introduced an error with the terminiation message path.
This patchset mimics the solution used elsewhere such as from [1].

[0] https://review.opendev.org/c/openstack/openstack-helm/+/769575
[1] https://review.opendev.org/plugins/gitiles/openstack/openstack-helm/+/refs/heads/master/nova/templates/daemonset-compute.yaml#95

Change-Id: I0fac4e4ba1cd643a75d5341b3d6a920f07cc3dde
2021-01-07 10:57:25 -06:00
intlabs
97187997e4 Cinder: Enable iscsi to work correctly in cinder volume
This PS enables iscsi actions to work correctly in cinder
volume - enabling things like conversion of glance images
to cinder volumes (required for nova-boot-from-volume)

Change-Id: I63521ff9609ad89485a843bc0fbddb00e38dccc8
Signed-off-by: Pete Birley <pete@port.direct>
2021-01-06 14:15:20 -06:00
Michael Polenchuk
73b9629ea2 [cinder] Support service tokens
Bring in option to be able to create and send service
tokens to prevent long-running job failures (default is OFF).

Change-Id: I5e5707001687e464386696b9c8d80ad8b2977e97
2020-09-25 15:05:35 +04:00
Huang, Sophie (sh879n)
be690aa5a3 [Cinder] Configuration for external ceph backend
In this patchset, comfigmap of ceph.conf and secret of
cinder user keyring is created for externally managed ceph
Cinder backend.

Change-Id: Ie76bf207a7d42bd70a6be2648e060122f7daf5ad
2020-09-17 17:49:40 +00:00
Chinasubbareddy Mallavarapu
054affa290 [Cinder] Support for external ceph backend
This is to add support for external ceph cluster as second backend
for cinder.

prerequisite:
  - create ceph.conf for external ceph cluster as configmap
  - create cinder2 user and keyring on external ceph cluster
  - create keyring of user cinder2 as a secret

now point configmap and secret created as prerequisite under
values.ceph_client.external_ceph section

also we need to add second backend under values.conf.backends section
with all the details of external ceph cluster.

Change-Id: I8df9f1da7208304f479dbb70b19af97fb01cd38f
2020-09-03 23:58:10 -05:00
KHIYANI, RAHUL (rk0850)
3221807042 Add volumemounts to cinder-backup container
Adding volumemounts to allow cinder to access /var/lib/cinder/tmp

Change-Id: I1e93587da2b4889118f2b941c89e7d3adee2b7c8
2020-08-20 11:42:03 -05:00
Gupta, Sangeet (sg774j)
0a91dd5f30 feat-tls: Add certs to cinder scheduler and Volume.
This ps mounts certs to scheduler and Volume.

Change-Id: Ibc013ffd4e8fe7500fcfdd285ad896b0e6b97acc
2020-08-19 21:52:11 +00:00
diwakar thyagaraj
f0d3ad522b Fix Indentation for Apparmor in cinder-volume Cron Job
Change-Id: Ib0b0cfb46300eeb451b462bc37781e850361d63b
Signed-off-by: diwakar thyagaraj <diwakar.chitoor.thyagaraj@att.com>
2020-08-11 02:16:59 +00:00
diwakar thyagaraj
a892707f41 Add Application Armor to cinder-Job
Change-Id: Icab982b9168381a7795719a6348a5d1c85b71453
Signed-off-by: diwakar thyagaraj <diwakar.chitoor.thyagaraj@att.com>
2020-08-06 18:40:52 +00:00
Gupta, Sangeet (sg774j)
dd62dacdef feat(tls): add database certificate to cinder-pai
Change-Id: Ifab2eb8c345ce8ea110dbab044a2675f011e1ef3
2020-07-30 22:52:27 +00:00
Gupta, Sangeet (sg774j)
7b720184e3 feat(tls): Make openstack services compatible with mariadb with TLS
Change database scerets.

Change-Id: I068dfcb23d596d4b9bcde1944fb4def010490452
2020-07-24 23:02:09 +00:00
PrateekDodda
711631d664 Add missing security context to Cinder pods/containers
This updates the cinder chart to include the pod
security context on the pod template.

This also adds the container security context to set
readOnlyRootFilesystem flag to true

Change-Id: Ia6e3c56087bae6f8c86db688404c6ce3a1d5d99d
2020-07-24 16:09:49 +00:00
sgupta
702c17eb78 feat(tls): Make openstack services compatible with mariadb with TLS
Depends-on: https://review.opendev.org/#/c/741037/
Change-Id: I21f4ede3bd18c0af8da1eba60cd0b7b932a31410
2020-07-14 23:32:03 +00:00
Zuul
c35a74c729 Merge "Add missing security context to Cinder pods/containers" 2020-07-13 18:57:50 +00:00
Andrii Ostapenko
44d263b2bf Enable templates linting
- braces
- brackets
- colons
- commas
- comments
- hyphens
- indentation
- key-duplicates

with corresponding code changes.

Also disable enforcement for document-(start|end) rules and
disables warnings to increase readability.

* Unrestrict octal values rule since benefits of file modes readability
  exceed possible issues with yaml 1.2 adoption in future k8s versions.
  These issues will be addressed when/if they occur.

Change-Id: Ic5e327cf40c4b09c90738baff56419a6cef132da
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-07-11 00:52:51 +00:00
Tin Lam
918a307427 feat(tls): add tls support to openstack services
This patch set enables TLS for the following OpenStack services: keystone,
horizon, glance, cinder, heat, nova, placement and neutron for s- (stein)
and t- (train) release. This serves as a consolidation and clean up patch
for the following patches:

[0] https://review.opendev.org/#/c/733291
[1] https://review.opendev.org/#/c/735202
[2] https://review.opendev.org/#/c/733962
[3] https://review.opendev.org/#/c/733404
[4] https://review.opendev.org/#/c/734896

This also addresses comments mentioned in previous patches.

Co-authored-by: Gage Hugo <gagehugo@gmail.com>
Co-authored-by: sgupta <sg774j@att.com>

Depends-on: https://review.opendev.org/#/c/737194/

Change-Id: Id34ace54298660b4b151522916e929a29f5731be
Signed-off-by: Tin Lam <tin@irrational.io>
2020-07-10 09:36:31 -05:00
DODDA, PRATEEK REDDY (PD2839)
6e3c3a2eb4 Add missing security context to Cinder pods/containers
This updates the Cinder chart to include the pod
security context on the pod template.

This also adds the container security context to set
readOnlyRootFilesystem flag to true

Change-Id: If17af3e3dba188a43ed11a0d5757fcae9f5358e8
2020-07-07 01:42:27 +00:00
diwakar thyagaraj
477602f2e7 Enable Apparmor to osh test Pods
Change-Id: I0a67f66cc4ed8a1e3a5c3c458b7c1521f9169160
Signed-off-by: diwakar thyagaraj <diwakar.chitoor.thyagaraj@att.com>
2020-06-01 18:32:51 +00:00
Gage Hugo
db79e79788 Remove OSH Authors copyright
The current copyright refers to a non-existent group
"openstack helm authors" with often out-of-date references that
are confusing when adding a new file to the repo.

This change removes all references to this copyright by the
non-existent group and any blank lines underneath.

Change-Id: Ia035037e000f1bf95202fc07b8cd1ad0fc019094
2020-04-03 20:53:32 +00:00
dt241s@att.com
1c46490094 Enable Apparmor to Cinder
Co-Authored by gage Hugo <gagehugo@gmail.com>.

This Patchset creates Zuul Gate Jobs for apparmor to support Cinder.

Change-Id: I7705512a3b50560b183e19f0868be40078241cdd
2020-04-01 04:27:56 +00:00
Huang, Sophie (sh879n)
8a7b7ba086 Enable Cinder backends to use iSCSI for data traffic
In this patchset, the iSCSI protocol support is added
to enable Cinder to use iSCSI based storage backends.

Bootable volumes are not supported, only VM attached
volumes are supported for this initial patchset.

Change-Id: I1b35290b62d2cebae4bd8be62126a53f230ac6c0
2020-03-16 14:23:23 +00:00
Gage Hugo
f9dbba7043 Revert "Revert "Keystone Authtoken Cache: allow universal secret key to be set""
This reverts commit 90d070390d.

Change-Id: I017c6e9676b872e1aab21f9dc8aa2f93db58d49f
2020-02-21 11:16:55 -06:00
Zuul
ff95038bae Merge "Modify incorrect format of Cinder policy file" 2020-02-19 16:44:08 +00:00
Gayathri Devi Kathiri
8401db0e77 Modify incorrect format of Cinder policy file
Cinder default format of policy file is changed from
"json" to "yaml" in stein. This patch set modifies
Cinder chart templates to load policies in yaml format.

Change-Id: I28f3d5be6609cd28bbc1ce8e5fc1d1cf4730b760
2020-02-18 18:09:24 +00:00
Zuul
040e6aa23a Merge "[Cinder] Gotpl script fix" 2020-02-13 20:41:01 +00:00
Vasyl Saienko
90d070390d Revert "Keystone Authtoken Cache: allow universal secret key to be set"
This reverts commit 1c85fdc390.

Do not use randomly generated strings in configmaps as this leads to
whole helm release redeployment even no values are changed. The random
items have to be generated outside of helm chart and provided via
values.
Also previous behaviour didn't allow to use cache during rolling upgrade
as new pods were spawned with new key.

Change-Id: I423611b18fca0d65e2e721a9c6a0c3d8df0813d2
2020-02-12 11:18:06 +00:00
Tin Lam
4f1636590a [Cinder] Gotpl script fix
The gotpl script that determines if a cinder backend is ceph-backed
is not properly handling additional backends that does not have the
driver "cinder.volume.drivers.rbd.RBDDriver". This patch set fixes
the gotpl so it no longer causes a rendering problem.

Change-Id: I902e82301019531832afebce7a1e2f0b28bac8f3
Signed-off-by: Tin Lam <tin@irrational.io>
2020-02-07 09:39:29 -06:00
Chinasubbareddy Mallavarapu
d03a8a1a22 Support the Nautilus release for Ceph
- Change all tests to support Nautilus,Mimic and Luminous releases
- Update ceph-config-helper image

Change-Id: I557b1efa12529d0ee51d4c5b9d4beb4abf1b0574
2019-12-17 16:23:15 +00:00
Pete Birley
d4cf8f8c71 Cinder: Make image conversion dir an emptydir
This PS makes the image conversion directory an emptydir, so that
we can use read only containers and sill convert images from glance
into volumes.

Change-Id: Id3cda737895451c2261bf9adfe54995db28c2f63
Signed-off-by: Pete Birley <pete@port.direct>
2019-07-31 15:05:29 -05:00
Zuul
777e5994e8 Merge "Cinder support multiple Ceph volume backends" 2019-07-29 15:16:14 +00:00