Commit Graph

3793 Commits

Author SHA1 Message Date
Zuul
51f28a8ee8 Merge "Fix helm test method about cinder" 2021-10-26 07:14:04 +00:00
Gage Hugo
613fecd37f Remove extra fsGroup
The keystone chart recently had a change to fix the world
readable warning message, but an extra fsGroup entry causes
the chart to fail to deploy when using helm3.

This change removes the offending entry from the values file
in the keystone chart.

Change-Id: I540854da7123f413215b627d3bfb077c6f4864c6
2021-10-23 05:37:20 +00:00
Gage Hugo
75349b25b7 Remove extra linting job
Now that the main linting job runs helm v3, this extra job is
no longer needed. This change removes the specific helm v3
linter job.

Change-Id: I40d6be368a4f36242c54b9a57b7e6f7328be8bb6
2021-10-22 17:31:25 -05:00
Zuul
b48929a4fa Merge "fix(log): reduces chattiness in keystone log" 2021-10-21 09:11:33 +00:00
Zuul
3cdf7be017 Merge "Add Masakari" 2021-10-20 20:16:37 +00:00
Tin Lam
73531436e9 fix(log): reduces chattiness in keystone log
Current implementation of Keystone prints a warning message if the
directory containing the fernet keys is world readable (o+r). As OSH
uses a volumeMount to handle fernet keys and is by default readonly,
there is no meaningful way to make the directory (not the keys) world
unreadable. Consequently, keystone just keep logging that warning,
adding no particular value besides flooding the log.

Rather than disabling the log message in keystone (as that warning is
meaningful from a security standpoint), this patch set changes the way
we deal with the secret volume so the directory is no longer world
readable, so keystone will stop issuing that warning message.

Signed-off-by: Tin Lam <t@lam.wtf>
Change-Id: Id29abe667f5ef0b61da3d3825b5bf795f2d98865
2021-10-20 09:21:50 -05:00
jinyuanliu
4063b20af4 Fix helm test method about cinder
This patch makes the helm test command more standard by calling script
of common.

Change-Id: Icb4bdb5c63b1630cb63d3e43a1e5595af0f4e6bf
2021-10-17 01:53:05 -04:00
xuxant02@gmail.com
5802a9c032 Add Masakari
Initial Chart for masakari

Change-Id: Iac5f6ae2bbe9d19d21aaaf9f638bf6d566dbe26f
2021-10-15 09:15:47 +05:45
Zuul
0d7800a8cc Merge "Update htk requirements repo" 2021-10-13 16:58:27 +00:00
Gage Hugo
c20c1e4400 Update htk requirements repo
As part of the move to helm v3, all the charts in the OSH repos
will no longer lint/build properly due to a lack of helm serve
in helm v3.

This change modifies the helm-toolkit repo location to the
osh-infra repo in order to account for the removal oh helm serve.

This work is part of the migration to helm v3 and will be utilized
in future changes.

Change-Id: I90d25943d69ad6c76455f7778a4894f00c525c46
2021-10-10 18:45:28 -05:00
Gage Hugo
f2108855f5 Remove helm status from deployment scripts
With the move to helm v3, helm status requires a namespace to be
specified, but doing so breaks helm v2 compatability. In order
to preserve our gating with both versions of helm while we make
the change from v2 to v3, this change removes the usage of helm
serve in openstack-helm's deployment scripts.

Once we fully move to helm v3, these scripts can be improved and
cleaned up to be more compatible with the new v3 syntax.

Change-Id: I02b6bbf780abf8c8bc7c1783c35d9411d25e18a8
2021-10-10 23:34:17 +00:00
DeJaeger, Darren (dd118r)
7803000a54 Helm 3 - Fix Additional Job Labels
If labels are not specified on a Job, kubernetes defaults them
to include the labels of their underlying Pod template. Helm 3
injects metadata into all resources [0] including a
`app.kubernetes.io/managed-by: Helm` label. Thus when kubernetes
sees a Job's labels they are no longer empty and thus do not get
defaulted to the underlying Pod template's labels. This is a
problem since Job labels are depended on by
- Armada pre-upgrade delete hooks
- Armada wait logic configurations
- kubernetes-entrypoint dependencies

Thus, for Job templates previously missed, this adds labels matching
the underlying Pod template to retain the same labels that were
present with Helm 2.

[0]: https://github.com/helm/helm/pull/7649

Change-Id: Ie438b449a3d9853d786215d40a39c32d164e9950
2021-10-10 12:04:49 -05:00
Gage Hugo
1e651dc3c3 Helm 3 - Fix Job Labels
If labels are not specified on a Job, kubernetes defaults them
to include the labels of their underlying Pod template. Helm 3
injects metadata into all resources [0] including a
`app.kubernetes.io/managed-by: Helm` label. Thus when kubernetes
sees a Job's labels they are no longer empty and thus do not get
defaulted to the underlying Pod template's labels. This is a
problem since Job labels are depended on by
- Armada pre-upgrade delete hooks
- Armada wait logic configurations
- kubernetes-entrypoint dependencies

Thus for each Job template this adds labels matching the
underlying Pod template to retain the same labels that were
present with Helm 2.

[0]: https://github.com/helm/helm/pull/7649

Change-Id: Ib5a7eb494fb776d74e1edc767b9522b02453b19d
2021-10-06 13:54:58 -05:00
Gupta, Sangeet (sg774j)
a772a30f07 nova: Update script to true of grep does get anything.
Change-Id: I54addea00b4ab91d8fe4925f88cacd582888a7f3
2021-10-06 14:02:45 +00:00
Gupta, Sangeet (sg774j)
b75545d0c6 nova: Define service cleaner sleep time
This makes the service cleaner sleep time if any service is down
provisionable.

Change-Id: If55a22c4f22ff0a48767dae3d57aca6c3c8cccac
2021-10-05 14:34:13 +00:00
Gupta, Sangeet (sg774j)
0c80a415bf nova: Give service time to restore
nova-service-cleaner job deletes the service which are down. If the
database is down, the service will go down as well. When database comes
back up, all the services starts to come back to up status. If the
nova-service-cleaner is run in this interim time, the service that
were down gets deleted. These would have come up if the job had not
run. Adding sleep to this job to give service time to come back up
if recovering. The sleep is set to 2 times the report_interval.

Change-Id: Ia292d19508e9449ccb40d1100b1d56b1283e5d53
2021-10-05 05:10:39 +00:00
Zuul
3237299ac6 Merge "Add missing slash" 2021-10-04 09:06:06 +00:00
Thiago Brito
b4c58ca27b Fixing nova's helm.sh/hook disablement
It's impossible to disable the helm.sh/hook for the nova-ks-service
job since the hook is being added in duplicity to the job dictionary
before the check for Values.helm3_hook. This commit removes the
duplicity so we can disable it properly.

Signed-off-by: Thiago Brito <thiago.brito@windriver.com>
Change-Id: Ie72a13afc81bce4424b10bbc542dc7c44dd38975
2021-10-01 15:46:00 -03:00
Zuul
e5b9b9cabc Merge "Add option to disable helm.sh/hook annotations" 2021-09-30 23:20:53 +00:00
Zuul
1f4ab070aa Merge "Removed default policy from horizon chart" 2021-09-30 18:33:13 +00:00
Zuul
ed64c95f0e Merge "Removed policies from values file" 2021-09-30 18:31:40 +00:00
Thiago Brito
21157f8e6a Add option to disable helm.sh/hook annotations
Adding a helm3_hook in values.yaml file in case hooks needs
to be disabled (e.g. on Helm v2).

Signed-off-by: Thiago Brito <thiago.brito@windriver.com>
Change-Id: I1c03ea9ee88d1306283ce577b100c9864bec5d1b
2021-09-29 18:40:15 -03:00
Darren DeJaeger
e783450071 Add rabbitmq secret volume + mount for audit usage cronjob
This PS adds the rabbitmq secret volume + mount for the audit
usage cronjob, as it was previously missing and the job's command(s)
were failing when run.

In addition, add labels to the CronJob's metadata, so that it can
be picked up for pre-delete hooks.

Change-Id: I0a2ed0655702b4e41cc12d3908b9aed141e6f0d2
2021-09-28 13:43:51 -05:00
xuxant02@gmail.com
fac3c74fdb Removed default policy from horizon chart
The policy document and policy documents in the code are conflicting and creating strange issue. As the policy for nova, neutron, keystone, glance and cinder are available in horizon code, they have been removed from the chart values file.

Change-Id: I78b487c11d3d018b18ce823ffd9d8b8940dfa575
2021-09-27 17:36:43 +05:45
xuxant02@gmail.com
a33ea84f91 Removed policies from values file
Removing the hardcoded policy document from the values file of helm chart in favor of policy in code.

Change-Id: I5c3c4699cafc76d3aa7d9c94f6e15eeff3f22b6c
2021-09-24 15:18:20 +05:45
xuxant02@gmail.com
e4fffb30e5 Fix for before option in archive_deleted_rows
Script fails with too many arguments when provided command like "$(date -d 'now - 2 days')" as the value for --before option. Addition of quotes fix the issue.

Change-Id: I0639d8aea368988976d5990c42e960de44844f61
2021-09-21 11:42:24 +05:45
ericxiett
c5105fd9da Add missing slash
The default of 'domain_config_dir' in keystone is '/etc/keystone/domains'.
This patch adds the missing slash.

Change-Id: I30523ec3fd3144811a76b9078e915eff4ffa2b66
2021-09-21 09:44:59 +08:00
Zuul
54da75fd71 Merge "Fix db connection key name in DEFAULT config" 2021-09-19 23:35:34 +00:00
root
d7524be959 Fix db connection key name in DEFAULT config
Change-Id: I7c31d2f036e7088564fd947e5979dd34c283f768
2021-09-17 17:03:50 +02:00
root
2787c16197 Add default polices
Change-Id: Ia9c054a246b258eff5b196e582aa2a743c95bbd2
2021-09-07 15:59:17 +02:00
Zuul
f0639fccb1 Merge "Re-enable multinode gating jobs" 2021-09-06 03:39:37 +00:00
Zuul
078c611c39 Merge "Cleanup unused jobs" 2021-09-06 03:23:17 +00:00
Zuul
f18953f187 Merge "Added post-install and post-upgrade for jobs in heat" 2021-09-04 22:16:50 +00:00
Gage Hugo
4a952a84a6 Re-enable multinode gating jobs
Now that the kubeadm-aio is fixed, we can re-enable the
multinode jobs for gating against openstack-helm.

Change-Id: Ib1f1bca5f370e0326ea0211dfcfba9544bd458b2
2021-09-04 01:29:47 +00:00
Gage Hugo
9c7380568e Cleanup unused jobs
This change removes a bunch of old and duplicated jobs,
duplicate netpol and the old armada jobs that have not
been maintained. Also removed the tls job from
experimental since we run it now in gating.

Change-Id: Ic19520d8790c52d66d62b20a23658c57d954697e
2021-09-04 00:42:28 +00:00
OpenStack Proposal Bot
04ed1e1aca Imported Translations from Zanata
For more information about this automatic import see:
https://docs.openstack.org/i18n/latest/reviewing-translation-import.html

Change-Id: I38723d7007d74b34ec3cc722ed879c0aa30b7dab
2021-09-03 22:08:50 +00:00
Zuul
e62864e97f Merge "Added helm.sh/hook annotations for nova chart" 2021-08-31 21:15:23 +00:00
Susanta Gautam
7ca67915a3 Added helm.sh/hook annotations for placement chart jobs
Chart upgrade fails as some immutable fields in job are needed to be applied earlier then the job manifests. To solve the problem, helm.sh/hook annotations with post-install and post-upgrade values can be used so that the jobs are the last one to be applied after all the manifests. As jobs are dependent one services, hook weight is used to maintain the job creation order.

Change-Id: I7551977599d376e4d240fff5cb9d002fc918d9fe
2021-08-27 18:09:42 +05:45
Zuul
4d4b527558 Merge "Add logic to Cinder bootstrap to handle timing issue" 2021-08-26 18:18:02 +00:00
Sophie Huang
8ea0e27892 Add logic to Cinder bootstrap to handle timing issue
During upgrade, the Cinder pods go through the upgrade
process. Sometimes, the pods are unavailable to handle
the requests in bootstrap even the Cinder services are
up. This patchset gives the bootstrap job additional
attempt to finish the tasks

Change-Id: Ie7bd8909f1c93b76b2242748318f892a6ff9c53d
2021-08-24 21:04:47 +00:00
Zuul
f405eab5f3 Merge "Added helm.sh/hook annotations for jobs in glance chart." 2021-08-23 20:01:01 +00:00
root
764affd1eb Fix enable password retrieve config value
Now OPENSTACK_ENABLE_PASSWORD_RETRIEVE value is string so always
get true regardless of the config value.

Change-Id: I0fb1203f22ddd6e707eeb80f72a3685c3b9c350f
2021-08-19 16:17:42 +02:00
Susanta Gautam
841fb577d9 Added post-install and post-upgrade for jobs in heat
Chart upgrading was failing due to some immutable fields are needed to upgrade before the jobs can be upgraded. For solving this issue, we have added the helm.sh/hook annotations with post-install and post-upgrade values. As for hook-weight annotations, we have added these to control the flow of the jobs with hook creation as the jobs are dependent. Like, db-init jobs need to run before db-sync and so on. Also values helm3_hook is introduced in values.yaml from which hooks can be disabled if needed.

Change-Id: Ibc99cb20482864f55daa12321e8d81414c1ef9f8
2021-08-19 15:55:38 +05:45
Susanta Gautam
30fbdb6748 Added helm.sh/hook annotations for jobs in glance chart.
Chart upgrading was failing due to some immutable fields in job are needed to upgrade. So, we have added the helm.sh/hook annotations with post-install and post-upgrade values. As for hook-weight annotations, we have added these to control the flow of the jobs with hook creation as the jobs are dependent. Like, db-init jobs need to run before db-sync and so on. Also helm3_hook value is introduced in values.yaml, which can be used to disable helm hook if needed.

Change-Id: Idb4b992b4061f4a014570b7933a585df1a096299
2021-08-18 17:36:09 +05:45
Susanta Gautam
bd825495a4 Added helm.sh/hook annotations for nova chart
Chart upgrading was failing due to some immutable fields are needed to be upgraded before the jobs can be upgraded. For solving this issue, helm.sh/hook annotations with post-install and post-upgrade has been added. As for hook-weight annotations, we have added these to control the flow of the jobs with hook creation as the jobs are dependent. Like, db-init jobs need to run before db-sync and so on. Also, helm3_hook value is added in values.yaml file in case hooks needs to be disabled if needed.

Change-Id: I4d489f5ded94f19dd3fcf58dafde00b18ff5bcae
2021-08-17 21:10:38 +05:45
Zuul
2f80bd3ff2 Merge "Add V and W jobs to zuul check" 2021-08-16 08:16:40 +00:00
Gage Hugo
dfcf42289b Run helm3 linter in check
This change adds a helm3 linter to the zuul check job list. The job
currently emits some warnings, these will be cleared up in future
changes.

Change-Id: I4d74ba5464e9e3d78b95298e9778b99f1b387fcd
2021-08-09 21:35:07 +00:00
Gage Hugo
73b307a3de Add V and W jobs to zuul check
This change adds the V and W openstack release jobs to the zuul
check list. This will bring OSH testing more in line with the latest
supported releases of OpenStack.

Change-Id: I2cc98159ee9bf1ad3ac5c70a772e2b4c1bbd7fa4
2021-08-09 13:36:13 -05:00
Chris Wedgwood
3a5c7afba1 [nova] add missing 'runlock' hostMount when enable_scsi
Change-Id: Ia6c9b50ae81bec238c4cabc422fe7140347a50a6
2021-08-06 12:51:42 -05:00
Zuul
cac3f01302 Merge "Allow Barbican to talk to TLS'd mariadb" 2021-08-05 21:25:33 +00:00