4006 Commits

Author SHA1 Message Date
Gage Hugo
7034968d96 Move check jobs to use helm3
This change migrates the check jobs in OSH to use the
new helm v3 script when deploying kubernetes via
minikube.

This is one step in the move to helm v3. Future changes
will migrate the other jobs.

Change-Id: If741db5997a27ed06584b9af2d50485d8de34a2b
2021-10-29 19:41:25 +00:00
Gage Hugo
bdd1e7ebe9 Make TLS job nonvoting
The move to helm v3 breaks the rendering for the ca-issuer chart.
While that gets fixed, we can temporary make the job non-voting
in order to unblock the migration to helm v3.

Change-Id: Ia25ac1f85974fc8c8ac8cf3ffedff746a92f2cf5
2021-10-28 18:23:25 -05:00
Gage Hugo
9a89037615 Update default image references
This change updates the image references in the keystone chart
to the latest supported releases of both openstack and ubuntu.

Change-Id: If4f30252b5d839cfe517ee57cbef96e7775e7ec5
2021-10-28 18:15:38 +00:00
Zuul
f07e5ef659 Merge "Fix helm test method about horizon" 2021-10-27 06:27:30 +00:00
Zuul
031c07ebb4 Merge "Fix helm test method about ceph-radosgateway" 2021-10-27 06:27:28 +00:00
Zuul
b920db54bd Merge "Fix helm test method about barbican" 2021-10-27 03:45:18 +00:00
Huy Tran
6b785b16dc Add option to extend the wait for cell-setup-init
In some deployement environments, nova compute processes took a bit
longer to register on all hosts, and vm/server is instantiated almost
immediately before the process is registered on remaining hosts.
This PS enhances the cell-setup-init script to enable option to
extend the wait before performing discover hosts.

Change-Id: Ie9867e64c554d4f39fdc7432823a1869f0b4a520
2021-10-26 19:03:48 +00:00
Zuul
96c7ec86c8 Merge "Fix helm test method about mistral" 2021-10-26 07:14:22 +00:00
Zuul
51f28a8ee8 Merge "Fix helm test method about cinder" 2021-10-26 07:14:04 +00:00
Gage Hugo
613fecd37f Remove extra fsGroup
The keystone chart recently had a change to fix the world
readable warning message, but an extra fsGroup entry causes
the chart to fail to deploy when using helm3.

This change removes the offending entry from the values file
in the keystone chart.

Change-Id: I540854da7123f413215b627d3bfb077c6f4864c6
2021-10-23 05:37:20 +00:00
Gage Hugo
75349b25b7 Remove extra linting job
Now that the main linting job runs helm v3, this extra job is
no longer needed. This change removes the specific helm v3
linter job.

Change-Id: I40d6be368a4f36242c54b9a57b7e6f7328be8bb6
2021-10-22 17:31:25 -05:00
Zuul
b48929a4fa Merge "fix(log): reduces chattiness in keystone log" 2021-10-21 09:11:33 +00:00
Zuul
3cdf7be017 Merge "Add Masakari" 2021-10-20 20:16:37 +00:00
Tin Lam
73531436e9 fix(log): reduces chattiness in keystone log
Current implementation of Keystone prints a warning message if the
directory containing the fernet keys is world readable (o+r). As OSH
uses a volumeMount to handle fernet keys and is by default readonly,
there is no meaningful way to make the directory (not the keys) world
unreadable. Consequently, keystone just keep logging that warning,
adding no particular value besides flooding the log.

Rather than disabling the log message in keystone (as that warning is
meaningful from a security standpoint), this patch set changes the way
we deal with the secret volume so the directory is no longer world
readable, so keystone will stop issuing that warning message.

Signed-off-by: Tin Lam <t@lam.wtf>
Change-Id: Id29abe667f5ef0b61da3d3825b5bf795f2d98865
2021-10-20 09:21:50 -05:00
jinyuanliu
caeaafd01b Fix helm test method about horizon
This patch makes the helm test command more standard by calling script
of common.

Change-Id: I3a54d85f0c1d16f28d4b1194f69d3c1daa456976
2021-10-17 02:20:24 -04:00
jinyuanliu
9abc09bcd2 Fix helm test method about ceph-radosgateway
This patch makes the helm test command more standard by calling script
of common.

Change-Id: I5a19cd9b94a405e0c1e55a7e009aaf9b46878a1c
2021-10-17 02:16:17 -04:00
jinyuanliu
1bcc531443 Fix helm test method about barbican
This patch makes the helm test command more standard by calling script
of common.

Change-Id: I1232699f95abd8a2ab31867e82cd4484ffc2677e
2021-10-17 02:11:53 -04:00
jinyuanliu
3e62ce320b Fix helm test method about mistral
This patch makes the helm test command more standard by calling script
of common.

Change-Id: Ied8355e80f27d560a989410d369fdceda7f851ca
2021-10-17 02:06:28 -04:00
jinyuanliu
4063b20af4 Fix helm test method about cinder
This patch makes the helm test command more standard by calling script
of common.

Change-Id: Icb4bdb5c63b1630cb63d3e43a1e5595af0f4e6bf
2021-10-17 01:53:05 -04:00
xuxant02@gmail.com
5802a9c032 Add Masakari
Initial Chart for masakari

Change-Id: Iac5f6ae2bbe9d19d21aaaf9f638bf6d566dbe26f
2021-10-15 09:15:47 +05:45
Zuul
0d7800a8cc Merge "Update htk requirements repo" 2021-10-13 16:58:27 +00:00
Gage Hugo
c20c1e4400 Update htk requirements repo
As part of the move to helm v3, all the charts in the OSH repos
will no longer lint/build properly due to a lack of helm serve
in helm v3.

This change modifies the helm-toolkit repo location to the
osh-infra repo in order to account for the removal oh helm serve.

This work is part of the migration to helm v3 and will be utilized
in future changes.

Change-Id: I90d25943d69ad6c76455f7778a4894f00c525c46
2021-10-10 18:45:28 -05:00
Gage Hugo
f2108855f5 Remove helm status from deployment scripts
With the move to helm v3, helm status requires a namespace to be
specified, but doing so breaks helm v2 compatability. In order
to preserve our gating with both versions of helm while we make
the change from v2 to v3, this change removes the usage of helm
serve in openstack-helm's deployment scripts.

Once we fully move to helm v3, these scripts can be improved and
cleaned up to be more compatible with the new v3 syntax.

Change-Id: I02b6bbf780abf8c8bc7c1783c35d9411d25e18a8
2021-10-10 23:34:17 +00:00
DeJaeger, Darren (dd118r)
7803000a54 Helm 3 - Fix Additional Job Labels
If labels are not specified on a Job, kubernetes defaults them
to include the labels of their underlying Pod template. Helm 3
injects metadata into all resources [0] including a
`app.kubernetes.io/managed-by: Helm` label. Thus when kubernetes
sees a Job's labels they are no longer empty and thus do not get
defaulted to the underlying Pod template's labels. This is a
problem since Job labels are depended on by
- Armada pre-upgrade delete hooks
- Armada wait logic configurations
- kubernetes-entrypoint dependencies

Thus, for Job templates previously missed, this adds labels matching
the underlying Pod template to retain the same labels that were
present with Helm 2.

[0]: https://github.com/helm/helm/pull/7649

Change-Id: Ie438b449a3d9853d786215d40a39c32d164e9950
2021-10-10 12:04:49 -05:00
Gage Hugo
1e651dc3c3 Helm 3 - Fix Job Labels
If labels are not specified on a Job, kubernetes defaults them
to include the labels of their underlying Pod template. Helm 3
injects metadata into all resources [0] including a
`app.kubernetes.io/managed-by: Helm` label. Thus when kubernetes
sees a Job's labels they are no longer empty and thus do not get
defaulted to the underlying Pod template's labels. This is a
problem since Job labels are depended on by
- Armada pre-upgrade delete hooks
- Armada wait logic configurations
- kubernetes-entrypoint dependencies

Thus for each Job template this adds labels matching the
underlying Pod template to retain the same labels that were
present with Helm 2.

[0]: https://github.com/helm/helm/pull/7649

Change-Id: Ib5a7eb494fb776d74e1edc767b9522b02453b19d
2021-10-06 13:54:58 -05:00
Gupta, Sangeet (sg774j)
a772a30f07 nova: Update script to true of grep does get anything.
Change-Id: I54addea00b4ab91d8fe4925f88cacd582888a7f3
2021-10-06 14:02:45 +00:00
Gupta, Sangeet (sg774j)
b75545d0c6 nova: Define service cleaner sleep time
This makes the service cleaner sleep time if any service is down
provisionable.

Change-Id: If55a22c4f22ff0a48767dae3d57aca6c3c8cccac
2021-10-05 14:34:13 +00:00
Gupta, Sangeet (sg774j)
0c80a415bf nova: Give service time to restore
nova-service-cleaner job deletes the service which are down. If the
database is down, the service will go down as well. When database comes
back up, all the services starts to come back to up status. If the
nova-service-cleaner is run in this interim time, the service that
were down gets deleted. These would have come up if the job had not
run. Adding sleep to this job to give service time to come back up
if recovering. The sleep is set to 2 times the report_interval.

Change-Id: Ia292d19508e9449ccb40d1100b1d56b1283e5d53
2021-10-05 05:10:39 +00:00
Zuul
3237299ac6 Merge "Add missing slash" 2021-10-04 09:06:06 +00:00
Thiago Brito
b4c58ca27b Fixing nova's helm.sh/hook disablement
It's impossible to disable the helm.sh/hook for the nova-ks-service
job since the hook is being added in duplicity to the job dictionary
before the check for Values.helm3_hook. This commit removes the
duplicity so we can disable it properly.

Signed-off-by: Thiago Brito <thiago.brito@windriver.com>
Change-Id: Ie72a13afc81bce4424b10bbc542dc7c44dd38975
2021-10-01 15:46:00 -03:00
Zuul
e5b9b9cabc Merge "Add option to disable helm.sh/hook annotations" 2021-09-30 23:20:53 +00:00
Zuul
1f4ab070aa Merge "Removed default policy from horizon chart" 2021-09-30 18:33:13 +00:00
Zuul
ed64c95f0e Merge "Removed policies from values file" 2021-09-30 18:31:40 +00:00
Thiago Brito
21157f8e6a Add option to disable helm.sh/hook annotations
Adding a helm3_hook in values.yaml file in case hooks needs
to be disabled (e.g. on Helm v2).

Signed-off-by: Thiago Brito <thiago.brito@windriver.com>
Change-Id: I1c03ea9ee88d1306283ce577b100c9864bec5d1b
2021-09-29 18:40:15 -03:00
Darren DeJaeger
e783450071 Add rabbitmq secret volume + mount for audit usage cronjob
This PS adds the rabbitmq secret volume + mount for the audit
usage cronjob, as it was previously missing and the job's command(s)
were failing when run.

In addition, add labels to the CronJob's metadata, so that it can
be picked up for pre-delete hooks.

Change-Id: I0a2ed0655702b4e41cc12d3908b9aed141e6f0d2
2021-09-28 13:43:51 -05:00
xuxant02@gmail.com
fac3c74fdb Removed default policy from horizon chart
The policy document and policy documents in the code are conflicting and creating strange issue. As the policy for nova, neutron, keystone, glance and cinder are available in horizon code, they have been removed from the chart values file.

Change-Id: I78b487c11d3d018b18ce823ffd9d8b8940dfa575
2021-09-27 17:36:43 +05:45
xuxant02@gmail.com
a33ea84f91 Removed policies from values file
Removing the hardcoded policy document from the values file of helm chart in favor of policy in code.

Change-Id: I5c3c4699cafc76d3aa7d9c94f6e15eeff3f22b6c
2021-09-24 15:18:20 +05:45
xuxant02@gmail.com
e4fffb30e5 Fix for before option in archive_deleted_rows
Script fails with too many arguments when provided command like "$(date -d 'now - 2 days')" as the value for --before option. Addition of quotes fix the issue.

Change-Id: I0639d8aea368988976d5990c42e960de44844f61
2021-09-21 11:42:24 +05:45
ericxiett
c5105fd9da Add missing slash
The default of 'domain_config_dir' in keystone is '/etc/keystone/domains'.
This patch adds the missing slash.

Change-Id: I30523ec3fd3144811a76b9078e915eff4ffa2b66
2021-09-21 09:44:59 +08:00
Zuul
54da75fd71 Merge "Fix db connection key name in DEFAULT config" 2021-09-19 23:35:34 +00:00
root
d7524be959 Fix db connection key name in DEFAULT config
Change-Id: I7c31d2f036e7088564fd947e5979dd34c283f768
2021-09-17 17:03:50 +02:00
root
2787c16197 Add default polices
Change-Id: Ia9c054a246b258eff5b196e582aa2a743c95bbd2
2021-09-07 15:59:17 +02:00
Zuul
f0639fccb1 Merge "Re-enable multinode gating jobs" 2021-09-06 03:39:37 +00:00
Zuul
078c611c39 Merge "Cleanup unused jobs" 2021-09-06 03:23:17 +00:00
Zuul
f18953f187 Merge "Added post-install and post-upgrade for jobs in heat" 2021-09-04 22:16:50 +00:00
Gage Hugo
4a952a84a6 Re-enable multinode gating jobs
Now that the kubeadm-aio is fixed, we can re-enable the
multinode jobs for gating against openstack-helm.

Change-Id: Ib1f1bca5f370e0326ea0211dfcfba9544bd458b2
2021-09-04 01:29:47 +00:00
Gage Hugo
9c7380568e Cleanup unused jobs
This change removes a bunch of old and duplicated jobs,
duplicate netpol and the old armada jobs that have not
been maintained. Also removed the tls job from
experimental since we run it now in gating.

Change-Id: Ic19520d8790c52d66d62b20a23658c57d954697e
2021-09-04 00:42:28 +00:00
OpenStack Proposal Bot
04ed1e1aca Imported Translations from Zanata
For more information about this automatic import see:
https://docs.openstack.org/i18n/latest/reviewing-translation-import.html

Change-Id: I38723d7007d74b34ec3cc722ed879c0aa30b7dab
2021-09-03 22:08:50 +00:00
Zuul
e62864e97f Merge "Added helm.sh/hook annotations for nova chart" 2021-08-31 21:15:23 +00:00
Susanta Gautam
7ca67915a3 Added helm.sh/hook annotations for placement chart jobs
Chart upgrade fails as some immutable fields in job are needed to be applied earlier then the job manifests. To solve the problem, helm.sh/hook annotations with post-install and post-upgrade values can be used so that the jobs are the last one to be applied after all the manifests. As jobs are dependent one services, hook weight is used to maintain the job creation order.

Change-Id: I7551977599d376e4d240fff5cb9d002fc918d9fe
2021-08-27 18:09:42 +05:45