Commit Graph

1047 Commits

Author SHA1 Message Date
Jenkins
dbfbbda826 Merge "Ceph: Fix Multinode Gates" 2017-08-07 16:28:17 +00:00
Jenkins
350f1b91b9 Merge "fix to avoid crash loop on ceph clean job" 2017-08-07 14:57:28 +00:00
Jenkins
075d9957af Merge "fix to avoid crash loop on glance clean job" 2017-08-07 14:47:26 +00:00
Pete Birley
59dfea0e58 Ceph: Fix Multinode Gates
This PS should make the multinode gate more reliable for ceph.

It's not perfect in that is uses the default route IPs in zuul, which
has a performance hit. The bash is also ugly as sin - but it gets us
moving again until somone has time to implement a more eligant solution
that works both in infra supplied nodes and other CI systems.

Change-Id: Ie1326f048c43d04a945ca155bde8824d17ddcbec
2017-08-07 03:39:37 +00:00
Stacey Fletcher
b3de787cf0 Gates: Add configurable timeouts
This PS allows for timeouts to be passed as arguments if a longer or
shorter timeout is needed.

Change-Id: Ie5d987084d0c1197bd491297021a9e5e2c36195c
2017-08-06 20:05:44 -05:00
Jenkins
4fcc7f78c8 Merge "Jobs: Add labels to all jobs" 2017-08-05 22:00:33 +00:00
Pete Birley
8f8a80019a Jobs: Add labels to all jobs
This PS adds labels to all jobs in OpenStack-Helm, allowing them to be
found by label searches. This makes management of large clusters using
tools like Armada easier.

Change-Id: I49b2cb7a94fab96958f187ca11e2c2a0c80ff843
2017-08-05 20:17:12 +00:00
Pete Birley
45ffd6290b Keystone user job: create domains if required
This PS creates the user and project domain during the keystone-user
jobs if reqired.

Change-Id: Ib885a3629ab32a9c60725495b50dc712948848fd
2017-08-05 09:41:06 -05:00
Tin Lam
c8f225ef91 Fix oslo _i18n issue
While trying to regenerate the .conf files, the gen-oslo-openstack-helm
tool spits back an error because of the removal of log translations in
OpenStack [0].  This patch set replaces the removed _LW() with the default
_() so the tool does not error out unexpectedly.

[0] d5e3652d12

Change-Id: I665775ae075b6ce0d1aa74ca5732e9e6566ff174
2017-08-04 08:22:15 -05:00
Dae Seong Kim
677c7d834b fix to avoid crash loop on ceph clean job
ceph clean job tries to delete a secret. but if there's no the secret,
the job falls in CrashLoopBackOff status when helm delete.

Change-Id: I863e43f576408fdcd24997bde9b658c50b0057c1
Closes-bug: 1708597
2017-08-04 16:36:47 +09:00
Dae Seong Kim
f45da069e4 fix to avoid crash loop on glance clean job
glance clean job tries to delete a image. but if there's no the image,
the job falls in CrashLoopBackOff status when helm delete.

Change-Id: I3b9c3057b9da8780ca27f1cb18dcd5541f3bcabc
Closes-bug: 1708581
2017-08-04 16:21:32 +09:00
Pete Birley
054ac68e92 KubeADM-AIO: update to K8s 1.6.8
This PS udpates the Kubernetes version to v1.6.8

Change-Id: I2170fbaf901e761cb732469dab5ad7bc946ddea5
2017-08-03 23:37:00 -05:00
Jenkins
268d8ef471 Merge "Fix joinListWithComma rendering when invoked with CLI values" 2017-08-02 20:26:55 +00:00
Jenkins
830875627d Merge "Add setup and rotate job for credential keys" 2017-08-02 14:52:39 +00:00
Jenkins
da48e214d1 Merge "Add support for Keystone's fernet tokens" 2017-08-02 13:47:52 +00:00
Pete Birley
04e05fcea4 Fix joinListWithComma rendering when invoked with CLI values
This PS fises a rendering erros in the joinListWithComma function
when used with values from the helm --set cli command.

From Kolla-Kubernetes: https://review.openstack.org/#/c/488513/
All Credit to: Serguei Bezverkhi

Change-Id: I013a37f5e6dec43232c6ee300be8f918f9ef554a
2017-08-02 08:38:14 -05:00
Michał Dulko
cfab320f26 Add setup and rotate job for credential keys
Keystone is using keys to encrypt credentials saved into the database.
The mechanism is very similar to fernet tokens. This commit implements a
job setting key repository up and rotate job for those keys. All is
based on implementation of fernet tokens.

Change-Id: I88faf1d02d2b317563e8603cebba542f8b133c6a
Closes-Bug: 1693807
2017-08-02 13:22:05 +02:00
Michał Dulko
03543a3d53 Add support for Keystone's fernet tokens
Keystone supports (and that's a default setting since Ocata) using
non-persistent fernet tokens instead of UUID tokens written into the DB.
This setting is in some cases better in terms of performance and
manageability (no more tokens DB table cleanups). OpenStack-Helm should
be able to support it.

General issue with fernet tokens is that keys used to encrypt them need
to be persistent and shared accross the cluster. Moreover "rotate"
operation generates a new key, so key repository will change over time.

This commit implements fernet tokens support by:
* A 'keystone-fernet-keys' secret is created to serve as keys repository.
* New fernet-setup Job will populate secret with initial keys.
* New fernet-rotate CronJob will be run periodically (weekly by default)
  and perform key rotation operation and update the secret.
* Secret is attached to keystone-api pods in /etc/keystone/fernet-tokens
  directory.

Turns out k8s is updating secrets attached to pods automatically, so
because of Keystone's fernet tokens implementation, we don't need to
worry about synchronization of the key repository. Everything should be
fine unless fernet-rotate job will run before all of the pods will
notice the change in the secret. As in real-world scenario you would
rotate your keys no more often than once an hour, this should be totally
fine.

Implements: blueprint keystone-fernet-tokens
Change-Id: Ifc84b8c97e1a85d30eb46260582d9c58220fbf0a
2017-08-02 13:22:05 +02:00
Robert Choi
f84716f43e Glance: Add paste_deploy values
Glance bootstrap job fails due to missing 'paste_deploy' values.
This PS solves the issue by adding the values to glance chart.

Change-Id: I850863fe29c25aab9cf57eee62098e2b5d23a7f8
Closes-Bug: 1705421
2017-08-02 14:23:01 +09:00
Jenkins
542105729b Merge "Randomize ceph namespace cleaner job name" 2017-08-01 19:59:41 +00:00
Jenkins
e8a17df247 Merge "Gate: Loopback device support" 2017-08-01 16:36:08 +00:00
Huamin Chen
4ae758a4f1 Randomize ceph namespace cleaner job name
Currently Ceph namespace job cleaner uses a fixed name. This leads to
helm delete fails to clean up Ceph package. This fix randomizes the job
name to avoid name conflicts.

DocImpact
Closes-Bug: #1707670

Change-Id: I7ac7b7482b945a9a836f6f69df0ef8cebc37bafb
2017-08-01 09:30:52 -04:00
Siri Kim
b5b7bdadb8 Fix openstack endpoint option at _ks-endpoint.sh
This PS fix openstack endpoint show option at _ks-endpoint.sh
as job-ks-endpoint fails when endpoint needs updated.

Change-Id: I8aa05f3d40e7825410eace3ad7b44d36e3bb6434
2017-08-01 18:59:37 +09:00
Pete Birley
fdbe8eb60d Gate: Loopback device support
This PS adds loopback device support to the gate scripts.
Rather than using simple loopback devices we use iscsi to
allow is to target the created devices via the bus they are
connected to. An arbitary number of devices of a desired size
can be created, and controlled via env vars.

Change-Id: I05fb7f3a1564bc36903aed2c46ed996bb8cc57c8
2017-07-31 17:12:20 -05:00
Pete Birley
04e015e49b Zuul: Gate script tidy
This PS cleans up some of the worst offenders in the gate scripts.

Change-Id: If310ae798c9572e8bde4834e5a4af5f97196efea
2017-07-29 23:58:08 -05:00
Pete Birley
8f9945f6fd Nova: Update bootstrap job
This PS updates the nova boostrap job, both bringing it inline with
other services and also adding the default flavours from Mitaka.
By setting the m1.tiny size to match the upstream it is expected
that the majority of gate failures will be solved - as many of the
VMs in nodepool do not have 20GB of free space on the rootfs.

Change-Id: I767795015422a1b326a6f34b5a3f50bf41a0ca4b
2017-07-29 23:51:47 -05:00
Jenkins
52903e5076 Merge "Install helm template plugin using helm" 2017-07-30 04:33:10 +00:00
Pete Birley
6600530421 Helm: Update to v2.5.1
This PS updates helm to v2.5.1.

Change-Id: I2b4883ce5abb79afb4ef8be6058edd6c552249f7
2017-07-29 22:16:37 -05:00
Pete Birley
e7abfee16d MariaDB: Update start script to be more robust
This PS updates the MariaDB start script remove templated values
from being directly inserted into the script. It also moves the
root connection params to a secret to prevent the root password
being exposed in logs.

Change-Id: I10977ef267877a5913bf265280ff5439c7bf268c
2017-07-29 23:05:20 +00:00
Steve Wilkerson
8dfc2cf3a3 Fix mariadb start script
Fixes the reference to mariadb replicas used when adding pods to
the mariadb cluster. This was causing nodes to not be added to
the cluster properly

Change-Id: I9df586c8939e241ea58d933652c767542fd364ff
2017-07-29 10:35:48 -05:00
Pete Birley
09ff02a2d6 Install helm template plugin using helm
This PS removes the workaround required by older versions of helm to
install the template plugin.

Change-Id: I35fb80b0841fb0d0be260694bd94580a7df1cc45
2017-07-29 10:07:50 -05:00
Jenkins
a51ac55fbd Merge "Update pod affinity to allow customisation" 2017-07-28 16:21:24 +00:00
Pete Birley
4734cf53c8 Keystone: always update service account passwords on chart deploy
This PS allows an operator to change the service account password
though the values fed into a chart.

Change-Id: If3a859f0db84237c71303ef329573c7d6aafdae7
2017-07-28 10:21:34 -05:00
Pete Birley
f30cbcf108 Update pod affinity to allow customisation
This PS updates the pod affinity function to allow customisation by
operators at the point of deployment.

Change-Id: I8b7b2f584e990e068051d9a6d5cc7b1e1adb5aa5
2017-07-28 15:02:47 +00:00
Pete Birley
a02d22a284 Ceph: Change default image pull policy
This PS changes the default image pull policy to match other OS-H
charts.

Change-Id: Ia73ff415c065edae9890cb78ced532a16ad9ce97
2017-07-26 14:52:04 -05:00
Jenkins
95d58a2f22 Merge "Add specs directory to OpenStack-Helm" 2017-07-26 14:25:06 +00:00
Steve Wilkerson
7279be8b85 Add specs directory to OpenStack-Helm
Adds the specs/ directory to openstack-helm for housing future
specifications for the project.  It also includes an appropriate
README with directions for drafting specs, links to the openstack
resources for bp+spec lifecycle, and a template for use in
drafting specifications

Change-Id: Ice23447b358b520a8b4fb703fc836e8f09fa34d1
2017-07-25 11:17:35 -05:00
Artur Korzeniewski
82cbfeb9ab Typo: change cinder to dns-helper in dns-helper/values.yaml
Change-Id: Ide8cb5066c5b9f164e10b63a3578970d3205e38d
2017-07-25 10:38:33 +02:00
Jenkins
05a472aa37 Merge "Fix instructions for Kubeadm AIO Setup" 2017-07-24 03:11:40 +00:00
ashish.billore
93c90b6f54 Fix instructions for Kubeadm AIO Setup
Updated the wordings and cleanup for Kubeadm AIO env setup.

Change-Id: I3c603b91aa4d04f66986e47f7b19777806e8f68f
2017-07-24 11:26:54 +09:00
Jenkins
9361c15386 Merge "Remove bootstrap image of glance when deleting glance chart." 2017-07-21 13:59:37 +00:00
Artur Korzeniewski
7e532bdb11 Helm-toolkit: Fixed upgrade daemonset snippet
The issue was with type of upgrade strategy, which was rendered as empty.
It was due to wrong access to the pod_replacement_strategy, which was
out of modified scope:

      daemonsets:
        pod_replacement_strategy: RollingUpdate
        dhcp_agent:
          enabled: false
          min_ready_seconds: 0
          max_unavailable: 1

and the snippet was modifying the scope to daemonset.dhcp_agent, then
trying to access daemonsets.dhcpagent.pod_replacement_strategy, which was
not there:

{{- $upgradeMap := index $envAll.Values.pod.lifecycle.upgrades.daemonsets $component }}
updateStrategy:
  type: {{ .pod_replacement_strategy }}

The fix is to evaluate the common variable before entering the scope
modification.

{{- $pod_replacement_strategy := $envAll.Values.pod.lifecycle.upgrades.daemonsets.pod_replacement_strategy -}}
type: {{ $pod_replacement_strategy }}

Change-Id: I78937b1bf1e0d50ca372de095582c71105d76331
Closes-Bug: 1705662
2017-07-21 11:09:36 +02:00
Jaesang Lee
d0146ba4c6 Remove bootstrap image of glance when deleting glance chart.
If you re-install glance chart with fixed bootstrap image id
in your own ceph environment, glance chart can't create bootstrap
image because of same object is exist in ceph.
This patch add job-clean that remove bootstrap image when you
delete glance chart.

Change-Id: I4ca55f0500479cbc48eff4133c7ac1683a76e60f
Closes-Bug: #1705386
2017-07-20 16:47:12 +09:00
Jenkins
d02814940c Merge "Support underscore headers in ingress" 2017-07-20 01:18:28 +00:00
Seungkyu Ahn
e7f82d7695 Support underscore headers in ingress
Nginx's configuration has the underscore header value disabled.
When uploading image, glance api uses underscore header.
For example, x-image-meta-disk_format or x-image-meta_name.

Change-Id: I86e7f7d8d908904a4e45fa68f6bd613028d45801
2017-07-19 23:16:50 +09:00
Dae Seong Kim
892f9bd839 remove pvc-ceph-client-key when deleting ceph
When trying to re-install ceph chart, the
ceph-namespace-client-key-generator job is not working because of the
already created pvc-ceph-client-key secret.
So it needs to remove the secret when deleting ceph chart.

Closes-Bug: #1705177
Change-Id: I7338a516fe3b9f265953b8b1fddd3dbfb97bafd2
2017-07-19 16:31:34 +09:00
Jenkins
a4a9b9c360 Merge "Ingress: Fix deployment type switching" 2017-07-18 18:31:52 +00:00
Larry Rensing
394a336c35 Remove unnecessary ceph mon pdb
Ceph mon has been changed from a statefulset to a daemonset,
so the PodDisruptionBudget is no longer needed.

Change-Id: I86d46ed2e6377177eff9251d5e4f3bb433eaf250
2017-07-18 04:13:22 +00:00
Pete Birley
e852e1e62d Ingress: Fix deployment type switching
This PS fixes the switching of deployment types from: Deployment to
Daemonset.

Change-Id: I4b1ddb70189d74b071b35f0e1f81cf26d53a21f6
2017-07-17 17:58:56 -05:00
Pete Birley
9eb86f1f3e Ceph: fix mon check
This Ps fixes the mon check script.

Change-Id: I25647c1cb62539e602e4a4027e55be66b02781fb
2017-07-17 17:17:31 -05:00