Commit Graph

1064 Commits

Author SHA1 Message Date
Pete Birley
8b58159e2d Ingress: fix ingress error page backend service
This Ps fixes the ingress error page service, which was not
attaching to the error page pod.

Change-Id: Ia4ce523d0e17a80a0860cf7bdbdc46875b344617
2017-08-25 01:47:22 +00:00
Jenkins
a95845062f Merge "Add a default mode to all charts missing it" 2017-08-11 20:05:52 +00:00
Darla Ahlert
afeb03879b Add a default mode to all charts missing it
This ps adds missing defaultMode to any chart missing it
on the configmap for volumes

Change-Id: If996d137fe1f4f5547dcbf43d9883924f192db57
2017-08-11 13:18:55 -05:00
Jenkins
8a8c813727 Merge "Update DNS policy for pods in host network namespace" 2017-08-11 15:16:17 +00:00
Pete Birley
53966ecbe1 Bug: Fixs nodeport indentation in keystone and barbican
This PS fixes the nodeport indentation in keystone and barbican.

Change-Id: I3903fcf3b1a3309b6b5e6324053682e7418cb0bc
2017-08-11 09:19:49 -05:00
Pete Birley
0c75f1ab9c Update DNS policy for pods in host network namespace
This PS updates the DNS policy for pods that run in the hosts network
namespace.

Change-Id: I5ff11985459c967e5248d1ce9f62ebfc578e3afb
2017-08-10 16:43:20 -05:00
Pete Birley
920cb9aae5 Gate: Set tests to run only if a deployment of OSH is performed
This PS updates the gate script to only run tests of OSH if it is
actually deployed.

Change-Id: Iaf89bbfffb01ca3c7ba7bfc5b5867794c6bfd5e8
2017-08-10 09:47:49 -05:00
Jenkins
c4050ba375 Merge "Armada OpenStack deployment yaml" 2017-08-09 20:29:16 +00:00
Huamin Chen
da9539bb87 Use RBD external provisioner
Currently RBD storageclass uses in-tree provisioner
kubernetes.io/rbd. Since containerized kubernetes controller image
doesn't include rbd binary, in-tree provisioner errors out.

This fix uses external provisioner ceph.com/rbd.

Closes-Bug: #1707937

Change-Id: Iad443a54c0229c0356beb6d872365298248c40c9
2017-08-09 11:24:59 -05:00
Tim Heyer
47bb6d2a85 Armada OpenStack deployment yaml
Armada is a tool for managing multiple helm charts with dependencies by
centralizing all configurations in a single Armada yaml. This yaml is
used for a full OpenStack deployment.

Co-Authored-By: Alexis Rivera <gardlt@tetrasol.org>
Co-Authored-By: Pete Birley <pete@port.direct>

Change-Id: I70b41f038c2819aeaa4b2c7bb617b7b2c38441d1
2017-08-09 09:40:46 -05:00
Huamin Chen
e30c1cf414 set DNS policy for osd daemonset
Use ClusterFirstWithHostNet DNS policy so osd pods can resolve mon address
through host network

Change-Id: I7aaeee1fc26cc1812c210bfe2c0f5b131c4cbd81
Closes-Bug: #1709439
2017-08-08 15:25:28 -04:00
Jenkins
9b58bee639 Merge "Licence: Remove licence header from rendered files" 2017-08-08 14:25:59 +00:00
Jenkins
66fa487563 Merge "Fix -- Ceph in multinode gate" 2017-08-07 23:09:02 +00:00
Jenkins
a0893b0d85 Merge "Charts: make manifests optional for all OpenStack elements" 2017-08-07 22:28:06 +00:00
Pete Birley
ff8744a9b9 Licence: Remove licence header from rendered files
This PS removes the licence header from rendered output from tiller,
significantly reducing the configmap size of charts deployed to the
cluster.

Change-Id: I5d1b246f2068f3b83bf59ba79fe8b88bbc9a6161
2017-08-07 17:16:13 -05:00
Steve Wilkerson
9fa445ab44 Fix -- Ceph in multinode gate
This fix aims to address the multinode gate issues for IPs on the
same subnet.

Change-Id: If158f78acf4d5e32eb495354307a0e3e5343ef6e
2017-08-07 17:11:11 -05:00
Pete Birley
35601e2bd3 Charts: make manifests optional for all OpenStack elements
This PS allows the rendering of manifests to be controlled. It enables
both increased control over deployment when required but also makes
development of a feature easier to target.

Change-Id: I1716e8ee23fe5c53f935bd739ea283bc4a2a9963
2017-08-07 14:59:48 -05:00
Jenkins
dbfbbda826 Merge "Ceph: Fix Multinode Gates" 2017-08-07 16:28:17 +00:00
Jenkins
350f1b91b9 Merge "fix to avoid crash loop on ceph clean job" 2017-08-07 14:57:28 +00:00
Jenkins
075d9957af Merge "fix to avoid crash loop on glance clean job" 2017-08-07 14:47:26 +00:00
Pete Birley
59dfea0e58 Ceph: Fix Multinode Gates
This PS should make the multinode gate more reliable for ceph.

It's not perfect in that is uses the default route IPs in zuul, which
has a performance hit. The bash is also ugly as sin - but it gets us
moving again until somone has time to implement a more eligant solution
that works both in infra supplied nodes and other CI systems.

Change-Id: Ie1326f048c43d04a945ca155bde8824d17ddcbec
2017-08-07 03:39:37 +00:00
Stacey Fletcher
b3de787cf0 Gates: Add configurable timeouts
This PS allows for timeouts to be passed as arguments if a longer or
shorter timeout is needed.

Change-Id: Ie5d987084d0c1197bd491297021a9e5e2c36195c
2017-08-06 20:05:44 -05:00
Jenkins
4fcc7f78c8 Merge "Jobs: Add labels to all jobs" 2017-08-05 22:00:33 +00:00
Pete Birley
8f8a80019a Jobs: Add labels to all jobs
This PS adds labels to all jobs in OpenStack-Helm, allowing them to be
found by label searches. This makes management of large clusters using
tools like Armada easier.

Change-Id: I49b2cb7a94fab96958f187ca11e2c2a0c80ff843
2017-08-05 20:17:12 +00:00
Pete Birley
45ffd6290b Keystone user job: create domains if required
This PS creates the user and project domain during the keystone-user
jobs if reqired.

Change-Id: Ib885a3629ab32a9c60725495b50dc712948848fd
2017-08-05 09:41:06 -05:00
Tin Lam
c8f225ef91 Fix oslo _i18n issue
While trying to regenerate the .conf files, the gen-oslo-openstack-helm
tool spits back an error because of the removal of log translations in
OpenStack [0].  This patch set replaces the removed _LW() with the default
_() so the tool does not error out unexpectedly.

[0] d5e3652d12

Change-Id: I665775ae075b6ce0d1aa74ca5732e9e6566ff174
2017-08-04 08:22:15 -05:00
Dae Seong Kim
677c7d834b fix to avoid crash loop on ceph clean job
ceph clean job tries to delete a secret. but if there's no the secret,
the job falls in CrashLoopBackOff status when helm delete.

Change-Id: I863e43f576408fdcd24997bde9b658c50b0057c1
Closes-bug: 1708597
2017-08-04 16:36:47 +09:00
Dae Seong Kim
f45da069e4 fix to avoid crash loop on glance clean job
glance clean job tries to delete a image. but if there's no the image,
the job falls in CrashLoopBackOff status when helm delete.

Change-Id: I3b9c3057b9da8780ca27f1cb18dcd5541f3bcabc
Closes-bug: 1708581
2017-08-04 16:21:32 +09:00
Pete Birley
054ac68e92 KubeADM-AIO: update to K8s 1.6.8
This PS udpates the Kubernetes version to v1.6.8

Change-Id: I2170fbaf901e761cb732469dab5ad7bc946ddea5
2017-08-03 23:37:00 -05:00
Jenkins
268d8ef471 Merge "Fix joinListWithComma rendering when invoked with CLI values" 2017-08-02 20:26:55 +00:00
Jenkins
830875627d Merge "Add setup and rotate job for credential keys" 2017-08-02 14:52:39 +00:00
Jenkins
da48e214d1 Merge "Add support for Keystone's fernet tokens" 2017-08-02 13:47:52 +00:00
Pete Birley
04e05fcea4 Fix joinListWithComma rendering when invoked with CLI values
This PS fises a rendering erros in the joinListWithComma function
when used with values from the helm --set cli command.

From Kolla-Kubernetes: https://review.openstack.org/#/c/488513/
All Credit to: Serguei Bezverkhi

Change-Id: I013a37f5e6dec43232c6ee300be8f918f9ef554a
2017-08-02 08:38:14 -05:00
Michał Dulko
cfab320f26 Add setup and rotate job for credential keys
Keystone is using keys to encrypt credentials saved into the database.
The mechanism is very similar to fernet tokens. This commit implements a
job setting key repository up and rotate job for those keys. All is
based on implementation of fernet tokens.

Change-Id: I88faf1d02d2b317563e8603cebba542f8b133c6a
Closes-Bug: 1693807
2017-08-02 13:22:05 +02:00
Michał Dulko
03543a3d53 Add support for Keystone's fernet tokens
Keystone supports (and that's a default setting since Ocata) using
non-persistent fernet tokens instead of UUID tokens written into the DB.
This setting is in some cases better in terms of performance and
manageability (no more tokens DB table cleanups). OpenStack-Helm should
be able to support it.

General issue with fernet tokens is that keys used to encrypt them need
to be persistent and shared accross the cluster. Moreover "rotate"
operation generates a new key, so key repository will change over time.

This commit implements fernet tokens support by:
* A 'keystone-fernet-keys' secret is created to serve as keys repository.
* New fernet-setup Job will populate secret with initial keys.
* New fernet-rotate CronJob will be run periodically (weekly by default)
  and perform key rotation operation and update the secret.
* Secret is attached to keystone-api pods in /etc/keystone/fernet-tokens
  directory.

Turns out k8s is updating secrets attached to pods automatically, so
because of Keystone's fernet tokens implementation, we don't need to
worry about synchronization of the key repository. Everything should be
fine unless fernet-rotate job will run before all of the pods will
notice the change in the secret. As in real-world scenario you would
rotate your keys no more often than once an hour, this should be totally
fine.

Implements: blueprint keystone-fernet-tokens
Change-Id: Ifc84b8c97e1a85d30eb46260582d9c58220fbf0a
2017-08-02 13:22:05 +02:00
Robert Choi
f84716f43e Glance: Add paste_deploy values
Glance bootstrap job fails due to missing 'paste_deploy' values.
This PS solves the issue by adding the values to glance chart.

Change-Id: I850863fe29c25aab9cf57eee62098e2b5d23a7f8
Closes-Bug: 1705421
2017-08-02 14:23:01 +09:00
Jenkins
542105729b Merge "Randomize ceph namespace cleaner job name" 2017-08-01 19:59:41 +00:00
Jenkins
e8a17df247 Merge "Gate: Loopback device support" 2017-08-01 16:36:08 +00:00
Huamin Chen
4ae758a4f1 Randomize ceph namespace cleaner job name
Currently Ceph namespace job cleaner uses a fixed name. This leads to
helm delete fails to clean up Ceph package. This fix randomizes the job
name to avoid name conflicts.

DocImpact
Closes-Bug: #1707670

Change-Id: I7ac7b7482b945a9a836f6f69df0ef8cebc37bafb
2017-08-01 09:30:52 -04:00
Siri Kim
b5b7bdadb8 Fix openstack endpoint option at _ks-endpoint.sh
This PS fix openstack endpoint show option at _ks-endpoint.sh
as job-ks-endpoint fails when endpoint needs updated.

Change-Id: I8aa05f3d40e7825410eace3ad7b44d36e3bb6434
2017-08-01 18:59:37 +09:00
Pete Birley
fdbe8eb60d Gate: Loopback device support
This PS adds loopback device support to the gate scripts.
Rather than using simple loopback devices we use iscsi to
allow is to target the created devices via the bus they are
connected to. An arbitary number of devices of a desired size
can be created, and controlled via env vars.

Change-Id: I05fb7f3a1564bc36903aed2c46ed996bb8cc57c8
2017-07-31 17:12:20 -05:00
Pete Birley
04e015e49b Zuul: Gate script tidy
This PS cleans up some of the worst offenders in the gate scripts.

Change-Id: If310ae798c9572e8bde4834e5a4af5f97196efea
2017-07-29 23:58:08 -05:00
Pete Birley
8f9945f6fd Nova: Update bootstrap job
This PS updates the nova boostrap job, both bringing it inline with
other services and also adding the default flavours from Mitaka.
By setting the m1.tiny size to match the upstream it is expected
that the majority of gate failures will be solved - as many of the
VMs in nodepool do not have 20GB of free space on the rootfs.

Change-Id: I767795015422a1b326a6f34b5a3f50bf41a0ca4b
2017-07-29 23:51:47 -05:00
Jenkins
52903e5076 Merge "Install helm template plugin using helm" 2017-07-30 04:33:10 +00:00
Pete Birley
6600530421 Helm: Update to v2.5.1
This PS updates helm to v2.5.1.

Change-Id: I2b4883ce5abb79afb4ef8be6058edd6c552249f7
2017-07-29 22:16:37 -05:00
Pete Birley
e7abfee16d MariaDB: Update start script to be more robust
This PS updates the MariaDB start script remove templated values
from being directly inserted into the script. It also moves the
root connection params to a secret to prevent the root password
being exposed in logs.

Change-Id: I10977ef267877a5913bf265280ff5439c7bf268c
2017-07-29 23:05:20 +00:00
Steve Wilkerson
8dfc2cf3a3 Fix mariadb start script
Fixes the reference to mariadb replicas used when adding pods to
the mariadb cluster. This was causing nodes to not be added to
the cluster properly

Change-Id: I9df586c8939e241ea58d933652c767542fd364ff
2017-07-29 10:35:48 -05:00
Pete Birley
09ff02a2d6 Install helm template plugin using helm
This PS removes the workaround required by older versions of helm to
install the template plugin.

Change-Id: I35fb80b0841fb0d0be260694bd94580a7df1cc45
2017-07-29 10:07:50 -05:00
Jenkins
a51ac55fbd Merge "Update pod affinity to allow customisation" 2017-07-28 16:21:24 +00:00
Pete Birley
4734cf53c8 Keystone: always update service account passwords on chart deploy
This PS allows an operator to change the service account password
though the values fed into a chart.

Change-Id: If3a859f0db84237c71303ef329573c7d6aafdae7
2017-07-28 10:21:34 -05:00