Commit Graph

126 Commits

Author SHA1 Message Date
Pete Birley
7463058b73 Reduce load in single node gate tests
This PS seeks to reduce the load exerted on the node in the single
node gate test - as a the single node gate is currently broken
due to resource starvation on the nodes.

Change-Id: I34db5108b4abb48bb452eed73067644cc03270c0
2017-08-26 17:01:19 -05:00
Jaesang Lee
59d9c463bd Fix incorrect description
change mis-spelled description in tools/overrides/mvp/cinder.yaml

Change-Id: Ifb4ae667b40418f12ab29654c6a7ff55fad931e1
2017-08-26 17:23:02 +09:00
Pete Birley
0251c099ba Nova: Support Cinder Volume Attachement using Ceph Backend
This PS enables cinder volume attachment for nova when used with ceph.

Change-Id: I9772f38fb3a1a9af26bd92ee18a651d3372de64c
2017-08-25 14:07:34 -05:00
Pete Birley
25683d8cf4 Neutron: move OvS interaction to native interface
This PS changes the MVP deployment of Neutron to use the native
interface rather than shelling uout to the clients. The values
were inserted during the original development of the MVP deployment
and subsequently left.

Change-Id: Ie098dc71a0fc82f000b7c40048e9f35913f05a79
2017-08-22 20:08:01 -05:00
Pete Birley
ff6e6d19f9 Gate: Heat functional test
This PS adds a functional test of heat in the OSH gates, it also moves
most params to a seperate file - making config of the gate in non-zuul
environments simpler.

Change-Id: I37a1bc0dcc8000c5da8067a8d376c78f7cd6f7ab
2017-08-21 13:55:53 -05:00
Pete Birley
0c715b8b3c Gate: Add heat to single node checks and to Armada checks
This PS adds heat to the single node and Armada based deployment
checks in the gate scripts. Additionally it moves the client calls
in the check scripts to use the heat engine pod.

Change-Id: Iccc996fb2b2140ed19c6708d6033b4a9dd1bfc46
2017-08-20 13:20:48 -05:00
Jenkins
b06fab9c07 Merge "KubeADM-AIO: allow customisation of CNI" 2017-08-15 17:49:28 +00:00
Pete Birley
52c549a2d3 KubeADM-AIO: allow customisation of CNI
This PS adds the ability to customise the CNI used by
the AIO KubeADM container.

Change-Id: If531a896e38baeda32c008d9645c34174603c690
2017-08-15 08:12:21 -05:00
Tin Lam
8e76f32407 Add barbican helm test
This patch set adds basic barbican test using the OpenStack Client.  This
patch set also addressed an issue where the href contains a duplicate
version in the path, e.g. http://URL:xxxx/v1/v1/secrets in secret path.

Change-Id: Ie66d00d5a0b02721ba41e6bf4b5e784fb49adce8
2017-08-15 05:08:20 -05:00
Pete Birley
920cb9aae5 Gate: Set tests to run only if a deployment of OSH is performed
This PS updates the gate script to only run tests of OSH if it is
actually deployed.

Change-Id: Iaf89bbfffb01ca3c7ba7bfc5b5867794c6bfd5e8
2017-08-10 09:47:49 -05:00
Jenkins
c4050ba375 Merge "Armada OpenStack deployment yaml" 2017-08-09 20:29:16 +00:00
Huamin Chen
da9539bb87 Use RBD external provisioner
Currently RBD storageclass uses in-tree provisioner
kubernetes.io/rbd. Since containerized kubernetes controller image
doesn't include rbd binary, in-tree provisioner errors out.

This fix uses external provisioner ceph.com/rbd.

Closes-Bug: #1707937

Change-Id: Iad443a54c0229c0356beb6d872365298248c40c9
2017-08-09 11:24:59 -05:00
Tim Heyer
47bb6d2a85 Armada OpenStack deployment yaml
Armada is a tool for managing multiple helm charts with dependencies by
centralizing all configurations in a single Armada yaml. This yaml is
used for a full OpenStack deployment.

Co-Authored-By: Alexis Rivera <gardlt@tetrasol.org>
Co-Authored-By: Pete Birley <pete@port.direct>

Change-Id: I70b41f038c2819aeaa4b2c7bb617b7b2c38441d1
2017-08-09 09:40:46 -05:00
Steve Wilkerson
9fa445ab44 Fix -- Ceph in multinode gate
This fix aims to address the multinode gate issues for IPs on the
same subnet.

Change-Id: If158f78acf4d5e32eb495354307a0e3e5343ef6e
2017-08-07 17:11:11 -05:00
Jenkins
dbfbbda826 Merge "Ceph: Fix Multinode Gates" 2017-08-07 16:28:17 +00:00
Pete Birley
59dfea0e58 Ceph: Fix Multinode Gates
This PS should make the multinode gate more reliable for ceph.

It's not perfect in that is uses the default route IPs in zuul, which
has a performance hit. The bash is also ugly as sin - but it gets us
moving again until somone has time to implement a more eligant solution
that works both in infra supplied nodes and other CI systems.

Change-Id: Ie1326f048c43d04a945ca155bde8824d17ddcbec
2017-08-07 03:39:37 +00:00
Stacey Fletcher
b3de787cf0 Gates: Add configurable timeouts
This PS allows for timeouts to be passed as arguments if a longer or
shorter timeout is needed.

Change-Id: Ie5d987084d0c1197bd491297021a9e5e2c36195c
2017-08-06 20:05:44 -05:00
Tin Lam
c8f225ef91 Fix oslo _i18n issue
While trying to regenerate the .conf files, the gen-oslo-openstack-helm
tool spits back an error because of the removal of log translations in
OpenStack [0].  This patch set replaces the removed _LW() with the default
_() so the tool does not error out unexpectedly.

[0] d5e3652d12

Change-Id: I665775ae075b6ce0d1aa74ca5732e9e6566ff174
2017-08-04 08:22:15 -05:00
Pete Birley
054ac68e92 KubeADM-AIO: update to K8s 1.6.8
This PS udpates the Kubernetes version to v1.6.8

Change-Id: I2170fbaf901e761cb732469dab5ad7bc946ddea5
2017-08-03 23:37:00 -05:00
Michał Dulko
03543a3d53 Add support for Keystone's fernet tokens
Keystone supports (and that's a default setting since Ocata) using
non-persistent fernet tokens instead of UUID tokens written into the DB.
This setting is in some cases better in terms of performance and
manageability (no more tokens DB table cleanups). OpenStack-Helm should
be able to support it.

General issue with fernet tokens is that keys used to encrypt them need
to be persistent and shared accross the cluster. Moreover "rotate"
operation generates a new key, so key repository will change over time.

This commit implements fernet tokens support by:
* A 'keystone-fernet-keys' secret is created to serve as keys repository.
* New fernet-setup Job will populate secret with initial keys.
* New fernet-rotate CronJob will be run periodically (weekly by default)
  and perform key rotation operation and update the secret.
* Secret is attached to keystone-api pods in /etc/keystone/fernet-tokens
  directory.

Turns out k8s is updating secrets attached to pods automatically, so
because of Keystone's fernet tokens implementation, we don't need to
worry about synchronization of the key repository. Everything should be
fine unless fernet-rotate job will run before all of the pods will
notice the change in the secret. As in real-world scenario you would
rotate your keys no more often than once an hour, this should be totally
fine.

Implements: blueprint keystone-fernet-tokens
Change-Id: Ifc84b8c97e1a85d30eb46260582d9c58220fbf0a
2017-08-02 13:22:05 +02:00
Pete Birley
fdbe8eb60d Gate: Loopback device support
This PS adds loopback device support to the gate scripts.
Rather than using simple loopback devices we use iscsi to
allow is to target the created devices via the bus they are
connected to. An arbitary number of devices of a desired size
can be created, and controlled via env vars.

Change-Id: I05fb7f3a1564bc36903aed2c46ed996bb8cc57c8
2017-07-31 17:12:20 -05:00
Pete Birley
04e015e49b Zuul: Gate script tidy
This PS cleans up some of the worst offenders in the gate scripts.

Change-Id: If310ae798c9572e8bde4834e5a4af5f97196efea
2017-07-29 23:58:08 -05:00
Jenkins
52903e5076 Merge "Install helm template plugin using helm" 2017-07-30 04:33:10 +00:00
Pete Birley
6600530421 Helm: Update to v2.5.1
This PS updates helm to v2.5.1.

Change-Id: I2b4883ce5abb79afb4ef8be6058edd6c552249f7
2017-07-29 22:16:37 -05:00
Pete Birley
09ff02a2d6 Install helm template plugin using helm
This PS removes the workaround required by older versions of helm to
install the template plugin.

Change-Id: I35fb80b0841fb0d0be260694bd94580a7df1cc45
2017-07-29 10:07:50 -05:00
ashish.billore
93c90b6f54 Fix instructions for Kubeadm AIO Setup
Updated the wordings and cleanup for Kubeadm AIO env setup.

Change-Id: I3c603b91aa4d04f66986e47f7b19777806e8f68f
2017-07-24 11:26:54 +09:00
Larry Rensing
bc8da1a89d Fix ceph single node gate health
Ceph's health when running in the single node gate currently
is 'HEALTH_WARN'.  This PS adds an extra config option such that
the ceph cluster will not attempt to perform replication when deployed
on a single node, as well as introduces a mvp yaml file for ceph
deployments in the gate.

Change-Id: Ib2ec3345140f541c94da044ff9d77723ea3ee2bd
2017-07-17 16:30:09 +00:00
Alan Meadows
ccea6b4df5 Convert ceph to utilize hostNetworking
This enhances the stability and recovery of ceph by leveraging
hostNetworking for monitors as well as OSDs, and enables the
K8S_HOST_NETWORK variable within ceph-docker.  This enhancement should
allow recovery of monitors from a complete downed cluster.

Additionally, ceph's generic "ceph-storage" node label has been
split out for mon, mds, and osd.

Co-Authored-By: Larry Rensing <lr699s@att.com>
Change-Id: I27efe5c41d04ab044dccb5f38db897cb041d4723
2017-07-14 19:06:57 +00:00
Jenkins
8453c077f4 Merge "Ceph: add bootstrap job to create pools." 2017-07-12 20:12:42 +00:00
Pete Birley
e99a3f29c5 Ceph: add bootstrap job to create pools.
This PS adds a bootstrap job to create the default pools for
OpenStack Services to consume.

Change-Id: I139d7f095c600821ef5ee3b4d2c70a00b971f32b
2017-07-12 11:27:52 -05:00
Jenkins
b3a58eba34 Merge "DNS: add helper chart to OSH for setting up hosts resolv.conf" 2017-07-12 15:35:44 +00:00
Jenkins
ed2bca3370 Merge "Kubernetes: bump version to K8s v1.6.7" 2017-07-11 13:20:28 +00:00
Pete Birley
66686005e5 DNS: add helper chart to OSH for setting up hosts resolv.conf
This PS adds a chart to setup the resolv.conf on hosts running
openstack-helm. The purpose of this is to reduce friction when
performing basic deployments of OS-H.

Change-Id: I6c6348afb01869cff9a90328ede795d92a91fb12
2017-07-10 11:11:14 -05:00
Pete Birley
7421dcb36f Kubernetes: bump version to K8s v1.6.7
This PS moves the K8s Version to 1.6.7.

Change-Id: I5a2b871119429ac90a5a284ecc79ebca00dea1ff
2017-07-09 17:11:29 -05:00
Tin Lam
8f577f284a Fix an issue where arp is not found
This patch set addresses an issue where the ``arp`` command cannot
be found by a non-root user due to path.

Change-Id: Ibfca30f38d72c5be0b98d92bd03ec40160196160
Signed-off-by: Tin Lam <tin@irrational.io>
2017-07-08 13:21:41 -05:00
Pete Birley
0c36b4354d Helm: Move to Helm v2.5.0
This PS Moves OpenStack-Helm to Helm version 2.5.0.

Change-Id: I79da76875a44a5fb7ff55f8c9a9d114ca5f9c186
2017-07-06 12:45:34 -05:00
Jenkins
6f3f72f57e Merge "Dev Scripts: Update service launch commands to use local helm charts" 2017-07-05 15:04:30 +00:00
Pete Birley
e924cd0374 Dev Scripts: Update service launch commands to use local helm charts
This PS changes the basic_launch .sh script to use the local chart
dirs to launch services - making it much easier to rapidly develop
charts locally.

Change-Id: Ib62cb8373708457b892e75cd916942620ca24fb6
2017-07-05 14:19:18 +00:00
Jenkins
2d7fe938c0 Merge "Fix MultiOpt options in gen-oslo-openstack-helm" 2017-07-05 13:46:14 +00:00
Michał Dulko
9eaa08678c Fix MultiOpt options in gen-oslo-openstack-helm
gen-oslo-openstack-helm generated configuration file templates in
incorrect form, causing setting mulitple values in Values.yaml to
produce something like:

  foo=barfoo=baz

This commit fixes this in the generator and updates config file
templates to generate configs correctly:

  foo=bar
  foo=baz

Change-Id: Iea661dcf1710987b2e111d7141ba888f01c44a50
Closes-Bug: 1699581
2017-07-04 17:26:06 +02:00
Jenkins
d901a9d12b Merge "Soft pod anti-affinity for all pods" 2017-07-03 20:12:58 +00:00
Jenkins
a995e6ced7 Merge "Cleanup installation docs" 2017-07-03 19:40:18 +00:00
Pete Birley
c5bbc97ab7 Soft pod anti-affinity for all pods
This PS adds soft anti-affinity to all pods in OS-H. By doing so
resiliancy is improved by attempting to ensure that pods are created
on seperate nodes.

Change-Id: I0c1092498f7a1e44218ef785ca3f73fa9f49819c
2017-07-03 14:15:40 -05:00
Pete Birley
7d109c371c Zuul Checks: Change the serviced launched to relefect gate resources
This PS changes the services launched in the single and multinode
gates to reflect the resources avalible.

Change-Id: I6b2824ef98fefb5532ebaae315c3c5a4c6f730da
2017-07-03 12:07:10 -05:00
Larry Rensing
8ce88e52e0 Cleanup installation docs
This PS organizes the installation document tree for easier navigation
and updating relevant content.

Change-Id: I51951d99dfc06bf441bd65ca817119cbca061851
2017-07-03 11:54:29 -05:00
Steve Wilkerson
9797750fd2 Add support for helm tests in multiple namespaces
Originally, the function to execute helm tests expected the helm
release to be in the openstack namespace. This changes the
function to get the namespace directly from the helm releases to
allow for the gathering of logs and removal of resources from the
namespace a release was installed to

Change-Id: Ic9d1215f363a6251bcc33bead311aba1ba67a658
2017-07-01 17:00:07 -05:00
Pete Birley
7ac9adb7ad Basic launch script: fix some typos in ceph deployment.
This PS fixes some minor typos in the ceph deployment used for dev
and ci checks.

Change-Id: Iab216aaa85fbccb978bb8d69b92f6793888a50d8
2017-06-30 08:44:02 -05:00
Jenkins
c4c1b937dd Merge "Gate: fix multinode support for running outside of zuul" 2017-06-29 23:20:35 +00:00
Pete Birley
5fd358f0ba Gate: fix multinode support for running outside of zuul
This PS fixes multinode operation when run outside of zuul.

Change-Id: I66fecae7c14fa4022882235d656f5c0ac97c12bc
2017-06-29 17:27:59 -05:00
Larry Rensing
8b90c3386a Change custom kube-controller-manager references
This PS changes the install guide in order to have users pull our
custom kube-controller-manager image prior to initializing their
Kubernetes cluster.  Also changes the reference in the gate to remove
redundant lines.

Change-Id: Ic32742b1df8145a99c8333a3d0711113e3cce30e
2017-06-29 20:05:57 +00:00