Commit Graph

109 Commits

Author SHA1 Message Date
Tin Lam
c8f225ef91 Fix oslo _i18n issue
While trying to regenerate the .conf files, the gen-oslo-openstack-helm
tool spits back an error because of the removal of log translations in
OpenStack [0].  This patch set replaces the removed _LW() with the default
_() so the tool does not error out unexpectedly.

[0] d5e3652d12

Change-Id: I665775ae075b6ce0d1aa74ca5732e9e6566ff174
2017-08-04 08:22:15 -05:00
Pete Birley
054ac68e92 KubeADM-AIO: update to K8s 1.6.8
This PS udpates the Kubernetes version to v1.6.8

Change-Id: I2170fbaf901e761cb732469dab5ad7bc946ddea5
2017-08-03 23:37:00 -05:00
Michał Dulko
03543a3d53 Add support for Keystone's fernet tokens
Keystone supports (and that's a default setting since Ocata) using
non-persistent fernet tokens instead of UUID tokens written into the DB.
This setting is in some cases better in terms of performance and
manageability (no more tokens DB table cleanups). OpenStack-Helm should
be able to support it.

General issue with fernet tokens is that keys used to encrypt them need
to be persistent and shared accross the cluster. Moreover "rotate"
operation generates a new key, so key repository will change over time.

This commit implements fernet tokens support by:
* A 'keystone-fernet-keys' secret is created to serve as keys repository.
* New fernet-setup Job will populate secret with initial keys.
* New fernet-rotate CronJob will be run periodically (weekly by default)
  and perform key rotation operation and update the secret.
* Secret is attached to keystone-api pods in /etc/keystone/fernet-tokens
  directory.

Turns out k8s is updating secrets attached to pods automatically, so
because of Keystone's fernet tokens implementation, we don't need to
worry about synchronization of the key repository. Everything should be
fine unless fernet-rotate job will run before all of the pods will
notice the change in the secret. As in real-world scenario you would
rotate your keys no more often than once an hour, this should be totally
fine.

Implements: blueprint keystone-fernet-tokens
Change-Id: Ifc84b8c97e1a85d30eb46260582d9c58220fbf0a
2017-08-02 13:22:05 +02:00
Pete Birley
fdbe8eb60d Gate: Loopback device support
This PS adds loopback device support to the gate scripts.
Rather than using simple loopback devices we use iscsi to
allow is to target the created devices via the bus they are
connected to. An arbitary number of devices of a desired size
can be created, and controlled via env vars.

Change-Id: I05fb7f3a1564bc36903aed2c46ed996bb8cc57c8
2017-07-31 17:12:20 -05:00
Pete Birley
04e015e49b Zuul: Gate script tidy
This PS cleans up some of the worst offenders in the gate scripts.

Change-Id: If310ae798c9572e8bde4834e5a4af5f97196efea
2017-07-29 23:58:08 -05:00
Jenkins
52903e5076 Merge "Install helm template plugin using helm" 2017-07-30 04:33:10 +00:00
Pete Birley
6600530421 Helm: Update to v2.5.1
This PS updates helm to v2.5.1.

Change-Id: I2b4883ce5abb79afb4ef8be6058edd6c552249f7
2017-07-29 22:16:37 -05:00
Pete Birley
09ff02a2d6 Install helm template plugin using helm
This PS removes the workaround required by older versions of helm to
install the template plugin.

Change-Id: I35fb80b0841fb0d0be260694bd94580a7df1cc45
2017-07-29 10:07:50 -05:00
ashish.billore
93c90b6f54 Fix instructions for Kubeadm AIO Setup
Updated the wordings and cleanup for Kubeadm AIO env setup.

Change-Id: I3c603b91aa4d04f66986e47f7b19777806e8f68f
2017-07-24 11:26:54 +09:00
Larry Rensing
bc8da1a89d Fix ceph single node gate health
Ceph's health when running in the single node gate currently
is 'HEALTH_WARN'.  This PS adds an extra config option such that
the ceph cluster will not attempt to perform replication when deployed
on a single node, as well as introduces a mvp yaml file for ceph
deployments in the gate.

Change-Id: Ib2ec3345140f541c94da044ff9d77723ea3ee2bd
2017-07-17 16:30:09 +00:00
Alan Meadows
ccea6b4df5 Convert ceph to utilize hostNetworking
This enhances the stability and recovery of ceph by leveraging
hostNetworking for monitors as well as OSDs, and enables the
K8S_HOST_NETWORK variable within ceph-docker.  This enhancement should
allow recovery of monitors from a complete downed cluster.

Additionally, ceph's generic "ceph-storage" node label has been
split out for mon, mds, and osd.

Co-Authored-By: Larry Rensing <lr699s@att.com>
Change-Id: I27efe5c41d04ab044dccb5f38db897cb041d4723
2017-07-14 19:06:57 +00:00
Jenkins
8453c077f4 Merge "Ceph: add bootstrap job to create pools." 2017-07-12 20:12:42 +00:00
Pete Birley
e99a3f29c5 Ceph: add bootstrap job to create pools.
This PS adds a bootstrap job to create the default pools for
OpenStack Services to consume.

Change-Id: I139d7f095c600821ef5ee3b4d2c70a00b971f32b
2017-07-12 11:27:52 -05:00
Jenkins
b3a58eba34 Merge "DNS: add helper chart to OSH for setting up hosts resolv.conf" 2017-07-12 15:35:44 +00:00
Jenkins
ed2bca3370 Merge "Kubernetes: bump version to K8s v1.6.7" 2017-07-11 13:20:28 +00:00
Pete Birley
66686005e5 DNS: add helper chart to OSH for setting up hosts resolv.conf
This PS adds a chart to setup the resolv.conf on hosts running
openstack-helm. The purpose of this is to reduce friction when
performing basic deployments of OS-H.

Change-Id: I6c6348afb01869cff9a90328ede795d92a91fb12
2017-07-10 11:11:14 -05:00
Pete Birley
7421dcb36f Kubernetes: bump version to K8s v1.6.7
This PS moves the K8s Version to 1.6.7.

Change-Id: I5a2b871119429ac90a5a284ecc79ebca00dea1ff
2017-07-09 17:11:29 -05:00
Tin Lam
8f577f284a Fix an issue where arp is not found
This patch set addresses an issue where the ``arp`` command cannot
be found by a non-root user due to path.

Change-Id: Ibfca30f38d72c5be0b98d92bd03ec40160196160
Signed-off-by: Tin Lam <tin@irrational.io>
2017-07-08 13:21:41 -05:00
Pete Birley
0c36b4354d Helm: Move to Helm v2.5.0
This PS Moves OpenStack-Helm to Helm version 2.5.0.

Change-Id: I79da76875a44a5fb7ff55f8c9a9d114ca5f9c186
2017-07-06 12:45:34 -05:00
Jenkins
6f3f72f57e Merge "Dev Scripts: Update service launch commands to use local helm charts" 2017-07-05 15:04:30 +00:00
Pete Birley
e924cd0374 Dev Scripts: Update service launch commands to use local helm charts
This PS changes the basic_launch .sh script to use the local chart
dirs to launch services - making it much easier to rapidly develop
charts locally.

Change-Id: Ib62cb8373708457b892e75cd916942620ca24fb6
2017-07-05 14:19:18 +00:00
Jenkins
2d7fe938c0 Merge "Fix MultiOpt options in gen-oslo-openstack-helm" 2017-07-05 13:46:14 +00:00
Michał Dulko
9eaa08678c Fix MultiOpt options in gen-oslo-openstack-helm
gen-oslo-openstack-helm generated configuration file templates in
incorrect form, causing setting mulitple values in Values.yaml to
produce something like:

  foo=barfoo=baz

This commit fixes this in the generator and updates config file
templates to generate configs correctly:

  foo=bar
  foo=baz

Change-Id: Iea661dcf1710987b2e111d7141ba888f01c44a50
Closes-Bug: 1699581
2017-07-04 17:26:06 +02:00
Jenkins
d901a9d12b Merge "Soft pod anti-affinity for all pods" 2017-07-03 20:12:58 +00:00
Jenkins
a995e6ced7 Merge "Cleanup installation docs" 2017-07-03 19:40:18 +00:00
Pete Birley
c5bbc97ab7 Soft pod anti-affinity for all pods
This PS adds soft anti-affinity to all pods in OS-H. By doing so
resiliancy is improved by attempting to ensure that pods are created
on seperate nodes.

Change-Id: I0c1092498f7a1e44218ef785ca3f73fa9f49819c
2017-07-03 14:15:40 -05:00
Pete Birley
7d109c371c Zuul Checks: Change the serviced launched to relefect gate resources
This PS changes the services launched in the single and multinode
gates to reflect the resources avalible.

Change-Id: I6b2824ef98fefb5532ebaae315c3c5a4c6f730da
2017-07-03 12:07:10 -05:00
Larry Rensing
8ce88e52e0 Cleanup installation docs
This PS organizes the installation document tree for easier navigation
and updating relevant content.

Change-Id: I51951d99dfc06bf441bd65ca817119cbca061851
2017-07-03 11:54:29 -05:00
Steve Wilkerson
9797750fd2 Add support for helm tests in multiple namespaces
Originally, the function to execute helm tests expected the helm
release to be in the openstack namespace. This changes the
function to get the namespace directly from the helm releases to
allow for the gathering of logs and removal of resources from the
namespace a release was installed to

Change-Id: Ic9d1215f363a6251bcc33bead311aba1ba67a658
2017-07-01 17:00:07 -05:00
Pete Birley
7ac9adb7ad Basic launch script: fix some typos in ceph deployment.
This PS fixes some minor typos in the ceph deployment used for dev
and ci checks.

Change-Id: Iab216aaa85fbccb978bb8d69b92f6793888a50d8
2017-06-30 08:44:02 -05:00
Jenkins
c4c1b937dd Merge "Gate: fix multinode support for running outside of zuul" 2017-06-29 23:20:35 +00:00
Pete Birley
5fd358f0ba Gate: fix multinode support for running outside of zuul
This PS fixes multinode operation when run outside of zuul.

Change-Id: I66fecae7c14fa4022882235d656f5c0ac97c12bc
2017-06-29 17:27:59 -05:00
Larry Rensing
8b90c3386a Change custom kube-controller-manager references
This PS changes the install guide in order to have users pull our
custom kube-controller-manager image prior to initializing their
Kubernetes cluster.  Also changes the reference in the gate to remove
redundant lines.

Change-Id: Ic32742b1df8145a99c8333a3d0711113e3cce30e
2017-06-29 20:05:57 +00:00
Jenkins
4ea250f8fd Merge "Helm: fix incorrect refences to old version of Helm." 2017-06-29 13:30:41 +00:00
Pete Birley
22da29c2be Logging: Disable debug logging by default
This PS disables debug logging for all services that had it on, and
removes the key from the default values.yaml. It does however ensure
that the mvp values has the appropriate key to make turning debugging
on simple.

Change-Id: I8ed84d531971cbd7984f029abbebb373af4c7311
2017-06-29 07:10:20 -05:00
Pete Birley
728caa3d7d Helm: fix incorrect refences to old version of Helm.
This PS fixes some references to Helm v2.3.1, which has been
replaced by Helm v2.4.1 as the reference version.

Change-Id: I369f4846623932c2420fab2632ac1c0d8aad3cff
2017-06-29 11:49:41 +00:00
Jenkins
e1874a7b1a Merge "Ingress controller for public endpoints" 2017-06-29 05:03:19 +00:00
Pete Birley
c0cf2337a2 Ingress controller for public endpoints
This PS provides the framework for Ingress controller based access to
public APIs.

Services covered:
 * Barbican
 * Cinder
 * Glance
 * Heat
 * Horizon
 * Keystone
 * Magnum
 * Mistral
 * Neutron
 * Nova
 * Senlin

Change-Id: I82d55f6ca41859ebed3312ec7d95b353df09e772
Implements: blueprint api-ingress
External-Tracking-Id: OSH-58, OSH-62
2017-06-28 17:37:10 -05:00
Jenkins
31d3ba45c7 Merge "Gate scripts: Update readme to describe multinode deployment" 2017-06-28 15:33:25 +00:00
Pete Birley
fc82130ceb Gate scripts: Update readme to describe multinode deployment
This PS updates the gate script to make multinode developer
deployment outside of zuul much clearer.

Change-Id: I25cc8c2f101dd0241d715ef7bf2e004cddf43c06
2017-06-28 14:45:26 +00:00
Jaesang Lee
55c1625a4f Helm Test: Cinder
Add rally tests in cinder helm chart.
It only test create a volume because volume driver is fake_driver.

Change-Id: Iba5df74df427a414c70dda6baf9bc7e775b1716d
Partial-Implements: blueprint implement-helm-test-for-charts
2017-06-28 04:45:46 +00:00
Pete Birley
8ef5d94674 Refactor Ceph secret generation
This PS refactors the ceph chart and secret generation process.
The updated chart replaces the existing "bootstrap" chart.
Additionally, Ceph manifests and deployment guides were modified
accordingly.

Change-Id: I6f5bb88fc0f40cfee8865d9dab83859d765e7537
Co-Authored-By: Larry Rensing <lr699s@att.com>
2017-06-27 13:42:03 -05:00
Jenkins
b3f353ca7a Merge "Gates: Cleanup VM after basic functional test" 2017-06-23 18:18:38 +00:00
Jenkins
802b74ba0b Merge "Zuul logging: get descriptions of k8s objects running in gates" 2017-06-23 14:23:35 +00:00
Pete Birley
361aad0789 Gates: Cleanup VM after basic functional test
This ps stops and removes the test VM after we have finished with it.
This frees up resources for the helm tests to use on the small machines
we have avalible in openstack-infra.

Change-Id: I743d8a9271bd349636ffc57e86255cc967633844
2017-06-23 14:18:48 +00:00
Pete Birley
1da5ea7a95 Zuul logging: get descriptions of k8s objects running in gates
This ps adds descriptive logging of all k8s objects running in the
Zuul gates.

Change-Id: Id44b085f2e49bb89b0dd1d0d8444af0aa1265ed4
2017-06-23 13:07:12 +00:00
Pete Birley
d69f021e32 Nova: Helm test functionaility using Rally
This PS adds 'helm test' functionality using Rally to Nova

Change-Id: Ie53c42636b58e36c22a9260c67a7981183d741d3
Partial-Implements: blueprint implement-helm-test-for-charts
External-Tracking-Id: OSH-89
2017-06-22 19:00:41 -05:00
Pete Birley
653f7ed3e4 Neutron: Helm test functionaility using Rally
This PS adds 'helm test' functionality using Rally to Neutron

Change-Id: I6e89aca1870704368b4dc1f8ad93f8ba563002c1
Partial-Implements: blueprint implement-helm-test-for-charts
External-Tracking-Id: OSH-89
2017-06-22 15:51:27 -05:00
Pete Birley
960613e5c6 Boot VM's and basic functional test in Zuul Checks
This PS adds basic vm booting and functional testing to the single node
Zuul gates. Multinode testing will be once we have ceph running in zuul.

Change-Id: Ifcbdcaa4a30dee4088e369d4410dd737ef6f12cd
2017-06-22 14:23:26 -05:00
Darla Ahlert
7eeb9836c1 Fixing outdated versions and broken links in docs
Change-Id: I81df87c39d3ac8f0ba321b8d37a74f873c9a974d
2017-06-21 13:39:41 -05:00