Commit Graph

87 Commits

Author SHA1 Message Date
Jenkins
4e3bd88808 Merge "Glance: Backend support and auth improvements" 2017-09-11 17:30:37 +00:00
Pete Birley
b3f8b812ca Glance: Backend support and auth improvements
This PS enables the following backends for glance:
 * PVC
 * RBD
 * RadosGW (direct)
 * Swift

It also moves the creation of the RBD pool when required to a storage
init job. This job also creates credentials as required for glance to
use when accessing the required backend, rather than using the admin
keyring.

Change-Id: I90fead961ff73a9263826acc794128fa73ead2e1
2017-09-09 02:13:01 +00:00
Huamin Chen
84901ac56d Ceph: RGW and MDS deployment fixes
fix ceph.conf path in RGW
add variables_entrypoint.sh to MDS and RGW deployment

Change-Id: Ic977e397e3534b71eb17f7de4199ba31c343a0ba
Signed-off-by: Huamin Chen <hchen@redhat.com>
2017-09-08 14:59:44 -04:00
Jenkins
2e2ac8c387 Merge "Ceph: mon should get Pods from namespace other than ceph" 2017-09-08 05:56:57 +00:00
Huamin Chen
c56ebf2ea6 Ceph: mon should get Pods from namespace other than ceph
Currently CLUSTER and deployment namespace both default to ceph, so these
variables can be used exchangeably.But once deployment namespace changes,
MON daemonset will not be able to get its IP from ceph namespace.
This fix swaps CLUSTER with NAMESPACE and solves this problem

Change-Id: I0cf6afafb71f3972e24d13d479192e7a4e155de4
Signed-off-by: Huamin Chen <hchen@redhat.com>
2017-09-07 13:54:20 -04:00
Pete Birley
7c37157fb1 Ceph: RadosGW
This PS implements the ceph radosgw and also provides keystone
intergration, allowing ceph to provide a swift like service if
desired for object storage.

In addtion it updates the endpoint lookups to use valid yaml when
dealing with keystone services with a '-' in their name.

Change-Id: I9162ad657df2f77c1bc1afa93a8b999894b1b470
2017-09-06 23:35:47 -05:00
Pete Birley
c6a288d269 Ceph: Config Overides
This PS provides the same level of configuration tuneability and control to
the ceph chart as other charts within openstack-helm.

Change-Id: I620c3fdb31abe67ee5b4b4766b1523e02bb7f814
2017-09-06 19:36:54 -04:00
Pete Birley
b120667031 Endpoint lookups: fix typo in overrides
This PS fixes a typo in the endpoint lookup function and input.

Change-Id: I6ff6d68bf82e1e1f70438a7017f4e1a6df7f59a7
2017-09-06 11:15:54 -05:00
Pete Birley
f398d73c53 Ceph: Cleanup entrypoint scripts
This PS cleans up the entrypoint scripts to remove unrequired functions.

Change-Id: Ibc445e422c1ebad972de59b47955511d14dd6d3c
2017-09-05 16:34:02 -04:00
Mateusz Blaszkowski
e4f0690eb2 'affinity' constraints added in remaining services
Change-Id: I1ca654fbcc0301591e6b290d41fce1797ea2820a
Signed-off-by: Mateusz Blaszkowski <mateusz.blaszkowski@intel.com>
2017-09-04 05:56:19 -04:00
Jenkins
3ac70eb89d Merge "Set DNS policy for ceph-mon daemonset" 2017-09-01 14:35:50 +00:00
Pete Birley
bede94c835 Endpoint lookup namespace and fqdn support
This PS adds namespace and fqdn support to endpoint lookup functions,
it also permits over-riding of the puplic endpoint for ingress.

Change-Id: Ib61c5c00a214d75fe85fbffe9080c2ae88bd8cb9
2017-08-31 19:06:33 +00:00
Jaesang Lee
26252ae1fd Set DNS policy for ceph-mon daemonset
add dnsPolicy parameter in daemonset-mon.yaml, ceph-mon should have
dnsPolicy ClusterFirstWithHostNet because it use hostNetwork.

Closes-bug: 1713383
Change-Id: I14aba0f5caeb6cb7057aeadb18c60337b130da90
2017-08-28 11:27:54 +09:00
Pete Birley
39509c1eb5 Ceph: update namespace client key script to hard fail sucessfully
This PS updates the ceph namespace client key script to hard fail
if it cannot get the admin storage key from the namespace ceph is
deployed into.

Change-Id: Ieefe6d800a678d721294561b25bbebc874cfa74d
2017-08-22 11:12:04 -05:00
Huamin Chen
da9539bb87 Use RBD external provisioner
Currently RBD storageclass uses in-tree provisioner
kubernetes.io/rbd. Since containerized kubernetes controller image
doesn't include rbd binary, in-tree provisioner errors out.

This fix uses external provisioner ceph.com/rbd.

Closes-Bug: #1707937

Change-Id: Iad443a54c0229c0356beb6d872365298248c40c9
2017-08-09 11:24:59 -05:00
Huamin Chen
e30c1cf414 set DNS policy for osd daemonset
Use ClusterFirstWithHostNet DNS policy so osd pods can resolve mon address
through host network

Change-Id: I7aaeee1fc26cc1812c210bfe2c0f5b131c4cbd81
Closes-Bug: #1709439
2017-08-08 15:25:28 -04:00
Pete Birley
ff8744a9b9 Licence: Remove licence header from rendered files
This PS removes the licence header from rendered output from tiller,
significantly reducing the configmap size of charts deployed to the
cluster.

Change-Id: I5d1b246f2068f3b83bf59ba79fe8b88bbc9a6161
2017-08-07 17:16:13 -05:00
Jenkins
350f1b91b9 Merge "fix to avoid crash loop on ceph clean job" 2017-08-07 14:57:28 +00:00
Pete Birley
8f8a80019a Jobs: Add labels to all jobs
This PS adds labels to all jobs in OpenStack-Helm, allowing them to be
found by label searches. This makes management of large clusters using
tools like Armada easier.

Change-Id: I49b2cb7a94fab96958f187ca11e2c2a0c80ff843
2017-08-05 20:17:12 +00:00
Dae Seong Kim
677c7d834b fix to avoid crash loop on ceph clean job
ceph clean job tries to delete a secret. but if there's no the secret,
the job falls in CrashLoopBackOff status when helm delete.

Change-Id: I863e43f576408fdcd24997bde9b658c50b0057c1
Closes-bug: 1708597
2017-08-04 16:36:47 +09:00
Pete Birley
054ac68e92 KubeADM-AIO: update to K8s 1.6.8
This PS udpates the Kubernetes version to v1.6.8

Change-Id: I2170fbaf901e761cb732469dab5ad7bc946ddea5
2017-08-03 23:37:00 -05:00
Jenkins
542105729b Merge "Randomize ceph namespace cleaner job name" 2017-08-01 19:59:41 +00:00
Huamin Chen
4ae758a4f1 Randomize ceph namespace cleaner job name
Currently Ceph namespace job cleaner uses a fixed name. This leads to
helm delete fails to clean up Ceph package. This fix randomizes the job
name to avoid name conflicts.

DocImpact
Closes-Bug: #1707670

Change-Id: I7ac7b7482b945a9a836f6f69df0ef8cebc37bafb
2017-08-01 09:30:52 -04:00
Jenkins
a51ac55fbd Merge "Update pod affinity to allow customisation" 2017-07-28 16:21:24 +00:00
Pete Birley
f30cbcf108 Update pod affinity to allow customisation
This PS updates the pod affinity function to allow customisation by
operators at the point of deployment.

Change-Id: I8b7b2f584e990e068051d9a6d5cc7b1e1adb5aa5
2017-07-28 15:02:47 +00:00
Pete Birley
a02d22a284 Ceph: Change default image pull policy
This PS changes the default image pull policy to match other OS-H
charts.

Change-Id: Ia73ff415c065edae9890cb78ced532a16ad9ce97
2017-07-26 14:52:04 -05:00
Dae Seong Kim
892f9bd839 remove pvc-ceph-client-key when deleting ceph
When trying to re-install ceph chart, the
ceph-namespace-client-key-generator job is not working because of the
already created pvc-ceph-client-key secret.
So it needs to remove the secret when deleting ceph chart.

Closes-Bug: #1705177
Change-Id: I7338a516fe3b9f265953b8b1fddd3dbfb97bafd2
2017-07-19 16:31:34 +09:00
Larry Rensing
394a336c35 Remove unnecessary ceph mon pdb
Ceph mon has been changed from a statefulset to a daemonset,
so the PodDisruptionBudget is no longer needed.

Change-Id: I86d46ed2e6377177eff9251d5e4f3bb433eaf250
2017-07-18 04:13:22 +00:00
Pete Birley
9eb86f1f3e Ceph: fix mon check
This Ps fixes the mon check script.

Change-Id: I25647c1cb62539e602e4a4027e55be66b02781fb
2017-07-17 17:17:31 -05:00
Larry Rensing
bc8da1a89d Fix ceph single node gate health
Ceph's health when running in the single node gate currently
is 'HEALTH_WARN'.  This PS adds an extra config option such that
the ceph cluster will not attempt to perform replication when deployed
on a single node, as well as introduces a mvp yaml file for ceph
deployments in the gate.

Change-Id: Ib2ec3345140f541c94da044ff9d77723ea3ee2bd
2017-07-17 16:30:09 +00:00
Alan Meadows
ccea6b4df5 Convert ceph to utilize hostNetworking
This enhances the stability and recovery of ceph by leveraging
hostNetworking for monitors as well as OSDs, and enables the
K8S_HOST_NETWORK variable within ceph-docker.  This enhancement should
allow recovery of monitors from a complete downed cluster.

Additionally, ceph's generic "ceph-storage" node label has been
split out for mon, mds, and osd.

Co-Authored-By: Larry Rensing <lr699s@att.com>
Change-Id: I27efe5c41d04ab044dccb5f38db897cb041d4723
2017-07-14 19:06:57 +00:00
Larry Rensing
98d436eb94 Add ceph entrypoint scripts
This moves the set of ceph entrypoint scripts into the helm chart
this allows us to control how the different pods start.  Also gives
each script the +x flag to give better insight as to the execution of
entrypoint scripts.

Change-Id: Ib78b8a5d57f653bdb399a1980b34ab5ea25f94cc
2017-07-14 15:20:20 +00:00
Pete Birley
e99a3f29c5 Ceph: add bootstrap job to create pools.
This PS adds a bootstrap job to create the default pools for
OpenStack Services to consume.

Change-Id: I139d7f095c600821ef5ee3b4d2c70a00b971f32b
2017-07-12 11:27:52 -05:00
Pete Birley
20527cb57c Move k8s pod params under common key
This PS moves K8s pod params under a common key.

Change-Id: Ib4e72e82a4f1540fa800c39d0dcc91b286d96c93
2017-07-11 23:28:47 +00:00
Jenkins
ed2bca3370 Merge "Kubernetes: bump version to K8s v1.6.7" 2017-07-11 13:20:28 +00:00
Pete Birley
7421dcb36f Kubernetes: bump version to K8s v1.6.7
This PS moves the K8s Version to 1.6.7.

Change-Id: I5a2b871119429ac90a5a284ecc79ebca00dea1ff
2017-07-09 17:11:29 -05:00
Tin Lam
670a78bcbe Fix file permission and readOnly flag
This patchset enforces stricter file permission on *-etc configmap and
sets readOnly flag to true in a number of charts.

Change-Id: I233689a5d56dd1352e0d81997a94b4cdd6bed5d2
Signed-off-by: Tin Lam <tin@irrational.io>
2017-07-08 13:24:14 -05:00
Pete Birley
ac06f49849 Unify and normalise K8s Resources and Upgrade Strategy
This PS unifies and normalises Kubernetes resource allocation and
update strategy across all OpenStack-Helm elements.

Change-Id: Ia41fc453cb5191fa447ca6e1aa0f5b431c939dc8
2017-07-06 17:48:16 +00:00
Pete Birley
2a4a3fbdca Ceph: Fix pod antiaffinity for mons
This PS fixes the pod anti-affinity declaration for mons.

Change-Id: I81179453c5efaee66dc8a43075d8c542e3ddadef
2017-07-02 05:37:21 +00:00
Pete Birley
c0cf2337a2 Ingress controller for public endpoints
This PS provides the framework for Ingress controller based access to
public APIs.

Services covered:
 * Barbican
 * Cinder
 * Glance
 * Heat
 * Horizon
 * Keystone
 * Magnum
 * Mistral
 * Neutron
 * Nova
 * Senlin

Change-Id: I82d55f6ca41859ebed3312ec7d95b353df09e772
Implements: blueprint api-ingress
External-Tracking-Id: OSH-58, OSH-62
2017-06-28 17:37:10 -05:00
Pete Birley
8ef5d94674 Refactor Ceph secret generation
This PS refactors the ceph chart and secret generation process.
The updated chart replaces the existing "bootstrap" chart.
Additionally, Ceph manifests and deployment guides were modified
accordingly.

Change-Id: I6f5bb88fc0f40cfee8865d9dab83859d765e7537
Co-Authored-By: Larry Rensing <lr699s@att.com>
2017-06-27 13:42:03 -05:00
Pete Birley
9dc9640d22 Ceph: Remove Readme in chart directory
The readme in the chart directory was imported from ceph-docker and
never updated once the intial chart had been created, as a result
it has not represented the correct deployment path for Ceph for
an extended period of time (approx 5 months). This commit removes
it to reduce confusion.

Change-Id: Ibabab7b46743aabcb28fdd2aaefcc7de8b8cc2fb
2017-06-21 13:31:18 -05:00
Michał Dulko
a6cd9bac16 Use k8s 1.6 syntax of declaring affinity
K8s 1.6 has affinity/antiaffinity funtionalities as a beta feature. This
means we don't need to declare them using annotations. This commit
switches usages of affinity to 1.6 syntax.

Change-Id: Ia68f4ab28a018617bd44b1295fea58cd30eb4a39
2017-06-20 16:51:07 +02:00
Chris Wedgwood
192f02d100 [Ceph] Update default cluster network
The current default network for ceph works for very few people by
default.  Update it to match what most people seem to be using.

Change-Id: Icd5f87189b067865721203065e8caf33772d56ba
2017-06-09 20:29:01 +00:00
Tin Lam
5fcb0e3d10 Remove executable flag from Chart.yaml
TrivialFix: Some Chart.yaml's have permission 755; this patchset changes
that to 644 and be consistent with other yaml files.

Change-Id: I6453f91f0cd22330259bf24be9d4c331f2769ec2
2017-06-06 11:43:25 -05:00
Darla Ahlert
78dd37efc2 Update deployment for kubernetes 1.6
In Kubernetes 1.6, the deployment API version was changed
from extensions/v1beta1 to apps/v1beta1

Change-Id: I14ee465de381d25866224b9eae3512f0b42588d3
2017-06-02 08:45:08 -05:00
Jenkins
1ca77db357 Merge "Update remaining markdown docs to RST" 2017-06-01 21:32:41 +00:00
Jenkins
0a6e378387 Merge "Add pod disruption budget for ceph" 2017-05-31 21:28:57 +00:00
Larry Rensing
96e827e6b7 Add pod disruption budget for ceph
This adds default pod disruption budgets for ceph mons

Change-Id: I4a85140aea2a532bc073d97c7b985c7f61205a6d
2017-05-31 16:39:31 +00:00
Chris Wedgwood
f8260e9cd7 Lower Ceph requirements
Change-Id: Ie6698d4da7c911d70a1331b14dc46b3bd56af9ba
2017-05-23 23:30:35 +00:00