Commit Graph

64 Commits

Author SHA1 Message Date
Zuul
2fb6a79b49 Merge "Fluent-logging helm chart" 2017-12-15 20:29:50 +00:00
sungil
2862f038e2 Fluent-logging helm chart
This introduces an initial helm chart for fluent logging.
It provides a functional fluent-bit and fluentd deployment to
use in conjunction with elasticsearch and kibana to consume
and aggregate logs from all resource types in a cluster.
It can deliver logs to kafka for external tools to consume.

This PS moves fluent-logging chart from osh-addons, osh to
osh-infra repo.
previous ps(addon): https://review.openstack.org/#/c/507023/
previous ps(osh): https://review.openstack.org/#/c/514622/

Specification: https://review.openstack.org/#/c/505491/
Partially implements: blueprint osh-logging-framework

Change-Id: I72e580aa3a197550060fc07af8396a7c8368d40b
2017-12-15 10:52:16 -06:00
Zuul
740dbf8b37 Merge "Makefile: Allow pulling of all images for a targeted chart" 2017-12-14 22:40:32 +00:00
Zuul
093e64631d Merge "Add missing prometheus and alertmanager resources" 2017-12-14 00:20:52 +00:00
Zuul
6bda2f5acf Merge "Enable ceph-mgr label on nodes to support luminous" 2017-12-13 20:25:19 +00:00
Ganesh Maharaj Mahalingam
b3e63a9b47 Enable ceph-mgr label on nodes to support luminous
Change-Id: I17359df62a720cbd0b3ff79b1d642f99b3e81b3f
Signed-off-by: Ganesh Maharaj Mahalingam <ganesh.mahalingam@intel.com>
2017-12-13 10:06:15 -08:00
Alan Meadows
1af212c0ab Support IP addresses as hosts within keystone_endpoint_uri_lookup
This allows the keystone endpoint uri lookup function to
avoid adding a FQDN suffix to an IP address based host
entry.

Change-Id: I016e6512fb21182a8be9e3de1e4a2da59a20fb36
2017-12-13 16:45:48 +00:00
portdirect
64f6e66cb3 Makefile: Allow pulling of all images for a targeted chart
This PS brings the OSH-Infra Make inline with OSH and allows images
to be pulled on a per chart basis to the local machine.

Change-Id: Ieda89adf97140a2ad3824ff36e969bd016ccdf00
2017-12-12 19:05:59 -05:00
Zuul
1c66ca1c12 Merge "Add Elasticsearch liveness/readiness probes" 2017-12-12 20:20:31 +00:00
Steve Wilkerson
bea44e53bf Add Elasticsearch liveness/readiness probes
The elasticsearch tests fail because the pods don't have
readiness or liveliness probes in the templates. This adds those
definitions

Change-Id: I4fd25aec5ae02d89ae1b933d8b083a3e9cafc55a
2017-12-11 18:47:46 -06:00
Zuul
39968768e9 Merge "Helm: update to 2.7.2" 2017-12-12 00:27:31 +00:00
Steve Wilkerson
605faded2e Gather deployment information after checks run
Adds tasks to gather descriptions of kubernetes objects, logs from
deployed pods, logs from helm test pods, the status of each
helm release, and metrics from endpoints exposed to prometheus

Change-Id: I606797c6a5d75ba446ed2c16a9710f7b0227f910
2017-12-11 09:57:28 -06:00
Pete Birley
6faa1b4c0b Helm: update to 2.7.2
This PS updates the version of helm to v2.7.2 which includes some
security fixes.

Change-Id: Ic6de39985a88c4e0fb062c35f9ee6c256b3d20d9
2017-12-05 15:07:58 -06:00
Steve Wilkerson
5fae0f2880 Add missing prometheus and alertmanager resources
Alertmanager and prometheus were missing entries for job
resources in values.yaml. Also added resources to the prometheus
helm test template

Change-Id: I11dbad19d1f881c398a4b4dcd0c0eab23fccf278
2017-12-01 18:30:47 -06:00
Steve Wilkerson
4b94e47c94 Add Elasticsearch to OSH Infra
This moves the Elasticsearch chart to OSH infra, along with rbac
rules for running Elasticsearch. It includes a cronjob for running
ES Curator for cleaning up old indices

Change-Id: I69fcbe8b77de8b594eba5340a6e4340f389ba5bf
2017-12-01 17:42:23 -06:00
Zuul
9051ec4ac2 Merge "Prometheus monitoring for OSH infra" 2017-11-30 23:06:45 +00:00
Steve Wilkerson
429a4edd86 Prometheus monitoring for OSH infra
This will move prometheus to OSH-infra to be included as part of
the basic infrastructure deploy for openstack-helm. It includes
charts for Prometheus, Node Exporter, Kube-State-Metrics, and
Alertmanager. It provides a base for monitoring and alerting
for the underlying infrastructure

Partially Implements: blueprint osh-monitoring

Change-Id: Ie453373b54c5f1825339ce0566e4b5d0f74abc20
2017-11-30 09:43:17 -06:00
Steve Wilkerson
2a915c4a15 Add support for running helm tests for charts
Adds a common-helm-test task executed as part of the
deploy-helm-packages playbook. It allows the ability to run helm
tests against a chart by including a helm_test key in the chart
definition

Change-Id: I52bd5ca2fafa4eb704369590f7903c127133b090
2017-11-30 09:09:46 -06:00
Steve Wilkerson
13c4199742 Adds extra args for kube_scheduler deploy
This adds extra args for the kube-scheduler to expose metrics on
port 10251 on all interfaces. This allows for Prometheus to gather
metrics for the scheduler

Change-Id: I26d473f511f6541a14a9387be1ce56841572bfff
2017-11-28 08:15:31 -06:00
portdirect
70e26302f7 Gate: Fix vars for local development use
This PS resolves an issue in the way ansible variables are merged
re-enableing use of the gate scripts for local development use.

Change-Id: Ia18a9f92816e4cc49f1c5423c04bed8a80abc6dc
2017-11-21 15:37:25 -05:00
Zuul
a2449cebcb Merge "KubeADM: Move shell commands to use bash and set env vars" 2017-11-20 23:56:20 +00:00
Zuul
775b1f9f88 Merge "Gate: Modularise gate for development use" 2017-11-20 23:44:59 +00:00
portdirect
864f554a72 KubeADM: Move shell commands to use bash and set env vars
This PS moves the shell module invocations to use bash and set the
required env vars explicity. This can seolve some issues on ubuntu
workstation hosts which uses dash for shell commands by default.

Change-Id: Ieb440e421d9d95676719d66fb4c787f88a9d8a2b
2017-11-20 15:40:30 -05:00
Zuul
172844c662 Merge "Gate: make pod subnet configurable" 2017-11-17 20:48:11 +00:00
portdirect
87f22838f2 Gate: Modularise gate for development use
This PS breaks down the gate to enable use as a development aid.

Change-Id: I376da8940ed085b7575dd528ec4082f42da1748c
2017-11-16 12:47:19 -05:00
Zuul
e3327455c7 Merge "Gate: force use of bash for ansible script module use" 2017-11-14 21:14:53 +00:00
intlabs
2029e94d1b Gate: force use of bash for ansible script module use
This PS forces the use of bash for ansible tasks that use the
script module.

Change-Id: I131768d48081834806eeb912d84c562eeada1f46
2017-11-13 13:17:54 -06:00
Zuul
c1f55190ac Merge "Gate: Add linter gate and path options to OSH-Infra" 2017-11-13 19:05:39 +00:00
Zuul
9bbf5df5cc Merge "Gate: Consolidate job definition to allow imports" 2017-11-13 16:32:45 +00:00
Tin Lam
5d70c0ec8f Gate: Add linter gate and path options to OSH-Infra
This patch set adds a zuul v3 trailing whitespace linter gate to
the OSH-infra repository.

It additionally updates the work_dir path to account for being
launched as a dependant project in zuulv3.

Change-Id: I680a5942f008a6246641bebca7d9880a7824f2ce
2017-11-13 10:06:16 -06:00
intlabs
80e1d68fa0 Gate: Move to k8s v1.8.3 and expose params
This PS moves to use version 1.8.3 of k8s and also exposes all the
versions as build params to the kubeadm-aio dockerfile.

Change-Id: I8e6ef8090f3fa178e950a42605a5d86e298e0c99
2017-11-13 01:17:18 +00:00
intlabs
8ac50d34af Gate: Add task to deploy yq and deps
This PS adds a task to deploy yq and it's deps

Change-Id: I8404060d4cc24542e59af8cbfd7c69c5c11c0834
2017-11-12 05:07:46 -06:00
intlabs
a731fdce4e Gate: Consolidate job definition to allow imports
This PS moves the Zuulv3 infra jobs to use a base that the various
nodesets can inherit from.

Change-Id: I8f9380d00d874d102d4a5c977edad499872006a9
2017-11-12 00:12:00 -06:00
Steve Wilkerson
62d5bfde3c Add entry for serviceaccount in flannel's values.yaml
The key for serviceaccount_flannel under manifests for flannel
was missing, resulting in failures when provisioning the kubeadm
aio with flannel

Change-Id: I842e4c4280de0217157aef98ecf4307d2e3506ab
2017-11-08 17:56:41 +00:00
Matt McEuen
2b185f5735 Gate: make pod subnet configurable
Make the CNI pod subnet configurable/overridable.

Change-Id: I5fa3a2178ad3a61c1bf939fc3c08c787169d350b
2017-11-05 18:52:42 -06:00
Zuul
75b656dc58 Merge "ImagePuller: add sudo for use when user is not in docker group" 2017-11-03 17:10:07 +00:00
Zuul
0ad3fd03b8 Merge "NFS: RBAC rules" 2017-11-03 15:14:32 +00:00
intlabs
fa041ea6da ImagePuller: add sudo for use when user is not in docker group
This PS adds sudo to the image puller commands to enable use when
the user is not in the docker group.

Change-Id: Ic2c2577e830f3db93952b72a92d360da83fb1a16
2017-11-03 00:28:54 -05:00
intlabs
98e2c5bde0 Kubernetes: move to 1.8.2
This PS moves the OpenStack-Infra gates to use Kubernetes v1.8.2

Change-Id: I8d1494df959ffbb94e0f76fa79d5180b53f87680
2017-11-02 23:44:55 -05:00
intlabs
fe62a25081 Helm: Move to version 2.7.0
This PS moves the OpenStack-Helm Infra gates to v2.7.0

Change-Id: I8f2067019022cfcbc81a53927c397720297fe547
2017-11-02 23:43:27 -05:00
intlabs
8d290a20f5 NFS: RBAC rules
This PS adds the RBAC policy for the NFS provsioner.

Change-Id: I1bb8cc267eaa7e6899dea10e7d02fdafa4c1903e
2017-11-03 04:12:43 +00:00
Zuul
72b644b66a Merge "Gate: remove zuul v2 stub" 2017-11-03 02:07:39 +00:00
intlabs
4ef2747f3a RBAC: enforce standard k8s RBAC policy
This PS removes the lax RBAC policy used in OSH to date, and the
standard rules are applied.

Change-Id: Ic2cf6063a4c0b7c4a6e73094f55ad424effc965c
2017-11-02 16:34:15 -05:00
intlabs
436845541b Image local repo jobs and multiple namespace support
This PS introduces support for using a local docker repo to
store images if desired, and adds multiple namespace support
to the entrypoint lookup functions.

Change-Id: Ib51aa30d3cc033795fe13f6c40a57d46171ad586
2017-11-02 16:23:32 -05:00
intlabs
ddf38fd47b Gate: remove zuul v2 stub
This PS removes the stub v2 gate setup script.

Change-Id: Ieb78bf466111e8b152e54ad2ee3ec32ff68b202d
2017-11-01 21:10:39 +00:00
Zuul
d4163dff03 Merge "Calico: Add basic dependency checks and rbac support" 2017-11-01 18:17:55 +00:00
Zuul
69c1bd6aa6 Merge "Chart Runner: Add NFS provisoner and Docker Registry" 2017-11-01 18:06:11 +00:00
intlabs
308f8a2121 Calico: Add basic dependency checks and rbac support
This PS update the calico chart and deployment to use
Kubernetes entrypoint, and apply appropriate RBAC rules to
the pods.

Change-Id: I9d875f50c4767b6714a4931b9ade0a6f94b533c2
2017-11-01 16:52:52 +00:00
intlabs
fd683f4241 Chart Runner: Add NFS provisoner and Docker Registry
This PS adds the NFS provisioner and Docker Registry to the OSH-Infra Repo,
these are being used as initial candidates for moving as they are simple
charts and allow the chart runner logic to be developed in the gate
playbooks.

Change-Id: Ie80b8578aafd3fe7252d3dcb603ea6af7586776e
2017-11-01 11:40:09 -05:00
intlabs
bdad21fd14 Kubernetes: widen nodeport range and serve statistics
This PS widens the range for nodeports, allowing standard OpenStack
ports to be used if desired for ingress.

Additionally the controller manager is set to serve statistics on the
standard port.

Change-Id: Id6549e90491a79c1ac6830a1324db7f13c88ea13
2017-11-01 11:32:51 -05:00