This adds the prometheus annotations to the tiller chart, allowing
for the scraping of metrics from tiller. currently, tiller exports
metrics specific to the grpc calls being made against it
Change-Id: Ibe10098689cc37a9de6306af86f4d63d8aab318b
This adds templates for a prometheus exporter for fluentd to
adequately capture log metrics and fluentd service metrics for
consumption by prometheus
Change-Id: I6d6a8c2be07af819dc6d99b8ce5f1d4b635a69f0
This PS removes the duplicate labeling of K8s namespaces everytime
the kubeadm image is run - as this action is performed by the
container itself while deploying k8s. It also updates the playbook
to label the kube-public ns.
Change-Id: Icfaabe54d263e0bbc52f2ac11835cb5d92ad32a4
This adds a chart for an elasticsearch exporter to expose metrics
for prometheus. This also moves the exporter to be included as
part of the chart it's meant to target as opposed to its own
separate chart
Change-Id: I491f4d1efba633827d8a6255218daeb9d427f922
This updates the prometheus metrics gathering role to dynamically
detect deployed namespaces instead of using hardcoded tasks for
each namespace. This allows the use of this job in openstack-helm
without needing to manually add additional namespaces
Change-Id: I2304aceab8dcda5471af708f57924193f03ee8f3
This patch set fixes the namespace labels and adds in a new log file to
describe all namespaces to troubleshoot gate issues where labels are not
applied properly.
Change-Id: I34c43c345f9a49df8d7fcf2e7824220a22698d46
Signed-off-by: Tin Lam <tin@irrational.io>
The update to helm 2.8.0 resulted in issues with releases not
registering as ready before timing out. This rolls the version back
until those issues are addressed
Change-Id: Id58f85f150054d82c047bd360258ebe9e571360f
There was a change in the upstream reference httpd image for
apache that changed how modules were built for apache.
This change adds the required fix to accomodate the change.
See isssue here https://github.com/docker-library/httpd/pull/87
The Elasticsearch image tag was updated to accomodate the kernel
versions used in the gate as part of the kernel update playbook
See https://github.com/elastic/elasticsearch/issues/28349#issuecomment-360233779
The openstack-exporter binary was changed to reflect changes made
to the openstack-exporter image
Change-Id: I1deb9e7cde794421dd33fade566c2a9fdb5007e6
This patch set adds label to "kube-system" and "default"
namespaces used for podSelector.
Change-Id: Ia67a0e4d9adf6f5575d74aebf77673aae3660c62
Signed-off-by: Tin Lam <tin@irrational.io>
This PS adds keystone user management to the prometheus-openstack-exporter
chart, and also performs some spring cleaning.
Change-Id: I69e40c523867f751ecd8c63169aefdfdf4eb5cd2
This PS simplifys and accelerates the collection of pod container
logs and k8s object info in the zuul gates, which can currently take
40 minutes for the 5 node OSH gate to complete.
Change-Id: Ie9b23174fade3df4a87f2b771ea654e2081b4f4e
This PS adds support for multiple replicas of Grafana to be
deployed, and adds MySQL based data persistance to the chart.
Change-Id: Ife44985a6d5024cc2074346340fba1d8efdecbfa
This PS drives basic CNI options via ansible playbook in the
KubeADM-AIO container and modifies the calico chart to support
configuration via values.
Change-Id: Iaf2f9807438c3a34e797c62c2c6913edb677997c
This PS moves build images to its own playbook, reduducing the time
taken to run the gates when not required.
Change-Id: I17203a6fa2e3c7898175389f13d680fe9347b920
This patch set adds in -E flag for ``sudo pip install`` so
any environment variable is preserved for the install. This
allows for some proxy-related variables such as ``http_proxy``
to pass through for pip.
This mirrors the change in [0].
[0] https://review.openstack.org/#/c/531270/1
Change-Id: Ib513fce862f31d784634645ac6b038c6a35f4cd6
This exporter provides a means for Prometheus to gather openstack
service metrics related to overlying openstack-helm deployments
Change-Id: I5f1789c62b4547add0c67edb51540f712bf43da8
Moves the grafana chart to OSH infra along with basic rbac rules
that may be tightened with future work.
Change-Id: Ie14627530a73d4b7b01eb93ca5f7174d99d9caec
This PS updates the docker daemon settings to run without
apply iptables rules. This simplifies host network management by
removing one of the actors interacting with iptables.
Change-Id: I335247afddf736b60212d199a3b860c3c792977f
This change allows users of the gate script to optionally
override the location of the ansible inventory and variables files,
so that they can live outside of the source tree.
Change-Id: Ibe7666ce366c7ad34e8ee6ff5ef3f23589aa10ce
This PS simplifys the helm release log gathering, to collect logs
from all charts released into the cluster, and also adds a `logs`
sub-target to the dev-deploy target in the Makefile.
Change-Id: I016a5e08163eaccf13331db6faa45fab1e9cf4f2
This provides an example action in the curator config for taking
snapshots of the elasticsearch indexes. As the snapshot action
requires a repository registered with Elasticsearch, this also
adds a PVC for a filesystem repository backed with NFS and a job
for registering the repository with Elasticsearch.
Change-Id: I26b788c58f52844e997bde5002459bddc1bb685e
This moves the Kibana chart to OSH infra, which finalizes moving
the logging components to OSH infra
Change-Id: Iacbfde8d5d7099fcb4dde8a437e030c2d4936de6
This adds the prometheus- prefix to the alertmanager,
kube-state-metrics and node exporter charts to reflect their
intended usage as part of a prometheus centric monitoring solution
This will imply a logical grouping of these components, similar to
their deployment in the osh-infra gates
Change-Id: I4f391a10b64389022f01a94ea3704c110f8f9bb5
The current fluent-bit implementation only supports the json-file
log driver for docker, this PS moves CentOS and Fedora to use that
until we can support Journald.
Change-Id: I8aa876aa96119d9a1a0e06c28873e3c4c1e3ace5