Commit Graph

246 Commits

Author SHA1 Message Date
Pete Birley
d003a082c8 Logging: Only output std logs to stdout
This PS removes the double logging of openstack components that
were caused by outputting to both stdout and stderr.

Change-Id: I6e0ae5861bbf5b8d736ae08251aa865e1c4ce0d8
Signed-off-by: Pete Birley <pete@port.direct>
2018-07-27 11:01:30 +00:00
Pete Birley
95c5b4942d Keystone: Use service domain for service users
This PS moves to use a service domain for openstack service accounts
and users.

Change-Id: Ibe7c5f83a9fc9960fb85e53f9745d24f2192a94a
Signed-off-by: Pete Birley <pete@port.direct>
2018-07-26 05:19:38 +00:00
Pete Birley
ec2f9d0808 Keystone: Update admin port declaration to use standard layout
This PS updates keystone, and the keystone endpoints sections to use
the same layout for port declarations as other charts.

Change-Id: I7dddabee6c74bf023da4b1cdf722a409e7475f8f
Signed-off-by: Pete Birley <pete@port.direct>
2018-07-25 13:00:52 -05:00
Steve Wilkerson
2f878e6cf7 Dynamically generate tags for oslo_log fluentd formatter
This proposes changing the tags added to the openstack logs
gathered by the fluentd handler from `openstack.<service>` to
`Namespace.Release` to account for multiple instances of openstack
services being deployed into different namespaces. This allows for
fine tuning the search queries in elasticsearch/kibana to target
specific service deployments in specific namespaces

Change-Id: Ia12dceb4089e107e15d8e30c92c91f350dc31318
2018-07-23 13:28:26 +00:00
Zuul
45b7dabe23 Merge "Nova: add live_migration_interface option" 2018-07-18 12:32:50 +00:00
Jawon Choo
31be86079d Nova: add live_migration_interface option
This option is useful in environments where the live-migration traffic
can impact the network plane significantly.
A separate network for live-migration traffic can then use this config
option and avoids the impact on the management network.

Change-Id: Id16c95e77730e5b244cf5bc69beb0e549c979701
2018-07-17 12:09:40 +00:00
Pete Birley
69fca6be30 Nova: Reap dead services
This PS adds a cron job that reaps dead services from Nova.

Change-Id: I59e74c7520b0341d7cb7ebddd4c21e459e9c2049
Signed-off-by: Pete Birley <pete@port.direct>
2018-07-16 18:38:50 +00:00
Steve Wilkerson
2840259fb8 Armada check: Add test directive to charts
This adds support for executing helm tests via the armada test
directive. It enables theses tests for all services, except for
nova and neutron as executing tests with armada force a chart to
wait. Forcing nova and neutron to wait effectively sequences the
charts, which will result in a failure to deploy past those
services

Depends-On: https://review.openstack.org/#/c/581148

Change-Id: I6ac845c82d744e2f5fd79c3e2ff3c1479dd1ddab
2018-07-11 13:34:58 +00:00
Yi Tseng
22965babe4 Fix incorrect nova config init script
nova-console-compute-init.sh and nove_consolt-proxy-init.sh generates
incorrect configuration if there exists multiple IP address on default
interface.

To solve this problem, we pickup first IP address if there exists
multiple IP on that interface.

Change-Id: Iaadd2e71d624122e68fdd628771df21cd61c0784
2018-07-10 12:36:53 +08:00
Ruslan Khanbikov
e0ed5d2708 RabbitMQ: It adds HA and ttl policy for notificaitons queues
This patchset introduces mirroring "notificaitons.*" queues messages across
rmq cluster nodes and add ttl expiration time for messages, utilizing
rabbitmq helm-toolkit

the configuration example:

rabbitmq:
  policies:
    - name: "test"
      vhost: "nova"
      definition: ".*"
      definition:
        ha-mode: all
  ...

equals:
 rabbitmqctl set_policies -p nova test ".*" "{"ha-mode":"all"}"
Signed-off-by: Ruslan Khanbikov <rk760n@att.com>

Change-Id: I61215de07cfaeb9d896126ef9abc94fcc9e429b9
Depends-On: I85240a50fb64a4d74454768034fe3bdcf25f3019
2018-07-06 18:31:25 +00:00
Pete Birley
25e50a34c6 Nova/Libvirt: mount vm state directories with bidirectional propagation
This PS updates the Nova and Libvirt charts to mount the vm state
directories with bidirectional mount propagation for k8s >= 1.10.
This allows mounts created by some volume drivers to be used, and
unaffected by pod restart.

Change-Id: Idaf664efb23a424dd8d9e1376ea7231b8565e3fe
Signed-off-by: Pete Birley <pete@port.direct>
2018-06-27 04:00:25 +00:00
Zuul
e8f561127f Merge "Add logging.conf files to enabled loggers/handlers/formatters" 2018-06-26 18:02:54 +00:00
Steve Wilkerson
da7bc575ec Add logging.conf files to enabled loggers/handlers/formatters
This introduces a mechanism for generating the logging.conf
file for the openstack services via the values. This allows us to
define loggers, handlers, and formatters for the services and the
modules they're composed of.

This also allows us to take advantage of the oslo fluent handler
and formatter. The fluent handler and formatter give us the
following benefits: sending logs directly to fluentd instead of
routed to stdout/stderr and then through fluentbit to fluentd,
project specific tags on the logged events (enables us to define
more robust filters in fluentd for aggregation if required),
full traceback support, and additional metadata (modules that
created logged event, etc)

Depends-On: https://review.openstack.org/577796

Change-Id: I63340ce6b03191d93a74d9ac6947f0b49b8a1a39
2018-06-26 09:51:14 -05:00
Pete Birley
e19be77f08 Ingress: Add initial TLS Support for core service public endpoints
This PS adds support for TLS on over-ridden fqdn's for public
endpoints for core OpenStack Services. Currently this implementation
is limited, in that it does not provide support for dynamicly loading
CAs into the containers, or specifying them manually via configuration.
As a result only well known or CA's added manually to containers will
be recognised.

Change-Id: I8f1b699af29cbed2d83ad91bb6840dccce8c5146
Depends-On: I535f38a8d92c01280d79926a1f0acd06984aabbf
Signed-off-by: Tin Lam <tin@irrational.io>
Signed-off-by: Pete Birley <pete@port.direct>
2018-06-26 07:15:24 +00:00
Zuul
0163d9c17d Merge "Dynamic dependencies: remove unused variable" 2018-06-17 16:51:47 +00:00
Zuul
a3475ae9c8 Merge "Gotpl: remove quote and trunc to suppress output" 2018-06-17 07:14:10 +00:00
Pete Birley
75ecf8fdf4 Gotpl: remove quote and trunc to suppress output
This PS removes the use of the `quote and truncate` approach to
suppress output from gotpl actions in templates and replaces it
with the recommended practice of defining `$_` instead.

Change-Id: I5f35c5f7e70b4f7f461d772e3b72ed1c695c56a8
Signed-off-by: Pete Birley <pete@port.direct>
2018-06-16 18:52:13 +00:00
Pete Birley
b1e515529f Dynamic dependencies: remove unused variable
This PS removes an unused variable from the resolution of
dynamic pod dependencies.

Change-Id: I95728a7b91d5143c2a44566179ef8066727020af
Signed-off-by: Pete Birley <pete@port.direct>
2018-06-16 14:19:26 +00:00
Pete Birley
5cfa1501a2 Daemonsets/Deployments: Use current kubernetes api version
This PS moves to use the current ga version for kubernetes daemonsets,
additionally any remaining deployments that were using the
`extensions/v1beta1` have been updated to `apps/v1`.

Story: 2002205
Task: 21735
Depends-On: If9703162dc472af1e6096bf2b9062802fd5ce8ab

Change-Id: Iba4e3d2798c54639e077b80999e669c79b616c6f
Signed-off-by: Pete Birley <pete@port.direct>
2018-06-15 14:35:31 -05:00
Pete Birley
67aed694c4 Deployments: Use current kubernetes deployment version
This PS moves to use the current ga version for kubernetes deployments.

Story: 2002205
Task: 21735
Depends-On: Icb4e7aa2392da6867427a58926be2da6f424bd56

Change-Id: I062a8a29dff70427ee9bcf09f595011b3611b0b1
Signed-off-by: Pete Birley <pete@port.direct>
2018-06-13 21:29:59 -05:00
zhulingjie
eb80c4f7f1 Update the home page for openstack project
Change-Id: I3841873915bb6e10e55375cd170688a7d6810535
2018-05-27 14:01:50 -04:00
Zuul
98b5716d21 Merge "Nova: Use helm-toolkit template for placement endpoints management" 2018-05-21 00:39:54 +00:00
Zuul
0c79d4e050 Merge "Nova: Use helm-toolkit template for placement service management" 2018-05-21 00:38:12 +00:00
Pete Birley
93de8767c9 Nova: Use helm-toolkit template for placement endpoints management
This PS uses helm-toolkit for the placement endpoints management job.

Change-Id: I98dea65f0f568cbd0f3b344adfc7e4ac73799200
Signed-off-by: Pete Birley <pete@port.direct>
2018-05-20 15:11:22 +00:00
Pete Birley
071ae008fd Nova: Use helm-toolkit template for placement service management
This PS uses helm-toolkit for the placement service management job.

Change-Id: If594a477478cf2d91ffdb4a6cfe919925aabbd63
2018-05-20 15:11:09 +00:00
Pete Birley
54dfb0debd Nova: Use helm-toolkit template for placement user management
This PS uses helm-toolkit for the placement user management job.

Change-Id: I6571ab5c257c69ef1c9640ba223fd35a54ddb4e5
2018-05-20 15:10:58 +00:00
Pete Birley
460675bf7f Add image management function to manifests
When removing helm-toolkit from OSH and swithcing to use the
toolkit from OSH-Infra, the image declaration function was missed.

Depends-On: I2f2012590d81ffcb159d49d8a76eedd4441744cd
Change-Id: I0f1118bb748f3fe1b6bb73acfc00e77c5cca9c7d
Signed-off-by: Pete Birley <pete@port.direct>
2018-05-20 10:10:16 -05:00
Pete Birley
20abcad4d5 Cinder: Use correct service names for api versions
This PS updates cinder to use the correct service names for API
versions

V2:
 * https://github.com/openstack-dev/devstack/blob/stable/newton/lib/cinder#L387
 * https://github.com/openstack-dev/devstack/blob/master/lib/cinder#L381

V3:
 * https://github.com/openstack-dev/devstack/blob/stable/newton/lib/cinder#L395
 * https://github.com/openstack-dev/devstack/blob/master/lib/cinder#L387

The custom value for Nova's cinder catalog_info is also removed, as this was
required to use the incorrect service catalog names.

Change-Id: Ic88826a3c8233e260caca69272cf32021825b48c
2018-05-13 04:00:28 +00:00
Pete Birley
00def94bad Nova/Ironic: Update nova-compute ironic pods to use nova compute labels
This PS updates the nova-compute ironic pods to use the nova-compute
labels, allowing cell managment jobs to be run.

Change-Id: Icd1c68882038f53d9948770a6f85b0e8ee53d964
2018-05-12 16:58:16 -05:00
Steve Wilkerson
354b311ec5 Add local-registry image managment to OSH from OSH-Infra
This PS adds the local registry image managment to OSH from OSH-Infra.
With this the delta between helm-toolkits in the Repo's is removed,
allowing the toolkit from OSH-Infra to be used and the one from OSH
to be depreciated.

Change-Id: If5e218cf7df17261fe5ef249d281f9d9637e2f6a
Co-Authored-By: Pete Birley <pete@port.direct>
2018-05-12 14:35:48 +00:00
Zuul
0117c1434c Merge "Nova: Don't set console server_proxyclient_address as null" 2018-05-09 02:11:49 +00:00
Pete Birley
45b223d9d1 Ceph/Libvirt/Cinder/Nova: update charts to support OpenStack >= Ocata
This PS updates the charts to suuport Ceph RBD volume attachment, for
Newton to Queens.

Change-Id: I675ee65579e7f9a0b328a03b4064cd85ae5d1de7
2018-05-08 18:32:17 +00:00
Jawon Choo
970b38e564 Nova: Don't set console server_proxyclient_address as null
This PS make server_proxyclient_address to use default values on other
pods except console-proxy pod and nova-compute pods.
Until Ocata version, null value was acceptable. But from Pike version,
occurs error.

Change-Id: I4ef4ed78f4ca0ee456c20b8bfd53956030388760
Closes-Bug: #1769842
2018-05-08 17:45:14 +09:00
Pete Birley
f4a0b57c9f Nova: Add initial cell v2 setup job
This PS adds a job to run post initial deployment to ensure at least
one node is added to the cell upon deploy.

Change-Id: I300ba9760bdcfcb01f17d731b0cbbc6d5d0bce61
2018-05-07 14:16:11 -05:00
Pete Birley
18b622f4fe Nova: Update cell and db management
This PS updates the nova db and cell managment jobs to both be
compatible with queens and also add nodes dyanmically on a cron
job as they come online.

Change-Id: I3393f5ba82ac81b1a1da1e433c1c5158660ec97a
2018-05-03 16:59:50 +00:00
Sean Eagan
97ac197a6e Move to v0.3.1 of kubernetes-entrypoint
Move to v0.3.1 of kubernetes-entrypoint which has 2
breaking changes to pod dependencies, and also adds support for
depending on jobs via labels.

Change-Id: I49d2cea11fbe5c5919ae22a020b877ebbb285992
2018-04-25 12:45:50 -05:00
Pete Birley
40a45b9751 RabbitMQ: Add vHost management and improve security
This PS adds vhost management to rabbitmq jobs. It also prevents
sensitive information being displayed in the management job, and
removes the 'administrator' tag from service users.

Change-Id: Id337f763c5e4776bce7269676a8a2dc54dc2e5f8
2018-04-19 08:26:45 -05:00
Hyunsun Moon
7295f308cc Don't mount pvc-ceph-client-key when not used
Closes-Bug: 1755975
Change-Id: I65a2e99cecce63bdae20f6e83cf62edf5327d7c6
2018-04-17 17:14:08 +09:00
Pete Birley
0fccc9a9a3 Nova: NoVNCProxy Ingress
This PS adds ingress rules and config for nova's novncproxy.

Change-Id: Ibc89e67c8ee6c93d8ee3e798dec10e976c002cab
2018-04-13 21:13:38 +00:00
Chris Wedgwood
bad317c515 nova: yaml indentation fixes
Change-Id: I45b6c691ce9ea4bb1cd4607efcf71a2dc068be3c
2018-04-11 21:12:18 +00:00
Zuul
757378fb7f Merge "fix typos in documentation" 2018-03-26 17:26:15 +00:00
Pete Birley
2f998bfb12 Nova: Update endpoint path to 2.1
This PS updates the Nova endpoint to use v2.1, which makes tempest
happy.

Change-Id: I1fbda225820cdc3b40be27198cc44caa15fac156
2018-03-23 11:34:06 -04:00
melissaml
205c50cd5d fix typos in documentation
Change-Id: Idb156b0141e177041de5c79b2118d682808d45aa
2018-03-23 08:38:21 +08:00
Pete Birley
6971143048 Ingress: support arbitary hostnames.
This PS allows arbitary hostnames to be used for public endpoints,
provided the resolve externally to the ingress controllers.

Change-Id: I44411687f756968d00178d487af66c2393e6bde0
2018-03-21 09:39:55 -05:00
Sean Eagan
6d0a0fc0c3 Use pod dependencies in nova chart
Changes nova chart to depend on neutron pod labels instead of daemonsets
in order to prepare for utilizing daemonset overrides in neutron chart,
Utilizes a new feature of kubernetes-entrypoint, pod dependencies, added
to kubernetes-entrypoint in v0.3.0.

Change-Id: Ic79ddc1b7f477195c5b3dfd630df4d78d7589030
2018-03-16 09:23:34 -05:00
Zuul
0c7b6e01a3 Merge "Nova: Fix sudoers location in nova-etc configmap" 2018-03-15 15:48:59 +00:00
Pete Birley
86be88e1d9 Neutron: SR-IOV support
This PS adds SR-IOV Support to OSH.

Change-Id: Ia744c6d7c4a45be7728bba3213b50f1246b897db
2018-03-14 18:13:13 -05:00
Steve Wilkerson
a71998a80c Nova: Fix sudoers location in nova-etc configmap
The nova_sudoers entry in the nova configmap-etc was consuming
the neutron_sudoers entry in the values.yaml. This corrects it to
point at nova_sudoers instead

Change-Id: I621c817c579cc1c31fa51b1a0f49a43a652784a2
2018-03-14 15:13:15 -05:00
Zuul
32a468178b Merge "Ingress controller service: consolidate to helm-toolkit" 2018-03-14 02:14:22 +00:00
Pete Birley
507600e898 Ingress controller service: consolidate to helm-toolkit
This PS consolidates the Ingress controller service, that is used
to resolve internal requests to public endpoints correctly, to
helm-toolkit.

Change-Id: If7c7deca1b8289a32709f7dc7c936883469aadfe
2018-03-12 13:48:39 +00:00