53 Commits

Author SHA1 Message Date
Zuul
c659b0fdd6 Merge "Update default overrides for openstack and ubuntu" 2021-03-11 03:53:39 +00:00
Chinasubbareddy Mallavarapu
85627eca0c [ceph] OSH:Make sure loopback devices persistent across reboots
Change-Id: I85e4c29925ac63ea7656901f5b03b919984cf12f
2021-02-22 13:54:39 +00:00
Gage Hugo
01a1ab2ecc Update default overrides for openstack and ubuntu
By default when deploying the openstack AIO, it will deploy
openstack ocata release on ubuntu xenial, which by now is quite
old and largely unsupported. This change updates these default
overrides to train and bionic respectively in order to bring
the default settings to more recent/supported releases.

Change-Id: I9b6e1120101767356413b1341828dc8d39bc9b3c
2021-02-03 19:45:59 +00:00
Andrii Ostapenko
25a02b797f Add force cron jobs test run
Change-Id: Iba1045e8b8a992c77449c77a16d410589b7778bc
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-09-10 17:15:26 -05:00
Andrii Ostapenko
f3ed377cbc Parallelize helm test run for compute-kit
Depends-On: https://review.opendev.org/742499
Change-Id: Iebc74280f5fd6302723caa325603645a2f9755dc
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-08-06 00:51:29 +00:00
Zuul
639f15a069 Merge "[CEPH] Update ceph scripts to create loopback devices" 2020-07-29 20:07:24 +00:00
Chinasubbareddy Mallavarapu
59dac81fd4 [CEPH] Update ceph scripts to create loopback devices
This is to update ceph scripts to create loopback devices
in single script and also to update gate scripts.

Change-Id: I937ae79512ffc998d8dbd0b277a611347550044b
2020-07-29 09:51:31 -05:00
Andrii Ostapenko
3aa712e818 Use default stein OPENSTACK_RELEASE for client setup
Change-Id: I07dfb5bb55a86b34ff0c1af3b5c183efdc0c892a
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-07-27 15:12:52 -05:00
Chinasubbareddy Mallavarapu
385c0775b9 [CEPH] Update dev scripts for ceph to handle loopback devices
This is to update loopback devices creation script to take device names
from developers in case if default devices are busy.

Change-Id: Ie368ebdfdc64ea00ccf62cf61010beddcc2cf4ce
2020-07-21 21:46:18 +00:00
Andrii Ostapenko
dac7c4f8bd Specify OPENSTACK_RELEASE for setup-client.sh constraints
Also include ensure-pip role to functional jobs.

Depends-On: https://review.opendev.org/741485
Change-Id: I68fd85ada78cd41108c2f292a8cb9a237cd79e8d
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-07-19 00:09:33 +00:00
Tin Lam
918a307427 feat(tls): add tls support to openstack services
This patch set enables TLS for the following OpenStack services: keystone,
horizon, glance, cinder, heat, nova, placement and neutron for s- (stein)
and t- (train) release. This serves as a consolidation and clean up patch
for the following patches:

[0] https://review.opendev.org/#/c/733291
[1] https://review.opendev.org/#/c/735202
[2] https://review.opendev.org/#/c/733962
[3] https://review.opendev.org/#/c/733404
[4] https://review.opendev.org/#/c/734896

This also addresses comments mentioned in previous patches.

Co-authored-by: Gage Hugo <gagehugo@gmail.com>
Co-authored-by: sgupta <sg774j@att.com>

Depends-on: https://review.opendev.org/#/c/737194/

Change-Id: Id34ace54298660b4b151522916e929a29f5731be
Signed-off-by: Tin Lam <tin@irrational.io>
2020-07-10 09:36:31 -05:00
Chinasubbareddy Mallavarapu
a385c18176 [CEPH] OSH: use loopback devices for ceph osds.
- This is to make use of loopback devices for ceph osds since
support for directory backed osds going to depricate.

- Move to bluestore from filestore for ceph-osds.

Change-Id: Ia95c9ceb81f7d253dd582a2e753a6ed8fe60a04d
2020-06-30 17:05:22 -05:00
Gage Hugo
3a3cabc3b8 Add python3-pip to list of installed packages
OSH requires pip3 to install the openstackclient, and a recent
change in infra made the images no longer contain
pip by default. This change adds python3-pip in order to address
this.

Change-Id: I32febc7194ced6ab88794c6ac9fa2aa373909827
2020-06-17 16:02:11 +00:00
Gage Hugo
db79e79788 Remove OSH Authors copyright
The current copyright refers to a non-existent group
"openstack helm authors" with often out-of-date references that
are confusing when adding a new file to the repo.

This change removes all references to this copyright by the
non-existent group and any blank lines underneath.

Change-Id: Ia035037e000f1bf95202fc07b8cd1ad0fc019094
2020-04-03 20:53:32 +00:00
Tin Lam
d0621d83bd [Gate] Fix failure
This patch set moves pip/2 to pip/3. This also removed a cap of
cmd2 package.

Change-Id: Ia0e377092d71416e96926215fe109cfbf54bc4ed
Signed-off-by: Tin Lam <tin@irrational.io>
2020-03-28 03:32:04 -05:00
sg774j
f76a3f5e0a Heat: Add ingress network policy overrides
This patch set adds in default heat ingress overrides.

Change-Id: I4e1f2b6687a05f2bf3ca91c941c2cf11abe68f07
2020-03-19 09:08:14 +00:00
Huang, Sophie (sh879n)
c9f506eee1 Tools: Update test-networkpolicy.sh
This patch set adds ingress network policy testcases for mariadb
in openstack namespace.

Depends-On: https://review.opendev.org/#/c/687162/
Change-Id: Ia2bc596baf623ef3f747fbd0534c8e058e1571f8
2020-03-18 15:40:40 +00:00
sg774j
86ae6d177a Tools: Update test-networkpolicy.sh
This adds network policy testcases for memcached in openstack
namespace.

Depends-On: https://review.opendev.org/#/c/685755/
Change-Id: I99a0598172453692817420ddefd8653f292124d9
2020-03-17 19:16:28 +00:00
songgongjun
9b74750a3c Replace "make all" in setup-client.sh
setup-client.sh is the script which setups the openstack client.
This script is referenced in the installation guide and many CI
jobs. More than installing the openstack client, the script builds
all the charts by calling `make all`. This script is also called in
openstack-helm-infra project CI job[1]. The `make all` may break the
CI at some situations. For example in the following case:

We make some changes of helm-toolkit to enhancement a tool function.
In the enhancement the function parameters are changed. At this
moment, we can't build some up-layer charts, because they call the
function with old parameters.

Actually, we don't have to make all in the setup-client.sh as we
build every single chart when we install the component. We just need
to build the helm-toolkit here. So this patch is to replace the
`make all` with `make helm-toolkit`

[1] https://github.com/openstack/openstack-helm-infra/blob/master/zuul.d/jobs.yaml#L314

Story: 2007291
Task: 38822

Change-Id: If5efb1a108a36281f2459594ba6424491d909580
Signed-off-by: songgongjun <gongjun.song@intel.com>
2020-02-24 17:07:59 +08:00
Gayathri Kathiri
6c65d21e94 Add Glance ingress network policy overrides
This patch set introduces the ingress network policy overrides
for Glance.

Change-Id: I2b28445dd6f0d2f1f8238d0d4bc1804136c92346
2020-01-09 12:06:14 +00:00
Tin Lam
5057052c70 Fix feature gate envvar overriding
Currently using envsubst to perform substitution of value overrides in
the feature gate caused conflicts as gotpl gets templated into those
overrides. This adds in '%%%REPLACE_${var}%%%' and uses sed to perform
the substitution instead to address the issue.

This is to achieve parity with OSH-infra patch in [0].

[0] https://review.opendev.org/#/c/697749/

Depends-On: https://review.opendev.org/#/c/697749

Change-Id: I3ed504c65900e7b84728019f3acdf706a40c0427
Signed-off-by: Tin Lam <tlam@omegaprime.dev>
2019-12-17 09:49:38 +00:00
Tin Lam
a25eccb7cb Implements egress network policy
This patch set adds in the egress policy for core OpenStack Services.

Depends-On: https://review.opendev.org/#/c/679853/

Change-Id: I585ddabcbd640db784520c913af8eddecaee3843
Signed-off-by: Tin Lam <tlam@omegaprime.dev>
2019-11-22 01:16:49 +00:00
Tin Lam
feb97a2dc3 Add horizon ingress override
This patch set adds in default horizon ingress overrides.

Change-Id: I5a7e8197b84bc5f1ad94d5d6a1d0662257404994
Signed-off-by: Tin Lam <tin@irrational.io>
2019-10-16 02:46:28 +00:00
Huang, Sophie (sh879n)
313fe0ca3e Add keystone ingress netpol
Change-Id: I75874b475039c1f7469f11e02e2231254cc9d8ca
Signed-off-by: Huang, Sophie (sh879n) <sh879n@att.com>
2019-10-08 10:41:38 -05:00
Zuul
24f9b2322a Merge "Add network policy nonvoting checks" 2019-09-27 14:06:26 +00:00
Gage Hugo
c3e085b800 Add network policy nonvoting checks
This change adds two network policy zuul checks, one for the compute-kit,
and one for cinder/ceph, to test network policy for each OpenStack
service. These checks will be non-voting initially.

The network policy rules for each service will initially allow all
traffic. These ingress/egress rules will be defined in future changes
to only explicitly allow traffic between services that are explicitly
allowed to communicate, other traffic will be denied.

Depends-On: https://review.opendev.org/#/c/685130/

Change-Id: Ide2998ebb2af2832f24ca7abc398a82e4a6d70e3
2019-09-26 11:57:15 -05:00
Andrii Ostapenko
09e1f524d4 Use configurable constraints to install clients
Change-Id: Ieb397a688907cc20b8fffafec01416ff9fb68515
2019-09-16 16:39:54 -05:00
Zuul
8b1d5016e8 Merge "Remove network policy override from memcache script" 2019-09-13 18:44:17 +00:00
Gage Hugo
fc5be700a3 Remove network policy override from memcache script
This change removes the network policy overrides that are set in
the common memcache setup script. These override will be implemented
in a future change as part of the rest of the network policy work.

Change-Id: I8954b6d88a650a576208e33b6e6e6ef00bdbef66
2019-09-03 15:12:10 -05:00
Andrii Ostapenko
10ef2bf27a Add components overrides retrieval to developer scripts
Change-Id: Id48c4a920f9463cd0b0283a13b0389e0927851a2
2019-08-30 14:54:56 +00:00
Pete Birley
cede6c0d48 Gate: Simpler multiple distro/over-ride support
This PS indroduces a simpler way to incorp over-rides into gate
runs, and also ensures that they are scoped to a single chart, rather
than all of the charts deployed within a gate run.

Depends-On: https://review.opendev.org/666957

Change-Id: I49edf52cc1fc5ec60ee9754c28880c9c0c54492e
Signed-off-by: Pete Birley <pete@port.direct>
2019-06-25 13:16:37 +00:00
Jiří Suchomel
295475481f Report the reason why the script hits a timeout.
Also small code cleanup and bit more consistency to the commands
and variables.

Change-Id: I7bb1a9e3bafc105c17010dc145adfb3a166e945e
2019-03-04 15:53:58 +01:00
Steve Wilkerson
e8e0d30e7b Use minikube deployment for single node gates
This updates the single node jobs to use the recently
added minikube deployment, with the intent to reduce
overall runtime for the single node jobs

Change-Id: I6efdbf890d86bf916cef2d1a3b7eba1f6132c2f9
2018-12-04 12:36:57 -06:00
Steve Wilkerson
1b7f673d8f Update openstack-helm checks/gates
This begins the reordering of the openstack-helm gates. This
deprecates the single node checks/gates that deployed the entire
stack in favor of single node checks/gates that are focused on
deploying charts with only their dependencies to reduce the
number of checks/gates required for a particular change. This also
moves the armada check to experimental, and moves the multinode
checks/gates to run as periodics. This will be followed up by
additional efforts to streamline these changes and incorporate
previous work targeting the same.

Change-Id: I63b87aceefc79a7a42c325669f2b4e3abb0c961c
2018-12-04 08:39:13 -06:00
Tin Lam
29f32a07ac Enable network policy enforcement
This patch set updates the gate to by default uses network policy
for all components and enforces them in Openstack-helm.

Change-Id: I70c90b5808075797f02670f21481a4f968205325
Depends-On: I78e87ef3276e948ae4dd2eb462b4b8012251c8c8
Co-Authored-By: Mike Pham <tp6510@att.com>
Signed-off-by: Tin Lam <tin@irrational.io>
2018-10-23 14:58:13 +00:00
Steve Wilkerson
75f6c9bb1b Gate: Fix make command for osh-infra charts
This updates the make command for the osh-infra charts in the
deployment scripts to account for the charts residing in
openstack-helm-infra instead of the openstack-helm working
directory

Change-Id: I9f492e586f69b0caf908366a9cae2b55da0d4cfc
2018-09-12 23:58:13 +00:00
Loic Nicolle
92b04a735d Deployment script: add "--ignore-installed" option to pip install command
adding "--ignore-installed" option to pip command 
allow the script to be executed on centOS 7.5.

Story: #2003603
Change-Id: Ibb756b3b658993eb999d4a07e35c76b5811913fe
2018-09-03 07:16:04 +00:00
Jean-Philippe Evrard
05d0e2b4b8 Revert "Update OSH Author copyrights to OSF"
This reverts commit b1755c3993.

Change-Id: I215a172f2ff4220340292b95f5323847944baeb7
2018-08-28 17:25:13 +00:00
Matt McEuen
b1755c3993 Update OSH Author copyrights to OSF
This PS updates the "Openstack-Helm Authors" copyright attribution
to be the "OpenStack Foundation", as decided in the 2018-03-20
team meeting:
http://eavesdrop.openstack.org/meetings/openstack_helm/2018/openstack_helm.2018-03-20-15.00.log.html

No other copyright attributions were changed.

Change-Id: I167ceedab8fadee28c19514fad6f125d0a521caf
2018-08-26 17:17:41 -05:00
Pete Birley
5f349ae653 Keystone: Disable v2 api
This PS disables the v2 keystone API, and finishes the migration to
full v3 support.

Change-Id: I3021ebe0bee668db9f28e7fb18e2d4b26172f209
Signed-off-by: Pete Birley <pete@port.direct>
2018-08-03 14:50:45 +00:00
Pete Birley
dc7008d9a5 Keystone: enable external access to admin endpoint
This PS moves to use port 80 by default for the keystone
asdmin endpoint, and adjusts paths accordingly.

Change-Id: Iccae704dadc17eba269e857301654782f64763c9
Signed-off-by: Pete Birley <pete@port.direct>
2018-08-02 14:40:20 +00:00
Pete Birley
460b1cea29 Memcached: move Memcached chart to OSH-Infra
This PS moves the Memcached chart to OSH-Infra

Story: 2002204
Task: 21727
Depends-On: https://review.openstack.org/#/c/585553

Change-Id: Iabf15db6d14df7e6b7246f8abb9d2e97f6d96172
Signed-off-by: Pete Birley <pete@port.direct>
2018-07-29 15:00:49 +00:00
Pete Birley
e19be77f08 Ingress: Add initial TLS Support for core service public endpoints
This PS adds support for TLS on over-ridden fqdn's for public
endpoints for core OpenStack Services. Currently this implementation
is limited, in that it does not provide support for dynamicly loading
CAs into the containers, or specifying them manually via configuration.
As a result only well known or CA's added manually to containers will
be recognised.

Change-Id: I8f1b699af29cbed2d83ad91bb6840dccce8c5146
Depends-On: I535f38a8d92c01280d79926a1f0acd06984aabbf
Signed-off-by: Tin Lam <tin@irrational.io>
Signed-off-by: Pete Birley <pete@port.direct>
2018-06-26 07:15:24 +00:00
Tin Lam
e66438b887 Fix pip package version
The python "cmd2" package installs version 0.9+ on Python 2.7,
which only support Python 3.4+. This causes a dependency error in
the gate due to issue outlined in [0].  We will pre-install a
capped version of "cmd2" that would work with Python 2.7.

[0] https://github.com/python-cmd2/cmd2/issues/421

Depends-On: I34cbde65b74efc2805bd7785f84878783d2badbf

Change-Id: I35c5b1cf2253bd3ab953745a795be8ac42668053
Signed-off-by: Tin Lam <tin@irrational.io>
2018-05-30 02:28:06 -05:00
Pete Birley
8b0de753eb Gate: stop pulling default images
This PS stops pulling the charts default images, as the make file
target cannot target over-rides - resulting in longer gate runs with
twice as many images pulled than required in some cases.

Change-Id: I2a49ab0e8034b0aadc2c06cc347f7d76ef71784a
2018-05-08 16:28:55 +00:00
Pete Birley
47eaa69860 Gate: allow chart specific over-rides to be applied
This PS allows chart specific over-rides to be appled to each chart
using the gate scripts.

Change-Id: Ie259113a129cddd84743c891be76782227e3bd24
2018-03-08 01:02:42 +00:00
Pete Birley
340a9ec434 Networking: dynamic backend support
This PS allows the neutron and nova charts to dynamicly adapt to
various backends.

Depends-On: I0ec13f45fd4561fec59d08b08eb78390a3866156

Change-Id: I1891af4b0e49237e229ff5e61e907dc3e413cf87
2018-02-26 13:16:25 +00:00
portdirect
2cb634789d Images: Move default to LOCI and Kolla newton gate
This PS moves the default image in OSH for most services to use LOCI
and also provides a Kolla gate for newton openstack.

Change-Id: Ice6cb9f89bc3ce6e8280e580d215aedda9e71904
2018-02-16 17:06:15 -05:00
portdirect
b77d3f3538 Gate/Docs: Update developer deploy scripts
This PS udpates the developer deploy scripts to enable simple
upgrades/updates of services.

Change-Id: I0ef5a6dcc9094cb1aac565141b782f9e83ad9d71
2018-02-11 18:17:35 +00:00
portdirect
b97d6ffc61 Gate: Update multinode scripts
This PS updates the multinode deploy scripts to show output in the
gates, stop proxying the kubedns service, and use a pvc to back mariadb.

Change-Id: I78caf3f15e4c5ca33eaa1e592e8df958f13be90b
2018-02-09 10:30:50 -05:00