Commit Graph

75 Commits

Author SHA1 Message Date
Ben Greear
8afaf822f4 cicd: Do nightly CICD runs even if no new builds were found.
Use the last-processed build for the nightly run.

Signed-off-by: Ben Greear <greearb@candelatech.com>
2021-01-11 15:33:31 -08:00
Ben Greear
4177daf291 cicd: Support option to upgrade with sysupgrade -n
Signed-off-by: Ben Greear <greearb@candelatech.com>
2020-12-08 13:26:38 -08:00
Ben Greear
33dba71e06 NOLA-15 ECW5410 testbed initial config. 2020-12-07 14:51:21 -08:00
Ben Greear
16322d1f5c CICD: Add NOLA-14 config files.
EAP102, with LANforge configured for <= 128 stations for more
modest load than NOLA-13.

Signed-off-by: Ben Greear <greearb@candelatech.com>
2020-12-07 13:48:16 -08:00
Ben Greear
c67cba5fe2 Merge branch 'master' of github.com:Telecominfraproject/wlan-testing 2020-12-04 23:48:35 +00:00
Ben Greear
7fe5179407 jfrog-poll: Add eap102 as supported platform.
Signed-off-by: Ben Greear <greearb@candelatech.com>
2020-12-04 23:48:15 +00:00
Ben Greear
30301480f9 CICD: Add NOLA-13 basic testbed.
EAP102 AP, LANforge with 4 ax radios and 4 /ac radios.

Signed-off-by: Ben Greear <greearb@candelatech.com>
2020-12-04 15:43:57 -08:00
Ben Greear
d499f82786 CICD: Fix NOLA-12, work with /ax DUTs.
Need to pass in user/password for DUT for these newer DUT
images that have root password set.

Don't assume sysupgrade file ends with '.bin', as ax ones are
tar.gz instead.
2020-12-04 13:33:03 -08:00
Ben Greear
6c0f238f11 CICD: Initial config files for Basic-12 testbed.
EAP 102 wifi-6 AP, LANforge has 2 /ac radios, 4 /ax radios.

Signed-off-by: Ben Greear <greearb@candelatech.com>
2020-12-04 11:02:07 -08:00
Ben Greear
fbfbe90a1c cicd: Nola-01, update testbed info file.
Set correct hardware...
2020-09-30 13:47:27 -07:00
Ben Greear
a9c5b2f76f cicd: Look for ec420 files as well.wq
Signed-off-by: Ben Greear <greearb@candelatech.com>
2020-09-30 20:33:49 +00:00
Ben Greear
7172463c2d cicd: Fix dpt on nola-01 testbed.
And mac on nola-3

Signed-off-by: Ben Greear <greearb@candelatech.com>
2020-09-02 05:07:45 -07:00
Ben Greear
5c3d4deeba cicd: Fix bugcheck logic.
Had some issues with the overlay, and need to pass the AP gateway IP address
to the basic_regression.bash script.

Signed-off-by: Ben Greear <greearb@candelatech.com>
2020-08-31 17:28:35 -07:00
Ben Greear
5700eb8c46 cicd: Enable bugcheck tool in openwrt.
This should allow us to capture binary firmware crash dumps
for better debugging options.

Signed-off-by: Ben Greear <greearb@candelatech.com>
2020-08-31 16:00:10 -07:00
Ben Greear
c1c276cd2b cicd: fix perl syntax typo
Signed-off-by: Ben Greear <greearb@candelatech.com>
2020-08-25 05:38:16 -07:00
Ben Greear
024b56e192 cicd: Attempt to work around AP stuck in bootloader.
Possibly the AP could get in this state from noise on the serial console
causing the bootloader to think 'any key' was hit.  Attempt to reset
and get back into openwrt if we detect bootloader when looking for
the default gateway.

Signed-off-by: Ben Greear <greearb@candelatech.com>
2020-08-25 05:31:12 -07:00
Ben Greear
9ae42eae01 cicd: Ensure logs are readable by all.
Signed-off-by: Ben Greear <greearb@candelatech.com>
2020-08-25 05:20:30 -07:00
Ben Greear
bd028478bb jfrog: Fix slack integration.
Signed-off-by: Ben Greear <greearb@candelatech.com>
2020-08-19 16:08:35 +00:00
Ben Greear
ac48a9313d cicd: Add testbed names to testbed info file.
To be used for reporting and especially sending to slack.

Signed-off-by: Ben Greear <greearb@candelatech.com>
2020-08-19 14:19:25 +00:00
Ben Greear
c0a775507b jfrog: Initial attempt at integrating with slack.
Needs testing on real system.

Signed-off-by: Ben Greear <greearb@candelatech.com>
2020-08-19 07:09:38 -07:00
Ben Greear
c293086716 jfrog: Whitespace fix.
No functional change.

Signed-off-by: Ben Greear <greearb@candelatech.com>
2020-08-19 06:28:06 -07:00
Ben Greear
dcac106096 cicd: Fix passing prompt to the scripts in lanforge-scripts directory.
They needed to know the new prompt too, otherwise we get no DUT logs, among
other things.

Signed-off-by: Ben Greear <greearb@candelatech.com>
2020-08-19 06:15:59 -07:00
Ben Greear
a908501f55 jfrog: Poll trunk and dev sub-directories.
Skip dev/staging builds, but do test dev/pending builds.
Needs some whitespace cleanup which I'll do in a bit on
a real editor.

Signed-off-by: Ben Greear <greearb@candelatech.com>
2020-08-18 21:48:15 +00:00
Ben Greear
4778f1414a cicd: Support more stations, deal with new prompt.
And some more scenario config, especially ap-auto.

Signed-off-by: Ben Greear <greearb@candelatech.com>
2020-08-18 14:41:20 -07:00
Ben Greear
57442e10e8 cicd/jfrog: Allow duplicate test runs on same image.
Append a run-count ID to the test results name so that we can run multiple
tests on the same image and have each run show up in the report history.

Signed-off-by: Ben Greear <greearb@candelatech.com>
2020-08-14 13:43:50 +00:00
Ben Greear
cd4d29e98a jfrog: fix typo
Signed-off-by: Ben Greear <greearb@candelatech.com>
2020-08-13 23:22:31 +00:00
Ben Greear
1e19c00d8d cicd/jfrog: Add option to specify duplicate-work setting.
So we can have jfrog orchestrator send to one or all testbeds
that match the hardware type.

Signed-off-by: Ben Greear <greearb@candelatech.com>
2020-08-13 16:19:52 -07:00
Ben Greear
c5ea4402e9 cicd: Add NOLA-04 testbed info.
ECW5410 platform, same as 02 testbed.
2020-08-13 16:10:14 -07:00
Ben Greear
6f8c39a2fa cicd: Ferndale testbed now uses cloud VM orchestrator.
And disable cloud-sdk until I can get that working again.
2020-08-13 13:27:49 -07:00
Ben Greear
a68127f365 tip/cicd: Add nola-basic-02 testbed info.
ECW5410 DUT.
2020-08-12 16:59:41 -07:00
Ben Greear
7aa14ba0ab Merge branch 'master' of github.com:Telecominfraproject/wlan-testing 2020-08-12 15:09:20 -07:00
Ben Greear
7f4ea9aca1 cicd: Add NOLA-basic-01 testbed.
ECW5211 DUT, testbed installed in TIP labs.

Still needs some work, and automation will not run smoothly
due to serial console issue where usb-ttl device craps
out each time we disconnect from the serial port.

Signed-off-by: Ben Greear <greearb@candelatech.com>
2020-08-12 15:07:44 -07:00
Ben Greear
2469dbcd24 cicd/jfrog: Make ul-host, kpi path configurable.
And add edgecore 5211 hw type.

Signed-off-by: Ben Greear <greearb@candelatech.com>
2020-08-12 21:47:44 +00:00
Ben Greear
608e24422e Add nola-basic-01 testbed cicd file.
Signed-off-by: Ben Greear <greearb@candelatech.com>
2020-08-12 09:25:34 -07:00
Ben Greear
5cd465ce3e cicd: Fix bad regex in testbed_poll
If debugging is enabled, the 'echo' command would show the same
thing we were searching for, but with a single trailing quote.

Check for that and remove the trailing quote if needed.

Signed-off-by: Ben Greear <greearb@candelatech.com>
2020-07-03 16:14:21 -07:00
Ben Greear
75784052cd cicd: Detect stuck DUT and/or other broken state
And then exit.  If sysupgrade fails or similar, then we
need a human to fix things.
2020-07-02 10:24:00 -07:00
Ben Greear
094da0d42b cicd: fix cloud-sdk remaining issues.
Had a few more things to fix before CICD worked with cloud sdk.  Also
sinced the non-cloud wireless config to match what the cloud does so that
it is easier to flip back and forth.

Default ferndale-01 test bed to use wpa2-psk
2020-06-26 15:21:43 -07:00
Ben Greear
f53fdddd56 cicd: Fix jfrog regex regression
And add some newlines.
2020-06-26 14:23:49 -07:00
Ben Greear
f34ec9169f cicd: Allow test beds to be configured to use cloud-sdk.
Idea is to automatically update /etc/hosts with the cloud
controler's IP address.  In future, might also get the
AP's serial number and poke that into the cloud-ctlr somehow.
2020-06-26 11:57:56 -07:00
Ben Greear
77957ee705 Merge branch 'master' of github.com:Telecominfraproject/wlan-testing 2020-06-22 12:15:44 -07:00
Ben Greear
ece50df916 jfrog: Support downloading images from other URLs.
This lets us do private builds, upload to some web server (candelatech.com currently)
and then run the automated LANforge CICD tests against that.
2020-06-22 12:14:46 -07:00
Ben Greear
510cbe4f79 cicd: Update with proper testrails ID. 2020-06-15 13:11:04 -07:00
Ben Greear
d7bcfc3868 jfrog: Add debugging msg. 2020-06-15 11:17:59 -07:00
Ben Greear
062994277a cicd: Store case-id in the testbed info.
I'll need to put this all together and test end to end,
pretty unlikely I got it all right the first time.
2020-06-13 06:43:02 -07:00
Ben Greear
6fd2422e33 jfrog: Attempt to deal with testrails data file. 2020-06-12 15:48:55 -07:00
Ben Greear
a234a3dc17 cicd: Add 32-sta scenario file, and example of how to use it.
For faster test run with only 32 stations.
2020-06-12 13:13:19 -07:00
Ben Greear
bf4217f206 cicd: Print out summary of steps.
Helps users watching the output to understand what his happening.
2020-06-12 12:46:14 -07:00
Ben Greear
f911612ce0 cicd: Use 'tip-read' for user/passwd by default. 2020-06-12 10:23:45 -07:00
Ben Greear
5ec6c8352a Merge branch 'master' of github.com:Telecominfraproject/wlan-testing 2020-06-03 13:27:59 -07:00
Ben Greear
ae5ebf7590 cicd/ecw5410: Improve work-arounds for DUT weirdness
The ecw5410 is a bit flakey at times, so add some additional work-arounds
to help recover from network-down during startup and such.

Tune the test config to match DUT and LANforge testbed for ECW5410
2020-06-03 13:26:23 -07:00