Commit Graph

1877 Commits

Author SHA1 Message Date
Ben Greear
6f8c39a2fa cicd: Ferndale testbed now uses cloud VM orchestrator.
And disable cloud-sdk until I can get that working again.
2020-08-13 13:27:49 -07:00
Ben Greear
554377ded8 nola2: Tune for smaller stations, ap-auto and dpt use proper STA and DUT.
I'm not sure fwcfg feature is in all builds yet, so run with fewer stations
for now.

Signed-off-by: Ben Greear <greearb@candelatech.com>
2020-08-13 06:34:25 -07:00
Ben Greear
a68127f365 tip/cicd: Add nola-basic-02 testbed info.
ECW5410 DUT.
2020-08-12 16:59:41 -07:00
Ben Greear
7aa14ba0ab Merge branch 'master' of github.com:Telecominfraproject/wlan-testing 2020-08-12 15:09:20 -07:00
Ben Greear
7f4ea9aca1 cicd: Add NOLA-basic-01 testbed.
ECW5211 DUT, testbed installed in TIP labs.

Still needs some work, and automation will not run smoothly
due to serial console issue where usb-ttl device craps
out each time we disconnect from the serial port.

Signed-off-by: Ben Greear <greearb@candelatech.com>
2020-08-12 15:07:44 -07:00
Ben Greear
2469dbcd24 cicd/jfrog: Make ul-host, kpi path configurable.
And add edgecore 5211 hw type.

Signed-off-by: Ben Greear <greearb@candelatech.com>
2020-08-12 21:47:44 +00:00
Ben Greear
608e24422e Add nola-basic-01 testbed cicd file.
Signed-off-by: Ben Greear <greearb@candelatech.com>
2020-08-12 09:25:34 -07:00
Ben Greear
68ee4c46b7 Fix serial port layout on ferndale testbed.
This is now pinned in udev, so hopefully it will not change again.

Signed-off-by: Ben Greear <greearb@candelatech.com>
2020-07-23 06:28:36 -07:00
Ben Greear
d5e30f418b Merge branch 'master' of github.com:Telecominfraproject/wlan-testing 2020-07-06 13:37:56 -07:00
Ben Greear
07df953393 update development testbed serial ports.
Jump host threw a disk, new one has different USB port layout,
so update accordingly.
2020-07-06 13:36:44 -07:00
Chris Busch
b35a919a1c Create LICENSE
Add TIP standard license
2020-07-06 10:38:51 -04:00
Ben Greear
5cd465ce3e cicd: Fix bad regex in testbed_poll
If debugging is enabled, the 'echo' command would show the same
thing we were searching for, but with a single trailing quote.

Check for that and remove the trailing quote if needed.

Signed-off-by: Ben Greear <greearb@candelatech.com>
2020-07-03 16:14:21 -07:00
Ben Greear
75784052cd cicd: Detect stuck DUT and/or other broken state
And then exit.  If sysupgrade fails or similar, then we
need a human to fix things.
2020-07-02 10:24:00 -07:00
Ben Greear
094da0d42b cicd: fix cloud-sdk remaining issues.
Had a few more things to fix before CICD worked with cloud sdk.  Also
sinced the non-cloud wireless config to match what the cloud does so that
it is easier to flip back and forth.

Default ferndale-01 test bed to use wpa2-psk
2020-06-26 15:21:43 -07:00
Ben Greear
f53fdddd56 cicd: Fix jfrog regex regression
And add some newlines.
2020-06-26 14:23:49 -07:00
Ben Greear
f34ec9169f cicd: Allow test beds to be configured to use cloud-sdk.
Idea is to automatically update /etc/hosts with the cloud
controler's IP address.  In future, might also get the
AP's serial number and poke that into the cloud-ctlr somehow.
2020-06-26 11:57:56 -07:00
Ben Greear
77957ee705 Merge branch 'master' of github.com:Telecominfraproject/wlan-testing 2020-06-22 12:15:44 -07:00
Ben Greear
ece50df916 jfrog: Support downloading images from other URLs.
This lets us do private builds, upload to some web server (candelatech.com currently)
and then run the automated LANforge CICD tests against that.
2020-06-22 12:14:46 -07:00
Ben Greear
510cbe4f79 cicd: Update with proper testrails ID. 2020-06-15 13:11:04 -07:00
Ben Greear
d7bcfc3868 jfrog: Add debugging msg. 2020-06-15 11:17:59 -07:00
Ben Greear
062994277a cicd: Store case-id in the testbed info.
I'll need to put this all together and test end to end,
pretty unlikely I got it all right the first time.
2020-06-13 06:43:02 -07:00
Ben Greear
6fd2422e33 jfrog: Attempt to deal with testrails data file. 2020-06-12 15:48:55 -07:00
Ben Greear
a234a3dc17 cicd: Add 32-sta scenario file, and example of how to use it.
For faster test run with only 32 stations.
2020-06-12 13:13:19 -07:00
Ben Greear
bf4217f206 cicd: Print out summary of steps.
Helps users watching the output to understand what his happening.
2020-06-12 12:46:14 -07:00
Ben Greear
f911612ce0 cicd: Use 'tip-read' for user/passwd by default. 2020-06-12 10:23:45 -07:00
Ben Greear
5ec6c8352a Merge branch 'master' of github.com:Telecominfraproject/wlan-testing 2020-06-03 13:27:59 -07:00
Ben Greear
ae5ebf7590 cicd/ecw5410: Improve work-arounds for DUT weirdness
The ecw5410 is a bit flakey at times, so add some additional work-arounds
to help recover from network-down during startup and such.

Tune the test config to match DUT and LANforge testbed for ECW5410
2020-06-03 13:26:23 -07:00
Ben Greear
8e158054bb cicd: Fix jfrog URL work-item to include sub-dir. 2020-06-03 07:22:07 -07:00
Ben Greear
4a5121397f cicd: Jfrog script now deals with platform sub-directories.
Jfrog binaries are now placed in sub-directories for each platform,
so update script to look in sub-directories for new builds.
2020-06-03 06:34:22 -07:00
Ben Greear
95b75390f7 ecw5410: This thing blows up on ch 149, change to ch36 where it seems stable. 2020-06-02 12:13:03 -07:00
Ben Greear
1ace9f49ea Add ecw5410 cicd testing files.
Probably needs some tweaking still.
2020-06-02 10:41:50 -07:00
Ben Greear
8cfc40d801 ecw5410: Add fwcfg and -tH firmware optimized for TIP-APs.
Supports 180 stations per radio, 8 vdevs, etc.
2020-06-02 10:29:58 -07:00
Ben Greear
52ecc737ec Update overlay to latest ath10k-ct 4019 and 9888 firmware.
This should fix one crash seen during regression tests.
2020-05-28 06:58:58 -07:00
Ben Greear
463541cfee jfrog: Fix typo. 2020-05-22 21:01:09 -07:00
Ben Greear
3f02ddf6c6 Merge branch 'master' of github.com:Telecominfraproject/wlan-testing 2020-05-22 15:38:29 -07:00
Ben Greear
d37885d614 cicd: Clear dhcp server cache at start of each test run. 2020-05-22 15:38:02 -07:00
Ben Greear
6ed760d244 test-orchestrator: Do partial uploads of just the new files instead of full upload.
Full upload each time does not scale well, so improve logic to just upload
the new reports that were found, and newly generated kpi graphs and data.
2020-05-22 15:36:57 -07:00
Ben Greear
41f2e16ff6 testbed-ctlr: Fix typo 2020-05-22 13:45:52 -07:00
Ben Greear
3ec6ecb309 Add pass/fail for ferndale testbed. 2020-05-22 11:42:26 -07:00
Ben Greear
2949cf7930 Add pass/fail metrics for some throughput and connection-time tests.
This will make pass/fail reporting more useful.
2020-05-22 11:25:50 -07:00
Ben Greear
ce01bb7e4d cicd: Gather wlan-ap gitlog if dir exists.
Helpful for knowing what is in the build.
2020-05-18 12:43:18 -07:00
Ben Greear
f8722b9396 cicd: Prefer 'fast' work items
Process the other ones later.  And pull latest 'wlan-ap'
dir if it exists, so we can get up-to-date git log.
2020-05-18 12:42:21 -07:00
Ben Greear
64825570e9 cicd: Disable openvsync for now.
Otherwise, the /etc/config/wireless will be overwritten and then
the tests cannot run.

Can re-enable it later when we have connectivity to the cloud.
2020-05-18 09:47:09 -07:00
Ben Greear
925c826c26 cicd: Use ssh compression when uploading report from test bed.
Less woe to those with weak internet!
2020-05-15 12:54:45 -07:00
Ben Greear
ba884ce817 Add latest 4019 ath10k-ct firmware to overlay. 2020-05-15 08:02:51 -07:00
Ben Greear
2219f2c527 cicd: Fix http upload path. 2020-05-15 08:02:29 -07:00
Ben Greear
21c5cd1e8b cicd: test orchestrator will request same test on all compatible test beds.
Gain additional test coverage by requesting all test beds that can
support a particular build image run the regression tests.

This also helps verify that the existing automation handles more than
one testbed at a time.
2020-05-14 17:03:50 -07:00
Ben Greear
0ef4fa12d3 cicd: Fix typo in testbed poll 2020-05-14 11:47:50 -07:00
Ben Greear
bc73881265 Update ben-home cicd testbed. 2020-05-14 10:58:46 -07:00
Ben Greear
2ed799f52b testbed: Fix overlay for ben-home test bed. 2020-05-14 10:53:42 -07:00