scottk/wlan-testing
1
0
Fork 0
mirror of https://github.com/Telecominfraproject/wlan-testing.git synced 2025-10-29 18:12:34 +00:00
Code Issues Packages Projects Releases Wiki Activity
67 Commits 139 Branches 0 Tags
b35a919a1c38b5b7b54bb3a5bc327e399458dfae
Commit Graph

67 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Chris Busch
b35a919a1c Create LICENSE 
Add TIP standard license
 2020-07-06 10:38:51 -04:00
Ben Greear
5cd465ce3e cicd: Fix bad regex in testbed_poll 
If debugging is enabled, the 'echo' command would show the same
thing we were searching for, but with a single trailing quote.

Check for that and remove the trailing quote if needed.

Signed-off-by: Ben Greear <greearb@candelatech.com>
 2020-07-03 16:14:21 -07:00
Ben Greear
75784052cd cicd: Detect stuck DUT and/or other broken state 
And then exit.  If sysupgrade fails or similar, then we
need a human to fix things.
 2020-07-02 10:24:00 -07:00
Ben Greear
094da0d42b cicd: fix cloud-sdk remaining issues. 
Had a few more things to fix before CICD worked with cloud sdk.  Also
sinced the non-cloud wireless config to match what the cloud does so that
it is easier to flip back and forth.

Default ferndale-01 test bed to use wpa2-psk
 2020-06-26 15:21:43 -07:00
Ben Greear
f53fdddd56 cicd: Fix jfrog regex regression 
And add some newlines.
 2020-06-26 14:23:49 -07:00
Ben Greear
f34ec9169f cicd: Allow test beds to be configured to use cloud-sdk. 
Idea is to automatically update /etc/hosts with the cloud
controler's IP address.  In future, might also get the
AP's serial number and poke that into the cloud-ctlr somehow.
 2020-06-26 11:57:56 -07:00
Ben Greear
77957ee705 Merge branch 'master' of github.com:Telecominfraproject/wlan-testing 2020-06-22 12:15:44 -07:00
Ben Greear
ece50df916 jfrog: Support downloading images from other URLs. 
This lets us do private builds, upload to some web server (candelatech.com currently)
and then run the automated LANforge CICD tests against that.
 2020-06-22 12:14:46 -07:00
Ben Greear
510cbe4f79 cicd: Update with proper testrails ID. 2020-06-15 13:11:04 -07:00
Ben Greear
d7bcfc3868 jfrog: Add debugging msg. 2020-06-15 11:17:59 -07:00
Ben Greear
062994277a cicd: Store case-id in the testbed info. 
I'll need to put this all together and test end to end,
pretty unlikely I got it all right the first time.
 2020-06-13 06:43:02 -07:00
Ben Greear
6fd2422e33 jfrog: Attempt to deal with testrails data file. 2020-06-12 15:48:55 -07:00
Ben Greear
a234a3dc17 cicd: Add 32-sta scenario file, and example of how to use it. 
For faster test run with only 32 stations.
 2020-06-12 13:13:19 -07:00
Ben Greear
bf4217f206 cicd: Print out summary of steps. 
Helps users watching the output to understand what his happening.
 2020-06-12 12:46:14 -07:00
Ben Greear
f911612ce0 cicd: Use 'tip-read' for user/passwd by default. 2020-06-12 10:23:45 -07:00
Ben Greear
5ec6c8352a Merge branch 'master' of github.com:Telecominfraproject/wlan-testing 2020-06-03 13:27:59 -07:00
Ben Greear
ae5ebf7590 cicd/ecw5410: Improve work-arounds for DUT weirdness 
The ecw5410 is a bit flakey at times, so add some additional work-arounds
to help recover from network-down during startup and such.

Tune the test config to match DUT and LANforge testbed for ECW5410
 2020-06-03 13:26:23 -07:00
Ben Greear
8e158054bb cicd: Fix jfrog URL work-item to include sub-dir. 2020-06-03 07:22:07 -07:00
Ben Greear
4a5121397f cicd: Jfrog script now deals with platform sub-directories. 
Jfrog binaries are now placed in sub-directories for each platform,
so update script to look in sub-directories for new builds.
 2020-06-03 06:34:22 -07:00
Ben Greear
95b75390f7 ecw5410: This thing blows up on ch 149, change to ch36 where it seems stable. 2020-06-02 12:13:03 -07:00
Ben Greear
1ace9f49ea Add ecw5410 cicd testing files. 
Probably needs some tweaking still.
 2020-06-02 10:41:50 -07:00
Ben Greear
8cfc40d801 ecw5410: Add fwcfg and -tH firmware optimized for TIP-APs. 
Supports 180 stations per radio, 8 vdevs, etc.
 2020-06-02 10:29:58 -07:00
Ben Greear
52ecc737ec Update overlay to latest ath10k-ct 4019 and 9888 firmware. 
This should fix one crash seen during regression tests.
 2020-05-28 06:58:58 -07:00
Ben Greear
463541cfee jfrog: Fix typo. 2020-05-22 21:01:09 -07:00
Ben Greear
3f02ddf6c6 Merge branch 'master' of github.com:Telecominfraproject/wlan-testing 2020-05-22 15:38:29 -07:00
Ben Greear
d37885d614 cicd: Clear dhcp server cache at start of each test run. 2020-05-22 15:38:02 -07:00
Ben Greear
6ed760d244 test-orchestrator: Do partial uploads of just the new files instead of full upload. 
Full upload each time does not scale well, so improve logic to just upload
the new reports that were found, and newly generated kpi graphs and data.
 2020-05-22 15:36:57 -07:00
Ben Greear
41f2e16ff6 testbed-ctlr: Fix typo 2020-05-22 13:45:52 -07:00
Ben Greear
3ec6ecb309 Add pass/fail for ferndale testbed. 2020-05-22 11:42:26 -07:00
Ben Greear
2949cf7930 Add pass/fail metrics for some throughput and connection-time tests. 
This will make pass/fail reporting more useful.
 2020-05-22 11:25:50 -07:00
Ben Greear
ce01bb7e4d cicd: Gather wlan-ap gitlog if dir exists. 
Helpful for knowing what is in the build.
 2020-05-18 12:43:18 -07:00
Ben Greear
f8722b9396 cicd: Prefer 'fast' work items 
Process the other ones later.  And pull latest 'wlan-ap'
dir if it exists, so we can get up-to-date git log.
 2020-05-18 12:42:21 -07:00
Ben Greear
64825570e9 cicd: Disable openvsync for now. 
Otherwise, the /etc/config/wireless will be overwritten and then
the tests cannot run.

Can re-enable it later when we have connectivity to the cloud.
 2020-05-18 09:47:09 -07:00
Ben Greear
925c826c26 cicd: Use ssh compression when uploading report from test bed. 
Less woe to those with weak internet!
 2020-05-15 12:54:45 -07:00
Ben Greear
ba884ce817 Add latest 4019 ath10k-ct firmware to overlay. 2020-05-15 08:02:51 -07:00
Ben Greear
2219f2c527 cicd: Fix http upload path. 2020-05-15 08:02:29 -07:00
Ben Greear
21c5cd1e8b cicd: test orchestrator will request same test on all compatible test beds. 
Gain additional test coverage by requesting all test beds that can
support a particular build image run the regression tests.

This also helps verify that the existing automation handles more than
one testbed at a time.
 2020-05-14 17:03:50 -07:00
Ben Greear
0ef4fa12d3 cicd: Fix typo in testbed poll 2020-05-14 11:47:50 -07:00
Ben Greear
bc73881265 Update ben-home cicd testbed. 2020-05-14 10:58:46 -07:00
Ben Greear
2ed799f52b testbed: Fix overlay for ben-home test bed. 2020-05-14 10:53:42 -07:00
Ben Greear
ac8aa20b8f Rename test-bed ID 2020-05-14 07:40:30 -07:00
Ben Greear
89ac8cfa19 testbed: Print out results of sysupgrade. 
This is first step of better error detection so that
we can know the DUT is in bad state and power-cycle or
request manual intervention.
 2020-05-13 12:17:26 -07:00
Ben Greear
992d2d3236 Update cicd notes. 2020-05-12 07:16:02 -07:00
Ben Greear
8ef6859a71 testbed: Clean up old reports 
Before moving new one into place to upload it to orchestrator.
Hopefully this fixes jumbled reports.
 2020-05-12 07:04:43 -07:00
Ben Greear
dfd3dacc7c jfrog: Ensure report directories are created. 2020-05-12 07:04:15 -07:00
Ben Greear
1b72489e6c cicd: Support basic and fast test types. 
End-to-end automated testing is mostly working, but still needs a bit of cleanup
and debugging.
 2020-05-09 08:33:55 -07:00
Ben Greear
0c3bd3cdf2 cicd: Fix openwrt overlay apply logic. 
Had some typos and bad path in the overlay tree.
Verified this works and now AP can handle large numbers of stations
per radio.
 2020-05-08 13:23:50 -07:00
Ben Greear
f3b9e32626 testbed_poll: Can now generate report. 
Fixed the sysupgrade logic and some other issues.  Script now does
sysupgrade on downloaded image from jfrog, applies overlay directory
for config and improved ath10k-ct firmware, runs automated test, and uploads
result back to the test orchestrator.
 2020-05-08 07:47:41 -07:00
Ben Greear
1320328ccf cicd: work towards auto-updating DUT. 
jfrog.pl can generate the work item.
testbed_poll.pl can find the work-item and attempt to update DUT and run test.
  Still need to tweak a few things and test this fully.
  Still need to be able to re-apply DUT overlay (for files sysupgrade blew away)
 2020-05-07 16:43:28 -07:00
Ben Greear
e64d10d990 cicd: Normalize test-bed names 
Use absolute path for testbed details path so we can run script
from html directory.
 2020-05-07 15:12:24 -07:00