Commit Graph

3550 Commits

Author SHA1 Message Date
Ben Greear
8e158054bb cicd: Fix jfrog URL work-item to include sub-dir. 2020-06-03 07:22:07 -07:00
Ben Greear
4a5121397f cicd: Jfrog script now deals with platform sub-directories.
Jfrog binaries are now placed in sub-directories for each platform,
so update script to look in sub-directories for new builds.
2020-06-03 06:34:22 -07:00
Ben Greear
95b75390f7 ecw5410: This thing blows up on ch 149, change to ch36 where it seems stable. 2020-06-02 12:13:03 -07:00
Ben Greear
1ace9f49ea Add ecw5410 cicd testing files.
Probably needs some tweaking still.
2020-06-02 10:41:50 -07:00
Ben Greear
8cfc40d801 ecw5410: Add fwcfg and -tH firmware optimized for TIP-APs.
Supports 180 stations per radio, 8 vdevs, etc.
2020-06-02 10:29:58 -07:00
Ben Greear
52ecc737ec Update overlay to latest ath10k-ct 4019 and 9888 firmware.
This should fix one crash seen during regression tests.
2020-05-28 06:58:58 -07:00
Ben Greear
463541cfee jfrog: Fix typo. 2020-05-22 21:01:09 -07:00
Ben Greear
3f02ddf6c6 Merge branch 'master' of github.com:Telecominfraproject/wlan-testing 2020-05-22 15:38:29 -07:00
Ben Greear
d37885d614 cicd: Clear dhcp server cache at start of each test run. 2020-05-22 15:38:02 -07:00
Ben Greear
6ed760d244 test-orchestrator: Do partial uploads of just the new files instead of full upload.
Full upload each time does not scale well, so improve logic to just upload
the new reports that were found, and newly generated kpi graphs and data.
2020-05-22 15:36:57 -07:00
Ben Greear
41f2e16ff6 testbed-ctlr: Fix typo 2020-05-22 13:45:52 -07:00
Ben Greear
3ec6ecb309 Add pass/fail for ferndale testbed. 2020-05-22 11:42:26 -07:00
Ben Greear
2949cf7930 Add pass/fail metrics for some throughput and connection-time tests.
This will make pass/fail reporting more useful.
2020-05-22 11:25:50 -07:00
Ben Greear
ce01bb7e4d cicd: Gather wlan-ap gitlog if dir exists.
Helpful for knowing what is in the build.
2020-05-18 12:43:18 -07:00
Ben Greear
f8722b9396 cicd: Prefer 'fast' work items
Process the other ones later.  And pull latest 'wlan-ap'
dir if it exists, so we can get up-to-date git log.
2020-05-18 12:42:21 -07:00
Ben Greear
64825570e9 cicd: Disable openvsync for now.
Otherwise, the /etc/config/wireless will be overwritten and then
the tests cannot run.

Can re-enable it later when we have connectivity to the cloud.
2020-05-18 09:47:09 -07:00
Ben Greear
925c826c26 cicd: Use ssh compression when uploading report from test bed.
Less woe to those with weak internet!
2020-05-15 12:54:45 -07:00
Ben Greear
ba884ce817 Add latest 4019 ath10k-ct firmware to overlay. 2020-05-15 08:02:51 -07:00
Ben Greear
2219f2c527 cicd: Fix http upload path. 2020-05-15 08:02:29 -07:00
Ben Greear
21c5cd1e8b cicd: test orchestrator will request same test on all compatible test beds.
Gain additional test coverage by requesting all test beds that can
support a particular build image run the regression tests.

This also helps verify that the existing automation handles more than
one testbed at a time.
2020-05-14 17:03:50 -07:00
Ben Greear
0ef4fa12d3 cicd: Fix typo in testbed poll 2020-05-14 11:47:50 -07:00
Ben Greear
bc73881265 Update ben-home cicd testbed. 2020-05-14 10:58:46 -07:00
Ben Greear
2ed799f52b testbed: Fix overlay for ben-home test bed. 2020-05-14 10:53:42 -07:00
Ben Greear
ac8aa20b8f Rename test-bed ID 2020-05-14 07:40:30 -07:00
Ben Greear
89ac8cfa19 testbed: Print out results of sysupgrade.
This is first step of better error detection so that
we can know the DUT is in bad state and power-cycle or
request manual intervention.
2020-05-13 12:17:26 -07:00
Ben Greear
992d2d3236 Update cicd notes. 2020-05-12 07:16:02 -07:00
Ben Greear
8ef6859a71 testbed: Clean up old reports
Before moving new one into place to upload it to orchestrator.
Hopefully this fixes jumbled reports.
2020-05-12 07:04:43 -07:00
Ben Greear
dfd3dacc7c jfrog: Ensure report directories are created. 2020-05-12 07:04:15 -07:00
Ben Greear
1b72489e6c cicd: Support basic and fast test types.
End-to-end automated testing is mostly working, but still needs a bit of cleanup
and debugging.
2020-05-09 08:33:55 -07:00
Ben Greear
0c3bd3cdf2 cicd: Fix openwrt overlay apply logic.
Had some typos and bad path in the overlay tree.
Verified this works and now AP can handle large numbers of stations
per radio.
2020-05-08 13:23:50 -07:00
Ben Greear
f3b9e32626 testbed_poll: Can now generate report.
Fixed the sysupgrade logic and some other issues.  Script now does
sysupgrade on downloaded image from jfrog, applies overlay directory
for config and improved ath10k-ct firmware, runs automated test, and uploads
result back to the test orchestrator.
2020-05-08 07:47:41 -07:00
Ben Greear
1320328ccf cicd: work towards auto-updating DUT.
jfrog.pl can generate the work item.
testbed_poll.pl can find the work-item and attempt to update DUT and run test.
  Still need to tweak a few things and test this fully.
  Still need to be able to re-apply DUT overlay (for files sysupgrade blew away)
2020-05-07 16:43:28 -07:00
Ben Greear
e64d10d990 cicd: Normalize test-bed names
Use absolute path for testbed details path so we can run script
from html directory.
2020-05-07 15:12:24 -07:00
Ben Greear
2695adee88 cicd: Add testbed poll logic.
This will run on the test-manager and poll the test orchestrator's
web page at well known locations to look for new builds that need
testing.
2020-05-06 14:16:34 -07:00
Ben Greear
bfc93ec88b Add start of jfrog CICD polling tool and notes. 2020-05-06 11:04:54 -07:00
Ben Greear
f8c06d0c0f Fix dataplane scenario for ferndale-basic-01 test bed. 2020-05-05 15:01:22 -07:00
Ben Greear
b59f174e73 Add testbed ferdale-01 test configuration files.
Currently this is hosting an EA8300.
2020-05-05 13:28:40 -07:00
Ben Greear
2c33d6ea2a Add git-log info to run-basic test script. 2020-04-30 20:51:30 -07:00
Ben Greear
b1a1dda9d3 Make the run-basic-fast support git-log info in reports. 2020-04-30 20:48:06 -07:00
Ben Greear
7b7602d661 automation: Add faster regression test.
More convenient for quick spot-checks.  Runs capacity test and
connection-time test.
2020-04-30 13:37:20 -07:00
Ben Greear
48f915a97f ben-testbed: Make WCT run better. 2020-04-24 16:33:20 -07:00
Ben Greear
26ae5e5f37 Add trimmed + htt-mgt firmware images to overlay directory.
And update fwcfg to support 200 stations on 9888, 162 on the other
two 4019 radios.
2020-04-24 09:46:28 -07:00
Ben Greear
41e52a595c Fix ben-home testbed configuration to work with current AP config. 2020-04-23 16:54:46 -07:00
Ben Greear
cbb53fb382 ben-testbed notes. 2020-04-23 11:15:14 -07:00
Ben Greear
db62158fcf Fix DUT flags and update notes. 2020-04-23 11:13:40 -07:00
Ben Greear
0991604b1c test-bed: Add openwrt overlay files for MR8300/EA8300
fwcfg and wireless config files.
2020-04-22 16:54:02 -07:00
Ben Greear
e597758b9b dpt: Fix upstream port in test cfg. 2020-04-22 16:45:37 -07:00
Ben Greear
0a3d5aa412 Add test-bed config
This test bed is similar to 'real' test beds, but uses a less
capable LANforge system with only 3 radios.  DUT is a Linksys
MR8300 (aka EA8300).
2020-04-22 16:39:26 -07:00
Ben Greear
7228c97c1a Add script to generate opensync cfg file from template and cfg options.
Quick way to build config files for opensync.
2020-04-20 16:51:11 -07:00
Ben Greear
4e25a0e140 Add initial notes and readme, script to copy wlan-lanforge-scripts 2020-04-20 05:35:45 -07:00