scottk/wlan-testing
1
0
Fork 0
mirror of https://github.com/Telecominfraproject/wlan-testing.git synced 2025-11-01 19:37:54 +00:00
Code Issues Packages Projects Releases Wiki Activity
59 Commits 140 Branches 0 Tags
ece50df9166c218645ac28dd2fa593091eb8b7ea
Commit Graph

59 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Ben Greear
ece50df916 jfrog: Support downloading images from other URLs. 
This lets us do private builds, upload to some web server (candelatech.com currently)
and then run the automated LANforge CICD tests against that.
 2020-06-22 12:14:46 -07:00
Ben Greear
d7bcfc3868 jfrog: Add debugging msg. 2020-06-15 11:17:59 -07:00
Ben Greear
062994277a cicd: Store case-id in the testbed info. 
I'll need to put this all together and test end to end,
pretty unlikely I got it all right the first time.
 2020-06-13 06:43:02 -07:00
Ben Greear
6fd2422e33 jfrog: Attempt to deal with testrails data file. 2020-06-12 15:48:55 -07:00
Ben Greear
a234a3dc17 cicd: Add 32-sta scenario file, and example of how to use it. 
For faster test run with only 32 stations.
 2020-06-12 13:13:19 -07:00
Ben Greear
bf4217f206 cicd: Print out summary of steps. 
Helps users watching the output to understand what his happening.
 2020-06-12 12:46:14 -07:00
Ben Greear
f911612ce0 cicd: Use 'tip-read' for user/passwd by default. 2020-06-12 10:23:45 -07:00
Ben Greear
5ec6c8352a Merge branch 'master' of github.com:Telecominfraproject/wlan-testing 2020-06-03 13:27:59 -07:00
Ben Greear
ae5ebf7590 cicd/ecw5410: Improve work-arounds for DUT weirdness 
The ecw5410 is a bit flakey at times, so add some additional work-arounds
to help recover from network-down during startup and such.

Tune the test config to match DUT and LANforge testbed for ECW5410
 2020-06-03 13:26:23 -07:00
Ben Greear
8e158054bb cicd: Fix jfrog URL work-item to include sub-dir. 2020-06-03 07:22:07 -07:00
Ben Greear
4a5121397f cicd: Jfrog script now deals with platform sub-directories. 
Jfrog binaries are now placed in sub-directories for each platform,
so update script to look in sub-directories for new builds.
 2020-06-03 06:34:22 -07:00
Ben Greear
95b75390f7 ecw5410: This thing blows up on ch 149, change to ch36 where it seems stable. 2020-06-02 12:13:03 -07:00
Ben Greear
1ace9f49ea Add ecw5410 cicd testing files. 
Probably needs some tweaking still.
 2020-06-02 10:41:50 -07:00
Ben Greear
8cfc40d801 ecw5410: Add fwcfg and -tH firmware optimized for TIP-APs. 
Supports 180 stations per radio, 8 vdevs, etc.
 2020-06-02 10:29:58 -07:00
Ben Greear
52ecc737ec Update overlay to latest ath10k-ct 4019 and 9888 firmware. 
This should fix one crash seen during regression tests.
 2020-05-28 06:58:58 -07:00
Ben Greear
463541cfee jfrog: Fix typo. 2020-05-22 21:01:09 -07:00
Ben Greear
3f02ddf6c6 Merge branch 'master' of github.com:Telecominfraproject/wlan-testing 2020-05-22 15:38:29 -07:00
Ben Greear
d37885d614 cicd: Clear dhcp server cache at start of each test run. 2020-05-22 15:38:02 -07:00
Ben Greear
6ed760d244 test-orchestrator: Do partial uploads of just the new files instead of full upload. 
Full upload each time does not scale well, so improve logic to just upload
the new reports that were found, and newly generated kpi graphs and data.
 2020-05-22 15:36:57 -07:00
Ben Greear
41f2e16ff6 testbed-ctlr: Fix typo 2020-05-22 13:45:52 -07:00
Ben Greear
3ec6ecb309 Add pass/fail for ferndale testbed. 2020-05-22 11:42:26 -07:00
Ben Greear
2949cf7930 Add pass/fail metrics for some throughput and connection-time tests. 
This will make pass/fail reporting more useful.
 2020-05-22 11:25:50 -07:00
Ben Greear
ce01bb7e4d cicd: Gather wlan-ap gitlog if dir exists. 
Helpful for knowing what is in the build.
 2020-05-18 12:43:18 -07:00
Ben Greear
f8722b9396 cicd: Prefer 'fast' work items 
Process the other ones later.  And pull latest 'wlan-ap'
dir if it exists, so we can get up-to-date git log.
 2020-05-18 12:42:21 -07:00
Ben Greear
64825570e9 cicd: Disable openvsync for now. 
Otherwise, the /etc/config/wireless will be overwritten and then
the tests cannot run.

Can re-enable it later when we have connectivity to the cloud.
 2020-05-18 09:47:09 -07:00
Ben Greear
925c826c26 cicd: Use ssh compression when uploading report from test bed. 
Less woe to those with weak internet!
 2020-05-15 12:54:45 -07:00
Ben Greear
ba884ce817 Add latest 4019 ath10k-ct firmware to overlay. 2020-05-15 08:02:51 -07:00
Ben Greear
2219f2c527 cicd: Fix http upload path. 2020-05-15 08:02:29 -07:00
Ben Greear
21c5cd1e8b cicd: test orchestrator will request same test on all compatible test beds. 
Gain additional test coverage by requesting all test beds that can
support a particular build image run the regression tests.

This also helps verify that the existing automation handles more than
one testbed at a time.
 2020-05-14 17:03:50 -07:00
Ben Greear
0ef4fa12d3 cicd: Fix typo in testbed poll 2020-05-14 11:47:50 -07:00
Ben Greear
bc73881265 Update ben-home cicd testbed. 2020-05-14 10:58:46 -07:00
Ben Greear
2ed799f52b testbed: Fix overlay for ben-home test bed. 2020-05-14 10:53:42 -07:00
Ben Greear
ac8aa20b8f Rename test-bed ID 2020-05-14 07:40:30 -07:00
Ben Greear
89ac8cfa19 testbed: Print out results of sysupgrade. 
This is first step of better error detection so that
we can know the DUT is in bad state and power-cycle or
request manual intervention.
 2020-05-13 12:17:26 -07:00
Ben Greear
992d2d3236 Update cicd notes. 2020-05-12 07:16:02 -07:00
Ben Greear
8ef6859a71 testbed: Clean up old reports 
Before moving new one into place to upload it to orchestrator.
Hopefully this fixes jumbled reports.
 2020-05-12 07:04:43 -07:00
Ben Greear
dfd3dacc7c jfrog: Ensure report directories are created. 2020-05-12 07:04:15 -07:00
Ben Greear
1b72489e6c cicd: Support basic and fast test types. 
End-to-end automated testing is mostly working, but still needs a bit of cleanup
and debugging.
 2020-05-09 08:33:55 -07:00
Ben Greear
0c3bd3cdf2 cicd: Fix openwrt overlay apply logic. 
Had some typos and bad path in the overlay tree.
Verified this works and now AP can handle large numbers of stations
per radio.
 2020-05-08 13:23:50 -07:00
Ben Greear
f3b9e32626 testbed_poll: Can now generate report. 
Fixed the sysupgrade logic and some other issues.  Script now does
sysupgrade on downloaded image from jfrog, applies overlay directory
for config and improved ath10k-ct firmware, runs automated test, and uploads
result back to the test orchestrator.
 2020-05-08 07:47:41 -07:00
Ben Greear
1320328ccf cicd: work towards auto-updating DUT. 
jfrog.pl can generate the work item.
testbed_poll.pl can find the work-item and attempt to update DUT and run test.
  Still need to tweak a few things and test this fully.
  Still need to be able to re-apply DUT overlay (for files sysupgrade blew away)
 2020-05-07 16:43:28 -07:00
Ben Greear
e64d10d990 cicd: Normalize test-bed names 
Use absolute path for testbed details path so we can run script
from html directory.
 2020-05-07 15:12:24 -07:00
Ben Greear
2695adee88 cicd: Add testbed poll logic. 
This will run on the test-manager and poll the test orchestrator's
web page at well known locations to look for new builds that need
testing.
 2020-05-06 14:16:34 -07:00
Ben Greear
bfc93ec88b Add start of jfrog CICD polling tool and notes. 2020-05-06 11:04:54 -07:00
Ben Greear
f8c06d0c0f Fix dataplane scenario for ferndale-basic-01 test bed. 2020-05-05 15:01:22 -07:00
Ben Greear
b59f174e73 Add testbed ferdale-01 test configuration files. 
Currently this is hosting an EA8300.
 2020-05-05 13:28:40 -07:00
Ben Greear
2c33d6ea2a Add git-log info to run-basic test script. 2020-04-30 20:51:30 -07:00
Ben Greear
b1a1dda9d3 Make the run-basic-fast support git-log info in reports. 2020-04-30 20:48:06 -07:00
Ben Greear
7b7602d661 automation: Add faster regression test. 
More convenient for quick spot-checks.  Runs capacity test and
connection-time test.
 2020-04-30 13:37:20 -07:00
Ben Greear
48f915a97f ben-testbed: Make WCT run better. 2020-04-24 16:33:20 -07:00