Commit Graph

24 Commits

Author SHA1 Message Date
Ben Greear
f5b4498da2 gui/cicd: Disable the multi-sta hunt test
It defaults to enabled, and was not intended to run here, so disable
it in the automation script.

Signed-off-by: Ben Greear <greearb@candelatech.com>
2020-10-24 08:40:45 -07:00
Ben Greear
68c3c4bbc2 cicd: Fix bugcheck log gathering
Several syntax errors and typos.

Signed-off-by: Ben Greear <greearb@candelatech.com>
2020-08-31 17:29:55 -07:00
Ben Greear
4306f85ff5 cicd: Support capturing bugcheck output on openwrt systems.
Signed-off-by: Ben Greear <greearb@candelatech.com>
2020-08-31 16:02:00 -07:00
Ben Greear
d09e2a7eef cicd: Fix passing prompt into the openwrt_ctl script.
So we can deal with DUT with prompts other than root@OpenWrt

Signed-off-by: Ben Greear <greearb@candelatech.com>
2020-08-19 06:17:47 -07:00
Ben Greear
802d48a98d gui-ap-auto: Disable band-steering test
This was added after the initial work to define the test configs,
so we need to explicitly disable it (or go edit all the test config
files).
2020-07-03 16:21:01 -07:00
Ben Greear
a327818014 cicd: Consider oom-killer a crash when processing logs. 2020-06-04 06:12:33 -07:00
Ben Greear
9bf6cacc29 cicd: Make log files unique per testbed.
So we can manage multiple test beds from one controller.
2020-06-03 10:44:59 -07:00
Ben Greear
3a807f19c1 cicd: Detect ath10k radio hard hang, attempt DUT reboot in that case.
And count this as if firmware crashed as far as log parsing is concerned.
2020-05-28 06:32:46 -07:00
Ben Greear
68d058b5cc gui-auto: Clear port counters at start of test. 2020-05-22 15:38:54 -07:00
Ben Greear
f1f3c5c351 cicd: Handle dut-gitlog
Add the DUT's gitlog to the report if it exists.
2020-05-18 12:44:06 -07:00
Ben Greear
14197d4d5b kpi: Add log errors to summary.
Count the crashes, WARNINGS, BUGS and other logging errors and propagate
counts to the summary pages.
2020-05-14 07:35:57 -07:00
Ben Greear
f475a31d07 cicd: Remove all endpoints and connections before starting new test.
Fix typo in log cleanup logic.
2020-05-10 11:23:03 -07:00
Ben Greear
9073065746 regression: Add note. 2020-05-09 08:33:27 -07:00
Ben Greear
11e8362be9 kpi: Support adding git-log info to the Run report. 2020-04-30 20:48:48 -07:00
Ben Greear
c1512b48a4 gui: Support setting verbosity slider. 2020-04-30 13:36:02 -07:00
Ben Greear
260b86ba8d auto-testing: Add KPI id support, round score to 2 decimal places. 2020-04-27 12:55:07 -07:00
Ben Greear
f7f47848e6 Add basic HTML page generation for automated test bed run. 2020-04-24 16:32:17 -07:00
Ben Greear
4241f810b2 gui-automation: Add serial-console and other logging.
The openwrt_ctl.py program can do some basic commands and console
logging on OpenWrt and LANforge Linux systems.

Add some more log gathering logic to the basic_regression.bash script.
2020-04-23 16:52:21 -07:00
Ben Greear
1decfbaa9d Update GUI readme. 2020-04-22 16:41:50 -07:00
Ben Greear
b8793edd31 gui-automation: Allow updating DUT with new info
Will help us track DUT software builds and such.
2020-04-17 13:18:52 -07:00
Ben Greear
6f9178a638 Add Dataplane pkt-size test to the basic-regression test. 2020-04-16 17:05:16 -07:00
Ben Greear
0497c25adf scripts: More gui automation fixes and improvements. 2020-04-16 16:34:35 -07:00
Ben Greear
474500b8f7 basic-regression: Add some more reset related tests, allow running individual tests. 2020-04-16 07:46:25 -07:00
Ben Greear
38e0fe9bd7 Add gui automation script for multiple reports in one go. 2020-04-15 17:54:47 -07:00