scottk/wlan-lanforge-scripts
1
0
Fork 0
mirror of https://github.com/Telecominfraproject/wlan-lanforge-scripts.git synced 2025-11-01 11:18:03 +00:00
Code Issues Packages Projects Releases Wiki Activity
3,768 Commits 8 Branches 0 Tags
f686f848fb728f6d72ac352b1be2ebc8ae2c79df
Commit Graph

52 Commits

Author SHA1 Message Date
Ben Greear
f5b4498da2 gui/cicd: Disable the multi-sta hunt test 
It defaults to enabled, and was not intended to run here, so disable
it in the automation script.

Signed-off-by: Ben Greear <greearb@candelatech.com>
 2020-10-24 08:40:45 -07:00
Ben Greear
68c3c4bbc2 cicd: Fix bugcheck log gathering 
Several syntax errors and typos.

Signed-off-by: Ben Greear <greearb@candelatech.com>
 2020-08-31 17:29:55 -07:00
Ben Greear
4306f85ff5 cicd: Support capturing bugcheck output on openwrt systems. 
Signed-off-by: Ben Greear <greearb@candelatech.com>
 2020-08-31 16:02:00 -07:00
Ben Greear
99d5d77891 kpi: Fix slack integration. 
Seems to be working now.

Signed-off-by: Ben Greear <greearb@candelatech.com>
 2020-08-19 09:08:06 -07:00
Ben Greear
22bb9fc080 kpi: Add initial attempt at integrating with slack. 
Code needs testing on real system and then needs the system
call added to actually send info into slack.

Signed-off-by: Ben Greear <greearb@candelatech.com>
 2020-08-19 07:07:59 -07:00
Ben Greear
d09e2a7eef cicd: Fix passing prompt into the openwrt_ctl script. 
So we can deal with DUT with prompts other than root@OpenWrt

Signed-off-by: Ben Greear <greearb@candelatech.com>
 2020-08-19 06:17:47 -07:00
Ben Greear
4e39aa6060 cicd/kpi: Fix pass/fail csv index. 
Ye olde off-by-one

Signed-off-by: Ben Greear <greearb@candelatech.com>
 2020-08-14 13:32:11 +00:00
Ben Greear
25721d73d9 Rename file that broke git checkouts on windows. 2020-07-09 20:50:51 -07:00
Ben Greear
c676d5f959 Add example CICD test-controller and test-orchestrator scripts. 2020-07-09 13:55:56 -07:00
Ben Greear
802d48a98d gui-ap-auto: Disable band-steering test 
This was added after the initial work to define the test configs,
so we need to explicitly disable it (or go edit all the test config
files).
 2020-07-03 16:21:01 -07:00
Ben Greear
85d4acd639 kpi: Fix missing newline. 2020-06-15 11:17:14 -07:00
Ben Greear
f076c82062 kpi: Add initial code to create testrails data file 
Will allow importing results into testrails.
 2020-06-12 15:47:51 -07:00
Ben Greear
a327818014 cicd: Consider oom-killer a crash when processing logs. 2020-06-04 06:12:33 -07:00
Ben Greear
9bf6cacc29 cicd: Make log files unique per testbed. 
So we can manage multiple test beds from one controller.
 2020-06-03 10:44:59 -07:00
Ben Greear
3a807f19c1 cicd: Detect ath10k radio hard hang, attempt DUT reboot in that case. 
And count this as if firmware crashed as far as log parsing is concerned.
 2020-05-28 06:32:46 -07:00
Ben Greear
f5ed685dad kpi: Add comments/documentation for kpi.java classes. 
To help me and others remember how this all fits together.
 2020-05-27 06:56:38 -07:00
Ben Greear
9008d20408 kpi: Add historical graphs for pass/fail totals. 
Provides a nice way to check on overall results and test coverage.
 2020-05-27 06:41:43 -07:00
Ben Greear
68d058b5cc gui-auto: Clear port counters at start of test. 2020-05-22 15:38:54 -07:00
Ben Greear
5e8c9dd3b2 kpi: Support subtests passed/failed. 2020-05-22 12:52:59 -07:00
Ben Greear
f1f3c5c351 cicd: Handle dut-gitlog 
Add the DUT's gitlog to the report if it exists.
 2020-05-18 12:44:06 -07:00
Ben Greear
14197d4d5b kpi: Add log errors to summary. 
Count the crashes, WARNINGS, BUGS and other logging errors and propagate
counts to the summary pages.
 2020-05-14 07:35:57 -07:00
Ben Greear
78c8185239 cicd: Add links to log files with errors in them. 
Makes it easier to find firmware crashes and other bugs.
 2020-05-14 06:52:42 -07:00
Ben Greear
a2e179c936 cicd: Process console logs, adding links to problem areas. 2020-05-13 16:58:12 -07:00
Ben Greear
af45be8916 kpi: Add notes on processing logs. 
Want a way to quickly notice kernel splats and firmware crashes.
 2020-05-13 12:16:17 -07:00
Ben Greear
bb105c2f16 kpi: Fix 'rename' logic for generate png files. 
The File.rename logic did not work well, but Files.move()
appears to work better.  Maybe due to different mount points or
something.

Also add lots of debugging to kpi.java, will remove it later.
 2020-05-11 11:08:25 -07:00
Ben Greear
f475a31d07 cicd: Remove all endpoints and connections before starting new test. 
Fix typo in log cleanup logic.
 2020-05-10 11:23:03 -07:00
Ben Greear
9073065746 regression: Add note. 2020-05-09 08:33:27 -07:00
Ben Greear
03b180b610 kpi: Add pass/fail reporting. 2020-05-04 07:04:33 -07:00
Ben Greear
1eb90b8f22 kpi: Add numeric report for last data value, delta, and percentage change. 2020-05-04 06:38:35 -07:00
Ben Greear
b60b1f4265 kpi: Put score graphs in their own section. 
These are higher priority and should be separate from the other
data graphs.
 2020-05-04 06:05:45 -07:00
Ben Greear
80c4cd0fdd kpi: Fix sizing thumbnail reports. 2020-05-02 10:28:39 -07:00
Ben Greear
d981c3d3ac Add thumbnails for the kpi pngs. 
Needs some html work still it seems, thumbnails are too large.
 2020-05-01 15:49:20 -07:00
Ben Greear
5dec4bebd9 kpi: Add links to latest test run info. 
For easier click-through to see recent results.
 2020-05-01 08:51:30 -07:00
Ben Greear
11e8362be9 kpi: Support adding git-log info to the Run report. 2020-04-30 20:48:48 -07:00
Ben Greear
c1512b48a4 gui: Support setting verbosity slider. 2020-04-30 13:36:02 -07:00
Ben Greear
ca9ecb24ec Add gnuplot files for group graphs. 2020-04-30 11:46:08 -07:00
Ben Greear
02954a7a14 kpi: Add group graphs. 
And customized units on graphs.
 2020-04-30 11:44:30 -07:00
Ben Greear
97ec011fec kpi: Fix more ordering issues. 2020-04-29 16:44:19 -07:00
Ben Greear
e49a8e0590 kpi: Improve html output 
Improve ordering, add DUT info in the test-run details.
 2020-04-29 16:06:24 -07:00
Ben Greear
e8767aabcd kpi: Generate test-bed history web page. 
Includes historical graphs for each data set, and links
to test bed runs.
 2020-04-29 13:44:42 -07:00
Ben Greear
aae4953061 kpi: Generate gnuplot graphs for each data 2020-04-29 11:59:22 -07:00
Ben Greear
4f13a36b38 gui scripting: Add tool to parse historical kpi data and turn it into useful reports. 
Currently, it can only parse the csv data.  Next it can generate some graphs and html
and such.
 2020-04-28 16:33:53 -07:00
Ben Greear
260b86ba8d auto-testing: Add KPI id support, round score to 2 decimal places. 2020-04-27 12:55:07 -07:00
Ben Greear
f7f47848e6 Add basic HTML page generation for automated test bed run. 2020-04-24 16:32:17 -07:00
Ben Greear
4241f810b2 gui-automation: Add serial-console and other logging. 
The openwrt_ctl.py program can do some basic commands and console
logging on OpenWrt and LANforge Linux systems.

Add some more log gathering logic to the basic_regression.bash script.
 2020-04-23 16:52:21 -07:00
Ben Greear
1decfbaa9d Update GUI readme. 2020-04-22 16:41:50 -07:00
Ben Greear
b8793edd31 gui-automation: Allow updating DUT with new info 
Will help us track DUT software builds and such.
 2020-04-17 13:18:52 -07:00
Ben Greear
6f9178a638 Add Dataplane pkt-size test to the basic-regression test. 2020-04-16 17:05:16 -07:00
Ben Greear
0497c25adf scripts: More gui automation fixes and improvements. 2020-04-16 16:34:35 -07:00
Ben Greear
474500b8f7 basic-regression: Add some more reset related tests, allow running individual tests. 2020-04-16 07:46:25 -07:00