Commit Graph

503 Commits

Author SHA1 Message Date
Chuck SmileyRekiere
720147e802 lf_qa.py : updated exceptions to print out reasonable explantions
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-12-07 17:30:27 -07:00
Matthew Stidham
1deae84e52 mine_regression_results: Include Machine name in output
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-07 10:10:37 -08:00
Chuck SmileyRekiere
ae94318f07 lf_check.py : fixed relative paths for lf_qa reports
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-12-07 08:28:18 -07:00
Chuck SmileyRekiere
7a2931d2ab *_test.json : pulled out the stability from AP Auto,
AP auto taking over 7 hours.

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-12-07 06:56:21 -07:00
Chuck SmileyRekiere
fa06f99269 dut.json : differenciate between SSID and BSSID
test.json : differenciate between SSID and BSSID
lf_check.py : differenciate between SSID and BSSID

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-12-06 17:52:02 -07:00
Chuck SmileyRekiere
4a73628b74 dut.json : updated for consistant use of BSSID_USED
test.json : updated for consistant use of BSSID_USED
lf_check.py : updated for use of BSSID_USED
Updated AP Auto test

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-12-06 17:42:04 -07:00
Matthew Stidham
bc47c24087 mine_regression_results: Initial commit
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-06 14:07:44 -08:00
Chuck SmileyRekiere
a563fe9d3e lf_check.py : added lf qa link to output report
lf_qa.py : removed None prior to sorting lists to prevent exceptions
ct_us_002_tests.json : updated test_l3_longevity.py test
report.css , reduced the size of copy button to 10 px to prevent jumping.

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-12-06 07:09:04 -07:00
Chuck SmileyRekiere
5f753e6b51 lf_check.py : show the copy when hovering
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-12-04 10:26:37 -07:00
Chuck SmileyRekiere
ab608f1dc2 lf_check.py : added test suite duration , start and tend time.
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-12-04 10:14:55 -07:00
Chuck SmileyRekiere
e3066eae2c lf_check.py : updated json exception to point to the file
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-12-04 09:33:45 -07:00
Chuck SmileyRekiere
dafc866b49 lf_qa.py : fixed check for empty list
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-12-04 08:11:00 -07:00
Chuck SmileyRekiere
287d3af2f7 lf_check.py : update latest at top directory for suite
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-12-04 07:56:07 -07:00
Chuck SmileyRekiere
2e16dada66 lf_qa.py support for subtest presentation.
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-12-03 19:35:33 -05:00
Chuck SmileyRekiere
7aa04ecbc3 lf_check.py ct_001_AX88U_dut.json: pass in serial number fix
ct_us_001_tests.json test update

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-12-01 15:59:54 -07:00
Chuck SmileyRekiere
f36004fcc5 lf_check.py : directory name reflects the test suite
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-11-30 19:03:32 -05:00
Chuck SmileyRekiere
c40e164248 lf_check.py : added summary to summary some tests failed
ct_us_001_scripts.json : added information about --create_scenario <name>
and instance name

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-11-30 18:54:10 -05:00
Chuck SmileyRekiere
b2c95bdc33 lf_check.py : bug fix
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-11-30 12:14:25 -07:00
Chuck SmileyRekiere
43fa8db465 lf_check.py : add test run, success, timeout, failure summary
ct_us_001_scripts.json : fixed typo

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-11-30 12:34:06 -05:00
Chuck SmileyRekiere
9a66e91fde test_l3_longevity.py added comments for the layer3_cols flags
lf_qa.py comments updates for sub-tests

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-11-29 15:20:41 -07:00
Chuck SmileyRekiere
19752da2eb lf_check.py : removed \n from the scripts git sha
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-11-23 14:02:42 -07:00
Chuck SmileyRekiere
648491247a lf_check.py : updated to add the lanforge fedora version to the report
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-11-23 12:01:52 -07:00
Chuck SmileyRekiere
f50d420e5c ct_us_001_tests.json : updated to remove multiband performance
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-11-22 10:52:45 -07:00
Chuck SmileyRekiere
fdc2b90336 ct_us_001_tests.json : syntax fix
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-11-22 10:41:17 -07:00
Chuck SmileyRekiere
6daca2c3d5 ct_us_001_tests.json : add ap_auto bc test
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-11-22 10:24:35 -07:00
Chuck SmileyRekiere
c1e91fa395 ct_us_003_rig.json ct_us_004_rig.json : updated for TEST_SERVER usage
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-11-22 11:58:29 -05:00
Chuck SmileyRekiere
af6083f7a1 lf_check.py : added server override , and abiltiy to set sever in json
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-11-22 11:57:16 -05:00
Chuck SmileyRekiere
55db4b8b96 test_l3_longevity.py : pass in the dut information
lf_qa.py : bug fix for serial number

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-11-19 13:35:12 -07:00
Chuck SmileyRekiere
505c21de1f lf_check.py : fixed bug in check for tests failed
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-11-17 16:48:18 -07:00
Chuck SmileyRekiere
495dafff12 ct_us_001_scripts.json - minor name change
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-11-17 11:27:29 -07:00
Chuck SmileyRekiere
2ea53395b9 lf_check.py : check for subtest failures
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-11-17 11:19:27 -07:00
Chuck SmileyRekiere
4bad6732f8 ct_us_001_scripts.json : added cleanup for cxs and sta prior to the test
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-11-17 11:00:07 -07:00
Chuck SmileyRekiere
7b9946e756 ct_us_00X_tests.json : updated nightly script name
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-11-17 07:36:44 -07:00
Chuck SmileyRekiere
89b7d57cea ct_us_X_tests.json updated for supporting TEST_SERVER being passed in
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-11-17 07:18:43 -07:00
Chuck SmileyRekiere
7261a9f032 lf_qa.py : fixed paths in report when not running with a server
lf_check.py : added --server input and TEST_SERVER parameter

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-11-17 07:09:33 -07:00
Matthew Stidham
fb2652a9e8 lf_qa: Remove invalid comparisons
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-11-16 11:05:42 -08:00
Chuck SmileyRekiere
1aa792930a One Interface support to work with
inconsistent list construction between single and multiple elements
decided around May 23, 2018
Updates for probe with AX210 , AX200 wiphy

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-11-13 06:36:29 -07:00
Chuck SmileyRekiere
a71b65ff6e lf_report_test.py lf_graph.py added to lf_check.py regression
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-11-12 07:48:49 -07:00
Chuck SmileyRekiere
dd80666057 ct_us_001_scripts.json updated for testing individual scripts
updated layer3_test.py to accept the correct parameters

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-11-11 20:37:30 -07:00
Chuck SmileyRekiere
c10a2ec2cf ct_us_001_scripts.json : script regression updates
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-11-11 20:37:30 -07:00
Chuck SmileyRekiere
ac34a5316c ct_us_001_tests.json : updated for using the wifi_mode and wifi_settings
per radio

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-11-11 11:47:47 -07:00
Chuck SmileyRekiere
bb29c5ff23 ct_us_002_tests.json : test updates
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-11-10 08:04:24 -07:00
Chuck SmileyRekiere
8271e54714 ct_us_001_rig.json : update the rig
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-11-09 10:35:57 -07:00
Chuck SmileyRekiere
a5ddd4047f ct_us_*.json test updates
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-11-09 07:38:53 -07:00
Chuck SmileyRekiere
88e8517382 lf_qa.py added update_layout(autotypenumbers='convert types') plotly latest
version is updated so needed to treat numbers as objects.

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-11-09 06:19:03 -07:00
Chuck SmileyRekiere
35081c3fd8 ct_us_001_scripts.json replace with variables
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-11-08 21:00:47 -07:00
Chuck SmileyRekiere
3315cff3ea *rig.json update the upstream port to alias
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-11-08 20:39:16 -07:00
Chuck SmileyRekiere
86bb4fa42c test_l3_longevity.py : updated destination so --mgr and --lfmgr added dest='lfmgr'
updated the scripts tesing to allow for looped tests.

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-11-08 10:58:58 -07:00
Chuck SmileyRekiere
a0e7685f3c ct_us_00X_tests.json : rename of nightly to be a sorter test
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-11-07 09:46:16 -07:00
Chuck SmileyRekiere
ae5b49d4d5 lf_check.py : pep8 and white space
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-11-06 12:18:06 -06:00