Commit Graph

572 Commits

Author SHA1 Message Date
Chuck SmileyRekiere
68a89b7acf ct_us_XXX_tests.json : changed to --set 'Skip 2.4Ghz Tests' 0
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:44:27 +05:30
Chuck SmileyRekiere
22feb17867 ct_us_002_tests.json: ap_auto tests for the correct 2g radions
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:44:27 +05:30
Matthew Stidham
886b80392e mine_regression_test: More reasonable color order for chart
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:44:27 +05:30
Matthew Stidham
515c6925f0 mine_regression_results: In heatmap, display the worst result for each test.
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:44:27 +05:30
Matthew Stidham
53b751ea52 mine_regression_results: Improve colors, add titles
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:44:27 +05:30
Chuck SmileyRekiere
35c590e589 lf_check.py : Created UPSTREAM_ALIAS ,for chamberview tests that only need
the alias, the shelf and resource is entered seperately.
Updated the ct_us_XXX_rig ro UPSTREAM_ALIAS
Updated the associated CV tests
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:44:27 +05:30
Matthew Stidham
f3e5c72c70 mine_regression_results: Make images bigger. Create heatmap showing device/script relationship
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:44:27 +05:30
Chuck SmileyRekiere
972f5f01cf lf_check.py: added suite name to summary
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:44:27 +05:30
Chuck SmileyRekiere
05c7982451 lf_check.py: removed defaults from required args, made --suite required
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:44:27 +05:30
Chuck SmileyRekiere
5041f2a41a ct_XXX_dut.json: Note on when to use DUT_SET_NAME, for the --set parameter
ct_us_XXX_tests.json : fixed AP Auto tests to use the USE_DUT_NAME

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:44:27 +05:30
Matthew Stidham
ea9b5b0cba mine_regression_results: Save png of script results
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:44:27 +05:30
Matthew Stidham
f6a1b3afd0 mine_regression_test: statement seems to have no effect
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:44:27 +05:30
Matthew Stidham
7b54f5e324 mine_regression_test: Improve save_csv argument, save test specific csv on request
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:44:27 +05:30
Chuck SmileyRekiere
671ab48923 ct_us_XXX_tests.json : added 5g test_l3_longevity.py to multi suite,
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:44:27 +05:30
Chuck SmileyRekiere
9d85020e74 ct_us_XXX_tests.json : removed redudant suite, added suite_l3_mulit, and
added a test to suite_l3
lf_check.py: print out command debugging , help debug complicated commands

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:44:27 +05:30
Chuck SmileyRekiere
27074b439a ct_us_XXX_tests.json: updated radios used for wifi capacity, added mediatech
for 002

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:44:27 +05:30
Chuck SmileyRekiere
666381c70d ct_us_XXX_tests.json : formatting updates for test_l3_longevity so the command
may be copied from the results and directly run

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:44:27 +05:30
Chuck SmileyRekiere
19a2ac2fa7 lf-help_check.bash, test_l3_longevity.py, lf_check.py updated errors to
string ERROR:

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:44:27 +05:30
Chuck SmileyRekiere
0960687948 ct_us_scripts.json : updated syntax for test_l3_longevity so copy command line
has correct syntax in results

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:44:27 +05:30
Chuck SmileyRekiere
b14c2272f3 ct_us_002_tests.json : ap_auto the building of the dut and chamberview are
now enabled, ap_basic connect was enabled without these being enabled.

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:44:27 +05:30
Chuck SmileyRekiere
39e1452b51 lf_qa.py : pep8 linting , autopep8
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:44:27 +05:30
Chuck SmileyRekiere
ef9c02ad5c lf_check.py : pep8 linting autopep8
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:44:27 +05:30
Chuck SmileyRekiere
02d7f9c4aa lf_check.py : made TIMEOUT take presidence, the checking for pass/fail would
show a pass when there was a TIMEOUT , this is important for longer tests
like ap_auto that can be 3-4 hours long.

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:44:27 +05:30
Chuck SmileyRekiere
9ff8e4ae52 ct_us_XXX_tests.json : increased time for ap_auto tests to the run to completion
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:44:27 +05:30
Chuck SmileyRekiere
afcdc46c5e lf_check.py : changed check for --help file check to ERROR FAILED check
and put some tests failed.

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:44:27 +05:30
Chuck SmileyRekiere
97fb9a20bf ct_us_XXX_tests.json : shortened timing on ap_auto tests to timeout quicker
on error conditions.  Also increasing the systems testing (F27, F30 and F35)

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:44:27 +05:30
Chuck SmileyRekiere
a50b70d6a5 ct_us_XXX_tests.json : added ap_auto stability suite
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:44:27 +05:30
Chuck SmileyRekiere
166c845b14 lf_cleanup.py : updated to choose a resource defaults to 1, for cleaning
QA 003 realm
ct_us_003_tests.json : re-arranged tests so nightly at top

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:44:26 +05:30
Chuck SmileyRekiere
01b108ec57 ct_us_scripts.json : moved variable time for 24g to a radio that supports
24g on all three QA systems

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:44:26 +05:30
Chuck SmileyRekiere
d804ce1dc3 ct_us_scripts.json , ct_us_001_scripts.json : removed trailing underscore
from test-tag

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:44:26 +05:30
Chuck SmileyRekiere
921b45df12 lf_help_check.bash : added ERROR , so lf_check.py will catch the error
py-scripts
ct_us_001_scripts.json added lf_help_check.bash
ct_us_scripts.json added lf_help_check.bash
2022-07-12 15:44:26 +05:30
Chuck SmileyRekiere
902dd03495 lf_check.py : added the server Fedora Version
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:44:26 +05:30
Chuck SmileyRekiere
059177a68b ct_us_001_tests.json : placed nightly runs at top of file
ct_us_004_tests.json : placed nightly runs at top of tile

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:44:26 +05:30
shivamcandela
7d0a01eb32 Merge ../lanforge-scripts 2021-12-17 07:17:29 +05:30
Matthew Stidham
b7838416c6 mine_regression_results: Improve output table so it has columns tallying the number of successes, errors, partial errors, partial failures specifically
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-16 15:43:18 -08:00
Matthew Stidham
d73df6d5c9 mine_regression_results: mine data from dingo
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-16 15:35:34 -08:00
Chuck SmileyRekiere
25b2fdbfb8 lf_check.py : add Server Host name, Server ip , Python3 Version Python3 Executable
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-12-15 18:15:48 -07:00
Matthew Stidham
af19c13649 mine_regression_results: add badger to regression results csv
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-15 14:47:07 -08:00
Chuck SmileyRekiere
40986001ce ct_us_scripts.json : syntax fix
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-12-15 12:09:53 -07:00
Chuck SmileyRekiere
f3fc3c850c ct_us_scripts.json : additional test scripts added
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-12-15 12:07:04 -07:00
shivamcandela
0df163cf90 Merge ../lanforge-scripts 2021-12-15 23:33:41 +05:30
Chuck SmileyRekiere
7e0563ac21 ct_us_scripts.json : changed suite_scipte_r to suite_scripts
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-12-15 09:57:10 -07:00
Chuck SmileyRekiere
64774a4cd0 ct_us_XXX_rig.json added candela email.
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-12-15 08:48:53 -07:00
Chuck SmileyRekiere
ca2dfeeda1 test_l3_powersave_traffic.py : updated for single interface,
ct_us_scripts.json updated scripts to test

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-12-15 07:48:51 -07:00
Chuck SmileyRekiere
aba356c1ad ct_us_scripts.json : added test_ipv4_ps , test_ipv4_ttls , tests turned off
place holders when bridge is worked out.

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-12-14 07:21:29 -07:00
Chuck SmileyRekiere
66b33ce9fe test_ipv4_ttls.py : pass up upstream_port configuraiton,
ct_us_scripts.json updated test added cleanup.

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-12-14 06:18:16 -07:00
Chuck SmileyRekiere
8a3dc2221e ct_us_scripts.json: regression updates
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-12-14 06:18:16 -07:00
Chuck SmileyRekiere
78bffdbbf0 ct_us_scripts.json : initial checkin - attempt to include more regression
lf_cleanup.py : added the cleanup of moni with sta

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-12-14 05:01:38 -07:00
shivamcandela
7134c3a8b7 fixed merge conflicts
Signed-off-by: shivamcandela <shivam.thakur@candelatech.com>
2021-12-13 13:01:01 +05:30
Chuck SmileyRekiere
040ca87757 ct_us_001_scripts.json : shortened one of the script runs
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-12-10 07:47:13 -07:00