Commit Graph

588 Commits

Author SHA1 Message Date
Chuck SmileyRekiere
6791c2e3e8 ct_us_xxx_rig.json : updated email list
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:33 +05:30
Chuck SmileyRekiere
9212fc19fd ct_us_XXX_tests.json : --stations is not needed for wifi capacity tests,
This may have prevented the tests from completing on media tech and ax210

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:33 +05:30
Chuck SmileyRekiere
387d7ff71b ct_us_001_tests.json, ct_us_004_tests.json : consistent number of 2g and 5g radios in ap_auto tests
based on radios 802.11 support.

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:32 +05:30
Chuck SmileyRekiere
474cc09811 ct_us_002_tests.json : consistent number of 2g and 5g radios in ap_auto tests
updated 2g max_stations to 4

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:32 +05:30
Chuck SmileyRekiere
817aa9bab6 ct_us_scripts.json : disable test_l3_powersave_traffic hardcodes station to
149 , until that is fixed.

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:32 +05:30
Chuck SmileyRekiere
0810876412 ct_us_003_tests.json: ap_auto , one station per radio for AX and mdk
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:17 +05:30
Chuck SmileyRekiere
9f15163986 ct_us_XXX_tests.json: changed default connect time in AP tests to 500ms
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:17 +05:30
Chuck SmileyRekiere
254ce87563 ct_us_004_tests.json: have only basic connect ap test on nightly
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:17 +05:30
Chuck SmileyRekiere
6353e2c973 ct_us_002_tests.json: changed station count for 2.4g radions to be the number
of working 2.4g radios.

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:17 +05:30
Chuck SmileyRekiere
3e5833e0a6 lf_check.py : add test suite to the title on html and pdf
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:17 +05:30
Chuck SmileyRekiere
a6c528d72d lf_qa.py : test list for subtests did not need to re-sort the list, the
data was previously ordered by date.

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:17 +05:30
Chuck SmileyRekiere
e854fe6a3f ct_us_XXX_tests.json : no dual band radios to test band stearing according to
ap_auto test

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:17 +05:30
Chuck SmileyRekiere
e3c2a2b565 ct_us_XXX_tests.json: updated ap_auto timeout for basic connect to 20 min
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:17 +05:30
Chuck SmileyRekiere
a6f7af38a3 ct_us_002_tests.json : fixed the expected number of 2.4Ghz connections
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:16 +05:30
Chuck SmileyRekiere
a66c74ef08 ct_us_XXX_tests.json : changed timing for ap_auto basic connect to 900 seconds
15 min

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:16 +05:30
Chuck SmileyRekiere
72c7bed99d ct_us_XXX_tests.json: added --raw_line to the ap_auto to set the cx_psk_thresh:
to 300.  Added ap_auto basic connect test to help begin to debug cv tests

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:16 +05:30
Chuck SmileyRekiere
68a89b7acf ct_us_XXX_tests.json : changed to --set 'Skip 2.4Ghz Tests' 0
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:44:27 +05:30
Chuck SmileyRekiere
22feb17867 ct_us_002_tests.json: ap_auto tests for the correct 2g radions
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:44:27 +05:30
Matthew Stidham
886b80392e mine_regression_test: More reasonable color order for chart
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:44:27 +05:30
Matthew Stidham
515c6925f0 mine_regression_results: In heatmap, display the worst result for each test.
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:44:27 +05:30
Matthew Stidham
53b751ea52 mine_regression_results: Improve colors, add titles
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:44:27 +05:30
Chuck SmileyRekiere
35c590e589 lf_check.py : Created UPSTREAM_ALIAS ,for chamberview tests that only need
the alias, the shelf and resource is entered seperately.
Updated the ct_us_XXX_rig ro UPSTREAM_ALIAS
Updated the associated CV tests
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:44:27 +05:30
Matthew Stidham
f3e5c72c70 mine_regression_results: Make images bigger. Create heatmap showing device/script relationship
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:44:27 +05:30
Chuck SmileyRekiere
972f5f01cf lf_check.py: added suite name to summary
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:44:27 +05:30
Chuck SmileyRekiere
05c7982451 lf_check.py: removed defaults from required args, made --suite required
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:44:27 +05:30
Chuck SmileyRekiere
5041f2a41a ct_XXX_dut.json: Note on when to use DUT_SET_NAME, for the --set parameter
ct_us_XXX_tests.json : fixed AP Auto tests to use the USE_DUT_NAME

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:44:27 +05:30
Matthew Stidham
ea9b5b0cba mine_regression_results: Save png of script results
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:44:27 +05:30
Matthew Stidham
f6a1b3afd0 mine_regression_test: statement seems to have no effect
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:44:27 +05:30
Matthew Stidham
7b54f5e324 mine_regression_test: Improve save_csv argument, save test specific csv on request
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:44:27 +05:30
Chuck SmileyRekiere
671ab48923 ct_us_XXX_tests.json : added 5g test_l3_longevity.py to multi suite,
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:44:27 +05:30
Chuck SmileyRekiere
9d85020e74 ct_us_XXX_tests.json : removed redudant suite, added suite_l3_mulit, and
added a test to suite_l3
lf_check.py: print out command debugging , help debug complicated commands

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:44:27 +05:30
Chuck SmileyRekiere
27074b439a ct_us_XXX_tests.json: updated radios used for wifi capacity, added mediatech
for 002

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:44:27 +05:30
Chuck SmileyRekiere
666381c70d ct_us_XXX_tests.json : formatting updates for test_l3_longevity so the command
may be copied from the results and directly run

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:44:27 +05:30
Chuck SmileyRekiere
19a2ac2fa7 lf-help_check.bash, test_l3_longevity.py, lf_check.py updated errors to
string ERROR:

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:44:27 +05:30
Chuck SmileyRekiere
0960687948 ct_us_scripts.json : updated syntax for test_l3_longevity so copy command line
has correct syntax in results

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:44:27 +05:30
Chuck SmileyRekiere
b14c2272f3 ct_us_002_tests.json : ap_auto the building of the dut and chamberview are
now enabled, ap_basic connect was enabled without these being enabled.

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:44:27 +05:30
Chuck SmileyRekiere
39e1452b51 lf_qa.py : pep8 linting , autopep8
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:44:27 +05:30
Chuck SmileyRekiere
ef9c02ad5c lf_check.py : pep8 linting autopep8
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:44:27 +05:30
Chuck SmileyRekiere
02d7f9c4aa lf_check.py : made TIMEOUT take presidence, the checking for pass/fail would
show a pass when there was a TIMEOUT , this is important for longer tests
like ap_auto that can be 3-4 hours long.

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:44:27 +05:30
Chuck SmileyRekiere
9ff8e4ae52 ct_us_XXX_tests.json : increased time for ap_auto tests to the run to completion
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:44:27 +05:30
Chuck SmileyRekiere
afcdc46c5e lf_check.py : changed check for --help file check to ERROR FAILED check
and put some tests failed.

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:44:27 +05:30
Chuck SmileyRekiere
97fb9a20bf ct_us_XXX_tests.json : shortened timing on ap_auto tests to timeout quicker
on error conditions.  Also increasing the systems testing (F27, F30 and F35)

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:44:27 +05:30
Chuck SmileyRekiere
a50b70d6a5 ct_us_XXX_tests.json : added ap_auto stability suite
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:44:27 +05:30
Chuck SmileyRekiere
166c845b14 lf_cleanup.py : updated to choose a resource defaults to 1, for cleaning
QA 003 realm
ct_us_003_tests.json : re-arranged tests so nightly at top

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:44:26 +05:30
Chuck SmileyRekiere
01b108ec57 ct_us_scripts.json : moved variable time for 24g to a radio that supports
24g on all three QA systems

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:44:26 +05:30
Chuck SmileyRekiere
d804ce1dc3 ct_us_scripts.json , ct_us_001_scripts.json : removed trailing underscore
from test-tag

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:44:26 +05:30
Chuck SmileyRekiere
921b45df12 lf_help_check.bash : added ERROR , so lf_check.py will catch the error
py-scripts
ct_us_001_scripts.json added lf_help_check.bash
ct_us_scripts.json added lf_help_check.bash
2022-07-12 15:44:26 +05:30
Chuck SmileyRekiere
902dd03495 lf_check.py : added the server Fedora Version
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:44:26 +05:30
Chuck SmileyRekiere
059177a68b ct_us_001_tests.json : placed nightly runs at top of file
ct_us_004_tests.json : placed nightly runs at top of tile

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:44:26 +05:30
shivamcandela
7d0a01eb32 Merge ../lanforge-scripts 2021-12-17 07:17:29 +05:30