Commit Graph

659 Commits

Author SHA1 Message Date
Chuck SmileyRekiere
10c8c501dc lf_tx_power.py : initial development to have lf_tx_power.py us lf_report and
lf_kpi_csv libraries to place the results in the correct directories when
running lf_check.py to do batches.
lf_check.py : initial import lf_kpi_csv.py to lf_check to have historical
statistics for QA test runs.
2022-07-12 15:46:15 +05:30
Chuck SmileyRekiere
0d5f4e9e47 lf_check.py : used the logger library
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:46:15 +05:30
Chuck SmileyRekiere
a39f2ed4d6 lf_check.py : added batch capability for channel, nss, bandwidth, tx_power
and with tx_power being able to be included in the batch or taken from the
command line.

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:46:15 +05:30
Chuck SmileyRekiere
2f00b694ad lf_tx_power.py : added info for lf_associate_ap.pl working directory
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:46:15 +05:30
Chuck SmileyRekiere
60978d33e5 lf_tx_power.py: set wifi_mode and ieee80211w when creating a station
lf_check.py : TODO added for running batch for larger tests

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:46:15 +05:30
Chuck SmileyRekiere
6f653db272 cc_module_9800_3504.py : updated for dtim for 24g, 6g (5g already present)
wifi_ctl_9800_3504.py : update for dtim for 24g, 6g (5g already present)
lf_check.py : changed info to warning if test enable isn'TRUE or FALSE

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:46:15 +05:30
Chuck SmileyRekiere
b5c7f3413f lf_check.py : updated iterations to be a member of the lf_check.py class
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:46:15 +05:30
Chuck SmileyRekiere
a9dc04a0d6 lf_check.py : fixed report index reference
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:46:15 +05:30
Chuck SmileyRekiere
f8d0949d94 lf_check.py : initial step in allowing test to input channel, nss, bw, tx power for tests
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:46:15 +05:30
Chuck SmileyRekiere
d8509deda8 lf_qa.py : changed logger.WARNING to logger.warning
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:46:15 +05:30
Scott Wedge
7dc43f6ef6 lf_qa.py: add logger module
Signed-off-by: Scott Wedge <scott.wedge@candelatech.com>
2022-07-12 15:46:15 +05:30
Chuck SmileyRekiere
f2ad775a7f ct_us_scripts.json : added sta_connect2.py to nightlyl
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:46:15 +05:30
Chuck SmileyRekiere
ebec9d4b71 ct_us_scripts.json : syntax fix
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:46:15 +05:30
Chuck SmileyRekiere
03f540a527 ct_us_scripts.json : updated sta_connect2.py and lf_ftp.py json
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:46:15 +05:30
Chuck SmileyRekiere
b71249b487 ct_us_scripts.json : fixed name of sta_connect2.py in json test
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:46:15 +05:30
Chuck SmileyRekiere
7b44c76fe9 ct_us_scripts.json : added suite_sta_connect2, suite_lf_ftp
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:46:15 +05:30
Chuck SmileyRekiere
3573417456 lf_check.py : stderr not send to stdout, subprocess output read line by line
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:46:15 +05:30
Chuck SmileyRekiere
81bfda13d3 ct_us_00X_tests.json : use the test rig definition UPSTREAM_PORT: also use shelf.resource.endpoint
To have AP Auto tests pass.
ct_us_001_scripts.json use test rig defintion UPSTREAM_PORT
ct_us_scripts.json use test rig defintion UPSTREAM_PORT

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:46:15 +05:30
Chuck SmileyRekiere
64cbf20b97 lf_check.py logging updates for meta file not being present
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:46:13 +05:30
Chuck SmileyRekiere
9830d08a49 lf_check.py : created exceptions if the metadata file is not present
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:46:13 +05:30
Chuck SmileyRekiere
c07c211e52 lf_qa.py : removed exit on not being able to find png file
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:46:13 +05:30
Chuck SmileyRekiere
6791c2e3e8 ct_us_xxx_rig.json : updated email list
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:33 +05:30
Chuck SmileyRekiere
9212fc19fd ct_us_XXX_tests.json : --stations is not needed for wifi capacity tests,
This may have prevented the tests from completing on media tech and ax210

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:33 +05:30
Chuck SmileyRekiere
387d7ff71b ct_us_001_tests.json, ct_us_004_tests.json : consistent number of 2g and 5g radios in ap_auto tests
based on radios 802.11 support.

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:32 +05:30
Chuck SmileyRekiere
474cc09811 ct_us_002_tests.json : consistent number of 2g and 5g radios in ap_auto tests
updated 2g max_stations to 4

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:32 +05:30
Chuck SmileyRekiere
817aa9bab6 ct_us_scripts.json : disable test_l3_powersave_traffic hardcodes station to
149 , until that is fixed.

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:32 +05:30
Chuck SmileyRekiere
0810876412 ct_us_003_tests.json: ap_auto , one station per radio for AX and mdk
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:17 +05:30
Chuck SmileyRekiere
9f15163986 ct_us_XXX_tests.json: changed default connect time in AP tests to 500ms
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:17 +05:30
Chuck SmileyRekiere
254ce87563 ct_us_004_tests.json: have only basic connect ap test on nightly
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:17 +05:30
Chuck SmileyRekiere
6353e2c973 ct_us_002_tests.json: changed station count for 2.4g radions to be the number
of working 2.4g radios.

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:17 +05:30
Chuck SmileyRekiere
3e5833e0a6 lf_check.py : add test suite to the title on html and pdf
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:17 +05:30
Chuck SmileyRekiere
a6c528d72d lf_qa.py : test list for subtests did not need to re-sort the list, the
data was previously ordered by date.

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:17 +05:30
Chuck SmileyRekiere
e854fe6a3f ct_us_XXX_tests.json : no dual band radios to test band stearing according to
ap_auto test

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:17 +05:30
Chuck SmileyRekiere
e3c2a2b565 ct_us_XXX_tests.json: updated ap_auto timeout for basic connect to 20 min
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:17 +05:30
Chuck SmileyRekiere
a6f7af38a3 ct_us_002_tests.json : fixed the expected number of 2.4Ghz connections
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:16 +05:30
Chuck SmileyRekiere
a66c74ef08 ct_us_XXX_tests.json : changed timing for ap_auto basic connect to 900 seconds
15 min

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:16 +05:30
Chuck SmileyRekiere
72c7bed99d ct_us_XXX_tests.json: added --raw_line to the ap_auto to set the cx_psk_thresh:
to 300.  Added ap_auto basic connect test to help begin to debug cv tests

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:16 +05:30
Chuck SmileyRekiere
68a89b7acf ct_us_XXX_tests.json : changed to --set 'Skip 2.4Ghz Tests' 0
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:44:27 +05:30
Chuck SmileyRekiere
22feb17867 ct_us_002_tests.json: ap_auto tests for the correct 2g radions
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:44:27 +05:30
Matthew Stidham
886b80392e mine_regression_test: More reasonable color order for chart
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:44:27 +05:30
Matthew Stidham
515c6925f0 mine_regression_results: In heatmap, display the worst result for each test.
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:44:27 +05:30
Matthew Stidham
53b751ea52 mine_regression_results: Improve colors, add titles
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:44:27 +05:30
Chuck SmileyRekiere
35c590e589 lf_check.py : Created UPSTREAM_ALIAS ,for chamberview tests that only need
the alias, the shelf and resource is entered seperately.
Updated the ct_us_XXX_rig ro UPSTREAM_ALIAS
Updated the associated CV tests
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:44:27 +05:30
Matthew Stidham
f3e5c72c70 mine_regression_results: Make images bigger. Create heatmap showing device/script relationship
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:44:27 +05:30
Chuck SmileyRekiere
972f5f01cf lf_check.py: added suite name to summary
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:44:27 +05:30
Chuck SmileyRekiere
05c7982451 lf_check.py: removed defaults from required args, made --suite required
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:44:27 +05:30
Chuck SmileyRekiere
5041f2a41a ct_XXX_dut.json: Note on when to use DUT_SET_NAME, for the --set parameter
ct_us_XXX_tests.json : fixed AP Auto tests to use the USE_DUT_NAME

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:44:27 +05:30
Matthew Stidham
ea9b5b0cba mine_regression_results: Save png of script results
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:44:27 +05:30
Matthew Stidham
f6a1b3afd0 mine_regression_test: statement seems to have no effect
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:44:27 +05:30
Matthew Stidham
7b54f5e324 mine_regression_test: Improve save_csv argument, save test specific csv on request
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:44:27 +05:30