Commit Graph

2552 Commits

Author SHA1 Message Date
Jed Reynolds
563c7d4258 regression_test.sh: updates CSS to reference brand fonts and report.css
Signed-off-by: Jed Reynolds <jed@bitratchet.com>
2021-12-02 14:51:23 -08:00
Jed Reynolds
cd397ec883 regression_test.sh: WIP making html styles more enjoyable
Signed-off-by: Jed Reynolds <jed@bitratchet.com>
2021-12-02 14:51:18 -08:00
Chuck SmileyRekiere
ac936583da update_dependencies.py , requirements.txt : removed bokeh
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-12-02 14:46:04 -07:00
Matthew Stidham
0c68ddd984 regression_test: Add partial_failure css
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-02 09:52:55 -08:00
Matthew Stidham
a929e43205 regression_test: Partial failure function in case there is a lanforge failure but Python doesn't fail
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-02 09:49:54 -08:00
Chuck SmileyRekiere
7aa04ecbc3 lf_check.py ct_001_AX88U_dut.json: pass in serial number fix
ct_us_001_tests.json test update

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-12-01 15:59:54 -07:00
Matthew Stidham
feccfeb685 regression_test: improve update line in case virtualenv exists
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-01 14:11:54 -08:00
Chuck SmileyRekiere
f36004fcc5 lf_check.py : directory name reflects the test suite
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-11-30 19:03:32 -05:00
Chuck SmileyRekiere
c40e164248 lf_check.py : added summary to summary some tests failed
ct_us_001_scripts.json : added information about --create_scenario <name>
and instance name

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-11-30 18:54:10 -05:00
Chuck SmileyRekiere
b2c95bdc33 lf_check.py : bug fix
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-11-30 12:14:25 -07:00
Chuck SmileyRekiere
43fa8db465 lf_check.py : add test run, success, timeout, failure summary
ct_us_001_scripts.json : fixed typo

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-11-30 12:34:06 -05:00
Matthew Stidham
9e2e4a1c73 test_generic: Fix os.path.exists error
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-11-29 16:46:34 -08:00
Matthew Stidham
93977892e6 lf_multipsk: Fix regressions
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-11-29 16:36:07 -08:00
Matthew Stidham
a9928bbc2b regression_test: test_l4 only needs to run for 15 seconds
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-11-29 14:58:40 -08:00
Matthew Stidham
2177dd3575 test_l4: Fix bare except
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-11-29 14:58:25 -08:00
Matthew Stidham
ea79a485e0 test_l3_unicast_traffic_gen: Cleanup whitespace
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-11-29 14:53:18 -08:00
Matthew Stidham
5b0f6cfc59 test_l3_longevity: Fix undefined variables
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-11-29 14:50:14 -08:00
Matthew Stidham
f622702ff3 regression-test: Use user defined variables for network on test_l3_longevity test
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-11-29 14:44:52 -08:00
Matthew Stidham
a45dbf191b regression_test: Fix test_l3_longevity command flags
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-11-29 14:41:19 -08:00
Matthew Stidham
a29d582e89 test_l3_longevity: Use set literal when possible
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-11-29 14:32:51 -08:00
Matthew Stidham
2a12e63914 test_l3_longevity: Remove unused variables
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-11-29 14:31:45 -08:00
Matthew Stidham
eaaed43f1e test_l3_longevity: Use the staticmethod class where relevant
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-11-29 14:29:53 -08:00
Matthew Stidham
f6f63f2816 test_l3_longevity: Fix whitespace
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-11-29 14:28:23 -08:00
Chuck SmileyRekiere
9a66e91fde test_l3_longevity.py added comments for the layer3_cols flags
lf_qa.py comments updates for sub-tests

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-11-29 15:20:41 -07:00
Chuck SmileyRekiere
b8a644895e test_l3_longevity.py : changed port_data variable from p -> port_data
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-11-29 15:20:40 -07:00
Matthew Stidham
3157b938b0 lf_wifi_capacity_test: fix mutable default arguments
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-11-29 14:18:56 -08:00
Matthew Stidham
06c255314e lf_tr398v2_test: Fix whitespace
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-11-29 14:17:37 -08:00
Matthew Stidham
4ce15f8bf3 lf_tr398v2_test: fix mutable default arguments
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-11-29 14:17:08 -08:00
Matthew Stidham
71467c2c23 lf_snp_test: fix whitespace problems
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-11-29 14:15:35 -08:00
Matthew Stidham
72efa0c69c lf_snp_test: Make argparse more verbose
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-11-29 14:14:23 -08:00
Matthew Stidham
febb426e3c lf_snp_test: Fix unreliable None comparisons
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-11-29 14:05:46 -08:00
Matthew Stidham
37e2710bb2 lf_snp_test: Fix whitespace
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-11-29 14:04:17 -08:00
Matthew Stidham
3b15113d30 lf_snp_test: Fix whitespace
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-11-29 14:02:47 -08:00
Matthew Stidham
82d20e68fc regression_test: Fix lf_dut_sta_vap_test call
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-11-29 13:46:21 -08:00
Matthew Stidham
418db00d4d test_wanlink: main() takes only 1 argument
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-11-29 13:10:02 -08:00
Matthew Stidham
8fccdf3111 regression_test: Remove TIP scripts, enable more of our scripts
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-11-29 13:03:05 -08:00
Matthew Stidham
356dbcf15a Revert "sta_connect2: Make the mgr argument on sta_connect2 more robust"
This reverts commit b3d9447c7e.
2021-11-29 13:00:32 -08:00
Matthew Stidham
e98e7c71c9 regression_test: Improve measure_station_time_up args
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-11-29 12:57:49 -08:00
Matthew Stidham
b3d9447c7e sta_connect2: Make the mgr argument on sta_connect2 more robust
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-11-29 12:56:11 -08:00
Matthew Stidham
3423dd0d73 regression_test: Improve measure_station_time_up args
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-11-29 12:51:59 -08:00
Matthew Stidham
cc305b8422 measure_station_time_up: Don't hardcode radio names
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-11-29 12:50:47 -08:00
Matthew Stidham
72363432d3 regression_test: improve measure_station_time_up call
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-11-29 12:48:06 -08:00
Logan Lipke
6fab304140 whitespace changes after autopep8 2021-11-29 10:14:28 -08:00
Matthew Stidham
4a97a90f28 ws_generic_monitor_test: Will run forever. It needs to be fixed.
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-11-24 22:29:06 -08:00
Matthew Stidham
5d95f27623 regression_test: test stalls on test_l3_scenario_throughput
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-11-24 19:56:01 -08:00
Matthew Stidham
d7efd606c9 run_cv_scenario: Fix whitespace
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-11-24 17:23:51 -08:00
Matthew Stidham
6c7aff23df run_cv_scenario: Remove trailing semicolons
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-11-24 17:23:25 -08:00
Matthew Stidham
a08afea0f4 measure_station_time_up: Fix whitespace errors
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-11-24 17:22:27 -08:00
Matthew Stidham
a952c392fb measure_station_time_up: Remove empty else clause
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-11-24 17:20:37 -08:00
Matthew Stidham
dce4488777 measure_station_time_up: Support csv, xlsx, and pickle for file outputs
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-11-24 17:19:50 -08:00