Commit Graph

2894 Commits

Author SHA1 Message Date
Matthew Stidham
72febfd9c1 Revert "Revert "scenario.py: Move get_events and find_new_events to Realm""
This reverts commit 3d6eb6c140bffaa904da96efb6692f07f57b9096.
2022-07-12 15:45:33 +05:30
Chuck SmileyRekiere
2d16517da8 test_l3_longevity.py : pep8
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:33 +05:30
Chuck SmileyRekiere
6c0e499938 test_l3_longevity.py : examples now show shelf.resource.radio for stations
and upstream ports.

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:33 +05:30
Chuck SmileyRekiere
387d7ff71b ct_us_001_tests.json, ct_us_004_tests.json : consistent number of 2g and 5g radios in ap_auto tests
based on radios 802.11 support.

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:32 +05:30
Chuck SmileyRekiere
474cc09811 ct_us_002_tests.json : consistent number of 2g and 5g radios in ap_auto tests
updated 2g max_stations to 4

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:32 +05:30
Chuck SmileyRekiere
817aa9bab6 ct_us_scripts.json : disable test_l3_powersave_traffic hardcodes station to
149 , until that is fixed.

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:32 +05:30
Jed Reynolds
8c8b5279b4 regression_test.sh: adds meta tag to discourage browser caching
Signed-off-by: Jed Reynolds <jed@bitratchet.com>
2022-07-12 15:45:32 +05:30
Matthew Stidham
bfc51a6c7b Revert "scenario.py: Move get_events and find_new_events to Realm"
Breaks things

This reverts commit 37026e108066be837936dde4bf73fd464d0746f7.
2022-07-12 15:45:32 +05:30
Matthew Stidham
0a3ce42238 sta_connect2: Set station_profile.sta_prefix
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:32 +05:30
Matthew Stidham
08b38b5044 scenario.py: Move get_events and find_new_events to Realm
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:32 +05:30
Matthew Stidham
14295a3ec6 create_l3_stations: num_sta variable should always be accurate
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:32 +05:30
Chuck SmileyRekiere
a9e5ad3935 test_l3.py : autopep8 linting
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:32 +05:30
Chuck SmileyRekiere
a82d0b9673 test_l3.py : longevity was still in this script
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:32 +05:30
Matthew Stidham
b5fcfa133e regression_test: test_l3_unicast_traffic_gen: update arguments
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:32 +05:30
Matthew Stidham
b709834d25 test_l3_unicast_traffic_gen:
Change inheritance to realm because we were using local_realm, and it was inheriting from LFCliBase. Its better to just inherit directly from Realm since Realm inherits LFCliBase
Use the create_basic_argparse function from Realm so we have standard command line args instead of reinventing the wheel.
Don't use the radio flag for something which is inherently different from what radio is used for in our other scripts, that was confusing.
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:32 +05:30
Matthew Stidham
c900dc06b6 regression_test: add test_l3_unicast_traffic_gen to regression_test
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:32 +05:30
Matthew Stidham
a8663dae67 test_l3_unicast_traffic_gen: Fix regresisons by fixing the realm.wait_for_ip call
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:32 +05:30
Ben Greear
749f611662 test_generic: Use auto-timeout for wait_for_ips.
And pass in debugging flag to the wait_until_ports_admin_up
method.

Signed-off-by: Ben Greear <greearb@candelatech.com>
2022-07-12 15:45:32 +05:30
Matthew Stidham
f22109c884 test_generic: wait_for_ip will inherit debug status from the class
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:32 +05:30
Matthew Stidham
b279f44604 test_ip_variable_time: wait_for_ip needs to have debug match that of test_ip_variable_time
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:30 +05:30
Matthew Stidham
fe9696f2d6 sta_connect: When querying for ports port,ip,ap, don't spout debug output when the port doesn't exist. The test runs whether this works or not.
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:24 +05:30
Matthew Stidham
47c49b57e5 regression_test: Run git pull --rebase at the beginning of the script, as a safety check
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:24 +05:30
Ben Greear
5056a01e94 sta-scan-test: Allow using existing stations.
Lots of changes to allow this script to scan on existing stations
on multiple resources.

Add --use_existing_station option.

Fix help to show how to properly specify multiple stations with
--sta_name

Comment out convoluted logic that tried to find radio info for stations.
This is not needed for any purpose that I can find, and it did not
allow me to specify sta_name with EID format.

Start scan on all stations, then do sleep time, then grab results.
This allows concurrent scanning on multiple resources/radios.

Print more info in text based output, add station resource and name
to output so we can decipher multiple radio output.

Add note about how .csv output is broken in this case, the logic
needs to be improved to append results for all stations and write a single file.

Add --scan_time argument to specify sleep time (defaults to 15 seconds
to match the original hard-coded value).

Signed-off-by: Ben Greear <greearb@candelatech.com>
2022-07-12 15:45:23 +05:30
Scott Wedge
5ea8ff21a7 test_l4.py: update help output, text and whitespace updates
Signed-off-by: Scott Wedge <wedges@candelatech.com>
2022-07-12 15:45:17 +05:30
Chuck SmileyRekiere
e86e2b19c1 test_l3_scenario_throughput.py : commented out ploting as ploting uses bokeh
the test was unmodified , and the xlsx report still generated. May need
to update test to support plotly.

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:17 +05:30
Chuck SmileyRekiere
0810876412 ct_us_003_tests.json: ap_auto , one station per radio for AX and mdk
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:17 +05:30
Chuck SmileyRekiere
9f15163986 ct_us_XXX_tests.json: changed default connect time in AP tests to 500ms
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:17 +05:30
Chuck SmileyRekiere
254ce87563 ct_us_004_tests.json: have only basic connect ap test on nightly
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:17 +05:30
Chuck SmileyRekiere
6353e2c973 ct_us_002_tests.json: changed station count for 2.4g radions to be the number
of working 2.4g radios.

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:17 +05:30
Chuck SmileyRekiere
3e5833e0a6 lf_check.py : add test suite to the title on html and pdf
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:17 +05:30
Matthew Stidham
a77b12e964 regression_test: Use BSSID variable wherever applicable in script
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:17 +05:30
Matthew Stidham
f5e87fb594 regression_test: Always use the mgr flag when runnin scenario.py
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:17 +05:30
Matthew Stidham
71c15f4a8c test_ipv4_ps: On pre-cleanup, do not trigger an error if the port doesn't exist
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:17 +05:30
Chuck SmileyRekiere
a6c528d72d lf_qa.py : test list for subtests did not need to re-sort the list, the
data was previously ordered by date.

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:17 +05:30
Chuck SmileyRekiere
51759446b6 cv_to_grafana.py: cv_base_adjust_parser is resolved in cv_test_manager
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:17 +05:30
Chuck SmileyRekiere
e854fe6a3f ct_us_XXX_tests.json : no dual band radios to test band stearing according to
ap_auto test

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:17 +05:30
Chuck SmileyRekiere
e3c2a2b565 ct_us_XXX_tests.json: updated ap_auto timeout for basic connect to 20 min
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:17 +05:30
Chuck SmileyRekiere
a6f7af38a3 ct_us_002_tests.json : fixed the expected number of 2.4Ghz connections
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:16 +05:30
Chuck SmileyRekiere
a66c74ef08 ct_us_XXX_tests.json : changed timing for ap_auto basic connect to 900 seconds
15 min

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:16 +05:30
Chuck SmileyRekiere
72c7bed99d ct_us_XXX_tests.json: added --raw_line to the ap_auto to set the cx_psk_thresh:
to 300.  Added ap_auto basic connect test to help begin to debug cv tests

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:16 +05:30
Matthew Stidham
76c266f21d test_ipv4_ps: Inherit directly from realm, local_realm is unstable
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:44:27 +05:30
Matthew Stidham
503b3d4384 test_l3_powersave_traffic: Finish removing local_realm from test_l3_powersave_traffic
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:44:27 +05:30
Matthew Stidham
694d22c85e asus_ap: Fix whitespace
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:44:27 +05:30
Matthew Stidham
f7766e8de9 lf_dfs_test: Cleanup whitespace
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:44:27 +05:30
Matthew Stidham
53f6501b10 test_l4.py: Better to just inherit directly from realm rather than using local_realm
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:44:27 +05:30
Matthew Stidham
884bf29231 test_l3_powersave_traffic: local_realm is unstable, better to just inherit directly from realm
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:44:27 +05:30
Matthew Stidham
d426f13ea0 testgroup: Inherit directly from realm to increase stability
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:44:27 +05:30
Matthew Stidham
ec2fd22e2a example_security_connection: Inherit directly from realm. local_realm is unstable
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:44:27 +05:30
Matthew Stidham
6b7f8dc65a example_security_connection: Fix whitespace
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:44:27 +05:30
Matthew Stidham
429e5559cc csv_to_grafana: Fix whitespace
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:44:27 +05:30