Matthew Stidham
c31fb26d20
scenario.py create are_any_ports_phantom and is_port_phantom functions
...
Signed-off-by: Matthew Stidham <stidmatt@gmail.com >
2022-07-12 15:45:33 +05:30
Matthew Stidham
58a6dd07cb
regression_test: simplify start_tests and add logic for checking ports in scenario.py
...
Signed-off-by: Matthew Stidham <stidmatt@gmail.com >
2022-07-12 15:45:33 +05:30
Matthew Stidham
d667912bca
regression_test: Fix links to logging directories
...
Signed-off-by: Matthew Stidham <stidmatt@gmail.com >
2022-07-12 15:45:33 +05:30
Matthew Stidham
164a58a723
regression_test: we only need to mkdir log_dir/name once, so I removed it on line 548
...
Signed-off-by: Matthew Stidham <stidmatt@gmail.com >
2022-07-12 15:45:33 +05:30
Matthew Stidham
bc608b913c
regression-test: logging links need to point to sub directory
...
Signed-off-by: Matthew Stidham <stidmatt@gmail.com >
2022-07-12 15:45:33 +05:30
Matthew Stidham
f26c994880
regression: tail needs a lowercase n, not an uppercase n to grab the last n lines
...
Signed-off-by: Matthew Stidham <stidmatt@gmail.com >
2022-07-12 15:45:33 +05:30
Matthew Stidham
f12a85fc9b
regression_test: Simplify logic to store logging information by writing it only once
...
Signed-off-by: Matthew Stidham <stidmatt@gmail.com >
2022-07-12 15:45:33 +05:30
Matthew Stidham
17d8a7c12e
scenario: Log "Starting Scenario" Every time scenario.py runs. This allows us to filter logging files for better debug information
...
Signed-off-by: Matthew Stidham <stidmatt@gmail.com >
2022-07-12 15:45:33 +05:30
Matthew Stidham
a2931eea9e
regression_test: Record log information about failed tests to LANforge device, search for Starting Scenario string which is automatically logged by scenario.py
...
Signed-off-by: Matthew Stidham <stidmatt@gmail.com >
2022-07-12 15:45:33 +05:30
Matthew Stidham
9dc92b3763
regression_test: Fix regression test logs address logic
...
Signed-off-by: Matthew Stidham <stidmatt@gmail.com >
2022-07-12 15:45:33 +05:30
Matthew Stidham
3a9357142b
regression_test: else statements don't require the word then, fix my bash mistake
...
Signed-off-by: Matthew Stidham <stidmatt@gmail.com >
2022-07-12 15:45:33 +05:30
Matthew Stidham
7076c08a3e
regression_test: save error logs to folder if a test fails and link to that folder in the regression report
...
Signed-off-by: Matthew Stidham <stidmatt@gmail.com >
2022-07-12 15:45:33 +05:30
Matthew Stidham
19dc262e51
regression_test: Add VAP_SSID argument for tests which create a VAP
...
Signed-off-by: Matthew Stidham <stidmatt@gmail.com >
2022-07-12 15:45:33 +05:30
Matthew Stidham
72febfd9c1
Revert "Revert "scenario.py: Move get_events and find_new_events to Realm""
...
This reverts commit 3d6eb6c140bffaa904da96efb6692f07f57b9096.
2022-07-12 15:45:33 +05:30
Chuck SmileyRekiere
2d16517da8
test_l3_longevity.py : pep8
...
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com >
2022-07-12 15:45:33 +05:30
Chuck SmileyRekiere
6c0e499938
test_l3_longevity.py : examples now show shelf.resource.radio for stations
...
and upstream ports.
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com >
2022-07-12 15:45:33 +05:30
Chuck SmileyRekiere
387d7ff71b
ct_us_001_tests.json, ct_us_004_tests.json : consistent number of 2g and 5g radios in ap_auto tests
...
based on radios 802.11 support.
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com >
2022-07-12 15:45:32 +05:30
Chuck SmileyRekiere
474cc09811
ct_us_002_tests.json : consistent number of 2g and 5g radios in ap_auto tests
...
updated 2g max_stations to 4
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com >
2022-07-12 15:45:32 +05:30
Chuck SmileyRekiere
817aa9bab6
ct_us_scripts.json : disable test_l3_powersave_traffic hardcodes station to
...
149 , until that is fixed.
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com >
2022-07-12 15:45:32 +05:30
Jed Reynolds
8c8b5279b4
regression_test.sh: adds meta tag to discourage browser caching
...
Signed-off-by: Jed Reynolds <jed@bitratchet.com >
2022-07-12 15:45:32 +05:30
Matthew Stidham
bfc51a6c7b
Revert "scenario.py: Move get_events and find_new_events to Realm"
...
Breaks things
This reverts commit 37026e108066be837936dde4bf73fd464d0746f7.
2022-07-12 15:45:32 +05:30
Matthew Stidham
0a3ce42238
sta_connect2: Set station_profile.sta_prefix
...
Signed-off-by: Matthew Stidham <stidmatt@gmail.com >
2022-07-12 15:45:32 +05:30
Matthew Stidham
08b38b5044
scenario.py: Move get_events and find_new_events to Realm
...
Signed-off-by: Matthew Stidham <stidmatt@gmail.com >
2022-07-12 15:45:32 +05:30
Matthew Stidham
14295a3ec6
create_l3_stations: num_sta variable should always be accurate
...
Signed-off-by: Matthew Stidham <stidmatt@gmail.com >
2022-07-12 15:45:32 +05:30
Chuck SmileyRekiere
a9e5ad3935
test_l3.py : autopep8 linting
...
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com >
2022-07-12 15:45:32 +05:30
Chuck SmileyRekiere
a82d0b9673
test_l3.py : longevity was still in this script
...
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com >
2022-07-12 15:45:32 +05:30
Matthew Stidham
b5fcfa133e
regression_test: test_l3_unicast_traffic_gen: update arguments
...
Signed-off-by: Matthew Stidham <stidmatt@gmail.com >
2022-07-12 15:45:32 +05:30
Matthew Stidham
b709834d25
test_l3_unicast_traffic_gen:
...
Change inheritance to realm because we were using local_realm, and it was inheriting from LFCliBase. Its better to just inherit directly from Realm since Realm inherits LFCliBase
Use the create_basic_argparse function from Realm so we have standard command line args instead of reinventing the wheel.
Don't use the radio flag for something which is inherently different from what radio is used for in our other scripts, that was confusing.
Signed-off-by: Matthew Stidham <stidmatt@gmail.com >
2022-07-12 15:45:32 +05:30
Matthew Stidham
c900dc06b6
regression_test: add test_l3_unicast_traffic_gen to regression_test
...
Signed-off-by: Matthew Stidham <stidmatt@gmail.com >
2022-07-12 15:45:32 +05:30
Matthew Stidham
a8663dae67
test_l3_unicast_traffic_gen: Fix regresisons by fixing the realm.wait_for_ip call
...
Signed-off-by: Matthew Stidham <stidmatt@gmail.com >
2022-07-12 15:45:32 +05:30
Ben Greear
749f611662
test_generic: Use auto-timeout for wait_for_ips.
...
And pass in debugging flag to the wait_until_ports_admin_up
method.
Signed-off-by: Ben Greear <greearb@candelatech.com >
2022-07-12 15:45:32 +05:30
Matthew Stidham
f22109c884
test_generic: wait_for_ip will inherit debug status from the class
...
Signed-off-by: Matthew Stidham <stidmatt@gmail.com >
2022-07-12 15:45:32 +05:30
Matthew Stidham
b279f44604
test_ip_variable_time: wait_for_ip needs to have debug match that of test_ip_variable_time
...
Signed-off-by: Matthew Stidham <stidmatt@gmail.com >
2022-07-12 15:45:30 +05:30
Matthew Stidham
fe9696f2d6
sta_connect: When querying for ports port,ip,ap, don't spout debug output when the port doesn't exist. The test runs whether this works or not.
...
Signed-off-by: Matthew Stidham <stidmatt@gmail.com >
2022-07-12 15:45:24 +05:30
Matthew Stidham
47c49b57e5
regression_test: Run git pull --rebase at the beginning of the script, as a safety check
...
Signed-off-by: Matthew Stidham <stidmatt@gmail.com >
2022-07-12 15:45:24 +05:30
Ben Greear
5056a01e94
sta-scan-test: Allow using existing stations.
...
Lots of changes to allow this script to scan on existing stations
on multiple resources.
Add --use_existing_station option.
Fix help to show how to properly specify multiple stations with
--sta_name
Comment out convoluted logic that tried to find radio info for stations.
This is not needed for any purpose that I can find, and it did not
allow me to specify sta_name with EID format.
Start scan on all stations, then do sleep time, then grab results.
This allows concurrent scanning on multiple resources/radios.
Print more info in text based output, add station resource and name
to output so we can decipher multiple radio output.
Add note about how .csv output is broken in this case, the logic
needs to be improved to append results for all stations and write a single file.
Add --scan_time argument to specify sleep time (defaults to 15 seconds
to match the original hard-coded value).
Signed-off-by: Ben Greear <greearb@candelatech.com >
2022-07-12 15:45:23 +05:30
Scott Wedge
5ea8ff21a7
test_l4.py: update help output, text and whitespace updates
...
Signed-off-by: Scott Wedge <wedges@candelatech.com >
2022-07-12 15:45:17 +05:30
Chuck SmileyRekiere
e86e2b19c1
test_l3_scenario_throughput.py : commented out ploting as ploting uses bokeh
...
the test was unmodified , and the xlsx report still generated. May need
to update test to support plotly.
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com >
2022-07-12 15:45:17 +05:30
Chuck SmileyRekiere
0810876412
ct_us_003_tests.json: ap_auto , one station per radio for AX and mdk
...
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com >
2022-07-12 15:45:17 +05:30
Chuck SmileyRekiere
9f15163986
ct_us_XXX_tests.json: changed default connect time in AP tests to 500ms
...
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com >
2022-07-12 15:45:17 +05:30
Chuck SmileyRekiere
254ce87563
ct_us_004_tests.json: have only basic connect ap test on nightly
...
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com >
2022-07-12 15:45:17 +05:30
Chuck SmileyRekiere
6353e2c973
ct_us_002_tests.json: changed station count for 2.4g radions to be the number
...
of working 2.4g radios.
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com >
2022-07-12 15:45:17 +05:30
Chuck SmileyRekiere
3e5833e0a6
lf_check.py : add test suite to the title on html and pdf
...
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com >
2022-07-12 15:45:17 +05:30
Matthew Stidham
a77b12e964
regression_test: Use BSSID variable wherever applicable in script
...
Signed-off-by: Matthew Stidham <stidmatt@gmail.com >
2022-07-12 15:45:17 +05:30
Matthew Stidham
f5e87fb594
regression_test: Always use the mgr flag when runnin scenario.py
...
Signed-off-by: Matthew Stidham <stidmatt@gmail.com >
2022-07-12 15:45:17 +05:30
Matthew Stidham
71c15f4a8c
test_ipv4_ps: On pre-cleanup, do not trigger an error if the port doesn't exist
...
Signed-off-by: Matthew Stidham <stidmatt@gmail.com >
2022-07-12 15:45:17 +05:30
Chuck SmileyRekiere
a6c528d72d
lf_qa.py : test list for subtests did not need to re-sort the list, the
...
data was previously ordered by date.
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com >
2022-07-12 15:45:17 +05:30
Chuck SmileyRekiere
51759446b6
cv_to_grafana.py: cv_base_adjust_parser is resolved in cv_test_manager
...
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com >
2022-07-12 15:45:17 +05:30
Chuck SmileyRekiere
e854fe6a3f
ct_us_XXX_tests.json : no dual band radios to test band stearing according to
...
ap_auto test
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com >
2022-07-12 15:45:17 +05:30
Chuck SmileyRekiere
e3c2a2b565
ct_us_XXX_tests.json: updated ap_auto timeout for basic connect to 20 min
...
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com >
2022-07-12 15:45:17 +05:30