Commit Graph

2957 Commits

Author SHA1 Message Date
Matthew Stidham
c31fb26d20 scenario.py create are_any_ports_phantom and is_port_phantom functions
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
58a6dd07cb regression_test: simplify start_tests and add logic for checking ports in scenario.py
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
d667912bca regression_test: Fix links to logging directories
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
164a58a723 regression_test: we only need to mkdir log_dir/name once, so I removed it on line 548
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
bc608b913c regression-test: logging links need to point to sub directory
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
f26c994880 regression: tail needs a lowercase n, not an uppercase n to grab the last n lines
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
f12a85fc9b regression_test: Simplify logic to store logging information by writing it only once
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
17d8a7c12e scenario: Log "Starting Scenario" Every time scenario.py runs. This allows us to filter logging files for better debug information
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
a2931eea9e regression_test: Record log information about failed tests to LANforge device, search for Starting Scenario string which is automatically logged by scenario.py
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
9dc92b3763 regression_test: Fix regression test logs address logic
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
3a9357142b regression_test: else statements don't require the word then, fix my bash mistake
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
7076c08a3e regression_test: save error logs to folder if a test fails and link to that folder in the regression report
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
19dc262e51 regression_test: Add VAP_SSID argument for tests which create a VAP
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
72febfd9c1 Revert "Revert "scenario.py: Move get_events and find_new_events to Realm""
This reverts commit 3d6eb6c140bffaa904da96efb6692f07f57b9096.
2022-07-12 15:45:33 +05:30
Chuck SmileyRekiere
2d16517da8 test_l3_longevity.py : pep8
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:33 +05:30
Chuck SmileyRekiere
6c0e499938 test_l3_longevity.py : examples now show shelf.resource.radio for stations
and upstream ports.

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:33 +05:30
Chuck SmileyRekiere
387d7ff71b ct_us_001_tests.json, ct_us_004_tests.json : consistent number of 2g and 5g radios in ap_auto tests
based on radios 802.11 support.

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:32 +05:30
Chuck SmileyRekiere
474cc09811 ct_us_002_tests.json : consistent number of 2g and 5g radios in ap_auto tests
updated 2g max_stations to 4

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:32 +05:30
Chuck SmileyRekiere
817aa9bab6 ct_us_scripts.json : disable test_l3_powersave_traffic hardcodes station to
149 , until that is fixed.

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:32 +05:30
Jed Reynolds
8c8b5279b4 regression_test.sh: adds meta tag to discourage browser caching
Signed-off-by: Jed Reynolds <jed@bitratchet.com>
2022-07-12 15:45:32 +05:30
Matthew Stidham
bfc51a6c7b Revert "scenario.py: Move get_events and find_new_events to Realm"
Breaks things

This reverts commit 37026e108066be837936dde4bf73fd464d0746f7.
2022-07-12 15:45:32 +05:30
Matthew Stidham
0a3ce42238 sta_connect2: Set station_profile.sta_prefix
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:32 +05:30
Matthew Stidham
08b38b5044 scenario.py: Move get_events and find_new_events to Realm
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:32 +05:30
Matthew Stidham
14295a3ec6 create_l3_stations: num_sta variable should always be accurate
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:32 +05:30
Chuck SmileyRekiere
a9e5ad3935 test_l3.py : autopep8 linting
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:32 +05:30
Chuck SmileyRekiere
a82d0b9673 test_l3.py : longevity was still in this script
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:32 +05:30
Matthew Stidham
b5fcfa133e regression_test: test_l3_unicast_traffic_gen: update arguments
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:32 +05:30
Matthew Stidham
b709834d25 test_l3_unicast_traffic_gen:
Change inheritance to realm because we were using local_realm, and it was inheriting from LFCliBase. Its better to just inherit directly from Realm since Realm inherits LFCliBase
Use the create_basic_argparse function from Realm so we have standard command line args instead of reinventing the wheel.
Don't use the radio flag for something which is inherently different from what radio is used for in our other scripts, that was confusing.
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:32 +05:30
Matthew Stidham
c900dc06b6 regression_test: add test_l3_unicast_traffic_gen to regression_test
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:32 +05:30
Matthew Stidham
a8663dae67 test_l3_unicast_traffic_gen: Fix regresisons by fixing the realm.wait_for_ip call
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:32 +05:30
Ben Greear
749f611662 test_generic: Use auto-timeout for wait_for_ips.
And pass in debugging flag to the wait_until_ports_admin_up
method.

Signed-off-by: Ben Greear <greearb@candelatech.com>
2022-07-12 15:45:32 +05:30
Matthew Stidham
f22109c884 test_generic: wait_for_ip will inherit debug status from the class
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:32 +05:30
Matthew Stidham
b279f44604 test_ip_variable_time: wait_for_ip needs to have debug match that of test_ip_variable_time
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:30 +05:30
Matthew Stidham
fe9696f2d6 sta_connect: When querying for ports port,ip,ap, don't spout debug output when the port doesn't exist. The test runs whether this works or not.
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:24 +05:30
Matthew Stidham
47c49b57e5 regression_test: Run git pull --rebase at the beginning of the script, as a safety check
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:24 +05:30
Ben Greear
5056a01e94 sta-scan-test: Allow using existing stations.
Lots of changes to allow this script to scan on existing stations
on multiple resources.

Add --use_existing_station option.

Fix help to show how to properly specify multiple stations with
--sta_name

Comment out convoluted logic that tried to find radio info for stations.
This is not needed for any purpose that I can find, and it did not
allow me to specify sta_name with EID format.

Start scan on all stations, then do sleep time, then grab results.
This allows concurrent scanning on multiple resources/radios.

Print more info in text based output, add station resource and name
to output so we can decipher multiple radio output.

Add note about how .csv output is broken in this case, the logic
needs to be improved to append results for all stations and write a single file.

Add --scan_time argument to specify sleep time (defaults to 15 seconds
to match the original hard-coded value).

Signed-off-by: Ben Greear <greearb@candelatech.com>
2022-07-12 15:45:23 +05:30
Scott Wedge
5ea8ff21a7 test_l4.py: update help output, text and whitespace updates
Signed-off-by: Scott Wedge <wedges@candelatech.com>
2022-07-12 15:45:17 +05:30
Chuck SmileyRekiere
e86e2b19c1 test_l3_scenario_throughput.py : commented out ploting as ploting uses bokeh
the test was unmodified , and the xlsx report still generated. May need
to update test to support plotly.

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:17 +05:30
Chuck SmileyRekiere
0810876412 ct_us_003_tests.json: ap_auto , one station per radio for AX and mdk
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:17 +05:30
Chuck SmileyRekiere
9f15163986 ct_us_XXX_tests.json: changed default connect time in AP tests to 500ms
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:17 +05:30
Chuck SmileyRekiere
254ce87563 ct_us_004_tests.json: have only basic connect ap test on nightly
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:17 +05:30
Chuck SmileyRekiere
6353e2c973 ct_us_002_tests.json: changed station count for 2.4g radions to be the number
of working 2.4g radios.

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:17 +05:30
Chuck SmileyRekiere
3e5833e0a6 lf_check.py : add test suite to the title on html and pdf
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:17 +05:30
Matthew Stidham
a77b12e964 regression_test: Use BSSID variable wherever applicable in script
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:17 +05:30
Matthew Stidham
f5e87fb594 regression_test: Always use the mgr flag when runnin scenario.py
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:17 +05:30
Matthew Stidham
71c15f4a8c test_ipv4_ps: On pre-cleanup, do not trigger an error if the port doesn't exist
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:17 +05:30
Chuck SmileyRekiere
a6c528d72d lf_qa.py : test list for subtests did not need to re-sort the list, the
data was previously ordered by date.

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:17 +05:30
Chuck SmileyRekiere
51759446b6 cv_to_grafana.py: cv_base_adjust_parser is resolved in cv_test_manager
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:17 +05:30
Chuck SmileyRekiere
e854fe6a3f ct_us_XXX_tests.json : no dual band radios to test band stearing according to
ap_auto test

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:17 +05:30
Chuck SmileyRekiere
e3c2a2b565 ct_us_XXX_tests.json: updated ap_auto timeout for basic connect to 20 min
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:17 +05:30