Commit Graph

2921 Commits

Author SHA1 Message Date
Matthew Stidham
8ad0da6651 test_l3_unicast_traffic_gen: add pre_cleanup function
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
50bd38aa1d test_l3_unicast_traffic_gen: Explicit is better than implicit. Don't pass in self.resource when it isn't a flag in the argument.
Don't use positional flags.

Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
0ac894d599 regression_test: Grab run_client and run_mgr log files
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
3467b5c13d regression_test: Cleanup log files so we only have the text which is relevant to the test which just ran
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
bfed01c138 log_filter: Make log_filter executable
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
a8dbc480d0 log_filter: Initial Commit, filter a LANforge log file by timestamp
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Chuck SmileyRekiere
6791c2e3e8 ct_us_xxx_rig.json : updated email list
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
d8fa486d13 regression_test: run in virtual environment if virtual environment exists
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
10dc719e26 lf_report_test: Remove unused imports
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Chuck SmileyRekiere
9212fc19fd ct_us_XXX_tests.json : --stations is not needed for wifi capacity tests,
This may have prevented the tests from completing on media tech and ax210

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
cf32498e0f scenario.py: Check if 'phantom' is in port.keys() before the query
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
f1bb25aa2f scenario.py: Improve is_port_phantom logic in case there are two ports with one name in the output
Print out the name of the port which is phantom (if applicable)

Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
381ae85172 regression_test: Make a simpler call for the beginning of function test() when we call scenario.py
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
f5f29ea9ee regression_test: fix using = in python argparse argument error
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
c31fb26d20 scenario.py create are_any_ports_phantom and is_port_phantom functions
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
58a6dd07cb regression_test: simplify start_tests and add logic for checking ports in scenario.py
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
d667912bca regression_test: Fix links to logging directories
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
164a58a723 regression_test: we only need to mkdir log_dir/name once, so I removed it on line 548
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
bc608b913c regression-test: logging links need to point to sub directory
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
f26c994880 regression: tail needs a lowercase n, not an uppercase n to grab the last n lines
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
f12a85fc9b regression_test: Simplify logic to store logging information by writing it only once
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
17d8a7c12e scenario: Log "Starting Scenario" Every time scenario.py runs. This allows us to filter logging files for better debug information
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
a2931eea9e regression_test: Record log information about failed tests to LANforge device, search for Starting Scenario string which is automatically logged by scenario.py
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
9dc92b3763 regression_test: Fix regression test logs address logic
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
3a9357142b regression_test: else statements don't require the word then, fix my bash mistake
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
7076c08a3e regression_test: save error logs to folder if a test fails and link to that folder in the regression report
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
19dc262e51 regression_test: Add VAP_SSID argument for tests which create a VAP
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
72febfd9c1 Revert "Revert "scenario.py: Move get_events and find_new_events to Realm""
This reverts commit 3d6eb6c140bffaa904da96efb6692f07f57b9096.
2022-07-12 15:45:33 +05:30
Chuck SmileyRekiere
2d16517da8 test_l3_longevity.py : pep8
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:33 +05:30
Chuck SmileyRekiere
6c0e499938 test_l3_longevity.py : examples now show shelf.resource.radio for stations
and upstream ports.

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:33 +05:30
Chuck SmileyRekiere
387d7ff71b ct_us_001_tests.json, ct_us_004_tests.json : consistent number of 2g and 5g radios in ap_auto tests
based on radios 802.11 support.

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:32 +05:30
Chuck SmileyRekiere
474cc09811 ct_us_002_tests.json : consistent number of 2g and 5g radios in ap_auto tests
updated 2g max_stations to 4

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:32 +05:30
Chuck SmileyRekiere
817aa9bab6 ct_us_scripts.json : disable test_l3_powersave_traffic hardcodes station to
149 , until that is fixed.

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:32 +05:30
Jed Reynolds
8c8b5279b4 regression_test.sh: adds meta tag to discourage browser caching
Signed-off-by: Jed Reynolds <jed@bitratchet.com>
2022-07-12 15:45:32 +05:30
Matthew Stidham
bfc51a6c7b Revert "scenario.py: Move get_events and find_new_events to Realm"
Breaks things

This reverts commit 37026e108066be837936dde4bf73fd464d0746f7.
2022-07-12 15:45:32 +05:30
Matthew Stidham
0a3ce42238 sta_connect2: Set station_profile.sta_prefix
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:32 +05:30
Matthew Stidham
08b38b5044 scenario.py: Move get_events and find_new_events to Realm
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:32 +05:30
Matthew Stidham
14295a3ec6 create_l3_stations: num_sta variable should always be accurate
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:32 +05:30
Chuck SmileyRekiere
a9e5ad3935 test_l3.py : autopep8 linting
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:32 +05:30
Chuck SmileyRekiere
a82d0b9673 test_l3.py : longevity was still in this script
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:32 +05:30
Matthew Stidham
b5fcfa133e regression_test: test_l3_unicast_traffic_gen: update arguments
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:32 +05:30
Matthew Stidham
b709834d25 test_l3_unicast_traffic_gen:
Change inheritance to realm because we were using local_realm, and it was inheriting from LFCliBase. Its better to just inherit directly from Realm since Realm inherits LFCliBase
Use the create_basic_argparse function from Realm so we have standard command line args instead of reinventing the wheel.
Don't use the radio flag for something which is inherently different from what radio is used for in our other scripts, that was confusing.
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:32 +05:30
Matthew Stidham
c900dc06b6 regression_test: add test_l3_unicast_traffic_gen to regression_test
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:32 +05:30
Matthew Stidham
a8663dae67 test_l3_unicast_traffic_gen: Fix regresisons by fixing the realm.wait_for_ip call
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:32 +05:30
Ben Greear
749f611662 test_generic: Use auto-timeout for wait_for_ips.
And pass in debugging flag to the wait_until_ports_admin_up
method.

Signed-off-by: Ben Greear <greearb@candelatech.com>
2022-07-12 15:45:32 +05:30
Matthew Stidham
f22109c884 test_generic: wait_for_ip will inherit debug status from the class
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:32 +05:30
Matthew Stidham
b279f44604 test_ip_variable_time: wait_for_ip needs to have debug match that of test_ip_variable_time
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:30 +05:30
Matthew Stidham
fe9696f2d6 sta_connect: When querying for ports port,ip,ap, don't spout debug output when the port doesn't exist. The test runs whether this works or not.
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:24 +05:30
Matthew Stidham
47c49b57e5 regression_test: Run git pull --rebase at the beginning of the script, as a safety check
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:24 +05:30
Ben Greear
5056a01e94 sta-scan-test: Allow using existing stations.
Lots of changes to allow this script to scan on existing stations
on multiple resources.

Add --use_existing_station option.

Fix help to show how to properly specify multiple stations with
--sta_name

Comment out convoluted logic that tried to find radio info for stations.
This is not needed for any purpose that I can find, and it did not
allow me to specify sta_name with EID format.

Start scan on all stations, then do sleep time, then grab results.
This allows concurrent scanning on multiple resources/radios.

Print more info in text based output, add station resource and name
to output so we can decipher multiple radio output.

Add note about how .csv output is broken in this case, the logic
needs to be improved to append results for all stations and write a single file.

Add --scan_time argument to specify sleep time (defaults to 15 seconds
to match the original hard-coded value).

Signed-off-by: Ben Greear <greearb@candelatech.com>
2022-07-12 15:45:23 +05:30