Commit Graph

2933 Commits

Author SHA1 Message Date
Matthew Stidham
cc3d02a577 test_l3_longevity: Don't use a stand-in variable for args.debug. Call it directly
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
0438e6f7db create_l3_stations: declare the function has begun in debug, use correct grammar at the end of the function
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
24f7a64092 regression-test: if exit on error is 0, run the test
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
0563d0bb46 regression_test: bash varibles need to be in curly braces
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
739b12d8e1 regression_test: Add exit on error flag
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
c7ae54338e regression_test: Name log from gui log as gui_log.txt
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
530551dd48 regression_test: Save LANforge logs to logging directory
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
95777f8b31 scenario.py: Print existing ports at the end of the test when debug is turned on
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
6c8e2dd9cb regression_test: Append scenario.py output to STDOUT file
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
aa5b4b14ef regression_test: log_filter isn't ready for production
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
f53050bb3d test_l3_unicast_traffic_gen: Add comment clearly stating what pre_cleanup does
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
6933884f70 test_l3_unicast_traffic_gen: Add comment explaining why we remove any existing br0 at the beginning of the test
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
8ad0da6651 test_l3_unicast_traffic_gen: add pre_cleanup function
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
50bd38aa1d test_l3_unicast_traffic_gen: Explicit is better than implicit. Don't pass in self.resource when it isn't a flag in the argument.
Don't use positional flags.

Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
0ac894d599 regression_test: Grab run_client and run_mgr log files
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
3467b5c13d regression_test: Cleanup log files so we only have the text which is relevant to the test which just ran
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
bfed01c138 log_filter: Make log_filter executable
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
a8dbc480d0 log_filter: Initial Commit, filter a LANforge log file by timestamp
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Chuck SmileyRekiere
6791c2e3e8 ct_us_xxx_rig.json : updated email list
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
d8fa486d13 regression_test: run in virtual environment if virtual environment exists
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
10dc719e26 lf_report_test: Remove unused imports
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Chuck SmileyRekiere
9212fc19fd ct_us_XXX_tests.json : --stations is not needed for wifi capacity tests,
This may have prevented the tests from completing on media tech and ax210

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
cf32498e0f scenario.py: Check if 'phantom' is in port.keys() before the query
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
f1bb25aa2f scenario.py: Improve is_port_phantom logic in case there are two ports with one name in the output
Print out the name of the port which is phantom (if applicable)

Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
381ae85172 regression_test: Make a simpler call for the beginning of function test() when we call scenario.py
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
f5f29ea9ee regression_test: fix using = in python argparse argument error
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
c31fb26d20 scenario.py create are_any_ports_phantom and is_port_phantom functions
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
58a6dd07cb regression_test: simplify start_tests and add logic for checking ports in scenario.py
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
d667912bca regression_test: Fix links to logging directories
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
164a58a723 regression_test: we only need to mkdir log_dir/name once, so I removed it on line 548
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
bc608b913c regression-test: logging links need to point to sub directory
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
f26c994880 regression: tail needs a lowercase n, not an uppercase n to grab the last n lines
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
f12a85fc9b regression_test: Simplify logic to store logging information by writing it only once
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
17d8a7c12e scenario: Log "Starting Scenario" Every time scenario.py runs. This allows us to filter logging files for better debug information
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
a2931eea9e regression_test: Record log information about failed tests to LANforge device, search for Starting Scenario string which is automatically logged by scenario.py
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
9dc92b3763 regression_test: Fix regression test logs address logic
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
3a9357142b regression_test: else statements don't require the word then, fix my bash mistake
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
7076c08a3e regression_test: save error logs to folder if a test fails and link to that folder in the regression report
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
19dc262e51 regression_test: Add VAP_SSID argument for tests which create a VAP
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
72febfd9c1 Revert "Revert "scenario.py: Move get_events and find_new_events to Realm""
This reverts commit 3d6eb6c140bffaa904da96efb6692f07f57b9096.
2022-07-12 15:45:33 +05:30
Chuck SmileyRekiere
2d16517da8 test_l3_longevity.py : pep8
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:33 +05:30
Chuck SmileyRekiere
6c0e499938 test_l3_longevity.py : examples now show shelf.resource.radio for stations
and upstream ports.

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:33 +05:30
Chuck SmileyRekiere
387d7ff71b ct_us_001_tests.json, ct_us_004_tests.json : consistent number of 2g and 5g radios in ap_auto tests
based on radios 802.11 support.

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:32 +05:30
Chuck SmileyRekiere
474cc09811 ct_us_002_tests.json : consistent number of 2g and 5g radios in ap_auto tests
updated 2g max_stations to 4

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:32 +05:30
Chuck SmileyRekiere
817aa9bab6 ct_us_scripts.json : disable test_l3_powersave_traffic hardcodes station to
149 , until that is fixed.

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:32 +05:30
Jed Reynolds
8c8b5279b4 regression_test.sh: adds meta tag to discourage browser caching
Signed-off-by: Jed Reynolds <jed@bitratchet.com>
2022-07-12 15:45:32 +05:30
Matthew Stidham
bfc51a6c7b Revert "scenario.py: Move get_events and find_new_events to Realm"
Breaks things

This reverts commit 37026e108066be837936dde4bf73fd464d0746f7.
2022-07-12 15:45:32 +05:30
Matthew Stidham
0a3ce42238 sta_connect2: Set station_profile.sta_prefix
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:32 +05:30
Matthew Stidham
08b38b5044 scenario.py: Move get_events and find_new_events to Realm
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:32 +05:30
Matthew Stidham
14295a3ec6 create_l3_stations: num_sta variable should always be accurate
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:32 +05:30