Commit Graph

2945 Commits

Author SHA1 Message Date
Matthew Stidham
38724f7daa regression_test: Check if user is using anaconda, if so, install lanforge-scripts appropriately
if the user is not using any virtual environment, install from pip using --user flag

Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
ea9bad3ce6 regression_test: append to filename.txt, don't overwrite data from scenario.py
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
63211997a9 regression_test: Use correct arguments for lf_dataplane_test
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
4c1ab7edbc regression_test: Fix mamin logic of regression-test which was broken. Restore it back to where it was and add in the new features
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
2901944573 test_l3_powersave_traffic: make the local_realm input argument for modules explicit
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
a6241dc08c regression_test: Store report_data in report_data
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
c89b3930e0 regression_test: fix logic, fix arguments
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
a19b9e42ab test_l3_powersave_traffic: print ports when debug is on at beginning and end of test
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
91259d1474 regression_test: Save report-data to report-data.
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
ffacc6dde3 regression_test: ADd debug to three commands
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
9c5223637f Revert "regression_test: Add debug to three more commands": Broke debugging
This reverts commit da8109a14b295b83c6e28af5de9eeef9acb9b8ea.
2022-07-12 15:45:33 +05:30
Matthew Stidham
27f24bf2bd regression_test: Add debug to three more commands
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
cc3d02a577 test_l3_longevity: Don't use a stand-in variable for args.debug. Call it directly
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
0438e6f7db create_l3_stations: declare the function has begun in debug, use correct grammar at the end of the function
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
24f7a64092 regression-test: if exit on error is 0, run the test
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
0563d0bb46 regression_test: bash varibles need to be in curly braces
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
739b12d8e1 regression_test: Add exit on error flag
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
c7ae54338e regression_test: Name log from gui log as gui_log.txt
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
530551dd48 regression_test: Save LANforge logs to logging directory
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
95777f8b31 scenario.py: Print existing ports at the end of the test when debug is turned on
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
6c8e2dd9cb regression_test: Append scenario.py output to STDOUT file
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
aa5b4b14ef regression_test: log_filter isn't ready for production
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
f53050bb3d test_l3_unicast_traffic_gen: Add comment clearly stating what pre_cleanup does
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
6933884f70 test_l3_unicast_traffic_gen: Add comment explaining why we remove any existing br0 at the beginning of the test
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
8ad0da6651 test_l3_unicast_traffic_gen: add pre_cleanup function
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
50bd38aa1d test_l3_unicast_traffic_gen: Explicit is better than implicit. Don't pass in self.resource when it isn't a flag in the argument.
Don't use positional flags.

Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
0ac894d599 regression_test: Grab run_client and run_mgr log files
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
3467b5c13d regression_test: Cleanup log files so we only have the text which is relevant to the test which just ran
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
bfed01c138 log_filter: Make log_filter executable
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
a8dbc480d0 log_filter: Initial Commit, filter a LANforge log file by timestamp
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Chuck SmileyRekiere
6791c2e3e8 ct_us_xxx_rig.json : updated email list
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
d8fa486d13 regression_test: run in virtual environment if virtual environment exists
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
10dc719e26 lf_report_test: Remove unused imports
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Chuck SmileyRekiere
9212fc19fd ct_us_XXX_tests.json : --stations is not needed for wifi capacity tests,
This may have prevented the tests from completing on media tech and ax210

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
cf32498e0f scenario.py: Check if 'phantom' is in port.keys() before the query
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
f1bb25aa2f scenario.py: Improve is_port_phantom logic in case there are two ports with one name in the output
Print out the name of the port which is phantom (if applicable)

Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
381ae85172 regression_test: Make a simpler call for the beginning of function test() when we call scenario.py
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
f5f29ea9ee regression_test: fix using = in python argparse argument error
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
c31fb26d20 scenario.py create are_any_ports_phantom and is_port_phantom functions
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
58a6dd07cb regression_test: simplify start_tests and add logic for checking ports in scenario.py
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
d667912bca regression_test: Fix links to logging directories
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
164a58a723 regression_test: we only need to mkdir log_dir/name once, so I removed it on line 548
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
bc608b913c regression-test: logging links need to point to sub directory
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
f26c994880 regression: tail needs a lowercase n, not an uppercase n to grab the last n lines
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
f12a85fc9b regression_test: Simplify logic to store logging information by writing it only once
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
17d8a7c12e scenario: Log "Starting Scenario" Every time scenario.py runs. This allows us to filter logging files for better debug information
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
a2931eea9e regression_test: Record log information about failed tests to LANforge device, search for Starting Scenario string which is automatically logged by scenario.py
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
9dc92b3763 regression_test: Fix regression test logs address logic
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
3a9357142b regression_test: else statements don't require the word then, fix my bash mistake
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
7076c08a3e regression_test: save error logs to folder if a test fails and link to that folder in the regression report
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30