Commit Graph

2995 Commits

Author SHA1 Message Date
Ben Greear
c5ddccbdfd generic-cx: code cleanup and return error checking.
Clean up monitor logic in gen_cx profile to remove useless sleeps
and rename a variable that indicated it was msec but which was actually
seconds.

test_generic gets better error checking and also fixes bugs in how it
monitors the connection.  More work yet is needed for making the
monitor do a good pass/fail logic.

Signed-off-by: Ben Greear <greearb@candelatech.com>
2022-07-12 15:45:45 +05:30
Ben Greear
d532d7f8bf logging: Add set_json logic to lf_logger_config
This will be common code, put it in the helper class.

Signed-off-by: Ben Greear <greearb@candelatech.com>
2022-07-12 15:45:45 +05:30
Ben Greear
2f3eb58c41 Add --log_level option to lfcli base class.
Let user specify the level of logging desired.
Test implementaiton in example_security_connection.py

Signed-off-by: Ben Greear <greearb@candelatech.com>
2022-07-12 15:45:45 +05:30
Chuck SmileyRekiere
24e75a8ab3 create_l4.py : changed prints to logger
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:45 +05:30
Ben Greear
793a215e2b Add logging to example_security_connection script.
And add some more error checking with potential to exit
early if requested.

Signed-off-by: Ben Greear <greearb@candelatech.com>
2022-07-12 15:45:45 +05:30
Logan Lipke
b8787de105 lf_webpage.py: Added multi resource compatibility, started logging implementation, still WIP 2022-07-12 15:45:45 +05:30
Matthew Stidham
ff56cdccfb test_l3_unicast_traffic_gen: Fix improper station creation in test_l3_unicast_traffic_gen
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:45 +05:30
Matthew Stidham
e824080c24 regression_test: Use eval so that commands with quotes are properly executed
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:45 +05:30
Chuck SmileyRekiere
3426f22bcc test_l3.py : pep8 , white space changes
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:45 +05:30
Chuck SmileyRekiere
109d24e505 test_l3.py added exit(0) for pass , exit(1) for fail
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:45 +05:30
Matthew Stidham
f4ecff6bb4 regression-test: Always produce an HTML report
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:45 +05:30
Matthew Stidham
56f8c0a820 regression_test: don't quote the command when not in an eval command
add test_l3 to regression_test

Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:45 +05:30
Matthew Stidham
ae78aee979 regression_test: Fix scenario.py method call
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:45 +05:30
Matthew Stidham
261b491b23 create_l3_stations: remove trailing semicolons and make argumentse explicit
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:45 +05:30
Ben Greear
615dd1c9c3 regression-test: check test script return code to detect failure.
Also:  merge stderr/stdout, add more specific help example,
allow configuring report dir, add safety check for missing 'jq'.

Signed-off-by: Ben Greear <greearb@candelatech.com>
2022-07-12 15:45:45 +05:30
Chuck SmileyRekiere
57f8a83020 lf_logger_config_test.py : removed spacing from simple logger format, added filename
lf_logger_config_test.py : updated to show example of using lf_logger_config.json one directy up
lf_logger_config.json , lf_logger_config_example.json : updated with simple format

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:45 +05:30
Ben Greear
d697963cec create-cx: Add return code checking for cx and endp creation.
Check for false value in create_l3_stations and return error code
upon failure.

Add configurable timeout to waiting for cx/endp logic.

Signed-off-by: Ben Greear <greearb@candelatech.com>
2022-07-12 15:45:45 +05:30
Ben Greear
4bb9cb4b82 l3-stations: error checking for station creation.
In station_profile create method, pay attention to result of
wait_until_ports_appear.  If it returns False, we know creation
has failed somehow, so we do not need to do the extra checking
that was in the create() method.

create_l3_stations adds logic to check return code of station
create logic, and exit with error code if it could not
create them as expected.

Signed-off-by: Ben Greear <greearb@candelatech.com>
2022-07-12 15:45:45 +05:30
Chuck SmileyRekiere
d3035aca57 test_l3_longevity.py : changed printed errors to raise ValueError so script
exits on mis configuration

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:45 +05:30
Chuck SmileyRekiere
02dd8e41d5 sandbox/lf_logger_config_example.json : multiple loggers in one module test
sandbox/lf_sublogger_2.py : testing multiple loggers

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:45 +05:30
Chuck SmileyRekiere
1ced503244 lf_logger_config.py : default root logger to info form warning
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:45 +05:30
Matthew Stidham
43e6b7ef09 test_generic: Switch from print statements to logger statements
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:45 +05:30
Matthew Stidham
df5879fc77 sta_connect.setup: check_exists should be used as an argument in rm_port, the existing code was probably from before we had the check_exists method
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:45 +05:30
Chuck SmileyRekiere
0c9215abb5 lf_logger_config_example.json : sandbox example for using logging config
lf_logger_config_test.py : example program
lf_sublogger.py : included module sample
lf_sublogger_2.py : included an inherited module same.

This code is for becomming familiar with the logging module
2022-07-12 15:45:45 +05:30
Matthew Stidham
b7236d5007 sta_connect2: wait_until_ports_appear needs list of ports
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:45 +05:30
Chuck SmileyRekiere
a4eb0fceb9 lf_logger_config.json : the defaults in the file may need to be worked out,
or just that there will be custome configurations
test_l3.py : intial pass of using the logger functionality

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:45 +05:30
Chuck SmileyRekiere
eb63792064 test_l3.py : updated to use logger
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:45 +05:30
Matthew Stidham
3201f297cc sta_scan_test: Fix improper wait_until_ports_appear port_list input
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:45 +05:30
Chuck SmileyRekiere
7e175950a7 lf_logger_config.py : intial checkin of the lf logger library for
minimal wrapper around the python logger
lf_logger_config.json : example of how to set different log levels for
various modules.

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:43 +05:30
Matthew Stidham
dbc9c21b80 sta_scan_test: Don't use positional arguments. We were passing the port list into the URL field for wait_until_ports_appear
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
199dcb7ca1 sta_connect2: debug needs to be done as store_true, just like the rest of lanforge_scripts
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
ad845bafa3 regression_test: If the test is a success, reset LOGGING to a blank string
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
8fb5a4c5f8 Both files: Fix wait_until_ports_disappear arguments, debug is called by debug_, not debug
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
563111c851 tip_statio_powersave: pass debug to arguments
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
05fa06d8a6 test_l4: Pass debug information to realm
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
32e772b809 test_l3_WAN_LAN: Pass debug to realm
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
a124ccde42 test_ip_variable_time: Pass debug to rm_port
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
782c0b1d2c test_ipv4_ttls: Pass debug information to functions
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
ff0b787d8a test_ipv4_ps: Pass debug information to rm_port
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
2b6a74914b test_ip_connection: Pass debug information to rm_port command
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
7233c31940 sta_scan_test: Pass debug argument to wait_until_ports_appear
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
07f6bf3ca6 sta_connect2: Pass debug argument to wait_until_ports_disappear
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
35e21fdd68 sta_connect2: use debug argument flag and pass on to functions
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
44a260be66 create_vr: Create more debug output when debug is on
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
90cf89fa05 sta_connect: add debug when wait_until_something_something
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
7d4cf97a23 test_l3_unicast_traffic_gen: Output more debug output when debug is turned on
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
ac9d722a18 regression_test: add back logging recording logic
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
0c28b8745c scenario.py: Python logic allows us to easily compare lists of integers the way we want to
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
c9cdfe40be scenario.py: Use logic to test versions so that when we upgrade LANforge to 5.4.6 that scenario will still use the events tab without manual fixing.
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
f86e86545e scenario.py: Also check if LANforge version is 5.4.5 when determining whether to use events json data or not
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30