Commit Graph

216 Commits

Author SHA1 Message Date
Matthew Stidham
d667912bca regression_test: Fix links to logging directories
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
164a58a723 regression_test: we only need to mkdir log_dir/name once, so I removed it on line 548
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
bc608b913c regression-test: logging links need to point to sub directory
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
f26c994880 regression: tail needs a lowercase n, not an uppercase n to grab the last n lines
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
f12a85fc9b regression_test: Simplify logic to store logging information by writing it only once
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
a2931eea9e regression_test: Record log information about failed tests to LANforge device, search for Starting Scenario string which is automatically logged by scenario.py
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
9dc92b3763 regression_test: Fix regression test logs address logic
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
3a9357142b regression_test: else statements don't require the word then, fix my bash mistake
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
7076c08a3e regression_test: save error logs to folder if a test fails and link to that folder in the regression report
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
19dc262e51 regression_test: Add VAP_SSID argument for tests which create a VAP
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Jed Reynolds
8c8b5279b4 regression_test.sh: adds meta tag to discourage browser caching
Signed-off-by: Jed Reynolds <jed@bitratchet.com>
2022-07-12 15:45:32 +05:30
Matthew Stidham
b5fcfa133e regression_test: test_l3_unicast_traffic_gen: update arguments
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:32 +05:30
Matthew Stidham
c900dc06b6 regression_test: add test_l3_unicast_traffic_gen to regression_test
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:32 +05:30
Matthew Stidham
47c49b57e5 regression_test: Run git pull --rebase at the beginning of the script, as a safety check
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:24 +05:30
Matthew Stidham
a77b12e964 regression_test: Use BSSID variable wherever applicable in script
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:17 +05:30
Matthew Stidham
f5e87fb594 regression_test: Always use the mgr flag when runnin scenario.py
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:17 +05:30
Matthew Stidham
9851cee303 regression_text: add in end text function regression commands file
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:44:27 +05:30
Matthew Stidham
5edff0b54c regression_test: Don't test ipv6 and ttls for now
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:44:27 +05:30
Matthew Stidham
798e4d81c8 regression_test: Ensure pip is up to date before updating scripts
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:44:27 +05:30
Matthew Stidham
9354c02bd7 regression_test: Use mgr flag in sta_scan_test and measure_station_time_up
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:44:27 +05:30
Matthew Stidham
19678db8ce regression_test: sta_connect needs a manual BSSID
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:44:26 +05:30
Matthew Stidham
c07a89cf6b regression_test.sh: Remove run_cv_scenairo.py and rvr_scenario.py
We have one week until py3.6 gets deprecated. We need a fully  green board to compare against ASAP

Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:44:26 +05:30
Matthew Stidham
a72233f504 regression_test: Add run_cv_scenario.py
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-16 16:42:37 -08:00
Matthew Stidham
6f86f2aa05 regression_test: test_fileio macvlan IP will be on 10.40 network instead
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-16 09:46:19 -08:00
Matthew Stidham
40a9a68981 regression_test: more debug
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-14 11:43:20 -08:00
Matthew Stidham
c7ea081bd1 regression_test: Better command line echoing
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-14 10:28:36 -08:00
Matthew Stidham
4bba61d9e9 regression_test: Print ERROR in status column if stations could not acquire IPs
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-14 10:26:26 -08:00
Matthew Stidham
e724113a5f regression_test: Test sta_connect2.py
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-14 09:02:18 -08:00
Jed Reynolds
254681a205 regression_test.sh: adds sorting to bottom, fixes missing tbody end tag
Signed-off-by: Jed Reynolds <jed@bitratchet.com>
2021-12-13 20:22:46 -08:00
Matthew Stidham
bfccba0f76 regression_test: Improve resource specification
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-09 10:52:07 -08:00
Matthew Stidham
c8946f0a69 regression_test: add resource flag
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-09 10:50:38 -08:00
Matthew Stidham
ad30e6fc52 regression_test: Be able to use multiple realms on one device
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-09 10:42:24 -08:00
Matthew Stidham
6ceb57adbc regression_test: Echo "LANforge error" on screen when LANforge spits out a warning or error
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-09 09:44:07 -08:00
Matthew Stidham
13a4d79715 regression_test: Fix partial failure logic. Use Regex
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-08 16:42:28 -08:00
Matthew Stidham
5f9fd108a8 regression_test: Include location of python environment in system information table
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-08 13:27:01 -08:00
Matthew Stidham
ea91fb8824 regression_test: Our influx host is not working... not posting to influx, at least for now
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-08 11:37:25 -08:00
Matthew Stidham
58d12e339e regression_test: c7-graphana is no longer a valid hostname. Using an IP address instead
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-08 11:35:51 -08:00
Matthew Stidham
2d52f7369c regression_test: Fix LANforge ERror Messages column so we have a better understanding where the error is coming from
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-08 09:33:26 -08:00
Matthew Stidham
828ce68532 regression_test: Check to see if the error is due to LANforge or not
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-07 17:27:07 -08:00
Matthew Stidham
fc7f73f175 regression_test: Remove unused LANFORGE_DATA variable
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-07 16:17:12 -08:00
Matthew Stidham
3bca34baa4 regression_test: IP address in device table
Start title with Hostname

Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-07 16:14:19 -08:00
Matthew Stidham
bf6ee97298 regression_test: Fix system information table
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-07 14:48:57 -08:00
Matthew Stidham
4aa44b0eb4 regression_test: Fix curly brace
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-07 13:31:40 -08:00
Matthew Stidham
372920b7a8 regression_test: create_chamberview is dependent on create_chamberview_dut. run them together without resetting the lanforge between commands.
Run create_chamberview_dut before create_chamberview

Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-07 13:29:03 -08:00
Matthew Stidham
2e0f643484 regression_test: Create station and sensitivity
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-07 13:19:50 -08:00
Matthew Stidham
a4bded8f88 regression_test: Create station and dataplane
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-07 13:18:18 -08:00
Matthew Stidham
f1e42e994c regression_test: create_chamberview: Delete old instance of scenario if it already exists
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-07 13:14:58 -08:00
Matthew Stidham
f0f613d339 regression_test: Improve create_chamberview.py command
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-07 13:00:46 -08:00
Matthew Stidham
9e3c008ffb regression_test: Improve create_chamberview.py command
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-07 12:58:28 -08:00
Matthew Stidham
20ba391fd4 regression_test: Fix html table formatting
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-07 12:54:44 -08:00