Commit Graph

2637 Commits

Author SHA1 Message Date
Chuck SmileyRekiere
d0a6fee9b2 lf_check.py : full test duration broken out to h,m,s from just seconds
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-12-08 18:01:00 -07:00
Matthew Stidham
13a4d79715 regression_test: Fix partial failure logic. Use Regex
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-08 16:42:28 -08:00
Chuck SmileyRekiere
9d3ff010ef ct_us_001_tests.json : ap_auto update BSSID to BSSID_TO_USE
ct_us_004_test.json : ap_auto update BSSID to BSSID_TO_USE

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-12-08 17:38:48 -07:00
Chuck SmileyRekiere
5820c8e262 test_ip_variable_time.py : initial commit for setting specific channel
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-12-08 16:52:57 -07:00
Matthew Stidham
9ddfe06845 testgroup2: name_prefix cannot be blank
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-08 15:22:52 -08:00
Matthew Stidham
ebde0fea99 test_ipv4_ttls: Attempting to create stations after stations have already been built has been generating errors. This fixes the problem.
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-08 15:03:57 -08:00
Matthew Stidham
3201ee1e80 mine_regression_results: Support Python environment control variable
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-08 14:57:07 -08:00
Matthew Stidham
edadf4f545 testgroup2: Fix linting errors
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-08 13:29:48 -08:00
Matthew Stidham
5f9fd108a8 regression_test: Include location of python environment in system information table
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-08 13:27:01 -08:00
Matthew Stidham
8edb0cdb8d lf_graph.py: lf_graph had a very confusing assignment for init values which was unstable. Needs further work, but this will work for now.
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-08 13:01:33 -08:00
Matthew Stidham
ea91fb8824 regression_test: Our influx host is not working... not posting to influx, at least for now
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-08 11:37:25 -08:00
Matthew Stidham
58d12e339e regression_test: c7-graphana is no longer a valid hostname. Using an IP address instead
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-08 11:35:51 -08:00
Matthew Stidham
69ddad1009 lf_graph: Fix unused variables
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-08 11:03:13 -08:00
Matthew Stidham
4f76085982 lf_graph: Fix mutable default arguments
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-08 11:02:03 -08:00
Matthew Stidham
f50741bdae lf_graph: Remove redundant parentheses
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-08 11:02:03 -08:00
Matthew Stidham
2d52f7369c regression_test: Fix LANforge ERror Messages column so we have a better understanding where the error is coming from
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-08 09:33:26 -08:00
Matthew Stidham
4ae239c7c5 mine_regression_test: Move ips to argparser so a user can choose which devices they want to data mine. If none are selected, default to the devices we are currently using in the lab.
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-07 18:03:23 -08:00
Matthew Stidham
1f7ca179e8 mine_regression_results: Take advantage of the updates to regression reports which include system information
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-07 17:56:32 -08:00
Matthew Stidham
828ce68532 regression_test: Check to see if the error is due to LANforge or not
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-07 17:27:07 -08:00
Chuck SmileyRekiere
446e662d98 lf_qa.py : updated exception message
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-12-07 17:32:58 -07:00
Chuck SmileyRekiere
720147e802 lf_qa.py : updated exceptions to print out reasonable explantions
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-12-07 17:30:27 -07:00
Matthew Stidham
fc7f73f175 regression_test: Remove unused LANFORGE_DATA variable
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-07 16:17:12 -08:00
Matthew Stidham
3bca34baa4 regression_test: IP address in device table
Start title with Hostname

Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-07 16:14:19 -08:00
Matthew Stidham
bf6ee97298 regression_test: Fix system information table
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-07 14:48:57 -08:00
Matthew Stidham
4aa44b0eb4 regression_test: Fix curly brace
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-07 13:31:40 -08:00
Matthew Stidham
372920b7a8 regression_test: create_chamberview is dependent on create_chamberview_dut. run them together without resetting the lanforge between commands.
Run create_chamberview_dut before create_chamberview

Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-07 13:29:03 -08:00
Matthew Stidham
2e0f643484 regression_test: Create station and sensitivity
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-07 13:19:50 -08:00
Matthew Stidham
a4bded8f88 regression_test: Create station and dataplane
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-07 13:18:18 -08:00
Matthew Stidham
f1e42e994c regression_test: create_chamberview: Delete old instance of scenario if it already exists
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-07 13:14:58 -08:00
Matthew Stidham
f0f613d339 regression_test: Improve create_chamberview.py command
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-07 13:00:46 -08:00
Matthew Stidham
9e3c008ffb regression_test: Improve create_chamberview.py command
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-07 12:58:28 -08:00
Matthew Stidham
20ba391fd4 regression_test: Fix html table formatting
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-07 12:54:44 -08:00
Matthew Stidham
4f6ee25c81 regression_test: Save hostname to system information table
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-07 12:50:36 -08:00
Matthew Stidham
83136bb779 regression_test: Add System Information to System Information table
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-07 12:48:41 -08:00
Matthew Stidham
215fa5feee regression_test: Remove extra character
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-07 12:27:29 -08:00
Matthew Stidham
1deae84e52 mine_regression_results: Include Machine name in output
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-07 10:10:37 -08:00
Matthew Stidham
b1b612f421 regression_test:
New Table for system information
Record Python version
id tags for KPIs

Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-07 10:09:38 -08:00
Matthew Stidham
4290214993 create_qvlan: remove unused arguments
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-07 09:27:12 -08:00
Chuck SmileyRekiere
ae94318f07 lf_check.py : fixed relative paths for lf_qa reports
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-12-07 08:28:18 -07:00
Chuck SmileyRekiere
7a2931d2ab *_test.json : pulled out the stability from AP Auto,
AP auto taking over 7 hours.

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-12-07 06:56:21 -07:00
Matthew Stidham
b9de3f896c test_ip_connection doesn't have a test_duration flag
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-06 17:32:19 -08:00
Matthew Stidham
4e0730126d test_l3_longevity: Fix InfluxRequest import
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-06 17:30:13 -08:00
Matthew Stidham
bf8c8ed24a test_ip_variable_time: Fix logic
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-06 16:56:21 -08:00
Chuck SmileyRekiere
fa06f99269 dut.json : differenciate between SSID and BSSID
test.json : differenciate between SSID and BSSID
lf_check.py : differenciate between SSID and BSSID

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-12-06 17:52:02 -07:00
Chuck SmileyRekiere
4a73628b74 dut.json : updated for consistant use of BSSID_USED
test.json : updated for consistant use of BSSID_USED
lf_check.py : updated for use of BSSID_USED
Updated AP Auto test

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2021-12-06 17:42:04 -07:00
Matthew Stidham
7b36739a8b regression_test:
Data engineering 101
One data entry per row
One row per data entry
One variable per column
One column per variable

Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-06 15:52:06 -08:00
Matthew Stidham
7b4bb1dab7 regression_test: Needs backslashes for test_l3_longevity command
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-06 15:37:25 -08:00
Matthew Stidham
3744ddfbb0 regression_test: Fix radio2 argument
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-06 15:35:55 -08:00
Matthew Stidham
7aeef0674c test_l3_unicast_traffic_gen: Fix potential unassigned variable error
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-06 15:32:35 -08:00
Matthew Stidham
b9067250b7 test_l3_unicast_traffic_gen: Remove unused variables
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2021-12-06 15:28:41 -08:00