Commit Graph

5020 Commits

Author SHA1 Message Date
Matthew Stidham
19dc262e51 regression_test: Add VAP_SSID argument for tests which create a VAP
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
72febfd9c1 Revert "Revert "scenario.py: Move get_events and find_new_events to Realm""
This reverts commit 3d6eb6c140bffaa904da96efb6692f07f57b9096.
2022-07-12 15:45:33 +05:30
Matthew Stidham
89a1656e4a Revert "Revert "realm.Realm: Move get_events and find_new_events methods from scenario.py to realm""
This reverts commit 67fe51cebd5403e8240d3490b7539b1e41dd212a.
2022-07-12 15:45:33 +05:30
Matthew Stidham
b6cd3113b0 realm: Update wait_until_ports_appear method to pass timeout
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Matthew Stidham
1593da85a5 LFUtils: add sec_elapsed and timeout to wait_until_ports_appear
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:33 +05:30
Chuck SmileyRekiere
2d16517da8 test_l3_longevity.py : pep8
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:33 +05:30
Chuck SmileyRekiere
6c0e499938 test_l3_longevity.py : examples now show shelf.resource.radio for stations
and upstream ports.

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:33 +05:30
Chuck SmileyRekiere
387d7ff71b ct_us_001_tests.json, ct_us_004_tests.json : consistent number of 2g and 5g radios in ap_auto tests
based on radios 802.11 support.

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:32 +05:30
Chuck SmileyRekiere
474cc09811 ct_us_002_tests.json : consistent number of 2g and 5g radios in ap_auto tests
updated 2g max_stations to 4

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:32 +05:30
Chuck SmileyRekiere
817aa9bab6 ct_us_scripts.json : disable test_l3_powersave_traffic hardcodes station to
149 , until that is fixed.

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:32 +05:30
Jed Reynolds
8c8b5279b4 regression_test.sh: adds meta tag to discourage browser caching
Signed-off-by: Jed Reynolds <jed@bitratchet.com>
2022-07-12 15:45:32 +05:30
Matthew Stidham
44684df155 Revert "realm.Realm: Move get_events and find_new_events methods from scenario.py to realm"
Breaks things
This reverts commit 3cd8db24e2692ecdf11f61991b7975f0cc270713.
2022-07-12 15:45:32 +05:30
Matthew Stidham
bfc51a6c7b Revert "scenario.py: Move get_events and find_new_events to Realm"
Breaks things

This reverts commit 37026e108066be837936dde4bf73fd464d0746f7.
2022-07-12 15:45:32 +05:30
Matthew Stidham
0a3ce42238 sta_connect2: Set station_profile.sta_prefix
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:32 +05:30
Matthew Stidham
08b38b5044 scenario.py: Move get_events and find_new_events to Realm
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:32 +05:30
Matthew Stidham
14295a3ec6 create_l3_stations: num_sta variable should always be accurate
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:32 +05:30
Matthew Stidham
4de51da60c station_profile.create: rename my_sta_names to my_sta_eids
Add in better debug for when stations do not appear properly
Explicit PortNameSeries arguments

Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:32 +05:30
Matthew Stidham
e29a86d7f4 realm.Realm: Move get_events and find_new_events methods from scenario.py to realm
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:32 +05:30
Chuck SmileyRekiere
a9e5ad3935 test_l3.py : autopep8 linting
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:32 +05:30
Chuck SmileyRekiere
a82d0b9673 test_l3.py : longevity was still in this script
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:32 +05:30
Matthew Stidham
b5fcfa133e regression_test: test_l3_unicast_traffic_gen: update arguments
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:32 +05:30
Matthew Stidham
b709834d25 test_l3_unicast_traffic_gen:
Change inheritance to realm because we were using local_realm, and it was inheriting from LFCliBase. Its better to just inherit directly from Realm since Realm inherits LFCliBase
Use the create_basic_argparse function from Realm so we have standard command line args instead of reinventing the wheel.
Don't use the radio flag for something which is inherently different from what radio is used for in our other scripts, that was confusing.
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:32 +05:30
Matthew Stidham
c900dc06b6 regression_test: add test_l3_unicast_traffic_gen to regression_test
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:32 +05:30
Matthew Stidham
a8663dae67 test_l3_unicast_traffic_gen: Fix regresisons by fixing the realm.wait_for_ip call
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:32 +05:30
Matthew Stidham
e639ecf48f Revert "realm.wait_for_ip: Simple is better than complex. Return True inside the while loop when the passing condition is met so we can remove three redundant variables"
This reverts commit 915292ca6238a258f969f3b2c037f12f06143324.
2022-07-12 15:45:32 +05:30
Matthew Stidham
d4c335c357 Revert "Realm.wait_for_ip: We only need to checik that stas_without_ips and stas_without_ip6s are equal to zero once, simplify code further"
This reverts commit ec74b97bae4dce3eaf1b856d1e9bd7d7d271c42d.
2022-07-12 15:45:32 +05:30
Matthew Stidham
ec7fcf1ec4 Realm.wait_for_ip: We only need to checik that stas_without_ips and stas_without_ip6s are equal to zero once, simplify code further
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:32 +05:30
Matthew Stidham
f149a3d461 LFUtils.wait_until_ports_admin_up: return True or false depending on if the
test is successful or not

Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:32 +05:30
Matthew Stidham
63a9074f76 realm.wait_for_ip: Simple is better than complex. Return True inside the while loop when the passing condition is met so we can remove three redundant variables
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:32 +05:30
Ben Greear
749f611662 test_generic: Use auto-timeout for wait_for_ips.
And pass in debugging flag to the wait_until_ports_admin_up
method.

Signed-off-by: Ben Greear <greearb@candelatech.com>
2022-07-12 15:45:32 +05:30
Ben Greear
8446d8fc1b realm:wait_for_ip: re-write logic for correctness and debugging.
Check ipv6 and ipv4 independently of each other.

Auto-timeout check is moved to top of the method.

Improve debugging output.

Fix logic that attempted to print out all ports when
there is failure to find IPs for at least one of the ports.

Signed-off-by: Ben Greear <greearb@candelatech.com>
2022-07-12 15:45:32 +05:30
Matthew Stidham
a8bd985119 LFUtils.wait_until_ports_disappear: Add timeout with default set to 360 seconds
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:32 +05:30
Matthew Stidham
62ff764e13 LFUtils.wait_until_ports_admin_down: add timeout, defaulted to 360 seconds
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:32 +05:30
Matthew Stidham
25ef58262b realm.Realm.wait_for_ip: Improve debug output so that when a port is missing IP it will print out the name of the port
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:32 +05:30
Matthew Stidham
037210c049 LFUtils: remove unused variables
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:32 +05:30
Matthew Stidham
2d8e5411a2 LFUtils: Fix docstrings so they have all arguments
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:32 +05:30
Matthew Stidham
f22109c884 test_generic: wait_for_ip will inherit debug status from the class
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:32 +05:30
Matthew Stidham
b279f44604 test_ip_variable_time: wait_for_ip needs to have debug match that of test_ip_variable_time
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:30 +05:30
Matthew Stidham
5250be3c84 LFUtils.wait_until_ports_disappear: check for port statuses once per second
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:24 +05:30
Matthew Stidham
0f54243be8 LFUtils: Cleanup whitespace
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:24 +05:30
Matthew Stidham
fe9696f2d6 sta_connect: When querying for ports port,ip,ap, don't spout debug output when the port doesn't exist. The test runs whether this works or not.
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:24 +05:30
Matthew Stidham
47c49b57e5 regression_test: Run git pull --rebase at the beginning of the script, as a safety check
Signed-off-by: Matthew Stidham <stidmatt@gmail.com>
2022-07-12 15:45:24 +05:30
Ben Greear
5056a01e94 sta-scan-test: Allow using existing stations.
Lots of changes to allow this script to scan on existing stations
on multiple resources.

Add --use_existing_station option.

Fix help to show how to properly specify multiple stations with
--sta_name

Comment out convoluted logic that tried to find radio info for stations.
This is not needed for any purpose that I can find, and it did not
allow me to specify sta_name with EID format.

Start scan on all stations, then do sleep time, then grab results.
This allows concurrent scanning on multiple resources/radios.

Print more info in text based output, add station resource and name
to output so we can decipher multiple radio output.

Add note about how .csv output is broken in this case, the logic
needs to be improved to append results for all stations and write a single file.

Add --scan_time argument to specify sleep time (defaults to 15 seconds
to match the original hard-coded value).

Signed-off-by: Ben Greear <greearb@candelatech.com>
2022-07-12 15:45:23 +05:30
Ben Greear
cd6e6b18b2 lfutils: let wait_until_ports_admin_up handle multiple resources.
Default to treat station list as list of EIDS, and use it's
shelf/resource info instead of using resource 1 by default.
Caller may still use resource_id=X if they wish too, and it
will work as it did previously.

Add loop timeout (default is 300 tries with 1-sec sleep, so 5+
minutes).  This keeps the method from spinning forever if port
cannot come up.

Signed-off-by: Ben Greear <greearb@candelatech.com>
2022-07-12 15:45:17 +05:30
Scott Wedge
5ea8ff21a7 test_l4.py: update help output, text and whitespace updates
Signed-off-by: Scott Wedge <wedges@candelatech.com>
2022-07-12 15:45:17 +05:30
Chuck SmileyRekiere
e86e2b19c1 test_l3_scenario_throughput.py : commented out ploting as ploting uses bokeh
the test was unmodified , and the xlsx report still generated. May need
to update test to support plotly.

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:17 +05:30
Chuck SmileyRekiere
0810876412 ct_us_003_tests.json: ap_auto , one station per radio for AX and mdk
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:17 +05:30
Chuck SmileyRekiere
9f15163986 ct_us_XXX_tests.json: changed default connect time in AP tests to 500ms
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:17 +05:30
Chuck SmileyRekiere
254ce87563 ct_us_004_tests.json: have only basic connect ap test on nightly
Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:17 +05:30
Chuck SmileyRekiere
6353e2c973 ct_us_002_tests.json: changed station count for 2.4g radions to be the number
of working 2.4g radios.

Signed-off-by: Chuck SmileyRekiere <chuck.smileyrekiere@candelatech.com>
2022-07-12 15:45:17 +05:30