mirror of
https://github.com/Telecominfraproject/wlan-testing.git
synced 2025-10-30 02:22:44 +00:00
* Removed performance marker from peak_throughput_tests for twog and fiveg, Added AX_capacity testplan in performance for twog and fiveg Signed-off-by: jitendracandela <jitendra.kushavah@candelatech.com> * Added pass_fail_criteria argument Signed-off-by: jitendracandela <jitendra.kushavah@candelatech.com> * Removed performance marker from bidirectional test cases Signed-off-by: jitendracandela <jitendra.kushavah@candelatech.com> * Removed ow_sanity_lf marker from schema validation (#940) Signed-off-by: jitendracandela <jitendra.kushavah@candelatech.com> * add roam otd twog same channel wpa3 eap test (#941) Signed-off-by: anil-tegala <anil.tegala@candelatech.com> * add roam otd fiveg wpa3eap test (#942) Signed-off-by: anil-tegala <anil.tegala@candelatech.com> * Update test_bridge_mode.py (#944) Co-authored-by: Gopi Raga <117985788+GopiRaga7@users.noreply.github.com> * Update ucentralgw-qa-deployment.yaml (#945) * Added sleep time in the rate limiting test case (#946) Signed-off-by: jitendracandela <jitendra.kushavah@candelatech.com> * Fix roam OTA test issues with iwinfo output & Add Pass/Fail (#947) * improve re pattern to fetch ap data from iwconfig Signed-off-by: anil-tegala <anil.tegala@candelatech.com> * fix config issue in wpa2 tests Signed-off-by: anil-tegala <anil.tegala@candelatech.com> * fix key,value issues in config creation Signed-off-by: anil-tegala <anil.tegala@candelatech.com> * fix empty radio & wifi-bands config issue Signed-off-by: anil-tegala <anil.tegala@candelatech.com> * replace global config_data with local config in test Signed-off-by: anil-tegala <anil.tegala@candelatech.com> * add ap logs per testcase to allure Signed-off-by: anil-tegala <anil.tegala@candelatech.com> * fix missing underscore to get dut logs function Signed-off-by: anil-tegala <anil.tegala@candelatech.com> * refine selected testbed logic as per testbed names in lab-info Signed-off-by: anil-tegala <anil.tegala@candelatech.com> * marker and pass/fail addtions to roam ota tests Signed-off-by: anil-tegala <anil.tegala@candelatech.com> --------- Signed-off-by: anil-tegala <anil.tegala@candelatech.com> * Add hfcl_ion4xi to the overview page (#948) Signed-off-by: jitendracandela <jitendra.kushavah@candelatech.com> * Update ucentralgw-qa-deployment.yaml (#949) * Added udaya_a6-id2 to the sanity and performance overview page (#950) Signed-off-by: jitendracandela <jitendra.kushavah@candelatech.com> * WIFI-13871 CGW deploy testing (#951) Signed-off-by: Carsten Schafer <Carsten.Schafer@kinarasystems.com> Co-authored-by: Carsten Schafer <Carsten.Schafer@kinarasystems.com> * add roam ota twog & fiveg wpa2psk test (#952) * add roam ota twog and fiveg wpa2 psk test Signed-off-by: anil-tegala <anil.tegala@candelatech.com> * set missing band in 2G config Signed-off-by: anil-tegala <anil.tegala@candelatech.com> --------- Signed-off-by: anil-tegala <anil.tegala@candelatech.com> * Wifi 13874 (#953) * Added more logs to asb script Signed-off-by: jitendracandela <jitendra.kushavah@candelatech.com> * Increased sleep time after factory reset for ASB tests Signed-off-by: jitendracandela <jitendra.kushavah@candelatech.com> --------- Signed-off-by: jitendracandela <jitendra.kushavah@candelatech.com> * roam ota twog and fiveg wpa3psk test (#954) * add roam ota twog and fiveg wpa2 psk test Signed-off-by: anil-tegala <anil.tegala@candelatech.com> * add roam ota twog and fiveg wpa3 psk test Signed-off-by: anil-tegala <anil.tegala@candelatech.com> * set missing band in 2G config Signed-off-by: anil-tegala <anil.tegala@candelatech.com> --------- Signed-off-by: anil-tegala <anil.tegala@candelatech.com> * add roam ota twog and fiveg wpa2-eap test (#955) Signed-off-by: anil-tegala <anil.tegala@candelatech.com> * WIFI-13871: CGW deployment (#956) * WIFI-13871 CGW deploy testing Signed-off-by: Carsten Schafer <Carsten.Schafer@kinarasystems.com> * WIFI-13871 CGW deploy testing Signed-off-by: Carsten Schafer <Carsten.Schafer@kinarasystems.com> --------- Signed-off-by: Carsten Schafer <Carsten.Schafer@kinarasystems.com> Co-authored-by: Carsten Schafer <Carsten.Schafer@kinarasystems.com> * Update cgw-dev-deployment.yaml * WIFI-13871 Correct branch for deploy repo Signed-off-by: Carsten Schafer <Carsten.Schafer@kinarasystems.com> * add roam ota twog and fiveg wpa3 enterprise test (#958) Signed-off-by: anil-tegala <anil.tegala@candelatech.com> * WIFI-13871 Need sops installed as well Signed-off-by: Carsten Schafer <Carsten.Schafer@kinarasystems.com> * add roam ota 5g and 6g wpa2psk test (#959) * add roam ota fiveg and sixg wpa2psk test Signed-off-by: anil-tegala <anil.tegala@candelatech.com> * change security type to wpa3 Signed-off-by: anil-tegala <anil.tegala@candelatech.com> --------- Signed-off-by: anil-tegala <anil.tegala@candelatech.com> * Wifi 13853 (#960) * Removed >/dev/null 2>&1 for logs purpose Signed-off-by: jitendracandela <jitendra.kushavah@candelatech.com> * Added Verbosity for logs Signed-off-by: jitendracandela <jitendra.kushavah@candelatech.com> * Added retries=3 in the kubectl cp command Signed-off-by: jitendracandela <jitendra.kushavah@candelatech.com> * Added list of files in the pod /tmp/allure-results Signed-off-by: jitendracandela <jitendra.kushavah@candelatech.com> --------- Signed-off-by: jitendracandela <jitendra.kushavah@candelatech.com> * Wifi 13859 (#961) * Added hfcl_ion4xi in the sanity, performance, regression workflows and overview page Signed-off-by: jitendracandela <jitendra.kushavah@candelatech.com> * Removed hfcl_ion4xi from overview page Signed-off-by: jitendracandela <jitendra.kushavah@candelatech.com> --------- Signed-off-by: jitendracandela <jitendra.kushavah@candelatech.com> * Added wifi_capacity_ax_tests in the performance workflow Signed-off-by: jitendracandela <jitendra.kushavah@candelatech.com> * Modified marker name for ax capacity Signed-off-by: jitendracandela <jitendra.kushavah@candelatech.com> * Added performance pass-fail criteria file Signed-off-by: jitendracandela <jitendra.kushavah@candelatech.com> * Added pass-fail values for edgecore_eap105,sercomm_ap72tip Signed-off-by: jitendracandela <jitendra.kushavah@candelatech.com> * Added pass-fail values for udaya_a6-id2 Signed-off-by: jitendracandela <jitendra.kushavah@candelatech.com> * Added pass-fail values for edgecore_eap111 Signed-off-by: jitendracandela <jitendra.kushavah@candelatech.com> * add roam ota fiveg and sixg wpa3 enterprise test (#963) Signed-off-by: anil-tegala <anil.tegala@candelatech.com> * add roam ota twog and sixg sae test (#964) Signed-off-by: anil-tegala <anil.tegala@candelatech.com> * add roam ota twog and sixg wpa3 enterprise test (#965) * add roam ota twog and sixg wpa3 enterprise test Signed-off-by: anil-tegala <anil.tegala@candelatech.com> --------- Signed-off-by: anil-tegala <anil.tegala@candelatech.com> * Handle locations inside deploy repo (#966) Co-authored-by: Carsten Schafer <Carsten.Schafer@kinarasystems.com> * Added edgecore_eap105,sercomm_ap72tip to the sanity and performance overview page (#967) Signed-off-by: jitendracandela <jitendra.kushavah@candelatech.com> * Wifi 13921 (#969) * Modified as per new lab infra and Added udaya_a6-id2,edgecore_eap105,sercomm_ap72tip in the performance workflow Signed-off-by: jitendracandela <jitendra.kushavah@candelatech.com> * Modified as per new lab infra and Added udaya_a6-id2,edgecore_eap105,sercomm_ap72tip in the sanity workflow Signed-off-by: jitendracandela <jitendra.kushavah@candelatech.com> * Modified as per new lab infra and Added udaya_a6-id2,edgecore_eap105,sercomm_ap72tip in the regression workflow Signed-off-by: jitendracandela <jitendra.kushavah@candelatech.com> --------- Signed-off-by: jitendracandela <jitendra.kushavah@candelatech.com> * Replaced advanced-3b with advanced-1c (#971) Signed-off-by: jitendracandela <jitendra.kushavah@candelatech.com> * Added wifi_capacity_ax_tests for udaya_a6-id2,edgecore_eap105,sercomm_ap72tip APs Signed-off-by: jitendracandela <jitendra.kushavah@candelatech.com> --------- Signed-off-by: jitendracandela <jitendra.kushavah@candelatech.com> Signed-off-by: anil-tegala <anil.tegala@candelatech.com> Signed-off-by: Carsten Schafer <Carsten.Schafer@kinarasystems.com> Co-authored-by: Anil Kumar Tegala <anil.tegala@candelatech.com> Co-authored-by: Gopi Raga <117985788+GopiRaga7@users.noreply.github.com> Co-authored-by: GowthamPrajwal <86651786+GowthamPrajwal@users.noreply.github.com> Co-authored-by: mythri-candela <168416732+mythri-candela@users.noreply.github.com> Co-authored-by: Carsten Schafer <49571202+carsten989@users.noreply.github.com> Co-authored-by: Carsten Schafer <Carsten.Schafer@kinarasystems.com>
Test Case Execution Suite
Run on 1.X SDK
pytest -m sanity and not interop -s -vvv --testbed=basic-01 -o build=<firmware URL> --1.x
pytest -m sanity and interop -s -vvv --testbed=basic-01 -o build=<firmware URL> --1.x
pytest -m sanity_55 -s -vvv --testbed=basic-01 -o build=<firmware URL> --1.x
pytest -m performance -s -vvv --testbed=basic-01 -o build=<firmware URL> --1.x
pytest -m firmware -s -vvv --testbed=basic-01 -o build=<firmware URL> --1.x
Run on 2.X SDK
pytest -m uc_sanity -s -vvv --testbed=basic-03 -o build=<firmware URL>
pytest -m "performance and dataplane_throughput_test" -s -vvv --testbed=basic-03 -o build=<firmware URL>
You can customize the markets with and/or/not logical options
wlan-testing framework Information
pytest uses setup > test > tear_down
Fixtures : Code that needs to be part of more than 1 test cases, Setup and teardown is Implemented in Fixtures
Test cases are structured across different directories
├── wlan-testing
├── tests /* Root directory for tests */
We have 3 main resource types:
- Controller
- Access Points
- Traffic Generator
Controller is meant to Provision the Access-Point
├── tests /* Pytest cases Directory */
├── controller_tests /* controller has the REST API*/
├── conftest.py /* Fixtures to be used by controller tests */
├── test_api_login.py
├── test_api_customer.py
├── test_api_location.py
├── test_api_equipment.py
├── test_api_equipment_gateway.py
├── test_api_profile.py
├── test_api_firmware_management.py
Access-Point is meant to be connected to controller, as well as should be able to provide wired and wireless connectivity to Both real and virtual Clients
├── tests /* Pytest cases Directory */
├── access_point_tests
├── conftest.py /* Fixtures to be used by access point tests */
├── test_connectivity.py
├── test_radio.py
├── test_featureA.py To be added
├── test_featureB.py
e2e (End to End) test cases are further structured into test case physical environment
Each Environment differs in testbed setup
Controller AP Traffic Generator PDU Attenuator
basic : 1 1 1 LANforge 1 0 Atten
advanced : 1 1 1 LANforge 1 1 Atten
interOp : 1 - 8 Perfecto 0 1 Atten
MDU : 1 - - LANforge 0
Scale : 1 - - LANforge 0
├── tests /* Pytest cases Directory */
├── conftest.py /* Global Fixtures for tests */
├── tests - /* Pytest cases Directory */
├── e2e
├── advanced
├── conftest.py /* Fixtures specific to advanced LAB Environment */
├── basic
├── conftest.py /* Fixtures specific to basic LAB Environment */
├── interOp
├── conftest.py /* Fixtures specific to interOp LAB Environment */
├── mdu
├── conftest.py /* Fixtures specific to mdu LAB Environment */
|── mesh
├── conftest.py /* Fixtures specific to mesh LAB Environment */
|── scale
├── conftest.py /* Fixtures specific to scale LAB Environment */
Read the README.md in each e2e directory to get sample test case.
For any Clarifications, regarding Framework,
Email : shivam.thakur@candelatech.com