Files
wlan-testing/tests
Jitendrakumar Kushavah f4e7d51366 Wifi 13777 (#968)
* Removed performance marker from peak_throughput_tests for twog and fiveg, Added AX_capacity testplan in performance for twog and fiveg

Signed-off-by: jitendracandela <jitendra.kushavah@candelatech.com>

* Added pass_fail_criteria argument

Signed-off-by: jitendracandela <jitendra.kushavah@candelatech.com>

* Removed performance marker from bidirectional test cases

Signed-off-by: jitendracandela <jitendra.kushavah@candelatech.com>

* Removed ow_sanity_lf marker from schema validation (#940)

Signed-off-by: jitendracandela <jitendra.kushavah@candelatech.com>

* add roam otd twog same channel wpa3 eap test (#941)

Signed-off-by: anil-tegala <anil.tegala@candelatech.com>

* add roam otd fiveg wpa3eap test (#942)

Signed-off-by: anil-tegala <anil.tegala@candelatech.com>

* Update test_bridge_mode.py (#944)

Co-authored-by: Gopi Raga <117985788+GopiRaga7@users.noreply.github.com>

* Update ucentralgw-qa-deployment.yaml (#945)

* Added sleep time in the rate limiting test case (#946)

Signed-off-by: jitendracandela <jitendra.kushavah@candelatech.com>

* Fix roam OTA test issues with iwinfo output & Add Pass/Fail (#947)

* improve re pattern to fetch ap data from iwconfig

Signed-off-by: anil-tegala <anil.tegala@candelatech.com>

* fix config issue in wpa2 tests

Signed-off-by: anil-tegala <anil.tegala@candelatech.com>

* fix key,value issues in config creation

Signed-off-by: anil-tegala <anil.tegala@candelatech.com>

* fix empty radio & wifi-bands config issue

Signed-off-by: anil-tegala <anil.tegala@candelatech.com>

* replace global config_data with local config in test

Signed-off-by: anil-tegala <anil.tegala@candelatech.com>

* add ap logs per testcase to allure

Signed-off-by: anil-tegala <anil.tegala@candelatech.com>

* fix missing underscore to get dut logs function

Signed-off-by: anil-tegala <anil.tegala@candelatech.com>

* refine selected testbed logic as per testbed names in lab-info

Signed-off-by: anil-tegala <anil.tegala@candelatech.com>

* marker and pass/fail addtions to roam ota tests

Signed-off-by: anil-tegala <anil.tegala@candelatech.com>

---------

Signed-off-by: anil-tegala <anil.tegala@candelatech.com>

* Add hfcl_ion4xi to the overview page (#948)

Signed-off-by: jitendracandela <jitendra.kushavah@candelatech.com>

* Update ucentralgw-qa-deployment.yaml (#949)

* Added udaya_a6-id2 to the sanity and performance overview page (#950)

Signed-off-by: jitendracandela <jitendra.kushavah@candelatech.com>

* WIFI-13871 CGW deploy testing (#951)

Signed-off-by: Carsten Schafer <Carsten.Schafer@kinarasystems.com>
Co-authored-by: Carsten Schafer <Carsten.Schafer@kinarasystems.com>

* add roam ota twog & fiveg wpa2psk test (#952)

* add roam ota twog and fiveg wpa2 psk test

Signed-off-by: anil-tegala <anil.tegala@candelatech.com>

* set missing band in 2G config

Signed-off-by: anil-tegala <anil.tegala@candelatech.com>

---------

Signed-off-by: anil-tegala <anil.tegala@candelatech.com>

* Wifi 13874 (#953)

* Added more logs to asb script

Signed-off-by: jitendracandela <jitendra.kushavah@candelatech.com>

* Increased sleep time after factory reset for ASB tests

Signed-off-by: jitendracandela <jitendra.kushavah@candelatech.com>

---------

Signed-off-by: jitendracandela <jitendra.kushavah@candelatech.com>

* roam ota twog and fiveg wpa3psk test (#954)

* add roam ota twog and fiveg wpa2 psk test

Signed-off-by: anil-tegala <anil.tegala@candelatech.com>

* add roam ota twog and fiveg wpa3 psk test

Signed-off-by: anil-tegala <anil.tegala@candelatech.com>

* set missing band in 2G config

Signed-off-by: anil-tegala <anil.tegala@candelatech.com>

---------

Signed-off-by: anil-tegala <anil.tegala@candelatech.com>

* add roam ota twog and fiveg wpa2-eap test (#955)

Signed-off-by: anil-tegala <anil.tegala@candelatech.com>

* WIFI-13871: CGW deployment (#956)

* WIFI-13871 CGW deploy testing

Signed-off-by: Carsten Schafer <Carsten.Schafer@kinarasystems.com>

* WIFI-13871 CGW deploy testing

Signed-off-by: Carsten Schafer <Carsten.Schafer@kinarasystems.com>

---------

Signed-off-by: Carsten Schafer <Carsten.Schafer@kinarasystems.com>
Co-authored-by: Carsten Schafer <Carsten.Schafer@kinarasystems.com>

* Update cgw-dev-deployment.yaml

* WIFI-13871 Correct branch for deploy repo

Signed-off-by: Carsten Schafer <Carsten.Schafer@kinarasystems.com>

* add roam ota twog and fiveg wpa3 enterprise test (#958)

Signed-off-by: anil-tegala <anil.tegala@candelatech.com>

* WIFI-13871 Need sops installed as well

Signed-off-by: Carsten Schafer <Carsten.Schafer@kinarasystems.com>

* add roam ota 5g and 6g wpa2psk test (#959)

* add roam ota fiveg and sixg wpa2psk test

Signed-off-by: anil-tegala <anil.tegala@candelatech.com>

* change security type to wpa3

Signed-off-by: anil-tegala <anil.tegala@candelatech.com>

---------

Signed-off-by: anil-tegala <anil.tegala@candelatech.com>

* Wifi 13853 (#960)

* Removed >/dev/null 2>&1 for logs purpose

Signed-off-by: jitendracandela <jitendra.kushavah@candelatech.com>

* Added Verbosity for logs

Signed-off-by: jitendracandela <jitendra.kushavah@candelatech.com>

* Added retries=3 in the kubectl cp command

Signed-off-by: jitendracandela <jitendra.kushavah@candelatech.com>

* Added list of files in the pod /tmp/allure-results

Signed-off-by: jitendracandela <jitendra.kushavah@candelatech.com>

---------

Signed-off-by: jitendracandela <jitendra.kushavah@candelatech.com>

* Wifi 13859 (#961)

* Added hfcl_ion4xi in the sanity, performance, regression workflows and overview page

Signed-off-by: jitendracandela <jitendra.kushavah@candelatech.com>

* Removed hfcl_ion4xi from overview page

Signed-off-by: jitendracandela <jitendra.kushavah@candelatech.com>

---------

Signed-off-by: jitendracandela <jitendra.kushavah@candelatech.com>

* Added wifi_capacity_ax_tests in the performance workflow

Signed-off-by: jitendracandela <jitendra.kushavah@candelatech.com>

* Modified marker name for ax capacity

Signed-off-by: jitendracandela <jitendra.kushavah@candelatech.com>

* Added performance pass-fail criteria file

Signed-off-by: jitendracandela <jitendra.kushavah@candelatech.com>

* Added pass-fail values for edgecore_eap105,sercomm_ap72tip

Signed-off-by: jitendracandela <jitendra.kushavah@candelatech.com>

* Added pass-fail values for udaya_a6-id2

Signed-off-by: jitendracandela <jitendra.kushavah@candelatech.com>

* Added pass-fail values for edgecore_eap111

Signed-off-by: jitendracandela <jitendra.kushavah@candelatech.com>

* add roam ota fiveg and sixg wpa3 enterprise test (#963)

Signed-off-by: anil-tegala <anil.tegala@candelatech.com>

* add roam ota twog and sixg sae test (#964)

Signed-off-by: anil-tegala <anil.tegala@candelatech.com>

* add roam ota twog and sixg wpa3 enterprise test (#965)

* add roam ota twog and sixg wpa3 enterprise test

Signed-off-by: anil-tegala <anil.tegala@candelatech.com>

---------

Signed-off-by: anil-tegala <anil.tegala@candelatech.com>

* Handle locations inside deploy repo (#966)

Co-authored-by: Carsten Schafer <Carsten.Schafer@kinarasystems.com>

* Added edgecore_eap105,sercomm_ap72tip to the sanity and performance overview page (#967)

Signed-off-by: jitendracandela <jitendra.kushavah@candelatech.com>

* Wifi 13921 (#969)

* Modified as per new lab infra and Added udaya_a6-id2,edgecore_eap105,sercomm_ap72tip in the performance workflow

Signed-off-by: jitendracandela <jitendra.kushavah@candelatech.com>

* Modified as per new lab infra and Added udaya_a6-id2,edgecore_eap105,sercomm_ap72tip in the sanity workflow

Signed-off-by: jitendracandela <jitendra.kushavah@candelatech.com>

* Modified as per new lab infra and Added udaya_a6-id2,edgecore_eap105,sercomm_ap72tip in the regression workflow

Signed-off-by: jitendracandela <jitendra.kushavah@candelatech.com>

---------

Signed-off-by: jitendracandela <jitendra.kushavah@candelatech.com>

* Replaced advanced-3b with advanced-1c (#971)

Signed-off-by: jitendracandela <jitendra.kushavah@candelatech.com>

* Added wifi_capacity_ax_tests for udaya_a6-id2,edgecore_eap105,sercomm_ap72tip APs

Signed-off-by: jitendracandela <jitendra.kushavah@candelatech.com>

---------

Signed-off-by: jitendracandela <jitendra.kushavah@candelatech.com>
Signed-off-by: anil-tegala <anil.tegala@candelatech.com>
Signed-off-by: Carsten Schafer <Carsten.Schafer@kinarasystems.com>
Co-authored-by: Anil Kumar Tegala <anil.tegala@candelatech.com>
Co-authored-by: Gopi Raga <117985788+GopiRaga7@users.noreply.github.com>
Co-authored-by: GowthamPrajwal <86651786+GowthamPrajwal@users.noreply.github.com>
Co-authored-by: mythri-candela <168416732+mythri-candela@users.noreply.github.com>
Co-authored-by: Carsten Schafer <49571202+carsten989@users.noreply.github.com>
Co-authored-by: Carsten Schafer <Carsten.Schafer@kinarasystems.com>
2024-08-01 14:47:44 +05:30
..
2024-06-01 11:13:16 +05:30
2024-08-01 14:47:44 +05:30
2021-06-15 15:13:45 +05:30
2022-11-24 14:03:17 +03:00
2023-11-10 15:42:36 +05:30

Test Case Execution Suite

Run on 1.X SDK

pytest -m sanity and not interop -s -vvv --testbed=basic-01 -o build=<firmware URL> --1.x
pytest -m sanity and interop -s -vvv --testbed=basic-01 -o build=<firmware URL> --1.x
pytest -m sanity_55 -s -vvv --testbed=basic-01 -o build=<firmware URL> --1.x  
pytest -m performance -s -vvv --testbed=basic-01 -o build=<firmware URL> --1.x
pytest -m firmware -s -vvv --testbed=basic-01 -o build=<firmware URL> --1.x

Run on 2.X SDK

pytest -m uc_sanity -s -vvv --testbed=basic-03 -o build=<firmware URL> 
pytest -m "performance and dataplane_throughput_test" -s -vvv --testbed=basic-03 -o build=<firmware URL>


You can customize the markets with and/or/not logical options

wlan-testing framework Information

pytest uses setup > test > tear_down
Fixtures : Code that needs to be part of more than 1 test cases, Setup and teardown is Implemented in Fixtures

Test cases are structured across different directories

├── wlan-testing                 
    ├── tests       /* Root directory for tests  */                

We have 3 main resource types:

  1. Controller
  2. Access Points
  3. Traffic Generator

Controller is meant to Provision the Access-Point

├── tests                       /* Pytest cases Directory */
    ├── controller_tests    /* controller has the REST API*/
        ├── conftest.py     /* Fixtures to be used by controller tests */        
        ├── test_api_login.py
        ├── test_api_customer.py
        ├── test_api_location.py
        ├── test_api_equipment.py
        ├── test_api_equipment_gateway.py
        ├── test_api_profile.py
        ├── test_api_firmware_management.py 
               

Access-Point is meant to be connected to controller, as well as should be able to provide wired and wireless connectivity to Both real and virtual Clients

├── tests                       /* Pytest cases Directory */
    ├── access_point_tests            
        ├── conftest.py     /* Fixtures to be used by access point tests */
        ├── test_connectivity.py
        ├── test_radio.py
        ├── test_featureA.py    To be added 
        ├── test_featureB.py

e2e (End to End) test cases are further structured into test case physical environment

Each Environment differs in testbed setup

            Controller      AP      Traffic Generator   PDU     Attenuator
basic  :        1           1           1 LANforge       1       0 Atten
advanced :      1           1           1 LANforge       1       1 Atten
interOp :       1           -           8 Perfecto       0       1 Atten
MDU  :          1           -           - LANforge       0
Scale  :        1           -           - LANforge       0
├── tests              /* Pytest cases Directory */
    ├── conftest.py    /* Global Fixtures for tests */        
├── tests            - /* Pytest cases Directory */
      ├── e2e
          ├── advanced
            ├── conftest.py     /* Fixtures specific to advanced LAB Environment */
          ├── basic
            ├── conftest.py     /* Fixtures specific to basic LAB Environment */     
          ├── interOp
            ├── conftest.py     /* Fixtures specific to interOp LAB Environment */
          ├── mdu
            ├── conftest.py     /* Fixtures specific to mdu LAB Environment */
          |── mesh
            ├── conftest.py     /* Fixtures specific to mesh LAB Environment */
          |── scale
            ├── conftest.py     /* Fixtures specific to scale LAB Environment */

Read the README.md in each e2e directory to get sample test case.

For any Clarifications, regarding Framework,
Email : shivam.thakur@candelatech.com