Files
wlan-testing/tests
Shivam Thakur 516358d1b5 Wifi 7868 restructuring sanity suite to cover golden coverage of suites (#529)
* WIFI-7868: Added ow_sanity_lf suite for sanity restructuring

Added client connectivity tests under the ow_sanity_lf

Signed-off-by: shivam <shivam.thakur@candelatech.com>

* [WIFI-7869] Fix: regression testing AWS variables placement

Signed-off-by: Dmitry Dunaev <dmitry@opsfleet.com>

* [WIFI-7779] Add: helm deploy support for mailer envs (#517)

Signed-off-by: Dmitry Dunaev <dmitry@opsfleet.com>

* Also pin kubectl version when destroying namespace

Signed-off-by: Johann Hoffmann <johann.hoffmann@mailbox.org>

* [WIFI-7604] Add workflows to test deployment upgrade paths (#471)

* Create and switch to composite action for Docker Compose in Kubernetes deployment

Signed-off-by: Johann Hoffmann <johann.hoffmann@mailbox.org>

* Add missing inputs to composite action

Signed-off-by: Johann Hoffmann <johann.hoffmann@mailbox.org>

* Add input for hashed password and adapt variable names

Signed-off-by: Johann Hoffmann <johann.hoffmann@mailbox.org>

* Fix input variable names

Signed-off-by: Johann Hoffmann <johann.hoffmann@mailbox.org>

* Add Docker Compose upgrade test workflow

Signed-off-by: Johann Hoffmann <johann.hoffmann@mailbox.org>

* Get deploy script according to deployment_version input

Signed-off-by: Johann Hoffmann <johann.hoffmann@mailbox.org>

* Hard-code branch for testing

Signed-off-by: Johann Hoffmann <johann.hoffmann@mailbox.org>

* Re-add RTTY_TOKEN for testing previous release upgrades

Signed-off-by: Johann Hoffmann <johann.hoffmann@mailbox.org>

* [WIFI-7697] Move deploy related files from wlan-testing to wlan-cloud-ucentral-deploy (#472)

* Change composite actions and workflows to use wlan-cloud-ucentral-deploy repo

Signed-off-by: Johann Hoffmann <johann.hoffmann@mailbox.org>

* Checkout target branch matching with deployment version

Signed-off-by: Johann Hoffmann <johann.hoffmann@mailbox.org>

* Remove working-directory option

Signed-off-by: Johann Hoffmann <johann.hoffmann@mailbox.org>

* Rename image version variables to enable search and replace in deploy script

Signed-off-by: Johann Hoffmann <johann.hoffmann@mailbox.org>

* Remove defaults from action inputs

Signed-off-by: Johann Hoffmann <johann.hoffmann@mailbox.org>

* Try removing owsub and owanalytics ports for 2.4 deployment

Signed-off-by: Johann Hoffmann <johann.hoffmann@mailbox.org>

* Actually remove ports since commenting out doesn't work

Signed-off-by: Johann Hoffmann <johann.hoffmann@mailbox.org>

* [WIFI-7766] Switch Docker Compose testing workflow to deployment on EC2 (#499)

* Switch from Kubernetes pod to EC2 instance deployment

Signed-off-by: Johann Hoffmann <johann.hoffmann@mailbox.org>

* Fix indentation

Signed-off-by: Johann Hoffmann <johann.hoffmann@mailbox.org>

* Add VPC subnet ID to use existing security group

Signed-off-by: Johann Hoffmann <johann.hoffmann@mailbox.org>

* Move env variable definition to executed SSH command

Signed-off-by: Johann Hoffmann <johann.hoffmann@mailbox.org>

* Remove defaults from inputs to avoid overwriting deployment_version

Signed-off-by: Johann Hoffmann <johann.hoffmann@mailbox.org>

* Fix syntax

Signed-off-by: Johann Hoffmann <johann.hoffmann@mailbox.org>

* Fix variable syntax

Signed-off-by: Johann Hoffmann <johann.hoffmann@mailbox.org>

* Add my own SSH key for debugging

Signed-off-by: Johann Hoffmann <johann.hoffmann@mailbox.org>

* Revert "Add my own SSH key for debugging"

This reverts commit e4a9fee140.

Signed-off-by: Johann Hoffmann <johann.hoffmann@mailbox.org>

* Increase AWS instance size

Signed-off-by: Johann Hoffmann <johann.hoffmann@mailbox.org>

* Update package lists before installing

Signed-off-by: Johann Hoffmann <johann.hoffmann@mailbox.org>

* Add curl insecure option and append self-signed REST API cert to AP cert trust store

Signed-off-by: Johann Hoffmann <johann.hoffmann@mailbox.org>

* Pass FLAGS variable to clustersysteminfo Docker container

Signed-off-by: Johann Hoffmann <johann.hoffmann@mailbox.org>

* Switch to github.run_number for uniqueness

Signed-off-by: Johann Hoffmann <johann.hoffmann@mailbox.org>

* Start Docker manually on instance

Signed-off-by: Johann Hoffmann <johann.hoffmann@mailbox.org>

* Install Docker using the repository

Signed-off-by: Johann Hoffmann <johann.hoffmann@mailbox.org>

* Do not destroy created instances for debugging

Signed-off-by: Johann Hoffmann <johann.hoffmann@mailbox.org>

* Quote selfsigned_restapi_ca

Signed-off-by: Johann Hoffmann <johann.hoffmann@mailbox.org>

* Split SSH commands into multiple lines for better readability

Signed-off-by: Johann Hoffmann <johann.hoffmann@mailbox.org>

* Fix syntax

Signed-off-by: Johann Hoffmann <johann.hoffmann@mailbox.org>

* Fix typo

Signed-off-by: Johann Hoffmann <johann.hoffmann@mailbox.org>

* Revert "Split SSH commands into multiple lines for better readability"

This reverts commit c08ec026cfe3915e36cef3215226b41dd0319ed8.

Signed-off-by: Johann Hoffmann <johann.hoffmann@mailbox.org>

* Revert "Fix syntax"

This reverts commit f408cfd19f5cf01d6b1d1f78c930897f9442c7de.

Signed-off-by: Johann Hoffmann <johann.hoffmann@mailbox.org>

* Add debugging output for REST API CA cert

Signed-off-by: Johann Hoffmann <johann.hoffmann@mailbox.org>

* Add: RTTY_TOKEN env for older versions support

Signed-off-by: Dmitry Dunaev <dmitry@opsfleet.com>

* Download self-signed REST API CA cert directly to virtual AP

Signed-off-by: Johann Hoffmann <johann.hoffmann@mailbox.org>

* Switch to self-signed certs

Signed-off-by: Johann Hoffmann <johann.hoffmann@mailbox.org>

* Fix variable name

Signed-off-by: Johann Hoffmann <johann.hoffmann@mailbox.org>

* Fix step name

Signed-off-by: Johann Hoffmann <johann.hoffmann@mailbox.org>

* Change hostname and use sudo to add hosts entry

Signed-off-by: Johann Hoffmann <johann.hoffmann@mailbox.org>

* Fix syntax

Signed-off-by: Johann Hoffmann <johann.hoffmann@mailbox.org>

* Actually add IP to hosts entry

Signed-off-by: Johann Hoffmann <johann.hoffmann@mailbox.org>

* Fix missing hostname in AP hosts entry

Signed-off-by: Johann Hoffmann <johann.hoffmann@mailbox.org>

* Adapt Docker Compose upgrade workflow to EC2 instance deployment

Signed-off-by: Johann Hoffmann <johann.hoffmann@mailbox.org>

* Configure Docker to log to logstash input

Signed-off-by: Johann Hoffmann <johann.hoffmann@mailbox.org>

* Fix Docker daemon config

Signed-off-by: Johann Hoffmann <johann.hoffmann@mailbox.org>

* Add missing EOF

Signed-off-by: Johann Hoffmann <johann.hoffmann@mailbox.org>

* Fix indentation

Signed-off-by: Johann Hoffmann <johann.hoffmann@mailbox.org>

* Fix syntax

Signed-off-by: Johann Hoffmann <johann.hoffmann@mailbox.org>

* Try to fix syntax again

Signed-off-by: Johann Hoffmann <johann.hoffmann@mailbox.org>

* Use different delimiter

Signed-off-by: Johann Hoffmann <johann.hoffmann@mailbox.org>

* Fix conflict after rebase

Signed-off-by: Johann Hoffmann <johann.hoffmann@mailbox.org>

* Fix workflow syntax

Signed-off-by: Johann Hoffmann <johann.hoffmann@mailbox.org>

* Disable StrictHostKeyChecking in workflow

Signed-off-by: Johann Hoffmann <johann.hoffmann@mailbox.org>

Co-authored-by: Dmitry Dunaev <dmitry@opsfleet.com>

* Remove obsolete inputs and add RTTY_TOKEN to other workflows as well

Signed-off-by: Johann Hoffmann <johann.hoffmann@mailbox.org>

* Fix value file names

Signed-off-by: Johann Hoffmann <johann.hoffmann@mailbox.org>

* Wifi 7858 (#518)

* Crated a new file for FMS related testcases

Signed-off-by: haricharan-jaka <haricharan.jaka@candelatech.com>

* Removed Fms system ifo test case from gateway service file

Signed-off-by: haricharan-jaka <haricharan.jaka@candelatech.com>

* Added Location related test cases of Prov UI

Signed-off-by: haricharan-jaka <haricharan.jaka@candelatech.com>

* Added Location related functions for support

Signed-off-by: haricharan-jaka <haricharan.jaka@candelatech.com>

* Changed the function name

Signed-off-by: haricharan-jaka <haricharan.jaka@candelatech.com>

* Changed the allure attachment names on edit functions

Signed-off-by: haricharan-jaka <haricharan.jaka@candelatech.com>

* WIFI-7868: Added multivlan scenarios in ow_sanity and removed Some of the rate limiting as they take a long time to complete

Added few up, dw, up+dw in rate limit for ow_sanity_lf

Signed-off-by: shivam <shivam.thakur@candelatech.com>

* WIFI-7868 : Added dvlan and rate limit from radius in sanity suite and reduced the rate limiting tests as they are taking alot of time

Signed-off-by: shivam <shivam.thakur@candelatech.com>

* WIFI-7868 Adding some marker improvements to reduce number of test cases and increase coverage

optimised rate limiting, added dvlan, added rate limit with radius

Signed-off-by: shivam <shivam.thakur@candelatech.com>

Co-authored-by: Dmitry Dunaev <dmitry@opsfleet.com>
Co-authored-by: Dmitry Dunaev <83591011+dunaev-opsfleet@users.noreply.github.com>
Co-authored-by: Johann Hoffmann <johann.hoffmann@mailbox.org>
Co-authored-by: Haricharan Jaka <87761091+haricharan-jaka@users.noreply.github.com>
2022-05-17 01:32:12 +05:30
..
2021-06-15 15:13:45 +05:30
2022-05-05 17:19:10 +02:00
2022-05-12 19:20:52 +05:30
2022-05-07 13:07:35 +05:30
2022-05-05 17:19:10 +02:00
2022-05-05 17:19:10 +02:00
2021-08-05 17:50:19 +05:30
2022-04-19 17:21:04 +05:30

Test Case Execution Suite

Run on 1.X SDK

pytest -m sanity and not interop -s -vvv --testbed=basic-01 -o build=<firmware URL> --1.x
pytest -m sanity and interop -s -vvv --testbed=basic-01 -o build=<firmware URL> --1.x
pytest -m sanity_55 -s -vvv --testbed=basic-01 -o build=<firmware URL> --1.x  
pytest -m performance -s -vvv --testbed=basic-01 -o build=<firmware URL> --1.x
pytest -m firmware -s -vvv --testbed=basic-01 -o build=<firmware URL> --1.x

Run on 2.X SDK

pytest -m uc_sanity -s -vvv --testbed=basic-03 -o build=<firmware URL> 
pytest -m "performance and dataplane_throughput_test" -s -vvv --testbed=basic-03 -o build=<firmware URL>


You can customize the markets with and/or/not logical options

wlan-testing framework Information

pytest uses setup > test > tear_down
Fixtures : Code that needs to be part of more than 1 test cases, Setup and teardown is Implemented in Fixtures

Test cases are structured across different directories

├── wlan-testing                 
    ├── tests       /* Root directory for tests  */                

We have 3 main resource types:

  1. Controller
  2. Access Points
  3. Traffic Generator

Controller is meant to Provision the Access-Point

├── tests                       /* Pytest cases Directory */
    ├── controller_tests    /* controller has the REST API*/
        ├── conftest.py     /* Fixtures to be used by controller tests */        
        ├── test_api_login.py
        ├── test_api_customer.py
        ├── test_api_location.py
        ├── test_api_equipment.py
        ├── test_api_equipment_gateway.py
        ├── test_api_profile.py
        ├── test_api_firmware_management.py 
               

Access-Point is meant to be connected to controller, as well as should be able to provide wired and wireless connectivity to Both real and virtual Clients

├── tests                       /* Pytest cases Directory */
    ├── access_point_tests            
        ├── conftest.py     /* Fixtures to be used by access point tests */
        ├── test_connectivity.py
        ├── test_radio.py
        ├── test_featureA.py    To be added 
        ├── test_featureB.py

e2e (End to End) test cases are further structured into test case physical environment

Each Environment differs in testbed setup

            Controller      AP      Traffic Generator   PDU     Attenuator
basic  :        1           1           1 LANforge       1       0 Atten
advanced :      1           1           1 LANforge       1       1 Atten
interOp :       1           -           8 Perfecto       0       1 Atten
MDU  :          1           -           - LANforge       0
Scale  :        1           -           - LANforge       0
├── tests              /* Pytest cases Directory */
    ├── conftest.py    /* Global Fixtures for tests */        
├── tests            - /* Pytest cases Directory */
      ├── e2e
          ├── advanced
            ├── conftest.py     /* Fixtures specific to advanced LAB Environment */
          ├── basic
            ├── conftest.py     /* Fixtures specific to basic LAB Environment */     
          ├── interOp
            ├── conftest.py     /* Fixtures specific to interOp LAB Environment */
          ├── mdu
            ├── conftest.py     /* Fixtures specific to mdu LAB Environment */
          |── mesh
            ├── conftest.py     /* Fixtures specific to mesh LAB Environment */
          |── scale
            ├── conftest.py     /* Fixtures specific to scale LAB Environment */

Read the README.md in each e2e directory to get sample test case.

For any Clarifications, regarding Framework,
Email : shivam.thakur@candelatech.com