Test Harness on Simulation Environment Setup

THCI (Thread Host Controller Interface) is an implementation of the Python abstract class template IThci, which is used by the Thread Test Harness Software to control OpenThread-based reference devices according to each test scenario.

SI (Sniffer Interface) is an implementation of the sniffer abstract class template ISniffer, which is used by the Thread Test Harness Software to sniff all packets sent by devices.

Both OpenThread simulation and sniffer simulation are required to run on a POSIX environment. However, Harness has to be run on Windows, which is a non-POSIX environment. So two systems are needed, and their setup procedures in detail are listed in the following sections. Either two machines or one machine running two (sub)systems (for example, VM, WSL) is feasible.

Platform developers should modify the THCI implementation and/or the SI implementation directly to match their platform (for example, the path of the OpenThread repository).

POSIX Environment Setup

  1. Open the JSON format configuration file tools/harness-simulation/posix/config.yml:

    • Edit the value of ot_path to the absolute path where the top directory of the OpenThread repository is located. For example, change the value of ot_path to /home/<username>/repo/openthread.
    • For each entry in ot_build.ot, update the value of number to be the number of OT FTD simulations needed with the corresponding version.
    • For each entry in ot_build.otbr, update the value of number to be the number of OTBR simulations needed with the corresponding version.
    • The numbers above can be adjusted according to the requirement of test cases.
    • Edit the value of ssh.username to the username to be used for connecting to the remote POSIX environment.
    • Edit the value of ssh.password to the password corresponding to the username above.
    • Edit the value of discovery_ifname to the network interface that the Harness will connect to.

    Note that it may be time-consuming to build all versions of ot-cli-ftds and OTBR Docker images especially on devices such as Raspberry Pis.

  2. Run the installation script.

    $ tools/harness-simulation/posix/install.sh

Test Harness Environment Setup

  1. Copy the directory tools/harness-simulation from the POSIX machine to the Windows machine, and then switch to that directory.

  2. Double click the file harness\install.bat on Windows.

Run Test Harness on Simulation

  1. On the POSIX machine, change directory to the top of the OpenThread repository, and run the following commands.

    $ cd tools/harness-simulation/posix
$ ./launch_testbed.py -c config.yml

    This example starts several OT FTD simulations, OTBR simulations, and sniffer simulations and can be discovered on eth0. The number of each type of simulation is specified in the configuration file config.yml.

  2. Run the Test Harness. The information field of the device is encoded as <tag>_<node_id>@<ip_addr>. Choose the desired device as the DUT.

  3. Select one or more test cases to start the test.