Difference between revisions of "Running the tests"

Revision as of 09:32, 2 March 2011

This describes how to run the RDM Responder Tests. Before starting you may want to read the Responder Testing FAQ.

Install OLA

Follow one of OLA on OS X or OLA on Linux or OLA on Windows with VMWare to install OLA. If you want the biggest benefit from the tests you should use the version in the git repo as tests are added regularly.

Setup the Test Rig

The following controller devices are supported:

• RDM-TRI
• DMXter4 RDM / MiniDMXter

Connect the device under test to the controller device and start olad. Patch the output port on the controller device to a universe (UNIVERSE_NUMBER). Then run ola_rdm_discover, you should see the responder's UID appear:

 $ ola_rdm_discover -u UNIVERSE_NUMBER
 00a1:00010003
 7a70:ffffff00

Running the Tests

The tests are written in Python and run using ola_rdm_test.py. Below is the output from a typical test run:

 $ ./ola_rdm_test.py --universe 1  00a1:00010003
 Starting tests, universe 3, UID 00a1:00010003
 SetManufacturerLabel: Passed
 SetSoftwareVersionLabel: Passed
 GetManufacturerLabel: Passed
 GetSoftwareVersionLabelWithData: Failed
 ...
 ------------- Warnings --------------
 ------------ By Category ------------
   Product Information:  7 /  7   100%
       RDM Information:  1 /  1   100%
    Core Functionality:  2 /  2   100%
      Error Conditions: 10 / 16   62%
          DMX512 Setup:  3 /  3   100%
 -------------------------------------
 29 / 30 tests run, 23 passed, 6 failed, 0 broken

Useful Options

ola_rdm_test.py has some options which can assist in debugging failures. For a full list of options run with -h

-d, --debug

Show all debugging output, including actual & expected responses.

-l, --log

Log the output of the tests to a file. The UID and timestamp is appended to the filename

-t Test1,Test2 , --tests=Test1,Test2

Only run a subset of the Tests. Only the tests listed (and their dependencies) will be run.