avocado-framework-plugin-varianter-pict

.. _varianter_pict:

PICT Varianter plugin

avocado_varianter_pict

This plugin uses a third-party tool to provide variants created by "Pair-Wise" algorithms, also known as Combinatorial Independent Testing.

Installing PICT

PICT is a free software (MIT licensed) tool that implements combinatorial testing. More information about it can be found at https://github.com/Microsoft/pict/ .

If you're building from sources, make sure you have a C++ compiler such as GCC or clang, and make. The included Makefile should work out of the box and give you a pict binary.

Then copy the pict binary to a location in your $PATH. Alternatively, you may use the plugin --pict-binary command line option to provide a specific location of the pict binary, but that is not as convenient as having it on your $PATH.

Using the PICT Varianter Plugin

To install the Avocado PICT plugin from pip, use::

$ sudo pip install avocado-framework-plugin-varianter-pict

To run the example below, use the test included in the avocado code ::

$ git clone https://github.com/avocado-framework/avocado.git

The following listing is a sample (simple) PICT file included at avocado/examples/varianter_pict/params.pict ::

arch: intel, amd
block_driver: scsi, ide, virtio
net_driver: rtl8139, e1000, virtio
guest: windows, linux
host: rhel6, rhel7, rhel8

To list the variants generated with the default combination order (2, that is, do a pairwise idenpendent combinatorial testing)::

$ avocado variants --pict-parameter-file=avocado/examples/varianter_pict/params.pict Pict Variants (11): Variant amd-scsi-rtl8139-windows-rhel6-acff: /run Variant intel-scsi-virtio-linux-rhel8-26df: /run Variant amd-ide-virtio-windows-rhel7-3fe7: /run Variant amd-virtio-e1000-linux-rhel7-bf2d: /run Variant intel-scsi-e1000-windows-rhel8-4808: /run Variant intel-scsi-rtl8139-linux-rhel7-2975: /run Variant intel-virtio-rtl8139-windows-rhel8-6632: /run Variant intel-ide-rtl8139-linux-rhel6-edd2: /run Variant intel-virtio-virtio-windows-rhel6-e95a: /run Variant amd-ide-e1000-linux-rhel8-5fcc: /run Variant amd-ide-e1000-linux-rhel6-eb43: /run

To list the variants generated with a 3-way combination::

$ avocado variants --pict-parameter-file=avocado/examples/varianter_pict/params.pict
--pict-order-of-combinations=3

Pict Variants (28): Variant intel-ide-virtio-windows-rhel7-aea5: /run ...skip... Variant intel-scsi-e1000-linux-rhel7-9f61: /run

To run tests, just replace the variants avocado command for run::

$ avocado run --pict-parameter-file=avocado/examples/varianter_pict/params.pict /bin/true

The tests given in the command line should then be executed with all variants produced by the combinatorial algorithm implemented by PICT.