Talk:Quality/Test processes

Test mapping / Test plan configuration

1. Test request comes in. The request has parameters such as stage and "changed packages" list
2. Testplanner reads the configuration/mapping file and creates test plan(s)
3. Kickstart files are delivered to image builder and test plans for test automation

Mapping/configuration file:

name: Release testing
devices: [ chroot virtual n900 ]

kickstart:
  - chroot: chroot-release.ks
  - virtual: virtual-image-core.ks
  - n900: mer-core-n900.ks

default options:
  - chroot:
    filter: "hardware=chroot"
  - filter: "testset=core"
  - test package prefix: "-tests"

default packages:
  - chroot:
    - mer-core-chroot-tests
  - mer-core-sanity-tests

packages:
  - alc:
    filter: "name=unittests"
    versio: < 1.5.0
    device: [virtual n900]

  - bluez

  - qt5base:
    test packages:
      - mwts-location-tests 
        filter: "type=functional"
        versio: 2.3.1
        device: [virtual n900]
      - qt5base-unittests

Descriptions:

• devices: list of devices to execute tests
• kickstart: map kickstart files to devices
• default options: default options for all packages
  • filter: filter options to testrunner-lite
  • test package prefix: if no test package(s) defined for a package, then test package is the original package name + prefix. See the bluez package below.
• default packages: list of packages to execute always
• packages: package configurations for changed packages
  • version: package version to use
  • device: on which devices to execute the test
  • test packages: list of test packages and their configurations