The Mer Wiki now uses your Mer user account and password (create account on https://bugs.merproject.org/)


Talk:Quality/Test processes

From Mer Wiki
(Difference between revisions)
Jump to: navigation, search
(Test mapping / Test plan configuration)
Line 15: Line 15:
 
   - chroot: chroot-release.ks
 
   - chroot: chroot-release.ks
 
   - virtual: virtual-image-core.ks
 
   - virtual: virtual-image-core.ks
   - n900: mer-core-n900.ks
+
   - n900: nemo-n900.ks
  
 
default options:
 
default options:
Line 47: Line 47:
 
</pre>
 
</pre>
  
'''Descriptions''':
+
'''Description''':
  
* devices: list of devices to execute tests
+
* devices: a list of devices for the tests are executed
* kickstart: map kickstart files to devices
+
* kickstart: mapping kickstart files to devices
* default options: default options for all packages
+
* default options: default options for devices
 +
** filter: filter options to testrunner-lite
 +
** test package prefix: if test package(s) are not defined for a package, then trying to use "original package name + prefix" test package. See the bluez package below.
 +
* default packages: a list of test packages that are always executed
 +
* packages: the actual package mapping
 
** filter: filter options to testrunner-lite
 
** filter: filter options to testrunner-lite
** test package prefix: if no test package(s) defined for a package, then test package is the original package name + prefix. See the bluez package below.
 
* default packages: list of packages to execute always
 
* packages: package configurations for changed packages
 
 
** version: package version to use
 
** version: package version to use
 
** device: on which devices to execute the test
 
** device: on which devices to execute the test
 
** test packages: list of test packages and their configurations
 
** test packages: list of test packages and their configurations

Revision as of 16:39, 22 April 2012

Test mapping / Test plan configuration

Test mapping.png

  1. Test request comes in. The request has parameters such as stage and "changed packages" list
  2. Testplanner reads the configuration/mapping file and creates test plan(s)
  3. Kickstart files are delivered to image builder and test plans for test automation

Mapping/configuration file:

name: Release testing
devices: [ chroot virtual n900 ]

kickstart:
  - chroot: chroot-release.ks
  - virtual: virtual-image-core.ks
  - n900: nemo-n900.ks

default options:
  - chroot:
    filter: "hardware=chroot"
  - all:
    test package prefix: "-tests"

default packages:
  - chroot:
    - mer-core-chroot-tests
  - all:
    - mer-core-sanity-tests

packages:
  - alc:
    filter: "name=unittests"
    versio: < 1.5.0
    device: [virtual n900]

  - bluez

  - qt5base:
    test packages:
      - mwts-location-tests 
        filter: "type=functional"
        versio: 2.3.1
        device: [virtual n900]
      - qt5base-unittests

Description:

  • devices: a list of devices for the tests are executed
  • kickstart: mapping kickstart files to devices
  • default options: default options for devices
    • filter: filter options to testrunner-lite
    • test package prefix: if test package(s) are not defined for a package, then trying to use "original package name + prefix" test package. See the bluez package below.
  • default packages: a list of test packages that are always executed
  • packages: the actual package mapping
    • filter: filter options to testrunner-lite
    • version: package version to use
    • device: on which devices to execute the test
    • test packages: list of test packages and their configurations
Personal tools