The Mer Wiki now uses your Mer user account and password (create account on https://bugs.merproject.org/)
Quality/Test coverage
From Mer Wiki
< Quality(Difference between revisions)
(→Smoke testing) |
|||
| (13 intermediate revisions by one user not shown) | |||
| Line 1: | Line 1: | ||
| + | |||
| + | = Test plans = | ||
| + | |||
| + | Repositories for Mer tests | ||
| + | repo --name=mer-tests --baseurl=http://repo.pub.meego.com/home:/esmietti%3a/QA%3a/Tests/QA_Tools_Core_i486/ --save | ||
| + | repo --name=mer-tests --baseurl=http://repo.pub.meego.com/home:/esmietti%3a/QA%3a/Tests/QA_Tools_Core_i586/ --save | ||
| + | repo --name=mer-tests --baseurl=http://repo.pub.meego.com/home:/esmietti%3a/QA%3a/Tests/QA_Tools_Core_armv7l/ --save | ||
| + | repo --name=mer-tests --baseurl=http://repo.pub.meego.com/home:/esmietti%3a/QA%3a/Tests/QA_Tools_Core_armv7hl/ --save | ||
| + | |||
| + | == Smoke testing == | ||
| + | |||
| + | Minimal set of tests for covering basic functionality of the Mer core. | ||
| + | |||
| + | Package pattern for smoke tests | ||
| + | @MerSmokeTests | ||
| + | |||
| + | Test plan: [http://epeli.org/mer/qa/testplans/mer_smoke_test_plan.xml mer_smoke_test_plan_v0.1.xml] | ||
| + | |||
| + | Execute tests as root, copy user's /home/<user>/.eat-store-env to /root/. | ||
| + | |||
| + | = Test coverage = | ||
| + | |||
| + | {| border="1" cellspacing="0" cellpadding="5" | ||
| + | |- | ||
| + | ! Domain || Test package || Target || # of tests || Status || Comments | ||
| + | |- | ||
| + | | style="background-color:green;" | Communications/Bluetooth || blts-bluetooth || bluez || 28 || Packged || Some of the tests requires seconds device or accessories | ||
| + | |- | ||
| + | | style="background-color:yellow;"|Communications/Bluetooth || mwts-bluetooth || bluez || 44 || Not packaged || Uses Dbus interface, Some of the tests requires seconds device or accessories | ||
| + | |- | ||
| + | | style="background-color:red;"|Communications/Cellular Framework || blts-ofono || ofono || 52 || Not packaged || Maybe out-dated | ||
| + | |- | ||
| + | | style="background-color:red;"|Communications/Cellular Framework || mwts-ofono || ofono || 6 || Not packaged || Out-dated?, Includes SIM functionality | ||
| + | |- | ||
| + | | style="background-color:yellow;"|Core || mwts-filesystem || || 30 || Not packaged || Has USB mass storage tests too | ||
| + | |- | ||
| + | | style="background-color:red;"|Core? || blts-watchdog || || 3 || Not packaged || | ||
| + | |- | ||
| + | | style="background-color:red;"|Core? || blts-wlan-core || || 11 || Not packaged || Requires WLAN Aps and another device | ||
| + | |- | ||
| + | | style="background-color:red;"|Essentials/Base Essentials || blts-usb || libusb, libusb1 || 4 || Not packaged || Mainly manual testing | ||
| + | |- | ||
| + | | style="background-color:green;"|Graphics/Display & Graphics Adaptation || blts-fbdev || xorg-x11-drv-fbdev || 11 || Packaged || Requires framebuffer | ||
| + | |- | ||
| + | | style="background-color:green;"|Graphics/Input Adaptation || blts-input-devices || xorg-x11-drv-evdev, xorg-x11-drv-keyboard, xorg-x11-drv-mouse || 11 || Packaged || Requires configuration | ||
| + | |- | ||
| + | | style="background-color:yellow;"|Graphics/OpenGL ES || blts-opengles2-perf || llvm, mesa || 19 || Not packaged || Benchmark tests | ||
| + | |- | ||
| + | | style="background-color:green;"|Graphics/X11 || blts-x11 || || 49 || Packaged || Includes benchmark tests | ||
| + | |- | ||
| + | | style="background-color:green;"|Multimedia/ALSA || blts-alsa-core || alsa-lib, alsa-core? || 9 || Packaged || Requires configuration | ||
| + | |- | ||
| + | | style="background-color:yellow;"|Multimedia/Gstreamer, Multimedia/Codecs || mwts-gstreamer || gstreamer, gst-plugins-bad-free, gst-plugins-base, libogg, libtheora, libvorbis || 180 || Not packaged || Requires test data. Audio and video test cases | ||
| + | |- | ||
| + | | style="background-color:red;"|Qt/Qt, Qt/Qt Mobility|| mwts-network || || || || Qt Bearer in Qt5? | ||
| + | |- | ||
| + | | style="background-color:red;"|Qt/Qt || mwts-systeminfo || qt || 3 || Not packaged || In Qt5? | ||
| + | |- | ||
| + | | style="background-color:red;"|Qt/Qt, Qt/Qt Mobility || mwts-qtmultimedia || qt, qt-mobility || 17 || Not packaged || In Qt5?, Recording, image viewing, FM radio | ||
| + | |- | ||
| + | | style="background-color:red;"|Qt/Qt, Qt/Qt Mobility || mwts-sensors || qt, qt-mobility || 13 || Not packaged || In Qt5? | ||
| + | |} | ||
| + | |||
| + | [https://meego.gitorious.org/meego-quality-assurance/mcts/trees/master MeeGo test assets] | ||
| + | |||
[http://gitweb.merproject.org/gitweb?p=mer/project-core.git;a=blob;f=packages.xml;h=91ee95b8c5193830421677d6d3f1975a3027e04e;hb=HEAD List of core packages] | [http://gitweb.merproject.org/gitweb?p=mer/project-core.git;a=blob;f=packages.xml;h=91ee95b8c5193830421677d6d3f1975a3027e04e;hb=HEAD List of core packages] | ||
[http://www.mail-archive.com/mer-general@lists.merproject.org/msg00468.html Package groups] | [http://www.mail-archive.com/mer-general@lists.merproject.org/msg00468.html Package groups] | ||
Latest revision as of 13:06, 2 August 2012
[edit] Test plans
Repositories for Mer tests
repo --name=mer-tests --baseurl=http://repo.pub.meego.com/home:/esmietti%3a/QA%3a/Tests/QA_Tools_Core_i486/ --save repo --name=mer-tests --baseurl=http://repo.pub.meego.com/home:/esmietti%3a/QA%3a/Tests/QA_Tools_Core_i586/ --save repo --name=mer-tests --baseurl=http://repo.pub.meego.com/home:/esmietti%3a/QA%3a/Tests/QA_Tools_Core_armv7l/ --save repo --name=mer-tests --baseurl=http://repo.pub.meego.com/home:/esmietti%3a/QA%3a/Tests/QA_Tools_Core_armv7hl/ --save
[edit] Smoke testing
Minimal set of tests for covering basic functionality of the Mer core.
Package pattern for smoke tests
@MerSmokeTests
Test plan: mer_smoke_test_plan_v0.1.xml
Execute tests as root, copy user's /home/<user>/.eat-store-env to /root/.
[edit] Test coverage
| Domain | Test package | Target | # of tests | Status | Comments |
|---|---|---|---|---|---|
| Communications/Bluetooth | blts-bluetooth | bluez | 28 | Packged | Some of the tests requires seconds device or accessories |
| Communications/Bluetooth | mwts-bluetooth | bluez | 44 | Not packaged | Uses Dbus interface, Some of the tests requires seconds device or accessories |
| Communications/Cellular Framework | blts-ofono | ofono | 52 | Not packaged | Maybe out-dated |
| Communications/Cellular Framework | mwts-ofono | ofono | 6 | Not packaged | Out-dated?, Includes SIM functionality |
| Core | mwts-filesystem | 30 | Not packaged | Has USB mass storage tests too | |
| Core? | blts-watchdog | 3 | Not packaged | ||
| Core? | blts-wlan-core | 11 | Not packaged | Requires WLAN Aps and another device | |
| Essentials/Base Essentials | blts-usb | libusb, libusb1 | 4 | Not packaged | Mainly manual testing |
| Graphics/Display & Graphics Adaptation | blts-fbdev | xorg-x11-drv-fbdev | 11 | Packaged | Requires framebuffer |
| Graphics/Input Adaptation | blts-input-devices | xorg-x11-drv-evdev, xorg-x11-drv-keyboard, xorg-x11-drv-mouse | 11 | Packaged | Requires configuration |
| Graphics/OpenGL ES | blts-opengles2-perf | llvm, mesa | 19 | Not packaged | Benchmark tests |
| Graphics/X11 | blts-x11 | 49 | Packaged | Includes benchmark tests | |
| Multimedia/ALSA | blts-alsa-core | alsa-lib, alsa-core? | 9 | Packaged | Requires configuration |
| Multimedia/Gstreamer, Multimedia/Codecs | mwts-gstreamer | gstreamer, gst-plugins-bad-free, gst-plugins-base, libogg, libtheora, libvorbis | 180 | Not packaged | Requires test data. Audio and video test cases |
| Qt/Qt, Qt/Qt Mobility | mwts-network | Qt Bearer in Qt5? | |||
| Qt/Qt | mwts-systeminfo | qt | 3 | Not packaged | In Qt5? |
| Qt/Qt, Qt/Qt Mobility | mwts-qtmultimedia | qt, qt-mobility | 17 | Not packaged | In Qt5?, Recording, image viewing, FM radio |
| Qt/Qt, Qt/Qt Mobility | mwts-sensors | qt, qt-mobility | 13 | Not packaged | In Qt5? |
