The Mer Wiki now uses your Mer user account and password (create account on https://bugs.merproject.org/)

Quality/Test coverage

From Mer Wiki
< Quality(Difference between revisions)
Jump to: navigation, search
(Created page with " [http://gitweb.merproject.org/gitweb?p=mer/project-core.git;a=blob;f=packages.xml;h=91ee95b8c5193830421677d6d3f1975a3027e04e;hb=HEAD List of test packages] [http://www.mail-arc…")
 
(→‎Smoke testing)
 
(14 intermediate revisions by one user not shown)
Line 1: Line 1:
  
−
[http://gitweb.merproject.org/gitweb?p=mer/project-core.git;a=blob;f=packages.xml;h=91ee95b8c5193830421677d6d3f1975a3027e04e;hb=HEAD List of test packages]
+
= Test plans =
 +
 
 +
Repositories for Mer tests
 +
repo --name=mer-tests --baseurl=http://repo.pub.meego.com/home:/esmietti%3a/QA%3a/Tests/QA_Tools_Core_i486/ --save
 +
repo --name=mer-tests --baseurl=http://repo.pub.meego.com/home:/esmietti%3a/QA%3a/Tests/QA_Tools_Core_i586/ --save
 +
repo --name=mer-tests --baseurl=http://repo.pub.meego.com/home:/esmietti%3a/QA%3a/Tests/QA_Tools_Core_armv7l/ --save
 +
repo --name=mer-tests --baseurl=http://repo.pub.meego.com/home:/esmietti%3a/QA%3a/Tests/QA_Tools_Core_armv7hl/ --save
 +
 
 +
== Smoke testing ==
 +
 
 +
Minimal set of tests for covering basic functionality of the Mer core.
 +
 
 +
Package pattern for smoke tests
 +
@MerSmokeTests
 +
 
 +
Test plan: [http://epeli.org/mer/qa/testplans/mer_smoke_test_plan.xml mer_smoke_test_plan_v0.1.xml]
 +
 
 +
Execute tests as root, copy user's /home/<user>/.eat-store-env to /root/.
 +
 
 +
= Test coverage =
 +
 
 +
{| border="1" cellspacing="0" cellpadding="5"
 +
|-
 +
! Domain || Test package || Target || # of tests || Status || Comments
 +
|-
 +
| style="background-color:green;" | Communications/Bluetooth || blts-bluetooth || bluez || 28 || Packged || Some of the tests requires seconds device or accessories
 +
|-
 +
| style="background-color:yellow;"|Communications/Bluetooth || mwts-bluetooth || bluez || 44 || Not packaged || Uses Dbus interface, Some of the tests requires seconds device or accessories
 +
|-
 +
| style="background-color:red;"|Communications/Cellular Framework || blts-ofono || ofono || 52 || Not packaged || Maybe out-dated
 +
|-
 +
| style="background-color:red;"|Communications/Cellular Framework || mwts-ofono || ofono || 6 || Not packaged || Out-dated?, Includes SIM functionality
 +
|-
 +
| style="background-color:yellow;"|Core || mwts-filesystem ||  || 30 || Not packaged || Has USB mass storage tests too
 +
|-
 +
| style="background-color:red;"|Core? || blts-watchdog ||  || 3 || Not packaged ||
 +
|-
 +
| style="background-color:red;"|Core? || blts-wlan-core ||  || 11 || Not packaged || Requires WLAN Aps and another device
 +
|-
 +
| style="background-color:red;"|Essentials/Base Essentials || blts-usb || libusb, libusb1 || 4 || Not packaged || Mainly manual testing
 +
|-
 +
| style="background-color:green;"|Graphics/Display & Graphics Adaptation || blts-fbdev || xorg-x11-drv-fbdev || 11 || Packaged || Requires framebuffer
 +
|-
 +
| style="background-color:green;"|Graphics/Input Adaptation || blts-input-devices || xorg-x11-drv-evdev, xorg-x11-drv-keyboard, xorg-x11-drv-mouse || 11 || Packaged || Requires configuration
 +
|-
 +
| style="background-color:yellow;"|Graphics/OpenGL ES || blts-opengles2-perf || llvm, mesa || 19 || Not packaged || Benchmark tests
 +
|-
 +
| style="background-color:green;"|Graphics/X11 || blts-x11 ||  || 49 || Packaged || Includes benchmark tests
 +
|-
 +
| style="background-color:green;"|Multimedia/ALSA || blts-alsa-core || alsa-lib, alsa-core? || 9 || Packaged || Requires configuration
 +
|-
 +
| style="background-color:yellow;"|Multimedia/Gstreamer, Multimedia/Codecs || mwts-gstreamer || gstreamer, gst-plugins-bad-free, gst-plugins-base, libogg, libtheora, libvorbis || 180 || Not packaged || Requires test data. Audio and video test cases
 +
|-
 +
| style="background-color:red;"|Qt/Qt, Qt/Qt Mobility|| mwts-network ||  ||  ||  || Qt Bearer in Qt5?
 +
|-
 +
| style="background-color:red;"|Qt/Qt || mwts-systeminfo || qt || 3 || Not packaged || In Qt5?
 +
|-
 +
| style="background-color:red;"|Qt/Qt, Qt/Qt Mobility || mwts-qtmultimedia || qt, qt-mobility || 17 || Not packaged || In Qt5?, Recording, image viewing, FM radio
 +
|-
 +
| style="background-color:red;"|Qt/Qt, Qt/Qt Mobility || mwts-sensors || qt, qt-mobility || 13 || Not packaged || In Qt5?
 +
|}
 +
 
 +
[https://meego.gitorious.org/meego-quality-assurance/mcts/trees/master MeeGo test assets]
 +
 
 +
[http://gitweb.merproject.org/gitweb?p=mer/project-core.git;a=blob;f=packages.xml;h=91ee95b8c5193830421677d6d3f1975a3027e04e;hb=HEAD List of core packages]
  
 
[http://www.mail-archive.com/mer-general@lists.merproject.org/msg00468.html Package groups]
 
[http://www.mail-archive.com/mer-general@lists.merproject.org/msg00468.html Package groups]

Latest revision as of 13:06, 2 August 2012

[edit] Test plans

Repositories for Mer tests 

repo --name=mer-tests --baseurl=http://repo.pub.meego.com/home:/esmietti%3a/QA%3a/Tests/QA_Tools_Core_i486/ --save
repo --name=mer-tests --baseurl=http://repo.pub.meego.com/home:/esmietti%3a/QA%3a/Tests/QA_Tools_Core_i586/ --save
repo --name=mer-tests --baseurl=http://repo.pub.meego.com/home:/esmietti%3a/QA%3a/Tests/QA_Tools_Core_armv7l/ --save
repo --name=mer-tests --baseurl=http://repo.pub.meego.com/home:/esmietti%3a/QA%3a/Tests/QA_Tools_Core_armv7hl/ --save

[edit] Smoke testing

Minimal set of tests for covering basic functionality of the Mer core.

Package pattern for smoke tests 

@MerSmokeTests

Test plan: mer_smoke_test_plan_v0.1.xml

Execute tests as root, copy user's /home/<user>/.eat-store-env to /root/.

[edit] Test coverage

Domain Test package Target # of tests Status Comments
Communications/Bluetooth blts-bluetooth bluez 28 Packged Some of the tests requires seconds device or accessories
Communications/Bluetooth mwts-bluetooth bluez 44 Not packaged Uses Dbus interface, Some of the tests requires seconds device or accessories
Communications/Cellular Framework blts-ofono ofono 52 Not packaged Maybe out-dated
Communications/Cellular Framework mwts-ofono ofono 6 Not packaged Out-dated?, Includes SIM functionality
Core mwts-filesystem 30 Not packaged Has USB mass storage tests too
Core? blts-watchdog 3 Not packaged
Core? blts-wlan-core 11 Not packaged Requires WLAN Aps and another device
Essentials/Base Essentials blts-usb libusb, libusb1 4 Not packaged Mainly manual testing
Graphics/Display & Graphics Adaptation blts-fbdev xorg-x11-drv-fbdev 11 Packaged Requires framebuffer
Graphics/Input Adaptation blts-input-devices xorg-x11-drv-evdev, xorg-x11-drv-keyboard, xorg-x11-drv-mouse 11 Packaged Requires configuration
Graphics/OpenGL ES blts-opengles2-perf llvm, mesa 19 Not packaged Benchmark tests
Graphics/X11 blts-x11 49 Packaged Includes benchmark tests
Multimedia/ALSA blts-alsa-core alsa-lib, alsa-core? 9 Packaged Requires configuration
Multimedia/Gstreamer, Multimedia/Codecs mwts-gstreamer gstreamer, gst-plugins-bad-free, gst-plugins-base, libogg, libtheora, libvorbis 180 Not packaged Requires test data. Audio and video test cases
Qt/Qt, Qt/Qt Mobility mwts-network Qt Bearer in Qt5?
Qt/Qt mwts-systeminfo qt 3 Not packaged In Qt5?
Qt/Qt, Qt/Qt Mobility mwts-qtmultimedia qt, qt-mobility 17 Not packaged In Qt5?, Recording, image viewing, FM radio
Qt/Qt, Qt/Qt Mobility mwts-sensors qt, qt-mobility 13 Not packaged In Qt5?

MeeGo test assets

List of core packages

Package groups

Retrieved from "https://wiki.merproject.org/wiki/index.php?title=Quality/Test_coverage&oldid=2259"
Personal tools