The Mer Wiki now uses your Mer user account and password (create account on https://bugs.merproject.org/)
Quality
From Mer Wiki
(Difference between revisions)
(→Metrics) |
(→Metrics) |
||
Line 62: | Line 62: | ||
{| border="0" cellspacing="0" cellpadding="2" | {| border="0" cellspacing="0" cellpadding="2" | ||
− | ! colspan=" | + | ! colspan="5" | '''Closed bugs:''' |
|- | |- | ||
! Product: | ! Product: | ||
− | | colspan=" | + | | colspan="4" | Mer Core |
|- | |- | ||
! Status: | ! Status: | ||
− | | colspan=" | + | | colspan="4" | RESOLVED, RELEASED, VERIFIED, CLOSED |
|- | |- | ||
| | | | | | ||
− | | colspan="2" | '''By resolution:''' | + | | colspan="2" | '''By resolution:''' |
+ | | colspan="2" | '''By priority:''' | ||
|- | |- | ||
− | | || Fixed: || 114 | + | | || Fixed: || 114 || High: || 35 |
|- | |- | ||
− | | || Dupllicate: || 6 | + | | || Dupllicate: || 6 || Normal: || 37 |
|- | |- | ||
− | | || Invalid: || 4 | + | | || Invalid: || 4 || Low: || 15 |
+ | |- | ||
+ | | || || || Undecided: || 37 | ||
|- | |- | ||
| | | | | | ||
− | | colspan=" | + | | colspan="4" | '''By Assignee:''' |
|- | |- | ||
| || Sage || 39 | | || Sage || 39 | ||
Line 103: | Line 106: | ||
|- | |- | ||
! Total: | ! Total: | ||
− | | colspan=" | + | | colspan="4" | 124 (51 bugs and 71 tasks) |
|- | |- | ||
|} | |} |
Revision as of 07:43, 19 July 2012
Contents |
Quality
Metrics
Burn-down chart: | |||||
---|---|---|---|---|---|
Release | Changed packages | Added packages | Fixes | Bugs/tasks reported* | Bugs/tasks resolved* |
0.20120209.1 | 67 | 0 | 11 | 105 | 39 |
0.20120315.1 | 36 | 0 | 9 | 27 | 15 |
0.20120405.1 | 13 | 2 | 1 | 36 | 2 |
0.20120419.2 | 14 | 4 | 13 | 30 | 12 |
0.20120517.1 | 15 | 2 | 18 | 9 | 19 |
0.20120614.1 | 24 | 9 | 16 | 38 | 13 |
Total: | 169 | 17 | 68 | 245 | 100 |
(*) From Bugzilla, other values are from releases changelogs
Open bugs and tasks: | ||||
---|---|---|---|---|
Product: | Mer Core | |||
Status: | NEEDINFO, UNCONFIRMED, NEW, ASSIGNED, TRIAGEDUPSTREAM, REOPENED | |||
By priority: | By severity: | |||
High: | 9 | Critical | 1 | |
Normal: | 43 | Major | 4 | |
Low: | 86 | Normal | 37 | |
Trivial | 4 | |||
Echancement | 1 | |||
Task | 96 | |||
Total: | 143 (47 bugs and 96 tasks) |
Closed bugs: | ||||
---|---|---|---|---|
Product: | Mer Core | |||
Status: | RESOLVED, RELEASED, VERIFIED, CLOSED | |||
By resolution: | By priority: | |||
Fixed: | 114 | High: | 35 | |
Dupllicate: | 6 | Normal: | 37 | |
Invalid: | 4 | Low: | 15 | |
Undecided: | 37 | |||
By Assignee: | ||||
Sage | 39 | |||
not-taken | 31 | |||
need-triage | 22 | |||
Stskeeps | 14 | |||
lbt | 6 | |||
letters.random13 | 4 | |||
arnaud | 3 | |||
Martin Brook | 2 | |||
Robin | 2 | |||
Benjamin Federau | 1 | |||
Total: | 124 (51 bugs and 71 tasks) |
Mean-time of fixing bugs/tasks, [days] | ||||
---|---|---|---|---|
Product: | Mer Core | |||
Status: | RESOLVED, RELEASED, VERIFIED, CLOSED | |||
Priority: | Mean-time: | Min: | Max: | |
Bugs | ||||
High: | 22.2 | 0.3 | 81.5 | |
Normal: | 55.3 | 2.7 | 136.7 | |
Low: | - | - | - | |
Undecided: | 11.5 | 0.0 | 49.0 | |
Tasks | ||||
High: | 46.1 | 0.1 | 108.2 | |
Normal: | 39.1 | 7.0 | 126.9 | |
Low: | 37.4 | 9.3 | 97.0 | |
Undecided: | 20.4 | 0.0 | 80.0 |
Updated on 18.07.2012
QA Processes
QA tools
QA tools used in Mer:
HowTo's
ToDo
1. Test automation
- Automatic smoke testing
- Create test automation virtual image (with eat, SSH and static IP)
- Setup OTS environment
- Create "flasher" for OTS
- Create smoke test plan
- Test result reporting (QA-reports, see task Mer-244)
- Review OTS and how it fits to the BOSS
- Design to identify test constraints Mer-317
- Netconsole for debugging, http://www.mjmwired.net/kernel/Documentation/networking/netconsole.txt
2. Test coverage
- Create a coverage chart/table for core packages
3. Mer Dashboard
- Mer dashboard Mer-429
- http://www.youtube.com/watch?v=urmp-fmjRro
4. Documentation
- Create Category:About pages for tools and processes
- Create a documentation how to contribute to the QA tests
List of all bugs and tasks related to QA.
Contact
- Mailing lists
- IRC: Channel #mer on irc.freenode.net
Meetings
Future topics
- Bug metrics and QA ToDo list (19.7.2012)
- Test coverage (26.7.2012)
Minutes
- Meeting minutes 2012-07-12, Status update
- Meeting minutes 2012-07-05, Status update
- Meeting minutes 2012-06-21, Acceptance criteria for the tools and tests
- Meeting minutes 2012-06-14, Status update
- Meeting minutes 2012-05-31, Test automation image
- Meeting minutes 2012-05-24, QA tools and OBS
- Meeting minutes 2012-05-10, Status update
- Meeting minutes 2012-05-03, QA process and full log
- Meeting minutes 2012-04-26, Test constraints and mapping
- Meeting minutes 2012-04-19, Test package mapping
- Meeting minutes 2012-04-12, QA process, tools and tests
- Meeting minutes 2012-04-03, Initial meeting