The Mer Wiki now uses your Mer user account and password (create account on https://bugs.merproject.org/)
Quality
From Mer Wiki
(Difference between revisions)
(→Metrics) |
(→Metrics) |
||
| Line 62: | Line 62: | ||
{| border="0" cellspacing="0" cellpadding="2" | {| border="0" cellspacing="0" cellpadding="2" | ||
| − | ! colspan=" | + | ! colspan="5" | '''Closed bugs:''' |
|- | |- | ||
! Product: | ! Product: | ||
| − | | colspan=" | + | | colspan="4" | Mer Core |
|- | |- | ||
! Status: | ! Status: | ||
| − | | colspan=" | + | | colspan="4" | RESOLVED, RELEASED, VERIFIED, CLOSED |
|- | |- | ||
| | | | | | ||
| − | | colspan="2" | '''By resolution:''' | + | | colspan="2" | '''By resolution:''' |
| + | | colspan="2" | '''By priority:''' | ||
|- | |- | ||
| − | | || Fixed: || 114 | + | | || Fixed: || 114 || High: || 35 |
|- | |- | ||
| − | | || Dupllicate: || 6 | + | | || Dupllicate: || 6 || Normal: || 37 |
|- | |- | ||
| − | | || Invalid: || 4 | + | | || Invalid: || 4 || Low: || 15 |
| + | |- | ||
| + | | || || || Undecided: || 37 | ||
|- | |- | ||
| | | | | | ||
| − | | colspan=" | + | | colspan="4" | '''By Assignee:''' |
|- | |- | ||
| || Sage || 39 | | || Sage || 39 | ||
| Line 103: | Line 106: | ||
|- | |- | ||
! Total: | ! Total: | ||
| − | | colspan=" | + | | colspan="4" | 124 (51 bugs and 71 tasks) |
|- | |- | ||
|} | |} | ||
Revision as of 07:43, 19 July 2012
Contents |
Quality
Metrics
| Burn-down chart: | |||||
|---|---|---|---|---|---|
| Release | Changed packages | Added packages | Fixes | Bugs/tasks reported* | Bugs/tasks resolved* |
| 0.20120209.1 | 67 | 0 | 11 | 105 | 39 |
| 0.20120315.1 | 36 | 0 | 9 | 27 | 15 |
| 0.20120405.1 | 13 | 2 | 1 | 36 | 2 |
| 0.20120419.2 | 14 | 4 | 13 | 30 | 12 |
| 0.20120517.1 | 15 | 2 | 18 | 9 | 19 |
| 0.20120614.1 | 24 | 9 | 16 | 38 | 13 |
| Total: | 169 | 17 | 68 | 245 | 100 |
(*) From Bugzilla, other values are from releases changelogs
| Open bugs and tasks: | ||||
|---|---|---|---|---|
| Product: | Mer Core | |||
| Status: | NEEDINFO, UNCONFIRMED, NEW, ASSIGNED, TRIAGEDUPSTREAM, REOPENED | |||
| By priority: | By severity: | |||
| High: | 9 | Critical | 1 | |
| Normal: | 43 | Major | 4 | |
| Low: | 86 | Normal | 37 | |
| Trivial | 4 | |||
| Echancement | 1 | |||
| Task | 96 | |||
| Total: | 143 (47 bugs and 96 tasks) | |||
| Closed bugs: | ||||
|---|---|---|---|---|
| Product: | Mer Core | |||
| Status: | RESOLVED, RELEASED, VERIFIED, CLOSED | |||
| By resolution: | By priority: | |||
| Fixed: | 114 | High: | 35 | |
| Dupllicate: | 6 | Normal: | 37 | |
| Invalid: | 4 | Low: | 15 | |
| Undecided: | 37 | |||
| By Assignee: | ||||
| Sage | 39 | |||
| not-taken | 31 | |||
| need-triage | 22 | |||
| Stskeeps | 14 | |||
| lbt | 6 | |||
| letters.random13 | 4 | |||
| arnaud | 3 | |||
| Martin Brook | 2 | |||
| Robin | 2 | |||
| Benjamin Federau | 1 | |||
| Total: | 124 (51 bugs and 71 tasks) | |||
| Mean-time of fixing bugs/tasks, [days] | ||||
|---|---|---|---|---|
| Product: | Mer Core | |||
| Status: | RESOLVED, RELEASED, VERIFIED, CLOSED | |||
| Priority: | Mean-time: | Min: | Max: | |
| Bugs | ||||
| High: | 22.2 | 0.3 | 81.5 | |
| Normal: | 55.3 | 2.7 | 136.7 | |
| Low: | - | - | - | |
| Undecided: | 11.5 | 0.0 | 49.0 | |
| Tasks | ||||
| High: | 46.1 | 0.1 | 108.2 | |
| Normal: | 39.1 | 7.0 | 126.9 | |
| Low: | 37.4 | 9.3 | 97.0 | |
| Undecided: | 20.4 | 0.0 | 80.0 | |
Updated on 18.07.2012
QA Processes
QA tools
QA tools used in Mer:
HowTo's
ToDo
1. Test automation
- Automatic smoke testing
- Create test automation virtual image (with eat, SSH and static IP)
- Setup OTS environment
- Create "flasher" for OTS
- Create smoke test plan
- Test result reporting (QA-reports, see task Mer-244)
- Review OTS and how it fits to the BOSS
- Design to identify test constraints Mer-317
- Netconsole for debugging, http://www.mjmwired.net/kernel/Documentation/networking/netconsole.txt
2. Test coverage
- Create a coverage chart/table for core packages
3. Mer Dashboard
- Mer dashboard Mer-429
- http://www.youtube.com/watch?v=urmp-fmjRro
4. Documentation
- Create Category:About pages for tools and processes
- Create a documentation how to contribute to the QA tests
List of all bugs and tasks related to QA.
Contact
- Mailing lists
- IRC: Channel #mer on irc.freenode.net
Meetings
Future topics
- Bug metrics and QA ToDo list (19.7.2012)
- Test coverage (26.7.2012)
Minutes
- Meeting minutes 2012-07-12, Status update
- Meeting minutes 2012-07-05, Status update
- Meeting minutes 2012-06-21, Acceptance criteria for the tools and tests
- Meeting minutes 2012-06-14, Status update
- Meeting minutes 2012-05-31, Test automation image
- Meeting minutes 2012-05-24, QA tools and OBS
- Meeting minutes 2012-05-10, Status update
- Meeting minutes 2012-05-03, QA process and full log
- Meeting minutes 2012-04-26, Test constraints and mapping
- Meeting minutes 2012-04-19, Test package mapping
- Meeting minutes 2012-04-12, QA process, tools and tests
- Meeting minutes 2012-04-03, Initial meeting