Revision as of 09:26, 19 July 2012 (view source) Esmietti (Talk | contribs) (→‎QA Processes) ← Older edit		Revision as of 09:46, 19 July 2012 (view source) Esmietti (Talk | contribs) (→‎Metrics) Newer edit →
Line 1:		Line 1:
	= Quality =		= Quality =
−
−	== Metrics ==
−
−	{| border="0" cellspacing="0" cellpadding="5" style="text-align:center;"
−	! colspan="6" | '''Burn-down chart:'''
−	|-
−	| '''Release''' || '''Changed packages''' || '''Added packages''' || '''Fixes''' || '''Bugs/tasks reported*''' || '''Bugs/tasks resolved*'''
−	|-
−	| 0.20120209.1 || 67 || 0 || 11 || 105 || 39
−	|-
−	| 0.20120315.1 || 36 || 0 || 9 || 27 || 15
−	|-
−	| 0.20120405.1 || 13 || 2 || 1 || 36 || 2
−	|-
−	| 0.20120419.2 || 14 || 4 || 13 || 30 || 12
−	|-
−	| 0.20120517.1 || 15 || 2 || 18 || 9 || 19
−	|-
−	| 0.20120614.1 || 24 || 9 || 16 || 38 || 13
−	|-
−	! Total:
−	| 169 || 17 || 68 || 245 || 100
−	|-
−	|}
−
−	(*) From Bugzilla, other values are from releases changelogs
−
−
−	{| border="0" cellspacing="0" cellpadding="2"
−	! colspan="5" | '''Open bugs and tasks:'''
−	|-
−	! Product:
−	| colspan="4" | Mer Core
−	|-
−	! Status:
−	| colspan="4" | NEEDINFO, UNCONFIRMED, NEW, ASSIGNED, TRIAGEDUPSTREAM, REOPENED
−	|-
−	| |
−	| colspan="2" | '''By priority:'''
−	| colspan="2" | '''By severity:'''
−	|-
−	| || High: || 9 || Critical || 1
−	|-
−	| || Normal: || 43 || Major || 4
−	|-
−	| || Low: || 86 || Normal || 37
−	|-
−	| || Undecided: || 5 || Trivial || 4
−	|-
−	| colspan="3" | || Echancement || 1
−	|-
−	| colspan="3" | || Task || 96
−	|-
−	! Total:
−	| colspan="4" | 143 (47 bugs and 96 tasks)
−	|-
−	|}
−
−
−
−
−	{| border="0" cellspacing="0" cellpadding="2"
−	! colspan="5" | '''Closed bugs:'''
−	|-
−	! Product:
−	| colspan="4" | Mer Core
−	|-
−	! Status:
−	| colspan="4" | RESOLVED, RELEASED, VERIFIED, CLOSED
−	|-
−	| |
−	| colspan="2" | '''By resolution:'''
−	| colspan="2" | '''By priority:'''
−	|-
−	| || Fixed: || 114 || High: || 35
−	|-
−	| || Dupllicate: || 6 || Normal: || 37
−	|-
−	| || Invalid: || 4 || Low: || 15
−	|-
−	| || || || Undecided: || 37
−	|-
−	| |
−	| colspan="4" | '''By Assignee:'''
−	|-
−	| || Sage || 39
−	|-
−	| || not-taken || 31
−	|-
−	| || need-triage || 22
−	|-
−	| || Stskeeps || 14
−	|-
−	| || lbt || 6
−	|-
−	| || letters.random13 || 4
−	|-
−	| || arnaud || 3
−	|-
−	| || Martin Brook || 2
−	|-
−	| || Robin || 2
−	|-
−	| || Benjamin Federau || 1
−	|-
−	! Total:
−	| colspan="4" | 124 (51 bugs and 71 tasks)
−	|-
−	|}
−
−
−
−	{| border="0" cellspacing="0" cellpadding="2"
−	! colspan="5" | '''Mean-time of fixing bugs/tasks, [days]'''
−	|-
−	! Product:
−	| colspan="4" | Mer Core
−	|-
−	! Status:
−	| colspan="4" | RESOLVED, RELEASED, VERIFIED, CLOSED
−	|-
−	|  || '''Priority:''' || '''Mean-time:''' || '''Min:''' || '''Max:'''
−	|-
−	| '''Bugs''' || || || ||
−	|-
−	| || High: || 22.2 || 0.3 || 81.5
−	|-
−	| || Normal: || 55.3 || 2.7 || 136.7
−	|-
−	| || Low: || - || - || -
−	|-
−	| || Undecided: || 11.5 || 0.0 || 49.0
−	|-
−	| '''Tasks''' || || || ||
−	|-
−	| || High: || 46.1 || 0.1 || 108.2
−	|-
−	| || Normal: || 39.1 || 7.0 || 126.9
−	|-
−	| || Low: || 37.4 || 9.3 || 97.0
−	|-
−	| || Undecided: || 20.4 || 0.0 || 80.0
−	|-
−	|}
−
−
−
−	Updated on 18.07.2012
	== Quality of Mer==		== Quality of Mer==

---

Revision as of 09:46, 19 July 2012

Contents 1 Quality 1.1 Quality of Mer 1.2 QA tools 1.3 ToDo 1.4 Contact 1.5 Meetings 1.5.1 Future topics 1.5.2 Minutes

Quality

Quality of Mer

• Test coverage
• Metrics
• Test processes
• Development
• Terminology/Glossary

QA tools

QA tools used in Mer:

• Tools

HowTo's

• Execute tests
• Writing test-definition XMLs

ToDo

1. Test automation

1. Automatic smoke testing
   1. Create test automation virtual image (with eat, SSH and static IP)
   2. Setup OTS environment
      1. Create "flasher" for OTS
   3. Create smoke test plan
   4. Test result reporting (QA-reports, see task Mer-244)
2. Review OTS and how it fits to the BOSS
3. Design to identify test constraints Mer-317
4. Netconsole for debugging, http://www.mjmwired.net/kernel/Documentation/networking/netconsole.txt

2. Test coverage

1. Create a coverage chart/table for core packages

3. Mer Dashboard

1. Mer dashboard Mer-429
2. http://www.youtube.com/watch?v=urmp-fmjRro

4. Documentation

1. Create Category:About pages for tools and processes
2. Create a documentation how to contribute to the QA tests

List of all bugs and tasks related to QA.

Contact

• Mailing lists
• IRC: Channel #mer on irc.freenode.net

Meetings

Future topics

• Bug metrics and QA ToDo list (19.7.2012)
• Test coverage (26.7.2012)

Minutes

• Meeting minutes 2012-07-12, Status update
• Meeting minutes 2012-07-05, Status update
• Meeting minutes 2012-06-21, Acceptance criteria for the tools and tests
• Meeting minutes 2012-06-14, Status update
• Meeting minutes 2012-05-31, Test automation image
• Meeting minutes 2012-05-24, QA tools and OBS
• Meeting minutes 2012-05-10, Status update
• Meeting minutes 2012-05-03, QA process and full log
• Meeting minutes 2012-04-26, Test constraints and mapping
• Meeting minutes 2012-04-19, Test package mapping
• Meeting minutes 2012-04-12, QA process, tools and tests
• Meeting minutes 2012-04-03, Initial meeting