The Polarsys Maturity Model, unconference workshop, session 2

Transcript

1. The Polarsys Maturity Model Unconference workshop – session 2. Measuring the different dimensions Ga¨ el Blondelle, Boris Baldassari, Jesus M. Gonzalez-Barahona, Daniel Izquierdo (presenting) https://polarsys.org/wiki/Maturity_Assessment_WG Polarsys Meeting Ludwigsburg (Germany), October 27th 2014 Blondelle, Baldassari, Izquierdo, Gonzalez-Barahona (Bitergia) Polarsys Maturity Model Polarsys Working Group Meeting Oct 2014 / 19
2. c 2014 Some rights reserved. This presentation is distributed under the “Attribution-ShareAlike 3.0” license, by Creative Commons, available at http://creativecommons.org/licenses/by-sa/3.0/ Blondelle, Baldassari, Izquierdo, Gonzalez-Barahona (Bitergia) Polarsys Maturity Model Polarsys Working Group Meeting Oct 2014 / 19
3. Structure of the presentation 1 Mapping Attributes Mapping Attributes: Goals Mapping Attributes: Questions Mapping Attributes: Measures 2 Measures Data Source: SonarQube Data Source: Grimoire Data Source: Rule-Checking, PMI 3 Discussion Blondelle, Baldassari, Izquierdo, Gonzalez-Barahona (Bitergia) Polarsys Maturity Model Polarsys Working Group Meeting Oct 2014 / 19
4. Mapping Attributes Blondelle, Baldassari, Izquierdo, Gonzalez-Barahona (Bitergia) Polarsys Maturity Model Polarsys Working Group Meeting Oct 2014 / 19
5. Mapping attributes Follow a GQM approach Goal: main maturity attributes to be measured, Ecosystem, Process and Product Questions: needed to focus the study of the goals Measures: quantitative values associated to each question Blondelle, Baldassari, Izquierdo, Gonzalez-Barahona (Bitergia) Polarsys Maturity Model Polarsys Working Group Meeting Oct 2014 / 19
6. Mapping attributes: goals Main goals: Ecosystem: the maturity of the community around the project Process: the maturity of the process around the project Product: the maturity of the final product Blondelle, Baldassari, Izquierdo, Gonzalez-Barahona (Bitergia) Polarsys Maturity Model Polarsys Working Group Meeting Oct 2014 / 19
7. Mapping attributes: goals Ecosystem: Activity Diversity Responsiveness Support Visibility Usage User feedback Blondelle, Baldassari, Izquierdo, Gonzalez-Barahona (Bitergia) Polarsys Maturity Model Polarsys Working Group Meeting Oct 2014 / 19
8. Mapping attributes: goals Process: Configuration management Change management Intellectual property management Planning management Test management Blondelle, Baldassari, Izquierdo, Gonzalez-Barahona (Bitergia) Polarsys Maturity Model Polarsys Working Group Meeting Oct 2014 / 19
9. Mapping attributes: goals Product: Analysability Changeability Reliability Reusability Blondelle, Baldassari, Izquierdo, Gonzalez-Barahona (Bitergia) Polarsys Maturity Model Polarsys Working Group Meeting Oct 2014 / 19
10. Mapping attributes: questions Ecosystem -> Activity: Activity on the developer mailing list User mailing list activity Activity on the source code management system Process -> Planning management: Is the project on time according to its schedule? Is the project having regular milestones? Blondelle, Baldassari, Izquierdo, Gonzalez-Barahona (Bitergia) Polarsys Maturity Model Polarsys Working Group Meeting Oct 2014 / 19
11. Mapping attributes: measures Ecosystem -> Activity -> Developers mailing activity: Number of posts in the developers mailing list in the last month Ecosystem -> Activity -> Code activity: Number of commits in the last month Number of committed files in the last month Ecosystem -> Activity -> Users mailing activity: Number of posts in the users mailing list in the last month Blondelle, Baldassari, Izquierdo, Gonzalez-Barahona (Bitergia) Polarsys Maturity Model Polarsys Working Group Meeting Oct 2014 / 19
12. Measures Blondelle, Baldassari, Izquierdo, Gonzalez-Barahona (Bitergia) Polarsys Maturity Model Polarsys Working Group Meeting Oct 2014 / 19
13. Measures Some recommendations: Combination of measures for some attributes Single number for each measure Temporal specification Reuse of measurements when it makes sense Balance between simplicity and capturing the attribute Blondelle, Baldassari, Izquierdo, Gonzalez-Barahona (Bitergia) Polarsys Maturity Model Polarsys Working Group Meeting Oct 2014 / 19
14. Measures Three main data sources: Source code metrics: SonarQube Process and community metrics: Grimoire toolset Checks: PMI, PMD or Findbugs Blondelle, Baldassari, Izquierdo, Gonzalez-Barahona (Bitergia) Polarsys Maturity Model Polarsys Working Group Meeting Oct 2014 / 19
15. Source code metrics: SonarQube Some of the metrics: Function cloning, cyclomatic complexity, depth of inheritance tree Number of public attributes, number of public methods, comment rate % of lines covered by tests, number of total attributes, number of total methods Blondelle, Baldassari, Izquierdo, Gonzalez-Barahona (Bitergia) Polarsys Maturity Model Polarsys Working Group Meeting Oct 2014 / 19
16. Process and Community metrics: Grimoire Number of commits, authors, number of committed files, file stability index Updates, authors or defect density in the issue tracking system Number of posts by developers or non developers in developer or users mailing lists Developer response ratio in mailing lists, number of threads Blondelle, Baldassari, Izquierdo, Gonzalez-Barahona (Bitergia) Polarsys Maturity Model Polarsys Working Group Meeting Oct 2014 / 19
17. Checks: Rule-Checking tools, PMI SCM or ITS access info in the PMI, licenses identification, on time for next milestone, number of milestones, adherence to reusability tools non conformities index for reliability, reliability practice acquired Blondelle, Baldassari, Izquierdo, Gonzalez-Barahona (Bitergia) Polarsys Maturity Model Polarsys Working Group Meeting Oct 2014 / 19
18. Discussion Blondelle, Baldassari, Izquierdo, Gonzalez-Barahona (Bitergia) Polarsys Maturity Model Polarsys Working Group Meeting Oct 2014 / 19
19. Discussion Quality Attributes: How are the quality attributes capturing your needs? Do we need extra quality attributes? Questions: Are the questions properly capturing the needs of each QA? What are the interesting questions for your project? Extra questions? (demographics of my project, timezones of activity) Measures: Extra metrics per question? Missing metrics that should be there? Extra data sources? (review system, wikis or IRC activity) Blondelle, Baldassari, Izquierdo, Gonzalez-Barahona (Bitergia) Polarsys Maturity Model Polarsys Working Group Meeting Oct 2014 / 19