How Does Contributors' Involvement Influence the Build Status of an Open-Source Software Project?

Transcript

1. Marcel Rebouças
   How Does Contributors’ Involvement
   Influence the Build Status of an
   Open-Source Software Project?
   Renato Olivera Gustavo Pinto Fernando Castor
   mscr@cin.ufpe.br ros3@cin.ufpe.br gpinto@ufpa.br castor@cin.ufpe.br
   

   View Slide

2. Motivation (1/3)
   Casual contributors
   represent a large part
   of the OSS
   community (49%) and
   their contributions are
   far from trivial.
   

   View Slide

3. Motivation (2/3)
   Only 20% of the
   new contributors on
   OSS projects
   become long-term
   members.
   

   View Slide

4. Motivation (3/3)
   Lack of awareness
   and guidance
   during their first
   steps makes it hard
   to contribute!
   

   View Slide

5. They have little
   or no prior
   knowledge on
   the project
   domain
   Casual Contributors
   They might put
   more effort to
   create their
   first pull-
   request
   

   View Slide

6. Are casual contributors more prone
   to create a failing build?
   Research Question
   

   View Slide

7. Methodology
   TravisTorrent
   TravisCI
   CI Build Data
   Commiter Data
   Dataset Dataset without
   
   duplicated users
   User
   Disambiguation
   Technique
   Data
   Cleaning
   Dataset with 1,074
   
   curated projects
   Data
   Processing
   Data
   Statistical
   Tests
   

   View Slide

8. Data Overview
   1,074 projects 35,360 users 619,370 builds
   

   View Slide

9. Data Overview
   # Users
   0
   5000
   10000
   15000
   20000
   Builds
   1 2 3 4 5+
   0
   150000
   300000
   450000
   600000
   Casual
   Non-Casual
   1,074 projects 35,360 users 619,370 builds
   # Builds
   

   View Slide

10. Results
    0
    250
    500
    750
    1000
    No difference
    Higher Casual Success
    Lower Casual Success
    Being a casual contributor
    is not a strong indicator for
    creating failing builds
    # Number of Projects
    

    View Slide

11. 0
    22.5
    45
    67.5
    90
    0
    1.15
    2.3
    3.45
    4.6
    Results
    Casual contributions are smaller, both
    in modified source-code lines and
    modified files
    Median of Modified
    LoC
    Median of Modified
    Files
    

    View Slide

12. 0
    1.15
    2.3
    3.45
    4.6
    No difference
    Higher Casual Success
    Lower Casual Success
    Results
    Projects in which casuals
    fail more than non-casuals
    run more jobs per build.
    Median of jobs per
    build
    

    View Slide

13. Take-Away Message
    Are you a casual contributor?
    

    View Slide

14. Take-Away Message
    Are you a casual contributor?
    Go ahead and contribute!
    

    View Slide

15. View Slide

16. View Slide

17. View Slide

18. View Slide

19. gpinto@ufpa.br
    @gustavopinto
    

    View Slide