Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Modeling Changeset Topics

Modeling Changeset Topics

Christopher S. Corley, Kelly L. Kashuda
The University of Alabama

Daniel S. May
Swarthmore College

Nicholas A. Kraft
ABB Corporate Research

Topic modeling has been applied to several areas of software engineering, such as bug localization, feature location, triaging change requests, and traceability link recovery. Many of these approaches combine mining unstructured data, such as bug reports, with topic modeling a snapshot (or release) of source code. However, source code evolves, which causes models to become obsolete. In this paper, we explore the approach of topic modeling changesets over the traditional release approach. We conduct an exploratory study of four open source systems. We investigate the differences in corpora in each project, and evaluate the topic distinctness of the models.

*Note*: these slides were animation-heavy, YouTube recording available here: https://www.youtube.com/watch?v=S12B_CTeUtA

Christopher Corley

September 30, 2014
Tweet

More Decks by Christopher Corley

Other Decks in Research

Transcript

  1. Modeling Changeset Topics C.S. Corley, K.L. Kashuda, D.S. May, N.A.

    Kraft @excsc [email protected] cscorley/mud2014-modeling-changeset-topics
  2. 3

  3. 4 1

  4. 4 1

  5. 5 2

  6. 5 2

  7. 5 2

  8. 5 2

  9. 7

  10. 9 ƭ ƭ ƭ ƭ Release A … ƭ ƭ

    ƭ ƭ A+1 ƭ ƭ ƭ ƭ A+2 ƭ ƭ ƭ ƭ A+3 ƭ ƭ ƭ ƭ Release B
  11. 10 ƭ ƭ ƭ ƭ Release A … ƭ ƭ

    ƭ ƭ A+1 ƭ ƭ ƭ ƭ A+2 ƭ ƭ ƭ ƭ A+3 ƭ ƭ ƭ ƭ Release B
  12. 10 ƭ ƭ ƭ ƭ Release A … ƭ ƭ

    ƭ ƭ A+1 ƭ ƭ ƭ ƭ A+2 ƭ ƭ ƭ ƭ A+3 ƭ ƭ ƭ ƭ Release B ƭ ƭ ƭ ƭ
  13. 11

  14. 11 ƃ ƃ ƃ ƃ ƃ Rome wasn’t built in

    a day ƭ ƭ ƭ ƭ ƭ ƭ ƭ … neither is software.
  15. 12 ƭ ƭ ƭ ƭ Release A … ƭ ƭ

    ƭ ƭ A+1 ƭ ƭ ƭ ƭ A+2 ƭ ƭ ƭ ƭ A+3 ƭ ƭ ƭ ƭ Release B ƭ ƭ ƭ ƭ ƭ ƭ ƭ ƭ ƭ ƭ
  16. 12 ƭ ƭ ƭ ƭ Release A … ƭ ƭ

    ƭ ƭ A+1 ƭ ƭ ƭ ƭ A+2 ƭ ƭ ƭ ƭ A+3 ƭ ƭ ƭ ƭ Release B ƭ ƭ ƭ ƭ ƭ ƭ ƭ ƭ ƭ ƭ (not a good idea)
  17. 13 ƭ ƭ ƭ ƭ Release A … ƭ ƭ

    ƭ ƭ A+1 ƭ ƭ ƭ ƭ A+2 ƭ ƭ ƭ ƭ A+3 ƭ ƭ ƭ ƭ Release B
  18. 13 ƭ ƭ ƭ ƭ Release A … ƭ ƭ

    ƭ ƭ A+1 ƭ ƭ ƭ ƭ A+2 ƭ ƭ ƭ ƭ A+3 ƭ ƭ ƭ ƭ Release B ƭ ⭈ ƭ ƭ ⭈ ƭ ƭ ƭ ⭈
  19. 13 ƭ ƭ ƭ ƭ Release A … ƭ ƭ

    ƭ ƭ A+1 ƭ ƭ ƭ ƭ A+2 ƭ ƭ ƭ ƭ A+3 ƭ ƭ ƭ ƭ Release B ƭ ƭ ƭ ƭ ƭ ⭈ ƭ ƭ ⭈ ƭ ƭ ƭ ⭈
  20. 13 ƭ ƭ ƭ ƭ Release A … ƭ ƭ

    ƭ ƭ A+1 ƭ ƭ ƭ ƭ A+2 ƭ ƭ ƭ ƭ A+3 ƭ ƭ ƭ ƭ Release B ƭ ƭ ƭ ƭ (a much better idea) ƭ ⭈ ƭ ƭ ⭈ ƭ ƭ ƭ ⭈
  21. 16 ƭ ƭ ƭ ƭ Release A … ƭ ƭ

    ƭ ƭ A+1 ƭ ƭ ƭ ƭ A+2 ƭ ƭ ƭ ƭ A+3 ƭ ƭ ƭ ƭ Release B Source code repositories!
  22. 17 ƭ ƭ ƭ ƭ Release A … ƭ ƭ

    ƭ ƭ A+1 ƭ ƭ ƭ ƭ A+2 ƭ ƭ ƭ ƭ A+3 ƭ ƭ ƭ ƭ Release B But, how?
  23. 17 ƭ ƭ ƭ ƭ Release A … ƭ ƭ

    ƭ ƭ A+1 ƭ ƭ ƭ ƭ A+2 ƭ ƭ ƭ ƭ A+3 ƭ ƭ ƭ ƭ Release B But, how?
  24. 18 ƭ ƭ ƭ ƭ Release A … ƭ ƭ

    ƭ ƭ A+1 ƭ ƭ ƭ ƭ A+2 ƭ ƭ ƭ ƭ A+3 ƭ ƭ ƭ ƭ Release B
  25. 18 ƭ ƭ ƭ ƭ Release A … ƭ ƭ

    ƭ ƭ A+1 ƭ ƭ ƭ ƭ A+2 ƭ ƭ ƭ ƭ A+3 ƭ ƭ ƭ ƭ Release B diff A..A+1 diff A+1..A+2 diff A+2..A+3
  26. 18 ƭ ƭ ƭ ƭ Release A … ƭ ƭ

    ƭ ƭ A+1 ƭ ƭ ƭ ƭ A+2 ƭ ƭ ƭ ƭ A+3 ƭ ƭ ƭ ƭ Release B
  27. 19 Release Changeset ƭ ƭ ƭ ƭ ƭ ƭ ƭ

    ƭ How does the corpus change?
  28. 19 Release Changeset ƭ ƭ ƭ ƭ ƭ ƭ ƭ

    ƭ How does the corpus change? How does the model change?
  29. 20 99.7 % 93.1 % 93.5 % 67.1 % AspectJ

    Joda-Time RQ1: cosine similarity
  30. 21 AspectJ Joda-Time 2.31 ! 3.17 3.75 ! 2.78 1.34

    ! 1.03 ! RQ2: distinctness score
  31. 21 AspectJ Joda-Time 2.31 ! 3.17 3.75 ! 2.78 1.34

    ! 1.03 2.59 ! 3.56 ! RQ2: distinctness score
  32. 22 Release Changeset ƭ ƭ ƭ ƭ ƭ ƭ ƭ

    ƭ How does the corpus change? How does the model change?
  33. 23 Modeling Changeset Topics C.S. Corley, K.L. Kashuda, D.S. May,

    N.A. Kraft @excsc [email protected] cscorley/mud2014-modeling-changeset-topics
  34. 24 The Way that can be told of is not

    the eternal Way; The name that can be named is not the eternal name. The Nameless is the origin of Heaven and Earth; The Named is the mother of all things. Therefore let there always be non-being, so we may see their subtlety, And let there always be being, so we may see their outcome. The two are the same, But after they are produced, they have different names.
  35. 24 The Nameless is the origin of Heaven and Earth;

    The Named is the mother of all things. Therefore let there always be non-being, so we may see their subtlety, And let there always be being, so we may see their outcome. The two are the same, But after they are produced, they have different names. They both may be called deep and profound. Deeper and more profound, The door of all subtleties!
  36. 24 The Nameless is the origin of Heaven and Earth;

    The named is the mother of all things. ! Therefore let there always be non-being, so we may see their subtlety, And let there always be being, so we may see their outcome. The two are the same, But after they are produced, they have different names. They both may be called deep and profound. Deeper and more profound, The door of all subtleties!
  37. 25 ! ! ! ! ! The Way that can

    be told of is not the eternal Way; The name that can be named is not the eternal name. ! The Named is the mother of all things. The named is the mother of all things. ! ! ! ! ! ! ! ! They both may be called deep and profound. Deeper and more profound, The door of all subtleties! diff --git a/lao b/tzu index 635ef2c..5af88a8 100644 --- a/lao +++ b/tzu @@ -1,7 +1,6 @@ -The Way that can be told of is not the eternal Way; -The name that can be named is not the eternal name. The Nameless is the origin of Heaven and Earth; -The Named is the mother of all things. +The named is the mother of all things. + Therefore let there always be non-being, so we may see their subtlety, And let there always be being, @@ -9,3 +8,6 @@ And let there always be being, The two are the same, But after they are produced, they have different names. +They both may be called deep and profound. +Deeper and more profound, +The door of all subtleties!
  38. 25 ! ! ! ! ! The Way that can

    be told of is not the eternal Way; The name that can be named is not the eternal name. The Nameless is the origin of Heaven and Earth; The Named is the mother of all things. The named is the mother of all things. Therefore let there always be non-being, so we may see their subtlety, And let there always be being, ! The two are the same, But after they are produced, they have different names. They both may be called deep and profound. Deeper and more profound, The door of all subtleties! ! ! ! ! ! The Way that can be told of is not the eternal Way; The name that can be named is not the eternal name. ! The Named is the mother of all things. The named is the mother of all things. ! ! ! ! ! ! ! ! They both may be called deep and profound. Deeper and more profound, The door of all subtleties!