Tracking GHC Performance

Slide 1

Slide 1 text

Manuel M T Chakravarty & Mathieu Boespﬂug Tweag I/O Tracking GHC Performance And Other Regressions mchakravarty TacticalGrace justtesting.org tweag.io

Slide 2

Slide 2 text

Metrics of Performance Functional Correctness Execution Speed Compilation Speed

Slide 3

Slide 3 text

“Given GHC’s large surface area, getting all of this right is hard?”

Slide 4

Slide 4 text

Functional Correctness GHC 7.8.2

Slide 5

Slide 5 text

Functional Correctness GHC 8.2.1

Slide 6

Slide 6 text

Execution Speed GHC 7.0.1

Slide 7

Slide 7 text

Compilation Speed GHC 8.2.1

Slide 8

Slide 8 text

“What do these issues have in common?”

Slide 9

Slide 9 text

accelerate inline-java clr-inline attoparsec vector

Slide 10

Slide 10 text

“Can we use Stackage for regression testing?”

Slide 11

Slide 11 text

No content

Slide 12

Slide 12 text

GHC Regression Testing with Stackage ubuntu stackage:nightly docker build docker build stackage:head New

Slide 13

Slide 13 text

ubuntu stackage:nightly docker build docker build stackage:head build-constraints.yaml stackage-curator build-plan.yaml stackage-curator stackage-nightly

Slide 14

Slide 14 text

ubuntu stackage:nightly docker build docker build stackage:head build-constraints.yaml stackage-curator build-plan.yaml stackage-curator Version Conflicts HEAD

Slide 15

Slide 15 text

ubuntu stackage:nightly docker build docker build stackage:head build-constraints.yaml ộ Version Conflicts HEAD Build Results PruneConstraints pruned-constraints.yaml stackage-curator pruned-plan.yaml stackage-curator New

Slide 16

Slide 16 text

Functional Correctness Execution Speed Compilation Speed

Slide 17

Slide 17 text

Functional Correctness build-constraints.yaml ộ pruned-plan.yaml pruned-plan.yaml stackage-curator Build Results stackage-curator Build Results Compare

Slide 18

Slide 18 text

Functional Correctness Execution Speed Compilation Speed

Slide 19

Slide 19 text

Compilation Speed Compare build times of master vs branch Track performance over time “Tracking Performance over the entire software lifecycle” http://www.tweag.io/posts/2017-09-06-hyperion.html

Slide 20

Slide 20 text

Functional Correctness Execution Speed Compilation Speed

Slide 21

Slide 21 text

Execution Speed Packages with benchmark sections PRs and track over time

Slide 22

Slide 22 text

Functional Correctness Execution Speed Compilation Speed

Slide 23

Slide 23 text

Image Attribution https://pixabay.com/photo-2387317/ https://github.com/fpco/stackage/blob/master/DATA-FLOW.md