Mobile Ops: Measuring Performance and Automating Workflow

Mobile Ops: Measuring Performance and Automating Workflow

2ad55a66b8325eb097612c069ab76231?s=128

Clay Smith

April 27, 2016
Tweet

Transcript

  1. 2.

    "OH MOBILE OPS? THE THING PEOPLE DON'T DO?" - Anonymous

    Software Engineer Good background from @patrickdubois: http://www.jedi.be/blog/2016/01/28/Mobile %20Delivery%20with%20a%20devops%20mindset/
  2. 3.

    "Very few [businesses] are well prepared to successfully deploy and

    maintain apps." -Accenture Mobile Survey https://adtmag.com/articles/2015/09/30/accenture-mobile-survey.aspx
  3. 17.

    SOME CI ADVICE Automatically build and test on push Explore

    distributing beta builds Integrate with Slack/HipChat/etc Automatic Play Store release... maybe* http://simpleprogrammer.com/2009/12/30/continuous-integration-best-practices/ * https://wiki.jenkins-ci.org/display/JENKINS/Google+Play+Android+Publisher+Plugin https://github.com/Triple-T/gradle-play-publisher
  4. 19.

    BUILDING IT YOURSELF? ‣ Consider http://square.github.io/spoon/ ‣ Run tests on

    multiple devices in parallel + HTML Summary ‣ Pros: Device Labs look super cool ‣ Cons: Device labs are hard to maintain
  5. 20.

    BECOME A FARMER? ‣ Many choices (search "mobile device testing")

    ‣ Ex: https://aws.amazon.com/device-farm/ ‣ Can run tests or fuzz ‣ Most have build system integration + APIs (./gradlew devicefarmUpload)
  6. 23.

    WHAT THEY DID ‣ Desire to avoid performance regressions ‣

    Belief in the ability to detect performance issues before release by using advanced techniques and automation ("the lab") ‣ Advanced distributed system using zookeeper and custom racks of devices https://code.facebook.com/posts/924676474230092/mobile-performance-tooling-infrastructure-at-facebook/
  7. 24.

    CASE STUDY #2 Doing it with New Relic + TravisCI

    + GitHub + AWS Device Farm https://github.com/smithclay/AndroidPerfTestExample
  8. 25.

    TRAVISCI GITHUB AWS DEVICE FARM NEW RELIC INSIGHTS ♥ SASS

    TravisCI runs on commits and uploads the latest build to AWS Device Farm, where performance analytics are collected from the app with New Relic. Build Test Collect
  9. 26.
  10. 32.

    SOME MOBILE KPIS ‣ Network requests (including failed) ‣ Startup

    time ‣ Blocked UI time ‣ Crashes, other errors ‣ Critical user interactions ‣ 3rd party services—what are they doing? https://medium.com/@mandrigin/ios-app-performance-instruments-beyond-48fe7b7cdf2
  11. 35.