Etsy Journey to Continuous Integration for Mobile Apps

367fb0143b986d3c45a44da889b386da?s=47 Nassim Kammah
September 15, 2014
Programming
1
190

Etsy Journey to Continuous Integration for Mobile Apps

Slides presented during Velocity NY 2014.

While traditional websites can leverage their continuous delivery infrastructure to quickly identify and fix bugs, releasing mobile apps requires a 3rd party approval. Major bugs and security vulnerabilities call for emergency releases, which still require the app store approval and can mean days of poor user experience, developer frustration, and a negative impact to the app ratings and reviews.

A comprehensive suite of automated functional tests can greatly help detect defects early across the broad spectrum of devices and configurations. The challenge then becomes setting up a reliable, scalable, and sustainable infrastructure to automatically build and test your app on simulators and devices, as soon as a developer pushes new code.

Today, we want to share with the audience Etsy’s journey to setting up our Continuous Integration infrastructure for our mobile apps teams.

367fb0143b986d3c45a44da889b386da?s=128

Nassim Kammah

September 15, 2014
Tweet

More Decks by Nassim Kammah

See All by Nassim Kammah
367fb0143b986d3c45a44da889b386da?s=48 nkammah
0
440

Other Decks in Programming

See All in Programming
Bdd3fb3269e67bbc512f2530c409a926?s=48 tnishinaga
9
5.4k
D12a80cab206033a820ccff8319f957b?s=48 s_uryu
4
1.8k
15934fa2aa7b2ce21f091e9b7cffa856?s=48 manfredsteyer
0
170
B8403d102456248570005ee7fb2ba0f7?s=48 tooppoo
4
440
88493e31e8ac7540094d35f7cda46c8a?s=48 lnit
8
3.1k
0ca0c0ec6efe3a7f5220332a910e6da0?s=48 shinyoshiaki
1
510
D9e4d5a4b36f83fbde1076815df1362f?s=48 bmack
0
380
3e049ed33195d00a8b745b16c63dce6e?s=48 leew
0
130
4131d2f57a0db2a2b4d9a62bd389fd44?s=48 tarcieri
0
260
A093c82d1ffb09f8a023c757ffa7419d?s=48 yuzujoe
2
190
B67d76d100e6dbb2ec11087c44d02fbf?s=48 takahiro901
0
190
E24ebbedcae292dc8e4b56186e082220?s=48 iganari
1
300

Featured

See All Featured
2f5463832ccb768ccb4a1ca3607c27ef?s=48 jacobian
249
19k
A60068bce2e73de3a37ca9d2dbe36092?s=48 bryan
28
3.1k
F29327647a9cff5c69618bae420792ea?s=48 tenderlove
49
3.2k
245cee81a9c424266e5e401d844ea881?s=48 lara
168
9.1k
3ab1249be442027903e1180025340b3f?s=48 reverentgeek
17
1.2k
F68cb25ae3e5c2106997454b13b7737d?s=48 brad_frost
154
6.1k
9cde37f47e4a800ea081ea42de8d749a?s=48 dougneiner
119
7.7k
D47656e20ff5e42f125fc5ea0fd636c6?s=48 tmm1
61
7.4k
8081b26e05bb4354f7d65ffc34cbbd67?s=48 chriscoyier
681
180k
1177e050db6bafe62885362edf6e3537?s=48 lauravandoore
435
28k
245cee81a9c424266e5e401d844ea881?s=48 lara
588
60k
78b475797a14c84799063c7cd073962f?s=48 holman
458
270k

Transcript

  1. Etsy’s Journey to Continuous Integration for Mobile Apps Tuesday, September

    16, 14

  2. @kepioo bit.ly/etsyautobots Tuesday, September 16, 14

  3. 1990’s Tuesday, September 16, 14

  4. 2010 2011 2012 2013 2014 50 web deploys per day

    0 100 Tuesday, September 16, 14

  5. Tuesday, September 16, 14

  6. 2014 Tuesday, September 16, 14

  7. iOS Average App Review Time 09 / 14 6 days

    bit.ly/ios-review-trend Tuesday, September 16, 14

  8. Continuous Integration Tuesday, September 16, 14

  9. “release” constantly (not necessarily to customers) Tuesday, September 16, 14

  10. “If the code is not out there, it’s not teaching

    you anything” Tuesday, September 16, 14

  11. Culture Tuesday, September 16, 14

  12. Culture reviews try CI cluster Tests Apps Rotations Feature flags

    Bug Hunt automated build Tuesday, September 16, 14

  13. Automated builds Tuesday, September 16, 14

  14. command line or it does not count... Tuesday, September 16,

    14

  15. ipa build --scheme “Etsy” --configuration Release bit.ly/ios-ipa Tuesday, September 16,

    14

  16. build package for Test Flight package for App Store spot

    check with Test Flight submit Application Loader Tuesday, September 16, 14

  17. Every commit should build the mainline bit.ly/mfowler-ci Tuesday, September 16,

    14

  18. We use Jenkins (not Xcode bots) Provisioning profiles in repo

    Build all targets Groovy post build plugin Tuesday, September 16, 14

  19. bit.ly/nintendo-lamps Tuesday, September 16, 14

  20. + = Tuesday, September 16, 14

  21. magic to auto-resolve code signing Tuesday, September 16, 14

  22. Tuesday, September 16, 14

  23. ipa build --scheme “Etsy” --configuration Release --identity “iPhone: Etsy” --embed

    “/foo/bar.provision” Tuesday, September 16, 14

  24. Every commit should build the mainline on an integration machine

    bit.ly/mfowler-ci Tuesday, September 16, 14

  25. 25 mac mini Opscode Chef provisioning Homebrew + rbenv clicking

    required for initial Xcode install Tuesday, September 16, 14

  26. iOS certificates signing identities Android SDK’s, build tools emulators Tuesday,

    September 16, 14

  27. Everyone commits to the mainline everyday bit.ly/mfowler-ci Tuesday, September 16,

    14

  28. Branch in code Push to master Tuesday, September 16, 14

  29. self.window.rootViewController = boringController Tuesday, September 16, 14

  30. if ([ [EtsyConfig config] reskinEnabled ] ) { self.window.rootViewController =

    fancyController; } else { self.window.rootViewController = boringController; } Tuesday, September 16, 14

  31. [userDefaults objectForKey:@”EtsyReskinEnabled”] Tuesday, September 16, 14

  32. $server_config[‘ios_boe’][‘reskinEnabled”] = ‘on’; Tuesday, September 16, 14

  33. $server_config[‘ios_boe’][‘reskinEnabled”] = ‘on’; $server_config[‘ios_boe’][‘reskinEnabled”] = ‘staff’; $server_config[‘ios_boe’][‘reskinEnabled”] = ‘5%’; Tuesday,

    September 16, 14

  34. code “mess” feature flag clean up? Tuesday, September 16, 14

  35. flag changes detection version ranges support Tuesday, September 16, 14

  36. Code reviews Tuesday, September 16, 14

  37. $> review -r nkammah -cc ios@etsy.com --title "Velocity demo" Tuesday,

    September 16, 14

  38. Build Lint Unit Functional 1 - review script 2 -

    Github pull request builder 3 - Build Flow + Groovy console 1 2 3 Tuesday, September 16, 14

  39. Tuesday, September 16, 14

  40. bit.ly/try-poster Tuesday, September 16, 14

  41. Build Lint Unit Functional 1 - bit.ly/trylib 2 - Build

    Flow + Groovy console 2 git diff origin/master 1 Tuesday, September 16, 14

  42. bit.ly/trylib Test developer changes on CI cluster Tuesday, September 16,

    14

  43. unit tests Tuesday, September 16, 14

  44. legacy code testing Tuesday, September 16, 14

  45. feature unit test > Tuesday, September 16, 14

  46. Testing dojos Tuesday, September 16, 14

  47. 6 developers 1 computer / 1 projector 3 minutes to

    code then rotate simple testing objective Share / Learn / Have Fun Tuesday, September 16, 14

  48. Functional tests Tuesday, September 16, 14

  49. Tuesday, September 16, 14

  50. Page Object Model bit.ly/page-object-model Tuesday, September 16, 14

  51. In-House simulator Outsource on-device Tuesday, September 16, 14

  52. 300 devices in the pool 4 dedicated iOS 4 dedicated

    android bit.ly/app-thwack Tuesday, September 16, 14

  53. rolling window pass rate Tuesday, September 16, 14

  54. Dog Food Tuesday, September 16, 14

  55. etsy.com/appbuilds App Store Tuesday, September 16, 14

  56. Tuesday, September 16, 14

  57. App Rotations Tuesday, September 16, 14

  58. 8 volunteers in a room QA facilitator Mix of devices

    find bugs + + Tuesday, September 16, 14

  59. Bug Hunt (gamified focused testing) Tuesday, September 16, 14

  60. Mission Tuesday, September 16, 14

  61. Screenshot(s) Tuesday, September 16, 14

  62. Details Tuesday, September 16, 14

  63. Score ! Tuesday, September 16, 14

  64. bit.ly/bug-hunt Tuesday, September 16, 14

  65. Imagine Tuesday, September 16, 14

  66. `git push` => < 15 min Tuesday, September 16, 14

  67. Start your journey Tuesday, September 16, 14

  68. Package your app without Xcode Organize a test dojo Write

    a functional test Build reviews automatically Tuesday, September 16, 14

  69. Office hours wed. 11:20 am table 2 Slides : bit.ly/etsy-apps-ci

    Tuesday, September 16, 14

  70. What about Android ? Tuesday, September 16, 14

  71. We’re hiring! bit.ly/join-etsy Tuesday, September 16, 14

  72. Questions? Tuesday, September 16, 14