AndroidのCI環境をCircleCIからWerckerにした話

以下は本スライドに関連する記事になります。

AndroidのCI環境をCircleCIからWerckerに移行しました
http://tech.vasily.jp/entry/migrate_android_ci_from_circleci_to_wercker

CircleCIでbuild-toolsを23.0.2にした際にビルドが失敗する場合の対処方法
http://qiita.com/Horie1024/items/16901408c03154c70343

Androidのビルド用Dockerイメージの作成
http://qiita.com/Horie1024/items/7decc6f4b59285b85dce

WerckerでQuay.ioのPrivate Repositoryを使用する
http://qiita.com/Horie1024/items/f554f4eb7f2324b8fa06

WerckerでIP制限をかけたs3のバケットからkeystoreを取得しassembleReleaseを実行する
http://qiita.com/Horie1024/items/62eb4401daec1032cdec

Transcript

1. AndroidͷCI؀ڥΛ CircleCI͔ΒWerckerʹͨ͠࿩ VASILY,(Inc.(ງߐ 2016/6/9'Android'Tes1ng'Bootcamp'#2 ©"VASILY,"Inc.,"2016 1
2. About&Me • Ryosuke)Horie)@Horie1024 • →)ͷௗͷΞΠίϯͰ͢ • Android)Developer • VASILY,)Inc. ©"VASILY,"Inc.,"2016 2
3. ©"VASILY,"Inc.,"2016 3
4. ©"VASILY,"Inc.,"2016 4
5. ࠓ೔ͷൃදͰΘ͔Δ͜ͱ • CircleCI͔ΒWercker΁ͷҠߦํ๏ ©"VASILY,"Inc.,"2016 5
6. ൃදͷྲྀΕ • iQONͷ։ൃͰར༻͍ͯͨ͠CircleCIʹΑΔCI؀ڥͷ঺հ • CircleCIͰফ໣ͨ͠఺ • Werckerͷݕূ • Wercker΁ͷҠߦํ๏ͷ঺հ • CircleCI.with.DockerͰ͸μϝʁ ©"VASILY,"Inc.,"2016 6
7. iQONͷ։ൃͰར༻͍ͯͨ͠CI؀ڥ ©"VASILY,"Inc.,"2016 7
8. iQONͷCI/CD؀ڥ • 1೥൒΄Ͳલ͔ΒCircleCIΛར༻ • h+p:/ /tech.vasily.jp/entry/ circleci_deploygate_android_app_automa=on • Ϣχοτςετ͔ΒϦϦʔε࡞ۀ·ͰࣗಈԽ ©"VASILY,"Inc.,"2016 8
9. iQONͷ։ൃϑϩʔ • PullRequestϕʔεͷ։ൃ • releaseϒϥϯνʹରͯ͠PullRequest • master΁Ϛʔδͯ͠ϦϦʔε ©"VASILY,"Inc.,"2016 9
10. શମͷྲྀΕ ©"VASILY,"Inc.,"2016 10
11. Ϣχοτςετ • શͯͷϒϥϯνͰ࣮ࢪ ©"VASILY,"Inc.,"2016 11
12. BetaʹΑΔAPK഑෍ • ಛఆϒϥϯν΁ͷϚʔδͰ࣮ߦ • releaseϒϥϯν΁ͷϚʔδ • masterϒϥϯν΁ͷϚʔδ ©"VASILY,"Inc.,"2016 12
13. GooglePlay΁ͷϦϦʔε • master΁ͷϚʔδͰ࣮ߦ • α൛ͰΞοϓϩʔυ • BetaͰͷ࠷ऴ֬ೝ • ߋ৽৘ใΛهೖޙ੡඼൛΁ϓϩϞʔτ • ϦϦʔε׬ྃ ©"VASILY,"Inc.,"2016 13
14. CircleCIͰফ໣ͨ͠఺ ©"VASILY,"Inc.,"2016 14
15. CircleCIͰফ໣ͨ͠఺ • OOM(Out'of'Memory) • Ϗϧυ࣌ؒ • Ϗϧυ؀ڥͷζϨ ©"VASILY,"Inc.,"2016 15
16. OOMͷڪා • 4GBͷน • build*toolsɺGradle1PluginͷΞοϓσʔτ͸ා͍ • JAVA_OPSɺdexOp=onͳͲͰඍௐ੔ ©"VASILY,"Inc.,"2016 16
17. OOMͷڪා • Gradle(Plugin(2.0ʹ্͛ͨλΠϛϯάͰOOMසൃ • transformClassesWithDexForReleaseͰOOM • ༷ʑͳରࡦΛࢼΈΔ΋ղܾͤͣ ©"VASILY,"Inc.,"2016 17
18. ૿͑ଓ͚ΔϏϧυ࣌ؒ ©"VASILY,"Inc.,"2016 18
19. Ϗϧυ؀ڥͷζϨʹΑΔϏϧυࣦഊ • CircleCIଆͰ༻ҙ͞ΕͨSDK͕࠷৽Ͱ͸ͳ͍ • ૺ۰ͨ͠ࣄྫ:-Android-SDK-Toolsͷrevision͕࠷৽Ͱແ͍ • toolsͷΞοϓσʔτͰճආ dependencies: override(΋͘͠͸ pre): - echo y | android update sdk --no-ui --all --filter "tools" - echo y | android update sdk --no-ui --all --filter "build-tools-23.0.2" ©"VASILY,"Inc.,"2016 19
20. 1೥൒ͷӡ༻ͷ݁Ռ • circle.yml͕ෳࡶԽ • ϝϯςφϯεੑ͕ѱԽ • CircleCI͓͡͞Μʹ ©"VASILY,"Inc.,"2016 20
21. Ͳ͏͢Ε͹ղܾͰ͖Δ͔ʁ • Jenkins΁ͷҠߦ • ϝϯςφϯεΛߟ͑Δͱආ͚͍ͨ • ଞͷCIαʔϏε΁ͷ৐Γ׵͑ • ίετ͸ֻ͔Δ͕ݱ࣮త ©"VASILY,"Inc.,"2016 21
22. ·ͩ!CircleCI!Ͱফ໣ͯ͠Δͷʁ ©"VASILY,"Inc.,"2016 22
23. Werckerͷݕূ ©"VASILY,"Inc.,"2016 23
24. Wercker(ϫʔΧʔ)ʹ͍ͭͯݕূΛ։࢝ • OOM͕ආ͚ΒΕΔ͔ • Ϗϧυ࣌ؒͷ୹ॖ • Ϗϧυ؀ڥͷζϨΛແͤ͘Δ͔ ©"VASILY,"Inc.,"2016 24
25. OOMΛආ͚ΒΕΔ͔ • υΩϡϝϯτʹ͸ϝϞϦ੍ݶͷهࡌͳ͠ • OOMͷൃੜࣄྫΛ୳͕͢ݟ͚ͭΒΕͣ • WerckerͰCircleCIͰOOM͕ൃੜͨ͠৚݅ͰͷϏϧυΛ࣮ߦ • ෳ਺ճ࣮ߦ͕ͨ͠OOM͸ൃੜͤͣ • ආ͚ΒΕΔͱ൑அ ©"VASILY,"Inc.,"2016 25
26. OOMΛආ͚ΒΕΔ͔ • ࣮ߦ؀ڥ͕DockerͰ͋Δ͜ͱ͸ؔ܎͋Δ͔ʁ • docker runͷΦϓγϣϯ1 • -m)ϝϞϦϦϛοτͷࢦఆɻOOM͸ൃੜ͠ͳ͘ͳΔ • --oom-kill-disable)OOM)KillerͷແޮԽ • ࣮ࡍͲ͏ͳ͍ͬͯΔ͔Θ͔Βͳ͍ͷͰ஌Γ͍ͨ 1"Docker"run"ϦϑΝϨϯε#ϢʔβɾϝϞϦͷ੍ݶ ©"VASILY,"Inc.,"2016 26
27. Ϗϧυ࣌ؒͷ୹ॖ • AndroidΛϏϧυ͢ΔDockerΠϝʔδΛࣗ࡞ • SDKͷηοτΞοϓʹ͔͔Δ࣌ؒ෼୹ॖ • ΠϝʔδͷΩϟογϡͰpullʹֻ͔Δ࣌ؒΛ୹ॖ • Ϗϧυ࣌ؒΛ୹ॖՄೳ ©"VASILY,"Inc.,"2016 27
28. Ϗϧυ؀ڥͷζϨΛແͤ͘Δ͔ • DockerΠϝʔδΛࣗ࡞͢Δ͜ͱͰՄೳ • σϝϦοτ • Dockerfileͷϝϯςφϯε͕ඞཁʹͳΔ • େ͖ͳෛ୲ʹ͸ͳΒͳͦ͏ ©"VASILY,"Inc.,"2016 28
29. Wercker΁ͷҠߦํ๏ͷ঺հ ©"VASILY,"Inc.,"2016 29
30. ҠߦͷͨΊʹ΍Δ͜ͱ 1. Wercker΁ͷొ࿥ 2. ΞϓϦέʔγϣϯͷ࡞੒ 3. DockerΠϝʔδͷ࡞੒ 4. DockerΠϝʔδΛϨδετϦʹొ࿥ 5. wercker.ymlΛ࡞੒ ©"VASILY,"Inc.,"2016 30
31. Wercker΁ͷొ࿥ͱΞϓϦέʔγϣϯ࡞੒ • ʮGet%Startedʯ͔ΒWercker΁ొ࿥ • GitHubΞΧ΢ϯτͰͷొ࿥͕؆୯ ©"VASILY,"Inc.,"2016 31
32. Wercker΁ͷొ࿥ͱΞϓϦέʔγϣϯ࡞੒ • ্෦ʮCreateʯΛΫϦοΫ • ϝχϡʔ͔ΒʮApplica,onʯΛΫϦοΫ ©"VASILY,"Inc.,"2016 32
33. Wercker΁ͷొ࿥ͱΞϓϦέʔγϣϯ࡞੒ • ϦϙδτϦΛબ୒ ©"VASILY,"Inc.,"2016 33
34. Wercker΁ͷొ࿥ͱΞϓϦέʔγϣϯ࡞੒ • publicͳϓϩδΣΫτͳΒʮwercker,will,checkout,the,code,withoutusing,an,SSH,keyʯ • privateͳϓϩδΣΫτͳΒʮAdd,the,deploy,key,to,the,selected,repository,for,meʯ ©"VASILY,"Inc.,"2016 34
35. Wercker΁ͷొ࿥ͱΞϓϦέʔγϣϯ࡞੒ • νΣοΫΛೖΕΔͱApplica(on͕publicͱͯ͠ެ։ ©"VASILY,"Inc.,"2016 35
36. Wercker΁ͷొ࿥ͱΞϓϦέʔγϣϯ࡞੒ • ʮGenerate(a(default(wercker.ymlʯΛΫϦοΫ • wercker.ymlͷ਽ܗ͕දࣔ͞ΕΔͷͰίϐʔͯ͠ϓϩδΣΫτʹ௥Ճ ©"VASILY,"Inc.,"2016 36
37. Wercker΁ͷొ࿥ͱΞϓϦέʔγϣϯ࡞੒ • GitHubʹϓογϡ͢ΔͱϏϧυ͕։࢝ ©"VASILY,"Inc.,"2016 37
38. DockerΠϝʔδͷ࡞੒ • Android͕ϏϧυͰ͖ΔΠϝʔδΛ࡞Δ • ʮandroid)dockerΠϝʔδʯͰݕࡧ • ࠓճΠϝʔδΛࣗ࡞ͨ͠खॱ͸Qiitaʹ·ͱΊ·ͨ͠ • h0p:/ /goo.gl/htgMyw ©"VASILY,"Inc.,"2016 38
39. DockerΠϝʔδΛϗεςΟϯάαʔϏεʹొ࿥ • DockerHubɺQuay(Ωʔ).ioͳͲ • ࡞੒ͨ͠ΠϝʔδΛWercker͕pullͰ͖ΔΑ͏ʹ͢Δ • ฐࣾͷDockerΠϝʔδ͸Quay.ioʹϗετ2 • Android΋ͦ͜ʹ৐͔ͬΔ 2"ΞυαʔόʔΛElas'cBeanstalk"with"DockerʹҠߦͨ͠࿩ ©"VASILY,"Inc.,"2016 39
40. Quay.io͔ΒͷDockerΠϝʔδͷpull • iQONͰ࢖༻͢ΔDockerΠϝʔδ͸privateͳϦϙδτϦͱͯ͠ Quay.ioͰϗετ • WerckerͰ͸privateͳϦϙδτϦΛ • ৄࡉ͸Qiitaʹ·ͱΊͯ͋Γ·͢4h6p:/ /goo.gl/EFCPwI ©"VASILY,"Inc.,"2016 40
41. DockerΠϝʔδΛϗεςΟϯάαʔϏεʹొ࿥ • publicͳϓϩδΣΫτͳΒDockerHubͰे෼ • public.repositoryͰAndroid.SDKΛؚΉΠϝʔδΛެ։͢Δͱ࠶ ഑෍ͰϥΠηϯεҧ൓ • publicͱͯ͠ΠϝʔδΛެ։͢ΔͷΛආ͚Δඞཁ͕͋Δ • GitHubͱ࿈ܞͯ͠Automated.Build΋Մೳ • DockerfileΛߋ৽ͯ͠pushͨ͠ΒࣗಈͰΠϝʔδΛϏϧυ. ©"VASILY,"Inc.,"2016 41
42. WerckerͷϏϧυϑϩʔ • Wercker͸pipelineͱ͍͏֓೦Λ࣋ͭ • wercker.yml͸pipelineΛఆٛ͢ΔΠϝʔδ ©"VASILY,"Inc.,"2016 42
43. Workrflows • 5݄ʹൃද͞ΕͨWerckerͷ৽͍͠Ϗϧυϑϩʔ[^3] • JenkinsͷBuild4Pipeline4Pluginʹࣅ͍ͯΔ [^3]%Introducing%Wercker%Workflows ©"VASILY,"Inc.,"2016 43
44. Workrflows • ৽نͰ࡞੒ͨ͠Applica(onͷϏϧυϑϩʔ͸શͯWorkflows1 • چϏϧυϑϩʔ͔Β͸೚ҙͰϚΠάϨʔγϣϯՄೳ ©"VASILY,"Inc.,"2016 44
45. WorkflowsʹΑΔϏϧυϑϩʔ • wercker.ymlͰpipelineΛఆٛ • ैདྷ͸Build1ͱ1DeployͷΈ͕ͩͬͨ೚ҙʹఆٛՄೳ • pipelineΛWerckerͷWeb1UIͰ૊Έ߹ΘͤΔ ©"VASILY,"Inc.,"2016 45
46. circle.ymlͱwercker.ymlͷରԠ • pipeline͸stepsͱ͍͏୯ҐͰߏ੒͞ΕΔ • wercker.ymlͰ͸ఆٛͨ͠pipelineηΫγϣϯຖʹstepsΛఆ͍ٛͯ͘͠ • stepsʹ͸छྨ͕͋Δ[^4] • Internal6steps:6Wercker͕։ൃͨ͠૊ࠐΈͷsteps • A:er6steps:6pipeline͕failed6or6passedͨ͠ࡍʹ࣮ߦ͞ΕΔsteps • script6steps:6shell6commandΛ࣮ߦ͢Δsteps • Installing6packages:6packageͷΠϯετʔϧΛ࣮ߦ͢Δsteps • ࣗ࡞:6ʮstep6registryʯʹొ࿥͢Δ͜ͱͰwercker.yml͔Β࢖༻Ͱ͖Δ [^4]h&p:/ /devcenter.wercker.com/docs/steps/index.html ©"VASILY,"Inc.,"2016 46
47. circle.ymlͱwercker.ymlͷରԠ • ςετɺmasterϒϥϯνͷ৔߹ʹBetaͰͷ഑෍Λߦ͏cricle.yml machine: java: version: openjdk8 environment: ANDROID_HOME: /usr/local/android-sdk-linux dependencies: override: - echo y | android update sdk --no-ui --filter "android-23,build-tools-23.0.3" test: override: - ./gradlew testDebug deployment: master: branch: master commands: - ./gradlew assembleDebug crashlyticsUploadDistributionRelease ©"VASILY,"Inc.,"2016 47
48. circle.ymlͱwercker.ymlͷରԠ • machineɺdependencies͸WerckerͰ͸DockerΠϝʔδ͕୲͏ • boxηΫγϣϯΛఆٛ • DockerHub͔Β࡞੒ͨ͠ΠϝʔδΛpull box: horie1024/wercker-android-build:0.1 test: override: - ./gradlew testDebug deployment: master: branch: master commands: - ./gradlew assembleDebug crashlyticsUploadDistributionRelease ©"VASILY,"Inc.,"2016 48
49. circle.ymlͱwercker.ymlͷରԠ • test͸buildɺdeployment͸distribute0apkͱఆٛ box: horie1024/wercker-android-build:0.1 test: override: - ./gradlew testDebug deployment: master: branch: master commands: - ./gradlew assembleDebug crashlyticsUploadDistributionRelease ©"VASILY,"Inc.,"2016 49
50. circle.ymlͱwercker.ymlͷରԠ • script(stepsͰcircle.ymlͱಉ͡Α͏ʹ࣮ߦ box: horie1024/wercker-android-build:0.1 build: steps: - script: name: Unit test code: | ./gradlew testDebug distribute-apk: steps: - script: name: Distribute APK code: | - ./gradlew assembleDebug crashlyticsUploadDistributionRelease ©"VASILY,"Inc.,"2016 50
51. circle.ymlͱwercker.ymlͷରԠ • wercker.ymlΛGitHub΁ϓογϡ͢ΔͱϏϧυ͕։࢝ box: horie1024/wercker-android-build:0.1 build: steps: - script: name: Unit test code: | ./gradlew testDebug distribute-apk: steps: - script: name: Distribute APK code: | - ./gradlew assembleDebug crashlyticsUploadDistributionRelease ©"VASILY,"Inc.,"2016 51
52. Workflowsͷઃఆ • distribute*apk͸͜ͷ··ͩͱ࣮ߦ͞Εͳ͍ • WerckerͷWeb0UI͔ΒWorkflowsΛઃఆ͢Δඞཁ͕͋Δ • Applica8onͷʮManage0WorkflowsʯΛΫϦοΫ ©"VASILY,"Inc.,"2016 52
53. Workflowsͷઃఆ • ʮAdd$new$pipelineʯ͔ΒpipelineΛ௥Ճ • Name:$distribute4apk,$YML$Pipeline$name:$distribute4apk • YML$Pipeline$name͕wercker.ymlͰఆٛͨ͠pipelineʮdistribute4apkʯͱରԠ ©"VASILY,"Inc.,"2016 53
54. Workflowsͷઃఆ • ʮOn$BranchʯͰͲͷBranch৔߹ʹpipelineΛ࣮ߦ͢Δ͔ఆٛ • ʮExecute$pipelinesʯʹ͸ʮdistribute5apkʯΛࢦఆ ©"VASILY,"Inc.,"2016 54
55. Workflowsͷઃఆ • ׬੒ • masterϒϥϯν΁ͷpush͕͋ͬͨ৔߹ʮdistribute.apkʯpipeline͕࣮ߦ͞ΕBetaͰAPK͕഑෍ ©"VASILY,"Inc.,"2016 55
56. iQONͷcircle.yml͔Βwercker.yml΁Ҡߦ • iQONͷcircle.yml΋ಉ͡Α͏ʹwercker.ymlʹॻ͖׵͑ • ϢχοτςετɺBeta΁ͷ഑෍ɺGooglePlay΁ͷΞοϓϩʔυΛpipelineͰఆٛ • WorkflowsΛઃఆ ©"VASILY,"Inc.,"2016 56
57. Google&Play΁ͷࣗಈΞοϓϩʔυ • gradle(play(publisherΛར༻ play { serviceAccountEmail = SERVICE_ACCOUNT_EMAIL pk12File = file(KEY_FILE_PATH) track = PLAY_TARGET_TRACK // 'production' or 'rollout' or 'beta' or 'alpha' } • gradle(taskͰ࣮ߦɺGooglePlay΁Ξοϓϩʔυ ./gradlew publishApkRelease ©"VASILY,"Inc.,"2016 57
58. Google&Play΁ͷࣗಈΞοϓϩʔυ • werckerͷpipelineͰఆٛ upload-google-play: steps: - script: name: Upload APK to GooglePlay code: | ./gradlew publishApkRelease -PdisablePreDex crashlyticsUploadDistributionRelease ©"VASILY,"Inc.,"2016 58
59. keystoreɺ.p12ΩʔϑΝΠϧͷѻ͍ • IP੍ݶΛ͔͚ͨs3ͷόέοτʹ഑ஔ • Wercker͕ެ։͍ͯ͠Δsource-ipΛొ࿥ • build-pipelineͰfetch • ৄࡉ͸Qiitaʹ·ͱΊͯ͋Γ·͢-h9p:/ /goo.gl/B92HAf ©"VASILY,"Inc.,"2016 59
60. Ҡߦͨ݁͠Ռ • OOM͸ൃੜ͍ͯ͠ͳ͍(ࠓͷॴ) ©"VASILY,"Inc.,"2016 60
61. Ҡߦͨ݁͠Ռ • Ϗϧυ࣌ؒͷ୹ॖ • Ϣχοτςετ"໿5෼"$>"໿3෼ • ϢχοτςετɺϦϦʔεϏϧυɺGooglePlay΁ͷϦϦʔε"໿10෼"$>"໿6෼ ©"VASILY,"Inc.,"2016 61
62. Ҡߦͨ݁͠Ռ • Ϗϧυ؀ڥͷζϨ • DockerΠϝʔδΛࣗ࡞ͨ͜͠ͱͰղܾ • Dockerfileͷϝϯςφϯε࡞ۀ͸ෛ୲ʹ͸ײ͡ͳ͍ ©"VASILY,"Inc.,"2016 62
63. CircleCI(with(DockerͰ͸μϝʁ ©"VASILY,"Inc.,"2016 63
64. CircleCI(with(DockerͰ͸μϝʁ • DockerͳΒCircleCIͰ΋ར༻Մೳ • CircleCIͷVMͰdockerίϚϯυ͕ୟ͚Δ • DockerΛར༻ͨ͠৔߹΋4GB੍ݶ͕͋Δͷ͔ʁ • CircleCIͷDockerαϙʔτͰͷϏϧυΛࢼ͢ ©"VASILY,"Inc.,"2016 64
65. CircleCI(with(DockerͰ͸μϝʁ • CircleCIͰdockerΛར༻ͯ͠Ϗϧυ͢ΔͱOOM͕ൃੜ͠ͳ͔ͬͨ • -m.Φϓγϣϯ͸CirlceCIͷVMͰ͸༗ޮʹͳΒͳ͍ • OOMʹ͍ͭͯ͸CircleCIͰ΋WerckerͰ΋ݱঢ়Ͱ͸ආ͚ΒΕͦ͏ • CircleCIͰ͸DockerΠϝʔδͷΩϟογϡΛࣗྗͰ΍Δඞཁ͕͋Δ • circle.yml͕ෳࡶԽ ©"VASILY,"Inc.,"2016 65
66. CircleCI(with(DockerͰ͸μϝʁ • CircleCIͰ͸DockerΠϝʔδͷΩϟογϡΛࣗྗͰ΍Δඞཁ͕ ͋Δ • circle.yml͕ෳࡶԽ • Werckerͷํ͕ઃఆ͕γϯϓϧɺΠϝʔδͷΩϟογϡ΋σϑ ΥϧτͰޮ͘ ©"VASILY,"Inc.,"2016 66
67. ·ͱΊ • CircleCI͔ΒWercker΁ͷҠߦ͸ͦ͜·Ͱ೉͘͠ͳ͍ • Wercker΁ͷҠߦͰCircleCIͰײ͍ͯͨ͡໰୊఺ΛղܾͰ͖ͨ • CircleCI+with+Docker͸circle.yml͕ෳࡶԽ͢ΔͷͰ༷ࢠݟ ©"VASILY,"Inc.,"2016 67
68. ࠷ޙʹ • VASILYͰ͸AndroidΤϯδχΞΛืू͍ͯ͠·͢ʂ ©"VASILY,"Inc.,"2016 68
69. ͋Γ͕ͱ͏͍͟͝·ͨ͠ ©"VASILY,"Inc.,"2016 69