The Build Shrugged

“If you saw the build system of your project, if you saw that he struggles with the build times, resources and productivity of your team, and the greater his effort the heavier the build - What would you tell him?"

I…don't know. What…could he do? What would you tell him?" “To build.”

Indeed, we can’t build our projects without build systems. It’s fundamental to understand the internals and how we can get benefits in our project. During this session we will learn the internals and what’s the current state in the Android world using Gradle. Gradle has brought very interesting concepts in the last years like Lazy configurations and Workers API. We will learn what is the impact of these features and how to apply these tools in our projects. Finally, we will learn some techniques to measure performance in our projects with Tracer Agent and different tools in the ecosystem.

Transcript

1. THE BUILD SHRUGGED @INYAKI_MWC
6. BUILD SYSTEMS
7. INPUT OUTPUT BUILD SYSTEMS
8. INPUT OUTPUT KT CLASS CLASS DEX BUILD SYSTEMS
9. BUILD SYSTEMS SOURCE SOURCE SOURCE
10. BUILD SYSTEMS SOURCE SOURCE SOURCE OBJECT OBJECT OBJECT
11. BUILD SYSTEMS SOURCE SOURCE SOURCE OBJECT OBJECT OBJECT EXECUTABLE PROGRAM
12. BUILD SYSTEMS SOURCE SOURCE SOURCE OBJECT OBJECT OBJECT EXECUTABLE PROGRAM RELEASE PACKAGE DATA/IMAGES RESOURCES
13. BUILD SYSTEMS SOURCE SOURCE SOURCE OBJECT OBJECT OBJECT EXECUTABLE PROGRAM RELEASE PACKAGE DATA/IMAGES RESOURCES
22. BUILD SYSTEMS CONVENIENCE CORRECTNESS PERFORMANCE SCALABILITY
23. BUILD SYSTEMS GRADLE CMAKE BAZEL MAVEN SBT BUCK
24. BUILD SYSTEMS GRADLE CMAKE BAZEL MAVEN SBT BUCK
25. BAZEL
26. BAZEL
27. BAZEL
28. GRADLE
29. GRADLE
30. GRADLE GRADLE
31. GRADLE GRADLE https://services.gradle.org/distributions/gradle-5.1-all.zip
32. GRADLE GRADLE https://services.gradle.org/distributions/gradle-5.1-all.zip Project
33. GRADLE GRADLE https://services.gradle.org/distributions/gradle-5.1-all.zip Base Plugins Java Plugin Maven Plugin Groovy Plugin Project
34. GRADLE GRADLE https://services.gradle.org/distributions/gradle-5.1-all.zip Base Plugins Java Plugin Maven Plugin Groovy Plugin Project Kotlin DSL
35. GRADLE GRADLE ANDROID GRADLE PLUGIN
36. GRADLE GRADLE ANDROID GRADLE PLUGIN android { compileSdkVersion(28) defaultConfig { applicationId = "com.kotlin.client" minSdkVersion(21) targetSdkVersion(28) versionCode = 1 versionName = "1.0" } }
37. GRADLE GRADLE ANDROID GRADLE PLUGIN generatePureSplits jacoco lintOptions ndkDirectory packagingOptions productFlavors resourcePrefix sdkDirectory signingConfigs sourceSets splits testOptions variantFilter aaptOptions adbExecutable adbOptions buildToolsVersion buildTypes compileOptions compileSdkVersion dataBinding defaultConfig defaultPublishConfig dexOptions externalNativeBuild flavorDimensionList
38. GRADLE GRADLE ANDROID GRADLE PLUGIN generatePureSplits jacoco lintOptions ndkDirectory packagingOptions productFlavors resourcePrefix sdkDirectory signingConfigs sourceSets splits testOptions variantFilter aaptOptions adbExecutable adbOptions buildToolsVersion buildTypes compileOptions compileSdkVersion dataBinding defaultConfig defaultPublishConfig dexOptions externalNativeBuild flavorDimensionList
39. GRADLE GRADLE ANDROID GRADLE PLUGIN CUSTOM BUILD SCRIPT/PLUGINS
40. GRADLE GRADLE ANDROID GRADLE PLUGIN CUSTOM BUILD SCRIPT/PLUGINS plugins { id("kotlin-android") id("kotlin-android-extensions") id("kotlin-kapt") id("androidx.benchmark") }
41. INITIALIZATION CONFIGURATION EXECUTION
42. INITIALIZATION CONFIGURATION EXECUTION include ':app', ':bypass' include ':about', ':core', ':dribbble', ':designernews', ':search' include ':test_shared' project(':bypass').projectDir = new File(rootDir, 'third_party/bypass')
43. INITIALIZATION CONFIGURATION EXECUTION include ':app', ':bypass' include ':about', ':core', ':dribbble', ':designernews', ':search' include ':test_shared' project(':bypass').projectDir = new File(rootDir, 'third_party/bypass')
44. INITIALIZATION CONFIGURATION EXECUTION include ':app', ':bypass' include ':about', ':core', ':dribbble', ':designernews', ':search' include ':test_shared' project(':bypass').projectDir = new File(rootDir, 'third_party/bypass')
45. INITIALIZATION CONFIGURATION EXECUTION apply plugin: 'com.android.application' apply plugin: 'kotlin-android'
46. INITIALIZATION CONFIGURATION apply plugin: 'com.android.application' apply plugin: 'kotlin-android' EXECUTION
47. INITIALIZATION CONFIGURATION EXECUTION
48. INITIALIZATION CONFIGURATION EXECUTION
49. INITIALIZATION CONFIGURATION EXECUTION BUILDSRC MAIN BUILD GRADLE (CLASSPATH) BUILD.GRADLE BUILD.GRADLE BUILD.GRADLE
50. INITIALIZATION CONFIGURATION EXECUTION BUILDSRC MAIN BUILD GRADLE (CLASSPATH) BUILD.GRADLE BUILD.GRADLE BUILD.GRADLE Build
51. INITIALIZATION CONFIGURATION EXECUTION
52. apply plugin: 'com.android.dynamic-feature' apply plugin: 'kotlin-android' apply plugin: 'kotlin-kapt' apply from: '../core_dependencies.gradle' apply from: '../test_dependencies.gradle' apply from: '../repositories.gradle' android { compileSdkVersion versions.compileSdk defaultConfig { minSdkVersion versions.minSdk targetSdkVersion versions.targetSdk testInstrumentationRunner 'androidx.test.runner.AndroidJUnitRunner' } dataBinding { enabled true }
55. ProjectBuilder
56. `when`("OutputPublisher is included") { val project = ProjectBuilder.builder().build() val talaiotExtension = project.extensions.create("ext", Extension::class.java, project) talaiotExtension.publishers { outputPublisher { } } val publishers = PublishersProvider(project, logger).get() then("instance of OutputPublisher is created") { publishers.forAtLeastOne { it is OutputPublisher } } } ProjectBuilder
57. ProjectBuilder `when`("OutputPublisher is included") { val project = ProjectBuilder.builder().build() val talaiotExtension = project.extensions.create("talaiot", TalaiotExtension::class.java, project) talaiotExtension.publishers { outputPublisher { } } val publishers = PublishersProvider(project, logger).get() then("instance of OutputPublisher is created") { publishers.forAtLeastOne { it is OutputPublisher } } }
58. `when`("OutputPublisher is included") { val project = ProjectBuilder.builder().build() val talaiotExtension = project.extensions.create("ext", Extension::class.java, project) talaiotExtension.publishers { outputPublisher { } } val publishers = PublishersProvider(project, logger).get() then("instance of OutputPublisher is created") { publishers.forAtLeastOne { it is OutputPublisher } } } ProjectBuilder
59. `when`("OutputPublisher is included") { val project = ProjectBuilder.builder().build() val talaiotExtension = project.extensions.create("ext", Extension::class.java, project) talaiotExtension.publishers { outputPublisher { } } val publishers = PublishersProvider(project, logger).get() then("instance of OutputPublisher is created") { publishers.forAtLeastOne { it is OutputPublisher } } } ProjectBuilder
60. Gradle TestKit
61. Gradle TestKit @Test public void testHelloWorldTask() throws IOException { settingsFile = testProjectDir.newFile("settings.gradle"); buildFile = testProjectDir.newFile("build.gradle"); writeFile(settingsFile, "rootProject.name = 'hello-world'"); String buildFileContent = "task helloWorld {" + " doLast {" + " println 'Hello world!'" + " }" + "}"; writeFile(buildFile, buildFileContent); BuildResult result = GradleRunner.create() .withProjectDir(testProjectDir.getRoot()) .withArguments("helloWorld") .build(); assertTrue(result.getOutput().contains("Hello world!")); assertEquals(SUCCESS, result.task(":helloWorld").getOutcome()); }
62. Gradle TestKit @Test public void testHelloWorldTask() throws IOException { settingsFile = testProjectDir.newFile("settings.gradle"); buildFile = testProjectDir.newFile("build.gradle"); writeFile(settingsFile, "rootProject.name = 'hello-world'"); String buildFileContent = "task helloWorld {" + " doLast {" + " println 'Hello world!'" + " }" + "}"; writeFile(buildFile, buildFileContent); BuildResult result = GradleRunner.create() .withProjectDir(testProjectDir.getRoot()) .withArguments("helloWorld") .build(); assertTrue(result.getOutput().contains("Hello world!")); assertEquals(SUCCESS, result.task(":helloWorld").getOutcome()); }
63. Gradle TestKit @Test public void testHelloWorldTask() throws IOException { settingsFile = testProjectDir.newFile("settings.gradle"); buildFile = testProjectDir.newFile("build.gradle"); writeFile(settingsFile, "rootProject.name = 'hello-world'"); String buildFileContent = "task helloWorld {" + " doLast {" + " println 'Hello world!'" + " }" + "}"; writeFile(buildFile, buildFileContent); BuildResult result = GradleRunner.create() .withProjectDir(testProjectDir.getRoot()) .withArguments("helloWorld") .build(); assertTrue(result.getOutput().contains("Hello world!")); assertEquals(SUCCESS, result.task(":helloWorld").getOutcome()); }
64. Gradle TestKit > GradleRunner GRADLE VERSION GRADLE INSTALLATION PROJECT DIR ARGUMENTS BUILD BUILD’S OUTPUT BUILD’S LOGGING TASK EXECUTED PLUGIN CLASS PATH
65. Gradle TestKit @Test public void testHelloWorldTask() throws IOException { settingsFile = testProjectDir.newFile("settings.gradle"); buildFile = testProjectDir.newFile("build.gradle"); writeFile(settingsFile, "rootProject.name = 'hello-world'"); String buildFileContent = "task helloWorld {" + " doLast {" + " println 'Hello world!'" + " }" + "}"; writeFile(buildFile, buildFileContent); BuildResult result = GradleRunner.create() .withProjectDir(testProjectDir.getRoot()) .withArguments("helloWorld") .build(); assertTrue(result.getOutput().contains("Hello world!")); assertEquals(SUCCESS, result.task(":helloWorld").getOutcome()); }
66. Gradle TestKit @Test public void testHelloWorldTask() throws IOException { settingsFile = testProjectDir.newFile("settings.gradle"); buildFile = testProjectDir.newFile("build.gradle"); writeFile(settingsFile, "rootProject.name = 'hello-world'"); String buildFileContent = "task helloWorld {" + " doLast {" + " println 'Hello world!'" + " }" + "}"; writeFile(buildFile, buildFileContent); BuildResult result = GradleRunner.create() .withProjectDir(testProjectDir.getRoot()) .withArguments("helloWorld") .build(); assertTrue(result.getOutput().contains("Hello world!")); assertEquals(SUCCESS, result.task(":helloWorld").getOutcome()); }
67. Gradle TestKit dependencies { testImplementation(gradleTestKit()) }
68. Gradle TestKit dependencies { testImplementation(gradleTestKit()) } plugins { `java-gradle-plugin` }
69. Gradle TestKit given("Build Gradle File") { `when`("Talaiot is included with TaskDependencyGraph") { val buildFile = testProjectDir.newFile("build.gradle") buildFile.appendText( """ plugins { id 'java' id 'talaiot' } talaiot { publishers { taskDependencyGraphPublisher { gexf = true } } } """ )
70. Gradle TestKit given("Build Gradle File") { `when`("Talaiot is included with TaskDependencyGraph") { val buildFile = testProjectDir.newFile("build.gradle") buildFile.appendText( """ plugins { id 'java' id 'talaiot' } talaiot { publishers { taskDependencyGraphPublisher { gexf = true } } } """ )
71. Gradle TestKit val result = GradleRunner.create() .withProjectDir(testProjectDir.getRoot()) .withArguments("assemble") .withPluginClasspath() .build() then("gexf files is generated") { assert(File(“${testProjectDir.getRoot()}/talaiot/gexfTaskDependency.gexf") .exists()) assert(result.task(":assemble")?.outcome == TaskOutcome.SUCCESS) }
72. Gradle TestKit val result = GradleRunner.create() .withProjectDir(testProjectDir.getRoot()) .withArguments("assemble") .withPluginClasspath() .build() then("gexf files is generated") { assert(File(“${testProjectDir.getRoot()}/talaiot/gexfTaskDependency.gexf") .exists()) assert(result.task(":assemble")?.outcome == TaskOutcome.SUCCESS) }
73. Gradle TestKit val result = GradleRunner.create() .withProjectDir(testProjectDir.getRoot()) .withArguments("assemble") .withPluginClasspath() .build() then("gexf files is generated") { assert(File(“${testProjectDir.getRoot()}/talaiot/gexfTaskDependency.gexf") .exists()) assert(result.task(":assemble")?.outcome == TaskOutcome.SUCCESS) }
74. Measure everything
75. Measure everything
76. Measure everything Startup time(settings)
77. Measure everything Startup time(settings) Configuration Time
78. Measure everything Startup time(settings) Configuration Time
79. Measure everything Startup time(settings) Configuration Time GC Time
80. Measure everything Credit: Cristian Garcia
81. Measure everything
82. Measure everything https://github.com/cdsap/Talaiot
83. -Pandroid.enableProfileJson=true
84. -Pandroid.enableProfileJson=true
85. -Pandroid.enableProfileJson=true
86. -Pandroid.enableProfileJson=true
97. Worker API
98. Worker API
99. Worker API
101. Modularize Keep Simple Lazy/Worker API Api/Implementation Caching
102. Modularize Keep Simple Lazy/Worker API Test Iterate Measure Api/Implementation Caching
104. Thanks! @INYAKI_MWC