Supersonic Speed with JVM Args

Demystifying JVM arguments and how they effect Android builds so that you can get the best performance out of your builds. The concepts are greatly impacted by Gradle properties and build caching, therefore this talk discusses them both and how they impact each other.

Transcript

1. Supersonic Speed with JVM Args Dec 7th, 2023 Jason Pearson
 Senior Staff Engineer Formerly Hinge
2. First, about me:
6. CI experience since 2011. Built Android at Hinge, went from solo dev to 24 Android engineers. Also spent years in backend and fullstack roles across various companies.
7. Agenda Context 💻 JVM Args Make it Faster
8. Make it Faster 12 9 6 3 0 Unit Tests Release R8 UI Tests Unit Tests Release R8 UI tests minutes
9. ~400 Modules 💻 290k lines of Kotlin 24 active contributors Context Dagger Hilt (KAPT) 🗡 Gradle Kotlin Scripts KSP (except Dagger)
11. 💻
12. 💻
13. 💻
14. 💻
15. 💻
16. 💻
17. 💻
18. 💻 💻
19. 💻 💻 💻 💻
22. “But why is it taking so long?”
23. 🏗 Automate Building & Publishing “But why is it taking so long?” ⏰
24. 🏗 Automate Building & Publishing 👩🔬 Automate Tests “But why is it taking so long?” ⏰
25. 🏗 Automate Building & Publishing 👩🔬 Automate Tests 🔐 Automate Security “But why is it taking so long?” ⏰
26. 🏗 Automate Building & Publishing 👩🔬 Automate Tests 🔐 Automate Security “But why is it taking so long?” ⏰
27. 🏗 Automate Building & Publishing 👩🔬 Automate Tests 🔐 Automate Security ⏰ 📦 Caching JVM Args 🥷 Shadow Jobs Original Problems Scale Problems
28. This is reasonable 12 9 6 3 0 Unit Tests Release R8 UI Tests Unit Tests Release R8 UI tests minutes
29. 12 9 6 3 0 Unit Tests Release R8 UI Tests Unit Tests Release R8 UI tests minutes How did we get to this?
30. 12 9 6 3 0 Unit Tests Release R8 UI Tests Unit Tests Release R8 UI tests minutes How did we get to this?
31. Control 40 30 20 10 0 Partial Cache Hit Cache Hit Core Change Cache Hit Leaf Change minutes cache save gradle execution gradle configuration cache restore git Docker 👩🔬 Unit Tests on CI
32. Cache Dependencies 📦
33. Gradle Caches Build Cache Configuration Cache Dependency Cache Script Cache
34. Gradle Caches Build Cache EXECUTING Configuration Cache Dependency Cache Script Cache
35. Gradle Caches Build Cache EXECUTING Configuration Cache Dependency Cache Script Cache
36. Gradle Caches Build Cache EXECUTING Configuration Cache Dependency Cache Script Cache
37. Gradle Caches Build Cache CONFIGURING EXECUTING Configuration Cache Dependency Cache Script Cache
38. Gradle Caches Build Cache Configuration Cache Dependency Cache Script Cache
39. 💻 Local Support Gradle Caches Build Cache 💻 💻 💻 Configuration Cache Dependency Cache Script Cache Local Support Local Support Local Support
40. 💻 Local Support Gradle Caches Build Cache 💻 💻 💻 Configuration Cache Dependency Cache Script Cache Local Support Local Support Local Support
41. Gradle Cache directories ~/.gradle ├── caches │ ├── 8.1 │ ├── 8.2 │ ├── ⋮ │ ├── buildcache—1 │ ├── jars-9 │ ├── journal-1 │ ├── modules-2 │ └── transforms-3 │ ├── ⋮
42. Gradle Cache directories ~/.gradle ├── caches │ ├── 8.1 │ ├── 8.2 │ ├── ⋮ │ ├── buildcache—1 │ ├── jars-9 │ ├── journal-1 │ ├── modules-2 │ └── transforms-3 │ ├── ⋮ Dependency Cache
43. Gradle Cache directories ~/.gradle ├── caches │ ├── 8.1 │ ├── 8.2 │ │ ├── generated-gradle-jars │ │ └── kotlin-dsl │ ├── ⋮ │ ├── buildcache—1 │ ├── jars-9 │ ├── journal-1 │ ├── modules-2 │ └── transforms-3 │ Dependency Cache Script Cache
44. ~/.gradle/caches/<< gradle_version >>/generated-gradle-jars ~/.gradle/caches/<< gradle_version >>/kotlin-dsl ~/.gradle/caches/modules-2 ci-cache.yml
45. 💻 Local Support Gradle Caches Build Cache 💻 💻 💻 Configuration Cache Dependency Cache Script Cache Local Support Local Support Local Support
46. Gradle Caches Build Cache 💻 Configuration Cache Dependency Cache Script Cache Local Support 💻 Local Support Remote Support Remote Support
47. Control Cache build dependencies 40 30 20 10 0 Partial Cache Hit Cache Hit Core Change Cache Hit Leaf Change minutes cache save gradle execution gradle configuration cache restore git Docker
48. Control 40 30 20 10 0 Partial Cache Hit Cache Hit Core Change Cache Hit Leaf Change Cache build dependencies minutes cache save gradle execution gradle configuration cache restore git Docker
49. Gradle Properties Prioritizing quick one-liner quick wins None of these are defaults
50. # If you don't turn these on you aren't # getting any performance wins from # Gradle Build Cache or modularization. org.gradle.caching=true org.gradle.parallel=true gradle.properties
51. # Kotlin 1.7+ only # Good reason to upgrade if you are on # an older version. kotlin.incremental.useClasspathSnapshot =true gradle.properties
52. # Incremental compilation with KAPT. # Only if you still use KAPT. kapt.incremental.apt =true gradle.properties
53. # Stop generating BuildConfig Java stubs. # If this is the last Java in your codebase # you could see a decent performance win. android.enableBuildConfigAsBytecode =true gradle.properties
54. # Stop generating BuildConfig files # if you don't use them. android.defaults.buildfeatures.buildconfig =false gradle.properties
55. # Experimental flag for parallelizing # R8 work - only useful if you have # multiple R8 tasks. android.r8.maxWorkers =2 gradle.properties
56. # Summary org.gradle.caching=true org.gradle.parallel=true kotlin.incremental.useClasspathSnapshot=true kapt.incremental.apt=true android.enableBuildConfigAsBytecode=true android.defaults.buildfeatures.buildconfig=false android.r8.maxWorkers=2 gradle.properties
57. Gradle Properties
58. Gradle Properties Other engineers ask me, "Where do you find these?" github.com/androidx/androidx and other OSS projects
59. Control 40 30 20 10 0 Partial Cache Hit Cache Hit Core Change Cache Hit Leaf Change Gradle Properties minutes cache save gradle execution gradle configuration cache restore git Docker
60. Control 40 30 20 10 0 Partial Cache Hit Cache Hit Core Change Cache Hit Leaf Change minutes cache save gradle execution gradle configuration cache restore git Docker Gradle Properties
61. Cache Build Steps 📦
62. Gradle Caches Build Cache 💻 Configuration Cache Dependency Cache Script Cache Local Support 💻 Local Support Remote Support Remote Support
63. Gradle Caches Build Cache 💻 Configuration Cache Dependency Cache Script Cache Local Support 💻 Local Support Remote Support Remote Support
64. Gradle Build Cache - Cacheable Tasks
65. Gradle Build Cache - Modularize • Reduce the number of inputs per task and make them more stable • Watch Siggi’s talk about graph theory • Gradle build scans to observe performance
66. Gradle Remote Cache • Do it: https://docs.gradle.com/build-cache-node/ • 90 Days, 300GB, use validation scripts • Most local and CI runs will benefit from build cache hits • Free
67. • Provides support for features beyond remote cache • Really helps figure out failures, cache misses, and performance issues across a team • Looking forward to using test prediction.
68. Gradle Caches Build Cache 💻 Configuration Cache Dependency Cache Script Cache Local Support 💻 Local Support Remote Support Remote Support
69. Gradle Caches Build Cache 💻 Configuration Cache Dependency Cache Script Cache Remote Support Local Support Remote Support Remote Support
70. Control 40 30 20 10 0 Partial Cache Hit Cache Hit Core Change Cache Hit Leaf Change minutes cache save gradle execution gradle configuration cache restore git Docker Gradle Build Cache Optimization
71. Control 40 30 20 10 0 Partial Cache Hit Cache Hit Core Change Cache Hit Leaf Change minutes cache save gradle execution gradle configuration cache restore git Docker Gradle Build Cache Optimization
72. Is it worth it to use the latest JDK
73. Is it worth it to use the latest JDK Yes, 19+
74. • Yes, 19+ • 20 and 21 make incremental improvements to G1GC algorithm Is it worth it to use the latest JDK
75. Control JDK 11 -> JDK 19 40 30 20 10 0 Partial Cache Hit Cache Hit Core Change Cache Hit Leaf Change minutes cache save gradle execution gradle configuration cache restore git Docker
76. Control 40 30 20 10 0 Partial Cache Hit Cache Hit Core Change Cache Hit Leaf Change minutes cache save gradle execution gradle configuration cache restore git Docker JDK 11 -> JDK 19
77. Upgrade Tooling
78. Upgrade Tooling “Will JDK 19
 work on our project?”
79. Upgrade Tooling “Will version X of dependency Y work on our project?”
80. 🥷 Shadow Jobs “Will version X of dependency Y work on our project?”
81. 🥷 Shadow Jobs Run nightly checks against your project with latest snapshots of new versions. “Will version X of dependency Y work on our project?” Zac Sweers
82. 🥷 Shadow Jobs Run nightly checks against your project with latest snapshots of new versions. “Will version X of dependency Y work on our project?” Zac Sweers
83. JVM Argument Tuning
84. JVM Argument Tuning DISCLAIMER: I am not accountable for any of these settings. If they don’t work for you there are so many reasons why your setup would handle them differently.
85. Garbage Collection Algo Tradeoff 🗑
86. Garbage Collection Algo Tradeoff Each JVM GC algorithm makes a choice about what they optimize for and how much.
87. Garbage Collection Algo Tradeoff
88. Garbage Collection Algo Tradeoff Throughput Transactions per second
89. Garbage Collection Algo Tradeoff Throughput Latency Transactions per second Time spent in GC pauses
90. Garbage Collection Algo Tradeoff Throughput Footprint Latency Transactions per second Time spent in GC pauses Rough memory footprint size
91. Garbage Collection Algo Tradeoff Throughput Footprint Latency
92. Garbage Collection Algo Tradeoff Throughput Footprint Latency
93. Garbage Collection Algo Tradeoff Throughput Footprint Latency
94. Garbage Collection Algo Tradeoff Throughput Footprint Latency ParallelGC G1GC
95. Garbage Collection Algo Tradeoff Throughput Footprint Latency ParallelGC G1GC
96. Garbage Collection Algo Tradeoff Throughput Footprint Latency ParallelGC G1GC
97. ParallelGC Garbage Collection Algo Tradeoff G1GC
98. ParallelGC Garbage Collection Algo Tradeoff G1GC • Optimize for speed • Maximum footprint • Might have longer GC pauses • Balance throughput • Lower footprint • Shorter GC pauses
99. ParallelGC Garbage Collection Algo Tradeoff G1GC • Optimize for speed • Maximum footprint • Might have longer GC pauses • Balance throughput • Lower footprint • Shorter GC pauses Probably safe bet to be stable and fastest for most projects Might be faster for some projects
100. ParallelGC Garbage Collection Algo Tradeoff G1GC • Optimize for speed • Maximum footprint • Might have longer GC pauses • Balance throughput • Lower footprint • Shorter GC pauses • JDK 20 + 21 improvements! Probably safe bet to be stable and fastest for most projects Might be faster for some projects
101. kotlin.daemon.jvm.options When passing arguments, follow these rules: Use the minus sign - only before the arguments Xmx, XX:MaxMetaspaceSize, and XX:ReservedCodeCacheSize. Separate arguments with commas (,) without spaces. Arguments that come after a space will be used for the Gradle daemon, not for the Kotlin daemon. Kotlin JVM Arguments
102. kotlin.daemon.jvm.options When passing arguments, follow these rules: Use the minus sign - only before the arguments Xmx, XX:MaxMetaspaceSize, and XX:ReservedCodeCacheSize. Separate arguments with commas (,) without spaces. Arguments that come after a space will be used for the Gradle daemon, not for the Kotlin daemon. Kotlin JVM Arguments
103. kotlin.daemon.jvm.options When passing arguments, follow these rules: Use the minus sign - only before the arguments Xmx, XX:MaxMetaspaceSize, and XX:ReservedCodeCacheSize. Separate arguments with commas (,) without spaces. Arguments that come after a space will be used for the Gradle daemon, not for the Kotlin daemon. Kotlin JVM Arguments
104. kotlin.daemon.jvmargs You can add the kotlin.daemon.jvmargs property in the gradle.properties fi le: kotlin.daemon.jvmargs=-Xmx1500m -Xms=500m Kotlin JVM Arguments
105. kotlin.daemon.jvmargs You can add the kotlin.daemon.jvmargs property in the gradle.properties fi le: kotlin.daemon.jvmargs=-Xmx1500m -Xms=500m Using spaces at the beginning will cause all arguments to be ignored Kotlin JVM Arguments
106. Xmx (max) JVM Heap Size Xms (min) • Amount of memory it takes to compile your biggest task / module. • For most projects this is going to be your main app module’s minification step. • Somewhere between 80 and 100% of Xmx. • Heap only grows when GC happens, so increasing it avoids this penalty.
107. JVM Heap Size & Modularization are related
108. MaxMetaspaceSize Metaspace CompressedClassSpaceSize • class & non-class space • unlimited by default • virtual size of compressed classes • defaults to 1GB
109. Metaspace https://stuefe.de/posts/metaspace/analyze-metaspace-with-jcmd/
110. CompressedOops Metaspace CompressedClassPointers • Defaults on < 30GB heap • Uses 4 fewer bytes • Restricts memory heap to 32GB • Available if CompressedOops is on
111. What if we turn off CompressedClassSpace + CompressedOops? 20 15 10 5 0 On Off On Off minutes
112. Metaspace CompressedOops & unlimited MaxMetaspace is going to be better for majority of Android projects.
113. Metaspace CompressedOops & unlimited MaxMetaspace is going to be better for majority of Android projects. (so stick with the defaults)
114. Metaspace ~1GB Metaspace helps avoid early Metaspace-related GCs
115. Measuring Metaspace jcmp <pid> VM.metaspace
116. CodeCache Where the JVM stores its bytecode into compiled native code
117. CodeCache Where the JVM stores its bytecode into compiled native code
118. CodeCache ReservedCodeCacheSize is the maximum amount for cached bytecode
119. CodeCache So we gave ReservedCodeCacheSize 512mb
120. CodeCache To determine what number you should use, measure via JVM arg: –XX:+PrintCodeCache
121. SoftRefLRUPolicyMSPerMB The number of milliseconds to hold onto soft references per MB of heap size, default 1000
122. SoftRefLRUPolicyMSPerMB The number of milliseconds to hold onto soft references per MB of heap size, default 1000 = 2h 16m 32s 8GB Heap @ 1000 MS Policy
123. SoftRefLRUPolicyMSPerMB The number of milliseconds to hold onto soft references per MB of heap size, default 1000 = 2h 16m 32s 8GB Heap @ 1000 MS Policy 8GB Heap @ 10 MS Policy = 0h 1m 22s
124. SoftRefLRUPolicyMSPerMB The number of milliseconds to hold onto soft references per MB of heap size, default 1000 = 2h 16m 32s 8GB Heap @ 1 MS Policy 8GB Heap @ 1000 MS Policy = 0h 0m 8s 8GB Heap @ 10 MS Policy = 0h 1m 22s
125. Gradle Max Workers --max-workers The maximum number of active workers to allow Should probably be number of performance cores, possibly 1-2 less Will not spawn more workers is memory heap requirements cannot be met
126. jemalloc / tcmalloc Memory fragmentation slows down builds, use a better malloc algorithm
127. malloc alternatives Memory fragmentation slows down builds, use a better malloc algorithm
128. malloc alternatives We saw no speed difference with jemalloc, but it did notice 10% less memory usage
129. malloc alternatives Therefore use jemalloc (or tcmalloc) to be able to run more daemons in parallel with less memory pressure.
130. What do we actually pick for JVM args?
131. 🥷 Shadow Jobs 1. Instrument your build with JVM args as parameters 2. Run parameterized tests 3. Profit What do we actually pick for JVM args?
132. • GC Algo = It Depends • SoftRefLRUPolicyMSPerMB = 1 • CodeCache = 256MB - 512MB • MaxMetaspace = Some GB or unlimited • Metaspace = 64MB - 1GB • Xmx = 4GB - 12GB • Xms = Xmx • Max Workers=Performance Cores - 2 What do we actually pick?
133. • jcmp for Metaspace • –XX:+PrintCodeCache for CodeCache • Measure CPU & Memory resource usage, lots of tools available JVM Measurement Tools
134. Control JVM Optimizations 40 30 20 10 0 Partial Cache Hit Cache Hit Core Change Cache Hit Leaf Change minutes cache save gradle execution gradle configuration cache restore git Docker
135. Control 40 30 20 10 0 Partial Cache Hit Cache Hit Core Change Cache Hit Leaf Change minutes cache save gradle execution gradle configuration cache restore git Docker JVM Optimizations
136. Control 40 30 20 10 0 Partial Cache Hit Cache Hit Core Change Cache Hit Leaf Change minutes cache save gradle execution gradle configuration cache restore git Docker JVM Optimizations
137. Gradle Caches Build Cache Configuration Cache Dependency Cache Script Cache Remote Support Remote Support Remote Support 💻 Local Support
138. Gradle Caches Build Cache Configuration Cache Dependency Cache Script Cache Remote Support Remote Support Remote Support 💻 Local Support
139. # Enables the configuration cache: org.gradle.configuration-cache=true org.gradle.configuration-cache.problems=warn org.gradle.configuration-cache.inputs.unsafe.ignore.file-system- checks=(see github.com/androidx/androidx repo gradle.properties) gradle.properties
140. Gradle Cache directories ~/.gradle ├── caches │ └── ⋮ Dependency Cache Script Cache
141. Gradle Cache directories ~/.gradle ├── caches │ └── ⋮ ~/project ├── .gradle ├── app ├── build ├── gradle └── ⋮ Dependency Cache Script Cache
142. Gradle Cache directories ~/project ├── .gradle ├── app ├── build ├── gradle └── ⋮
143. Gradle Cache directories ~/project ├── .gradle │ │ │ │ ├── app ├── build ├── gradle └── ⋮
144. Gradle Cache directories ~/project ├── .gradle │ ├── 8.1 │ ├── 8.2 │ ├── ⋮ │ └── configuration-cache ├── app ├── build ├── gradle └── ⋮
145. ~/project ├── .gradle │ ├── 8.1 │ ├── 8.2 │ ├── ⋮ │ └── configuration-cache ├── app ├── build ├── gradle └── ⋮ Configuration Cache Gradle Cache directories
146. ~/.gradle/caches/<< gradle_version >>/generated-gradle-jars ~/.gradle/caches/<< gradle_version >>/kotlin-dsl ~/.gradle/caches/modules-2 .gradle/<< gradle_version >> .gradle/configuration-cache ci-cache.yml
147. As of Gradle 8.1 encryption was added. Asking Gradle support - configuration cache on CI is unsupported Gradle Configuration Cache on CI
148. As of Gradle 8.1 encryption was added. Gradle's response has been that configuration cache on CI is not supported Gradle Configuration Cache on CI
149. As of Gradle 8.1 encryption was added. Gradle's response has been that configuration cache on CI is not supported. But we persisted anyway... Gradle Configuration Cache on CI
150. Gradle Configuration Cache on CI Environment Variable Environment Variables Prefixed File system Entry File System property Value from custom source 35 1 2007 4 52 5 build/reports/configuration-cache/4tnz..i67j/27o6..b0jl/configuration-cache-report.html We looked at the reports for all inputs
151. But despite everything 100% of inputs being consistent we continued to get an unhelpful error message: Gradle Configuration Cache on CI
152. Gradle Configuration Cache on CI Calculating task graph as no configuration cache is available for tasks
153. Gradle Configuration Cache on CI “You need to cache the encryption key.” — Inaki Villar
154. Gradle Configuration Cache on CI Caveat to this method - you will be caching any secrets used by this build, so either: • Only use this for builds that do not rely on secrets • Knowingly store this with the security risk
156. Gradle Configuration Cache on CI
157. Gradle User Home directory ~/.gradle ├── caches │ ├── 8.1 │ │ … │ ├── 8.4 │ │ └── cc-keystore │ │ ├── cache.properties │ │ ├── cc-keystore.lock │ │ └── gradle.keystore │ ├── │ ├── buildcache—1 │ ├── jars-9 │ ├── journal-1 Configuration Cache Encryption
158. ~/.gradle/caches/<< gradle_version >>/generated-gradle-jars ~/.gradle/caches/<< gradle_version >>/kotlin-dsl ~/.gradle/caches/modules-2 .gradle/<< gradle_version >> .gradle/configuration-cache ci-cache.yml
159. ~/.gradle/caches/<< gradle_version >>/generated-gradle-jars ~/.gradle/caches/<< gradle_version >>/kotlin-dsl ~/.gradle/caches/<< gradle_version >>/cc-keystore ~/.gradle/caches/modules-2 .gradle/<< gradle_version >> .gradle/configuration-cache ci-cache.yml
160. Gradle Configuration Cache on CI Calculating task graph as no configuration cache is available for tasks
161. unit_tests: docker: - image: circleci/android:api-34-node steps: - run: name: Clean Gradle Cache command: | find . -type f -name '*.lock' -delete find . -type f -name 'gc.properties' -delete find ~/.gradle -type f -name '*.lock' -delete find ~/.gradle -type f -name 'gc.properties' -delete when: always - save_cache: paths: - ~/.gradle/caches/<< parameters.gradle_version >>/ generated-gradle-jars - ~/.gradle/caches/<< parameters.gradle_version >>/ kotlin-dsl - .gradle/configuration-cache - ~/.gradle/caches/<< parameters.gradle_version >>/ cc-keystore - .gradle/<< parameters.gradle_version >> config.yml
162. unit_tests: docker: - image: circleci/android:api-34-node steps: - run: name: Clean Gradle Cache command: | find . -type f -name '*.lock' -delete find . -type f -name 'gc.properties' -delete find ~/.gradle -type f -name '*.lock' -delete find ~/.gradle -type f -name 'gc.properties' -delete when: always - save_cache: paths: - ~/.gradle/caches/<< parameters.gradle_version >>/ generated-gradle-jars - ~/.gradle/caches/<< parameters.gradle_version >>/ kotlin-dsl - .gradle/configuration-cache - ~/.gradle/caches/<< parameters.gradle_version >>/ cc-keystore - .gradle/<< parameters.gradle_version >> config.yml 🤦
163. Gradle Configuration Cache on CI Calculating task graph as configuration cache cannot be reused because an input to task ‘:gradle-plugin:generateExternalPluginSpecBuilders' has changed.
164. Gradle Configuration Cache on CI Calculating task graph as configuration cache cannot be reused because an input to task ‘:gradle-plugin:generateExternalPluginSpecBuilders' has changed.
165. “Gradle has compilation avoidance for non- ABI changes in included builds, but due to a bug any inline function would cause all build scripts to be recompiled even when there is a non-ABI change.” - Nicklas Ansman Gradle Configuration Cache on CI
166. ~/.gradle/caches/<< gradle_version >>/generated-gradle-jars ~/.gradle/caches/<< gradle_version >>/kotlin-dsl ~/.gradle/caches/<< gradle_version >>/cc-keystore ~/.gradle/caches/modules-2 .gradle/<< gradle_version >> .gradle/configuration-cache gradle-plugin/build/pluginDescriptors ci-cache.yml
167. Gradle Configuration Cache on CI Could not load the value of field `patterns` of `org.gradle.configurationcache.serialization.codecs.DirectoryTree Spec` bean found in field `fileSystemInputs` of `org.gradle.configurationcache.fingerprint.ConfigurationCacheFing erprint$WorkInputs` bean found in Gradle runtime. > Failed to instrument class org/jetbrains/kotlin/gradle/tasks/ KotlinCompile$ScriptFilterSpec in ClassLoaderScopeIdentifier.Id{coreAndPlugins:settings[:gradle- plugin]:buildSrc[:gradle-plugin]:root-project[:gradle-plugin] (export)}
168. Gradle Configuration Cache on CI Could not load the value of field `patterns` of `org.gradle.configurationcache.serialization.codecs.DirectoryTree Spec` bean found in field `fileSystemInputs` of `org.gradle.configurationcache.fingerprint.ConfigurationCacheFing erprint$WorkInputs` bean found in Gradle runtime. > Failed to instrument class org/jetbrains/kotlin/gradle/tasks/ KotlinCompile$ScriptFilterSpec in ClassLoaderScopeIdentifier.Id{coreAndPlugins:settings[:gradle- plugin]:buildSrc[:gradle-plugin]:root-project[:gradle-plugin] (export)}
169. ~/.gradle/caches/<< gradle_version >>/generated-gradle-jars ~/.gradle/caches/<< gradle_version >>/kotlin-dsl ~/.gradle/caches/<< gradle_version >>/cc-keystore ~/.gradle/caches/modules-2 .gradle/<< gradle_version >> .gradle/configuration-cache gradle-plugin/build/pluginDescriptors ci-cache.yml
170. ~/.gradle/caches/<< gradle_version >>/generated-gradle-jars ~/.gradle/caches/<< gradle_version >>/kotlin-dsl ~/.gradle/caches/<< gradle_version >>/cc-keystore ~/.gradle/caches/modules-2 .gradle/<< gradle_version >> .gradle/configuration-cache gradle-plugin/build ci-cache.yml
171. ~/.gradle/caches/<< gradle_version >>/generated-gradle-jars ~/.gradle/caches/<< gradle_version >>/kotlin-dsl ~/.gradle/caches/<< gradle_version >>/cc-keystore ~/.gradle/caches/modules-2 ~/.gradle/caches/jars-9 ~/.gradle/caches/transforms-3 .gradle/<< gradle_version >> .gradle/configuration-cache gradle-plugin/build ci-cache.yml
172. Reusing configuration cache. Gradle Configuration Cache on CI
173. Gradle Configuration Cache on CI
174. Gradle Configuration Cache on CI
175. “Wow, I was prepared for a faster PR time but that was blazing” - Jacob Duron Gradle Configuration Cache on CI
176. Gradle Configuration Cache Update
177. “I believe its in the interest of Gradle and the community to support a method to share the configuration cache between machines that doesn't expose build secrets” - me Gradle Configuration Cache Update
178. TLDR; Wait for Gradle 8.6 and a new GitHub Gradle Build Action Gradle Configuration Cache Update
179. Gradle Caches Build Cache Configuration Cache Dependency Cache Script Cache Remote Support Remote Support Remote Support 💻 Local Support
180. Gradle Caches Build Cache Configuration Cache Dependency Cache Script Cache Remote Support Remote Support Remote Support Remote Support
181. Control Gradle Configuration Cache Reuse 40 30 20 10 0 Partial Cache Hit Cache Hit Core Change Cache Hit Leaf Change minutes cache save gradle execution gradle configuration cache restore git Docker
182. Control Gradle Configuration Cache Reuse 40 30 20 10 0 Partial Cache Hit Cache Hit Core Change Cache Hit Leaf Change minutes cache save gradle execution gradle configuration cache restore git Docker
183. 40 30 20 10 0 Gradle Configuration Cache Reuse Control Partial Cache Hit Cache Hit Core Change Cache Hit Leaf Change minutes cache save gradle execution gradle configuration cache restore git Docker
184. Overhead Cost Optimizations 📦 git clone pulls 400 MB big images (2.5 GB) Minutes to save cache ~60 seconds to restore cache
185. GitHub Actions 📦 pulls run at 200mb/s base images are cached better cache restore and save operations runs 2-5x faster
186. Control Present Day Unit Test Runs 40 30 20 10 0 Partial Cache Hit Cache Hit Core Change Cache Hit Leaf Change minutes cache save gradle execution gradle configuration cache restore git Docker
187. 40 30 20 10 0 Control Partial Cache Hit Cache Hit Core Change Cache Hit Leaf Change minutes cache save gradle execution gradle configuration cache restore git Docker Present Day Unit Test Runs
188. CI Speed Optimizations Cache Dependencies Cache Build Tasks Cache Configuration JVM Tuning Compiler Flags 🏋 📦 🚩
189. CI Speed Optimizations Cache Dependencies Cache Build Tasks Cache Configuration JVM Tuning Compiler Flags 🏋 📦 🚩 ✅
190. CI Speed Optimizations Cache Dependencies Cache Build Tasks Cache Configuration JVM Tuning Compiler Flags 🏋 📦 🚩 ✅ ✅
191. Questions? kaeawc / android-ci Proof of Concept:
192. Metaspace Citations Thomas Stüfe Blog https://stuefe.de/posts/metaspace/what-is-metaspace/ https://stuefe.de/posts/metaspace/metaspace-architecture/ https://stuefe.de/posts/metaspace/what-is-compressed-class-space/ https://stuefe.de/posts/metaspace/sizing-metaspace/ https://stuefe.de/posts/metaspace/analyze-metaspace-with-jcmd/ Oracle Class Metadata, PermGen and changes to native memory allocation
193. Gradle Documentation Gradle Files & Directories https://docs.gradle.org/current/userguide/directory_layout.html Gradle CI Ephemeral Best Practices https://docs.gradle.org/current/userguide/ dependency_resolution.html#sub:ephemeral-ci-cache Gradle Recommends using Daemons for CI https://docs.gradle.org/current/userguide/ gradle_daemon.html#continuous_integration
194. Kotlin JVM Args Documentation New Method https://kotlinlang.org/docs/gradle-compilation-and-caches.html#kotlin- daemon-jvmargs-property Deprecated Method https://kotlinlang.org/docs/gradle-compilation-and-caches.html#kotlin- daemon-jvm-options-system-property
195. JDK Version Documentation JDK Release Notes Summaries for GC Algo Changes 19 | 20 | 21 JVM SoftReferences Tuning CodeCache
196. JVM SoftReferences JVM SoftReferences
197. JVM CodeCache Tuning CodeCache
198. Shadow Jobs by Zac Sweers https://slack.engineering/shadow-jobs/