Dexs, R8 and 3.3

DroidKaigi, Tokyo 2019
MobileRefresh, Wellington 2018
AppsConf, Moscow 2018

Transcript

1. DEXS, R8 & 3.3 @INYAKI_MWC
2. DECKS, EFX & 909
4. D8 R8
5. KOTLIN FILE JAVA FILE
6. KOTLIN FILE JAVA FILE KOTLINC JAVAC CLASS
7. KOTLIN FILE JAVA FILE KOTLINC JAVAC CLASS DEX DX
8. KOTLIN FILE JAVA FILE KOTLINC JAVAC CLASS DEX APK DX
9. CLASS DEX APK
10. CLASS DEX APK
11. CLASS DEX APK
12. CLASS DEX APK fun hello(): String { return "Hello" }
13. CLASS DEX APK fun hello(): String { return "Hello" }
14. CLASS DEX APK fun hello(): String { return "Hello" }
15. CLASS DEX APK fun hello(): String { return "Hello" }
16. CLASS DEX APK fun hello(): String { val world = "Hello World" return world }
17. CLASS DEX APK fun hello(): String { val world = "Hello World" return world }
18. CLASS DEX APK fun hello(): String { val world = "Hello World" return world }
19. CLASS DEX APK fun hello(): String { val world = "Hello World" return world }
20. CLASS DEX APK JVM DALVIK-ART
21. CLASS DEX APK JVM DALVIK-ART STACK BASED REGISTER BASED 1. POP 20 2. POP 7 3. ADD 20, 7, result 4. PUSH result ADD R1, R2, R3 ;
22. CLASS DEX APK fun hello(): String { return "Hello" }
23. CLASS DEX APK fun hello(): String { return "Hello" }
24. CLASS DEX APK fun hello(): String { return "Hello" } http://mariokmk.github.io/programming/2015/03/06/learning-android-bytecode.html https://source.android.com/devices/tech/dalvik/dalvik-bytecode
25. CLASS A HEADER CONSTANT POOL CLASS FIELD ATTRIBUTES METHODS
26. CLASS A HEADER CONSTANT POOL CLASS FIELD ATTRIBUTES METHODS CLASS B HEADER CONSTANT POOL CLASS FIELD ATTRIBUTES METHODS
27. CLASS A HEADER CONSTANT POOL CLASS FIELD ATTRIBUTES METHODS CLASS B HEADER CONSTANT POOL CLASS FIELD ATTRIBUTES METHODS HEADER String_ids Type_ids Proto_ids Methods Fields Classes Data DEX
28. CLASS A HEADER CONSTANT POOL CLASS FIELD ATTRIBUTES METHODS CLASS B HEADER CONSTANT POOL CLASS FIELD ATTRIBUTES METHODS HEADER String_ids Type_ids Proto_ids Methods Fields Classes Data DEX
29. CLASS A HEADER CONSTANT POOL CLASS FIELD ATTRIBUTES METHODS CLASS B HEADER CONSTANT POOL CLASS FIELD ATTRIBUTES METHODS HEADER String_ids Type_ids Proto_ids Methods Fields Classes Data DEX
30. CLASS DEX APK
31. CLASS DEX APK
32. CLASS DEX APK MIN-SDK = 27
33. CLASS DEX APK MIN-SDK = 14
34. CLASS DEX APK MIN-SDK = 14
35. CLASS DEX APK 65536 MULTIDEXING EVERYWHERE
36. CLASS DEX APK 65536 MULTIDEXING EVERYWHERE
37. CLASS DEX APK
38. CLASS DEX APK DEX
39. CLASS DEX APK DALVIK ART DEX
40. CLASS DEX APK DALVIK ART DEXOPT ODEX DEX DEX2OAT ODEX VDEX JIT AOT JIT COMPACTDEX
45. D8
46. Android Gradle Plugin < 3.0
47. A.JAVA JAVAC A.CLASS DX B.JAVA B.CLASS CLASSES.DEX Android Gradle Plugin < 3.0
48. A.JAVA JAVAC A.CLASS DX B.JAVA B.CLASS CLASSES.DEX Android Gradle Plugin < 3.0
49. A.JAVA JAVAC A.CLASS DX B.JAVA B.CLASS CLASSES.DEX Android Gradle Plugin < 3.0
50. A.JAVA JAVAC A.CLASS DX B.JAVA B.CLASS CLASSES.DEX Android Gradle Plugin < 3.0
51. A.JAVA JAVAC A.CLASS DX B.JAVA B.CLASS CLASSES.DEX Android Gradle Plugin >= 3.0
52. A.JAVA JAVAC A.CLASS DX B.JAVA B.CLASS CLASSES.DEX Android Gradle Plugin >= 3.0
53. A.JAVA JAVAC A.CLASS DX B.JAVA B.CLASS CLASSES.DEX Android Gradle Plugin >= 3.0
54. A.JAVA JAVAC A.CLASS DX B.JAVA B.CLASS Android Gradle Plugin >= 3.0 A.DEX B.DEX
55. A.JAVA JAVAC A.CLASS DX B.JAVA B.CLASS Android Gradle Plugin >= 3.0 A.DEX B.DEX
56. A.JAVA JAVAC A.CLASS DX B.JAVA B.CLASS Android Gradle Plugin >= 3.0 A.DEX B.DEX DX MERGING CLASSES.DEX
57. A.JAVA JAVAC A.CLASS DX B.JAVA B.CLASS Android Gradle Plugin >= 3.0 A.DEX B.DEX DX MERGING CLASSES.DEX
58. A.JAVA JAVAC A.CLASS DX B.JAVA B.CLASS Android Gradle Plugin >= 3.1 A.DEX B.DEX DX MERGING CLASSES.DEX D8
59. Desugaring .subscribe( this::handleSupportFeatureGet, error -> log.e(error, "Unable to updateSupportFeature”) )
60. Desugaring A.JAVA JAVAC A.CLASS 8 DX CLASSES.DEX DESUGARING A.CLASS 6-7 .subscribe( this::handleSupportFeatureGet, error -> log.e(error, "Unable to updateSupportFeature”) )
61. Desugaring A.JAVA JAVAC A.CLASS 8 DX CLASSES.DEX DESUGARING A.CLASS 6-7
62. D8 A.JAVA JAVAC A.CLASS 8 DX CLASSES.DEX DESUGARING A.CLASS 6-7 D8
63. Show me numbers
64. Show me numbers
65. 56% MainDexFile Debug 75% MainDexFile Release 10% time Debug Builds
66. https://github.com/cdsap/Kotlin-Client-Server.git Gradle Profiler + Talaiot https://github.com/gradle/gradle-profiler https://github.com/cdsap/Talaiot
67. https://github.com/cdsap/Kotlin-Client-Server.git Gradle Profiler + Talaiot https://github.com/gradle/gradle-profiler https://github.com/cdsap/Talaiot
68. android.enableD8=true android.enableD8=false
69. android.enableD8=true android.enableD8=false
70. android.enableD8=false
71. android.enableD8=true android.enableD8=true
74. ivillar$ java -jar d8.jar --debug MainActivity.class
75. ivillar$ java -jar d8.jar --debug MainActivity.class ivillar$ dexdump classes.dex
76. Processing 'classes.dex'... Opened 'classes.dex', DEX version '035' Class #0 - Class descriptor : 'Lcom/example/myapplication/MainActivity;' Access flags : 0x0011 (PUBLIC FINAL) Superclass : 'Landroid/support/v7/app/AppCompatActivity;' Interfaces - Static fields - Direct methods - #0 : (in Lcom/example/myapplication/MainActivity;) name : '<init>' type : '()V' access : 0x10001 (PUBLIC CONSTRUCTOR) registers : 1 ins : 1 outs : 1 insns size : 4 16-bit code units positions : 0x0000 line=6 locals : 0x0000 - 0x0004 reg=0 this Lcom/example/myapplication/MainActivity; Virtual methods - #0 : (in Lcom/example/myapplication/MainActivity;) name : 'onCreate' type : '(Landroid/os/Bundle;)V' access : 0x0004 (PROTECTED) registers : 3 ins : 2 outs : 2 insns size : 10 16-bit code units positions : 0x0000 line=9 0x0003 line=10 0x0009 line=11 locals : 0x0000 - 0x000a reg=1 this Lcom/example/myapplication/MainActivity; 0x0000 - 0x000a reg=2 savedInstanceState Landroid/os/Bundle;
77. 3.1.X 3.2.X 3.3.X 3.0.X
78. 3.1.X 3.2.X 3.3.X 3.0.X ENABLED ENABLED ENABLED DISABLED
79. 3.1.X 3.2.X 3.3.X 3.0.X ENABLED ENABLED ENABLED DISABLED 1st Phase: D8/DX - 6 months approx 2nd Phase: D8/DX(deprecated) - 1 year approx 3rd Phase: DX Removed
80. R8
81. PROGUARD
82. SHRINK OBFUSCATE OPTIMIZE PROGUARD
83. A.JAVA JAVAC PROGUARD CLASSES.DEX AO.CLASS A.CLASS DX SHRINK OBFUSCATE OPTIMIZE PROGUARD
84. A.JAVA JAVAC PROGUARD CLASSES.DEX AO.CLASS A.CLASS D8 SHRINK OBFUSCATE OPTIMIZE PROGUARD DX
85. A.JAVA JAVAC PROGUARD CLASSES.DEX AO.CLASS A.CLASS D8 SHRINK OBFUSCATE OPTIMIZE PROGUARD Transformation API
87. A.JAVA JAVAC PROGUARD CLASSES.DEX AO.CLASS A.CLASS D8 SHRINK OBFUSCATE OPTIMIZE R8
88. A.JAVA JAVAC CLASSES.DEX A.CLASS SHRINK OBFUSCATE OPTIMIZE R8
89. SHRINK OBFUSCATE OPTIMIZE PROGUARD R8
90. SHRINK OBFUSCATE OPTIMIZE PROGUARD R8 -keep class com.alipay.android.app.IAlixPay{*;} -keep class com.alipay.android.app.IAlixPay$Stub{*;}
91. SHRINK OBFUSCATE OPTIMIZE minification.InterfaceA -> ItfA: int functionFromIntToInt(int) -> foo minification.InterfaceB -> ItfB: int functionFromIntToInt(int) -> bar PROGUARD R8
92. SHRINK OBFUSCATE OPTIMIZE minification.InterfaceA -> ItfA: int functionFromIntToInt(int) -> foo minification.InterfaceB -> ItfB: int functionFromIntToInt(int) -> bar PROGUARD R8
93. SHRINK OBFUSCATE OPTIMIZE minification.InterfaceA -> ItfA: int functionFromIntToInt(int) -> foo minification.InterfaceB -> ItfB: int functionFromIntToInt(int) -> bar PROGUARD R8
94. SHRINK OBFUSCATE OPTIMIZE PROGUARD R8
95. SHRINK OBFUSCATE OPTIMIZE PROGUARD R8 PROGUARD & R8 Remove unused classes/fields/methods Inline constants Propagate constants Remove unused code Propagate constant fields Remove write-only fields Simplify basic container classes Merge interfaces with single implementations Propagate constant return values Inline methods Outline common code into new methods PROGUARD Propagate constant arguments Simplify plain enum types Merge classes Make methods private Make methods static Desynchronize methods Simplify tail recursion Remove logging code Merge code R8 Simplify basic container classes Outline common code into new methods Merge Kotlin lambda constructs Optimize Kotlin lambda constructs https://www.guardsquare.com/en/blog/proguard-and-r8
96. SHRINK OBFUSCATE OPTIMIZE R8
97. SHRINK R8 ABSTRACT METHOD REMOVER ANNOTATION REMOVER HORIZONTAL CLASS MERGING VERTICAL CLASS MERGING ASSUME VALUES API OBFUSCATE OPTIMIZE
98. SHRINK R8 OBFUSCATE OPTIMIZE
99. SHRINK R8 OBFUSCATE OPTIMIZE IR
100. SHRINK R8 OBFUSCATE OPTIMIZE IR INLINING STATICIZER PROCESSING MEMBER VALUE STRING OPTIMIZE DEVIRTUALI ZER JAVA 8 REWRITER LAMBDA REWRITER LAMBDA MERGER
101. SHRINK R8 OBFUSCATE OPTIMIZE IR REWRITE LONG COMPARE & REQUIRE NON NULL SIMPLIFY ARRAY CONSTRUCTOR SPLIT RANGE INVOKE CONSTANTS SIMPLIFY IF REWRITE SWITCH LOG ARGUMENT TYPES COLLECT CLASS INIT DEFAULTS REWRITE THROWABLE ADD AND GET SUPRESS IDENTIFY RETURN ARGUMENTS NUMBER CONVERSION REGISTER ALLOCATION INLINING STATICIZER PROCESSING MEMBER VALUE STRING OPTIMIZE DEVIRTUALI ZER JAVA 8 REWRITER LAMBDA REWRITER LAMBDA MERGER
102. SHRINK R8 OBFUSCATE OPTIMIZE IR REWRITE LONG COMPARE & REQUIRE NON NULL SIMPLIFY ARRAY CONSTRUCTOR SPLIT RANGE INVOKE CONSTANTS SIMPLIFY IF REWRITE SWITCH LOG ARGUMENT TYPES COLLECT CLASS INIT DEFAULTS REWRITE THROWABLE ADD AND GET SUPRESS IDENTIFY RETURN ARGUMENTS NUMBER CONVERSION REGISTER ALLOCATION INLINING STATICIZER PROCESSING MEMBER VALUE STRING OPTIMIZE DEVIRTUALI ZER JAVA 8 REWRITER LAMBDA REWRITER LAMBDA MERGER
103. SHRINK R8 OBFUSCATE OPTIMIZE D8
104. SHRINK R8 OBFUSCATE OPTIMIZE D8
105. SHRINK OBFUSCATE OPTIMIZE R8
106. SHRINK OBFUSCATE OPTIMIZE R8
107. R8
108. R8 SHRINK OBFUSCATE OPTIMIZE
109. Show me numbers II
110. Show me numbers II
111. Use Case: Multi Module
112. Use Case: Multi Module Gradle 4.9 Android Plugin 3.3.0-alpha08 15 Modules + 1000 Classes R8 Disabled/Enabled
113. Use Case: Multi Module Gradle 4.9 Android Plugin 3.3.0-alpha08 15 Modules + 1000 Classes R8 Disabled/Enabled
114. Use Case: Multi Module Gradle 4.9 Android Plugin 3.3.0-alpha08 15 Modules + 1000 Classes R8 Disabled/Enabled
115. Kotlin Client Server assembleRelease android.enableR8 = false
116. Kotlin Client Server assembleRelease android.enableR8 = true
117. android.enableR8 = true
118. classpath "com.android.tools:r8:$versions.r8" android.enableR8 = true
119. Open Source
120. Test $ git clone https://r8.googlesource.com/r8 $ tools/gradle.py d8 r8 $ java -jar d8.jar —debug —output out HelloWorld.class $ java -jar r8.jar —output out --pg-conf proguard.cfg classes
122. @INYAKI_MWC