Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Sign up for free
Menu
Search
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Pricing
Search
Sign in
Sign up for free
Fluid User Interface with Hardware Acceleration
Search
Ariya Hidayat
February 22, 2013
Programming
13k
30
Share
Embed
Copy iframe code
Copy JS code
Copy link
Start on current slide
Fluid User Interface with Hardware Acceleration
Talk at W3Conf 2013, San Francisco.
Ariya Hidayat
February 22, 2013
Transcript
57 slides
Fluid User Interface with Hardware Acceleration Ariya Hidayat San Francisco
Feb 22, 2013 @ariyahidayat 1
2
Magical Advice Use translate3d for hardware acceleration 3
whoami 4
CSS3 5
Web Browser from 10,000 ft 6
Browser: High Level User Interface Browser Engine Graphics Stack Data
Persistence Render Engine JavaScript Engine Networking I/O 7
From Contents to Pixels HTML Parser DOM CSS Parser HTML
Style Sheets DOM Tree Style Rules Render Tree Render Layout Paint http://www.html5rocks.com/en/tutorials/internals/howbrowserswork 8
DOM Tree <html><body><p>Hello</p></body></html> HTMLDocument HTMLBodyElement HTMLParagraphElement attributes, children, contents 9
DOM Tree vs Render Tree HTMLDocument HTMLBodyElement HTMLParagraphElement RenderRoot RenderBody
RenderText tree structure/navigation metrics (box model) hit testing RenderStyle computed style many:1 10
Style Recalc vs Layout document.getElementById('box').style.top = '100px'; Aggregated “dirty” area
document.getElementById('box').style.backgroundColor = 'red'; No layout necessary, metrics are not flagged as “changed” 11
Minimizing Layout http://gent.ilcore.com/2011/03/how-not-to-trigger-layout-in-webkit.html http://code.google.com/p/chromium/source/search?q=%22-%3EupdateLayoutIgnorePendingStylesheets()%22 clientHeight clientLeft clientTop clientWidth offsetHeight offsetLeft
offsetParent offsetTop offsetWidth scrollLeft scrollTop scrollWidth innerText outerText Element focus() getBoundingClientRect() getClientRects() scrollByLines() scrollByPages() scrollHeight scrollIntoView() scrollIntoViewIfNeeded() 12
CSS Painting: 10 Stages http://www.w3.org/TR/CSS2/zindex.html Appendix E. Elaborate description of
Stacking Contexts • Background • Floats • Foreground • Selection • Outline Done by the render objects (in the render tree) 13
Graphics Stack: Crash Course 14
Path is Everything 15
Stroke = Outline Solid Dashed Dotted Textured 16
Brush = Fill Solid None Gradient Textured 17
Path Approximation Curves Polygon 18
Antialiasing 19
Transformation Scaling Rotation Perspective 20
Graphics Processing Unit “Fixed” geometry Transformation Textured triangles Parallelism 21
Optimized for Games http://epicgames.com/technology/epic-citadel http://www.rage.com/ 22
GPU Workflow Vertices Rendered Textured Matrix 23
Web Page Rendering 24
Game vs Web Page Predictable contents (assets) ✔ Mostly text
✔ Mostly images ✔ immediate Initial response 25
GPU Physical Limitations • Memory: Can’t store too much stuff
• Speed: Quad-core CPU can do certain operations better • Bandwidth: Data transfer can be the bottleneck • Power: Electrons always need energy 26
Fluid Animation At the beginning, push as many resources as
possible to the GPU During the animation, minimize the interaction between CPU-GPU 1 2 27
Immediate vs Retained draw the shape at (x, y) x
= x + 10 blit the buffer at (x, y) x = x + 10 For every animation tick... At the beginning... draw the shape onto a buffer Off main thread 28
Animation Mechanics Initialization Animation step “Hey, this is good stuff.
Cache it as texture #42.” “Apply [operation] to texture #42.” Animation loop 29
Element = Layer http://www.webkit.org/blog-files/leaves/ 30
Compositing: “Logical” 3-D Compositor Tweening Actual operation 31
By Force transform: translateZ(0) Not needed for CSS animation! .someid
{ animation-name: somekeyframeanimation; animation-duration: 7s; transform: translateZ(0); } Don’t do that 32
Tools & Examples 33
Debugging in Safari defaults write com.apple.Safari IncludeInternalDebugMenu 1 https://developer.apple.com/videos/wwdc/2012/?id=601 34
Compositing Indicator Composited layer Container layer No associated texture Overflow
Texture (number = upload) 35
Texture Upload No reupload Upload Opacity Position Size Filter Everything
else! “Hardware accelerated CSS” 36
Constant Upload = Bad http://codepen.io/ariya/full/xuwgy translate3d ??? 37
Transformation http://ariya.github.com/css/spinningcube/ http://dev.sencha.com/animator/demos/cogs/ 38
Fade In/Out http://dev.sencha.com/animator/demos/ions/ http://codepen.io/ariya/full/spzad 39
three.js Periodic Table http://mrdoob.github.com/three.js/examples/css3d_periodictable.html 40
Montage MovieShow http://montagejs.github.com/montage/samples/popcorn/ 41
Photon CSS Lighting http://photon.attasi.com 42
FPS View http://www.keithclark.co.uk/labs/css3-fps/ 43
Filter http://html.adobe.com/webstandards/csscustomfilters/cssfilterlab/ 44
Hacks & Tricks 45
Traffic Congestion The speed of the car vs the traffic
condition 46
Avoid Overcapacity .... .... Texture upload Think of the GPU
memory like a cache. 47
Prepare and Reuse Hide the poster (=layer) offscreen Viewport 48
Color Transition @keyframes box { 0% { transform: background-color: blue;
} 100% { transform: background-color: green; } } Need a new texture uploaded to the GPU for every in-between color 49
Color Transition Trick Blended with http://codepen.io/ariya/full/ofDIh 50
Timer Latency Depending on user reaction Animation end triggers the
JavaScript callback JavaScript code kicks the next animation Prepare both animation and hide the “wrong” one 51
More Stuff Jank Busters: http://www.youtube.com/watch?v=hAzhayTnhEI Continuous painting: http://updates.html5rocks.com/2013/02/Profiling-Long-Paint-Times-with- DevTools-Continuous-Painting-Mode Chrome
GPU rendering benchmark (Telemetry): http://www.chromium.org/developers/design-documents/rendering-benchmarks Skia debugger: http://wesleyhales.com/blog/2013/02/18/Adventures-With-the-Skia-Debugger/ 52
Final Words 53
http://www.trollquotes.org/619-super-spider-bat-troll-quote/ 54
Use CSS3 animation & transition Be advised of texture uploads
Never assume, always measure 55
There is No Silver Bullet Traditional graphics programming has been
always full of tricks. It will always be. 56
Thank You
[email protected]
@AriyaHidayat ariya.ofilabs.com Background artwork from http://kde-look.org/content/show.php/Sin+Flow?content=139751 CC
BY-NC-SA speakerdeck.com/ariya 57
More Decks by Ariya Hidayat
See All by Ariya Hidayat
RAG for Small LLM
ariya
0
270
Vector Search and LLM
ariya
0
250
Making a Bigger Impact with Open Source
ariya
0
140
Practical Testing of Firebase Projects
ariya
0
190
Practical CI/CD for React Native
ariya
0
200
Hijrah ke TypeScript
ariya
0
570
Unggul dan Berdikari dengan Open-source
ariya
0
360
Practical CI/CD for React Native
ariya
1
560
Integrasi Berkesinambungan untuk React Native
ariya
1
490
Other Decks in Programming
See All in Programming
Debian JP Projectのサーバー構成
uwabami
1
160
あなたの await、OS まで届いてる? strace で覗く JavaScript の非同期
hasutosasaki
1
2.4k
Secure Your Coding Agent Like It’s Malware (v1.5) 🇬🇧 @Code.talks 2026
richargh
0
200
Ruby から Emacs を操作したい
phigasui
0
370
TanStack Vue Query と Pinia Colada から学ぶ非同期状態の型設計
aoshi
0
700
ローカルLLMの基本と近況 2611 / Local LLM basics and recent situation 2611
kishida
3
640
AIが生成したコードは読むべきか?抽象化設計とコードの品質保証 / abstraction-design-and-quality
minodriven
17
9.5k
読みやすい!と評判(?)の発表の準備にかける私のこだわり
shoheimitani
0
120
自宅サーバはどこまで再現できるのか - Proxmox VE上のVM環境をIaCとバックアップで戻してみた
youto
0
440
Proxmox x Talos Linux x Terraform で実現するなんかいい感じの Kubernetes クラスタ / A Sleek Kubernetes Cluster Powered by Proxmox, Talos Linux, and Terraform
nnaka2992
0
300
Spec-driven Development with AI
simas
PRO
0
2.3k
AWS CDKを理解するために公式の定義を深掘って解説してみる / Understanding AWS CDK by Digging into Its Official Definition
akihisaikeda
3
320
Featured
See All Featured
Intergalactic Javascript Robots from Outer Space
tanoku
273
28k
Why Our Code Smells
bkeepers
PRO
340
58k
YesSQL, Process and Tooling at Scale
rocio
174
15k
個人開発の失敗を避けるイケてる考え方 / tips for indie hackers
panda_program
123
22k
Amusing Abliteration
ianozsvald
1
400
WCS-LA-2024
lcolladotor
0
1k
Sharpening the Axe: The Primacy of Toolmaking
bcantrill
46
3.1k
Designing Dashboards & Data Visualisations in Web Apps
destraynor
232
55k
Building a Scalable Design System with Sketch
lauravandoore
464
34k
Hiding What from Whom? A Critical Review of the History of Programming languages for Music
tomoyanonymous
3
1.5k
How To Speak Unicorn (iThemes Webinar)
marktimemedia
1
640
Fireside Chat
paigeccino
43
4.1k