Next Mobile WebApplication

Transcript

1. Next Mobile WebApplication uupaa 2013-­11-­30

2. Me @uupaa - 2012 join R&D App

3. 2013-11-30 HTML5 Conference 2013 Web 8

4. WebApp ? WebApp WebApp, Browser Game, SinglePageApplication, ES6, Storage, Cache,

   Audio, Canvas, WebWorker

5. NativeApp vs WebApp NativeApp WebApp ? 3D

6. WebApp

7. Single Page Application (SPA) SPA ? 1 WebApp

8. SPA (BGM) WebApp 800ms -> 200ms

9. SPA

10. Audio/WebAudio Audio <audio> BGM BGM SE Android <audio>

11. WebAudio WebAudio m4a(AAC) WebAudio <audio> SoundSprite

12. WebAudio ( ) (input) ( ) ( ) (JavaScript )

13. +-------+ +-------+ +-------+ +-------+ +-------+ | SE[0] | | SE[1]

    | | SE[n] | | BGM-A | | BGM-B | BufferSource <<AudioBuffer>> +---+---+ +---+---+ +---+---+ +---+---+ +---+---+ | | | | | | | | +----+---+ +---+----+ | | | | FADE-A | | FADE-B | BGM CrossFade <<Gain>> | | | +----+---+ +---+----+ +---------+---------+ +----+----+ | | +----+---+ +--+---+ | EFFECT | | LOOP | Effect/Loop Volume <<Gain>> +----+---+ +--+---+ +-------------+------------+ +---+---+ | MUTE | Mute <<Gain>> +---+---+ +------+------+ | Compressor | <<DynamicsCompressor>> +------+------+ +------+------+ | Distination | AudioContext.Distination +-------------+

14. var ctx = new global.AudioContext(); var node = { compressor:

    null, fade: [null,null], // CrossFade volume master: null, // master volume effect: null, // effect volume loop: null, // loop volume mute: null // mute }; node.compressor = ctx.createDynamicsCompressor(); node.mute = ctx.createGainNode(); node.master = ctx.createGainNode(); node.effect = ctx.createGainNode(); node.loop = ctx.createGainNode(); node.fade[0] = ctx.createGainNode(); node.fade[1] = ctx.createGainNode(); node.fade[0].connect(node.loop); node.fade[1].connect(node.loop); node.effect.connect(node.master); node.loop.connect(node.master); node.master.connect(node.mute); node.mute.connect(node.compressor); node.compressor.connect(ctx.destination);

15. ( MIDI)

16. WebAudio Web SE BGM OFF ON/OFF Android DualCore, 1GB RAM

    iOS iOS 7, iPhone 4S (iOS 6 ) Chrome for Android 31 http://hello.uupaa.net/issues/2/ HE-AAC

17. ( )

18. Canvas 65 70% 200dpi (in Google Play) $179 (Moto G)

    326dpi

19. Canvas CanvasRenderingContext2D#toDataURL 96dpi (ImageData) High Definition toDataURLHD toBlobHD createImageDataHD getImageDataHD

    putImageDataHD

20. 2013 ImageData Width x Height Canvas ImageData Device 480 x

    320 600 KB iPhone (2007) 960 x 640 2.3 MB iPhone Retina (2010) 2048 x 1536 12 MB iPad Retina (2012) ImageData Pixel x 4byte(RGBA)

21. 2015 ImageData 2015 4K Width x Height Canvas ImageData Device

    960 x 640 2.3 MB iPhone Retina (2010) 2048 x 1536 12 MB iPad Retina (2012) 2560 x 1440 14 MB 2K Android (maybe 2014) 3840 x 2160 31.6 MB 4K Android (maybe 2015)

22. ImageData ImageData MB 16ms … for

23. ? WebWorker

24. WebWorker Canvas ? ? Canvas canvas.transferControlToProxy canvasProxy.setContext context.commit

25. CanvasProxy (1 ) <canvas></canvas> // index.js var canvas = document.querySelector("canvas");

    var canvasProxy = canvas.transferControlToProxy(); // CanvasProxy を取得 var canvasWorker = new Worker("BackgroundCanvasRender.js"); canvasWorker.postMessage(canvasProxy, [canvasProxy]); // Worker に渡す // BackgroundCanvasRender.js onmessage = function(event) { var context = new CanvasRenderingContext2D(); var canvasProxy = event.data; canvasProxy.setContext(context); // bind setInterval(function() { context.clearRect(0, 0, context.width, context.height); context.fillText(new Date() + "", 0, 100); context.commit(); // render }, 1000); };

26. ? 100 150MB GC window.gc() <img> <video> <svg> Worker Canvas

    drawImage …

27. High Definition CanvasProxy + WebWorker

28. Command Pattern ( )

29. Canvas API // before ctx.fillStyle = "#fff"; ctx.fillRect(0, 0, 100,

    100); // after var canvasCommands = [ ["fillStyle", "#fff"], ["fillRect", 0, 0, 100, 100] ]; for (var i = 0, iz = canvasCommands.length; i < iz; ++i) { switch (canvasCommands[i]) { case "fillStyle": ... break; case "fillRect": ... break; } });

30. : Android ( ) , ,

31. ( ) Android Browser, Chrome for Android ( )

32. DrawCall ( ) Canvas API DrawCall DrawCall // before function

    drawCall1() { ctx.fillRect(...); } function drawCall2() { ctx.fillRect(...); } drawCall1(); heavyRoutine(); drawCall2(); Chrome Canvas profiler DrawCall CanvasAPI

33. + SnapShot, Movie

34. + Remote Play DOM, CSS, Audio, Canvas App

35. + WebWorker WebWorker postMessage // index.js var worker = new

    Worker("Worker.js"); var request = []; worker.onmessage = function(event) { var response = event.data.response; : }; worker.postMessage({ request: request }); // Worker.js onmessage = function(event) { var request = event.data.request; postMessage({ response: ["ok"], error: null }); };

36. ( )

37. WebWorker

38. WebApp WebWorker ? , , , ,

39. WebWorker JavaScript ?

40. WebWorker ( )

41. importScripts navigator.userAgent, onLine JSON, BLOB, FileReader, FileReaderSync Timer - setTimeout(),

    setInterval() encodeURIComponent/decodeURIComponent TypedArray MessageChannel WebSQL, WebSQLSync WebSocket, XMLHttpRequest

42. navigator.webkitPersistentStorage navigator.webkitTemporaryStorage HighPerformanceTimer - performance.now() TextEncoder/TextDecoder Crypto, Base64(atob, btoa) ImageBitmap

    IndexedDB WorkerConsole - console.log() RequestFileSystem, RequestFileSystemSync ES6( Symbol, Set, Map, WeakMap, WeakSet, Promise )

43. postMessage ? Nexus 7(2012) Chrome 0.6ms, Mac Chrome 0.02ms var

    worker = new Worker("worker.js"); var score = 0; worker.onmessage = function(event) { worker.postMessage(++score); }; setTimeout(function() { worker.postMessage("stop"); }, 10 * 1000); // worker.js var payload = []; var timerID = setInterval(function() { postMessage(payload); }, 1); onmessage = function(event) { event.data === "stop" && clearInterval(timerID); };

44. postMessage Structured Cloning var payload = new Array(big number); postMessage(payload);

    1MB (payload) 32MB payload 25% var MB = 1024 * 1024; var payload = new Uint8ClampedArray( 1 * MB); // 無負荷時の 98% の速度で動作 var payload = new Uint8ClampedArray( 8 * MB); // 無負荷時の 90% の速度で動作 var payload = new Uint8ClampedArray(32 * MB); // 無負荷時の 25% の速度で動作 Structured Cloning

45. Transferable Objects postMessage (zero-copy) Transferable Objects var payload = new

    Array(big number); postMessage(payload, [payload]); Transferable Objects

46. WebWorker importScript JavaScript Prototype WebWorker

47. + Module Node.js, Browser, WebWorker (function(global) { // --- define

    ---------------------------------------------- // --- variable -------------------------------------------- // --- interface ------------------------------------------- function Class() { } // --- implement ------------------------------------------- // --- export ---------------------------------------------- if (global.process) { module.exports = Class; } global.Class = Class; })(this.self || global); : Typical JavaScript Module Pattern

48. WebWorker ? iframe

49. WebWorker

50. Storage, Cache, Offline Storage LocalStorage 5MB … WebSQL 50MB ApplicationCache

51. LocalStorage + WebSQL Base64 DataURI <img>

52. Asset Manifest 304 Not Modified HTTP 1 (SPDY ) 5MB

    + 5MB

53. Asset Manifes Sample ID URL MimeType Hash (MD5, SHA1 )

    , { "HelloAssetManifest": { "url": "asset/scene/Hello.js", "hash": "fd2b04", "mime": "scene/class", "size": 1425, "prime": 1 } }

54. Storage Indexed DB + Disk Quota Management API 10% ServiceWorker

    URL …

55. … デモ 1 30MB (140kB jpg x 210 ) Base64

    1 40 50MB 13 (600 800MB)

56. SinglePageApplication WebSQL LocalStorage Asset Manifest iframe Base64 Doubler 1 (Bulk

    Download)

57. Doubler Base64 ASCII SQLite(LocalStorage WebSQL ) UTF16 Doubler NULL, BOM,

    UTF16 Base64 200 250%

58. Doubler Code Point // Doubler.js: UTF16 Safe packer // Mobile

    Browser unavailable UTF16 words: // Safari: NULL, BOM // Chrome: NULL, BOM, SurrogatePairs // Android: NULL // // Desktop Browser unavailable UTF16 words: // Safari: NULL, BOM // Chrome: NULL, BOM, SurrogatePairs // // +- UINT16 -+- Doubler.pack() -+- unpack -+ // | 0x0000 | 0x0020, 0x8000 | -0x8000 | encode NULL // +----------+------------------+----------+ // | 0x0020 | 0x0020, 0x8020 | -0x8000 | encode 0x20 // +----------+------------------+----------+ // | 0xd800 | 0x0020, 0x5800 | +0x8000 | encode SurrogatePairs // | : | : | | // | 0xdfff | 0x0020, 0x5fff | | // +----------+------------------+----------+ // | 0xfffe | 0x0020, 0x7ffe | +0x8000 | encode BOM // | 0xffff | 0x0020, 0x7fff | | // +-- Tail --+- Doubler.pack() -+----------+ // | 0x00 | 0x0020, 0x9000 | -0x9000 | encode Tail byte // | : | : | | // | 0xff | 0x0020, 0x90ff | | // +----------+------------------+----------+

59. Bulk Download GIF AssetSprite 1 ? (SPDY )

60. </thank-you>