Tweet
Tweet

Slide 1

Slide 1 text

Open VideoMark Data Project and Open Data Introduction @ IOT46 WebDINO Japan - Tomoya ASAI

Slide 2

Slide 2 text

about:me Tomoya ASAI - dynamis webdino.org CTO dynamis @ Community Twitter: @dynamitter facebook.com/dynamis speakerdeck.com/dynamis note: Firefox = Red Panda = Petit Panda = Lesser Panda 2 @

Slide 3

Slide 3 text

about: WebDINO Japan Web, Browser, Open ( : ) (Chromium, Firefox ) ( : Gecko ) Web & Open Web IoT 2017 : Mozilla Japan WebDINO Japan https://www.webdino.org/ 3

Slide 4

Slide 4 text

Topics Web VideoMark Project Open Data 1st Analysis Next Steps 4

Slide 5

Slide 5 text

Acknowledgment Web VideoMark WebDINO Japan 貢 (QoE ) NTT 貢 GitHub 貢 https://vm.webdino.org/notice 5

Slide 6

Slide 6 text

Web VideoMark

Slide 7

Slide 7 text

Web VideoMark Paravi, TVer, YouTube IOT CQ Web VideoMark Project by WebDINO Japan http://vm.webdino.org/ 7

Slide 8

Slide 8 text

ಈըαʔϏεͷ ਪఆମײ඼࣭஋ ར༻ऀͷ
 ϒϥ΢βʔ ֶज़ݚڀ༻σʔλ
 ΍ௐࠪ෼ੳ݁Ռ͸
 Φʔϓϯσʔλʹ ʲΫϥΠΞϯτ৘ใʳ w ୺຤छผ
 1$PSϞόΠϧ w ϒϥ΢βόʔδϣϯ w 04όʔδϣϯ౳ ஫ࢯ໊ɾॅॴ౳ͷݸਓ ಛఆ৘ใ͸ؚ·ͳ͍
 6TFS"HFOU͔Βਪଌ ʲωοτϫʔΫ৘ใʳ w ௨৴ࣄۀࣾɾ*41 w ஍Ҭ ౎ಓ෎ݝ ౳ ஫ૹ৴ݩ*1ΞυϨεಗ ໊Խ ຤ඌΦΫςοτ ࡟আ ޙʹ(FP*1Ͱਪଌ ʲ࠶ੜ඼࣭ύϥϝʔλʳ w ಈը৘ใϏοτϨʔτɺ ղ૾౓ɺϑϨʔϜϨʔτ౳ w ࠶ੜ৘ใ࠶ੜͷதஅɺ όοϑΝϦϯά౳ w ૢ࡞৘ใಈըͷγʔΫɺ Ұ࣌ఀࢭɾ࠶։౳ 8FC7JEFP.BSL֦ுػೳ΍ϒϥ΢βʔͰࢹௌ৘ใΛऔಘ ಈը࠶ੜ࣌ͷ ମײ඼࣭஋Λ
 dͷ਺஋ͱͯ͠ ϑΟʔυόοΫ 2P& 2VBMJUZPG&YQFSJFODF 8FC 7JEFP.BSL αʔόʔ ࢹௌ৘ใΛ෼ੳ ಈը഑৴αʔϏε΁ΞΫηε )5.-ɺಈըϑΝΠϧ౳Λड৴ ௨৴ࣄۀऀɾ*41 αʔϏεվળ༻ʹ ௐࠪσʔλΛఏڙ ʂ ಈըࢹௌ࣌ͷ 2P&౳Λ֬ೝ ϓϥΠόγʔอޢॲཧ ֶज़ݚڀ༻σʔλ࡞੒ ಗ໊Խॲཧ ಈը഑৴αʔϏεɾ $%/αʔόʔ

Slide 9

Slide 9 text

(58%) ( ) (Chrome) (Web VideoMark) Android (VideoMark Browser) ( ) 9

Slide 10

Slide 10 text

IOT IOT https://www.webdino.org/updates/news/201902051051/ 10

Slide 11

Slide 11 text

Web VideoMark 1. Web VideoMark PC Chrome Web VideoMark Android VideoMark Browser 2. YouTube 3. 11

Slide 12

Slide 12 text

Web VideoMark Paravi, TVer, YouTube 12 PC (Chrome + ) Android ( )

Slide 13

Slide 13 text

Web VideoMark 13 QoE 
 ( )

Slide 14

Slide 14 text

API ( QoE ) VM URL "stats" 14

Slide 15

Slide 15 text

(QoE) (QoE) (QoE: Quality of Experience) (1 5) QoE QoE (ITU) Web VideoMark ITU (NTT ) 15

Slide 16

Slide 16 text

https://vm.webdino.org 16

Slide 17

Slide 17 text

Open Data

Slide 18

Slide 18 text

https://vm.webdino.org/opendata IP URL Android UserAgent UA (a,b,c) https://vm.webdino.org/opendata 18

Slide 19

Slide 19 text

IP URL User Agent UA Android ID ( ) 19

Slide 20

Slide 20 text

IP ( ) , , ISP (GeoIP ) URL CDN IP [**] URL [**] [*] [**] [**] ( ) etc... Representation [**] Representation / etc... QoE ( ) [*] (RTT) [**] [**] etc... [**] etc... CM [**] etc... [*] [**] 20

Slide 21

Slide 21 text

SIM ID GDPR IP GPS User Agent URL 21

Slide 22

Slide 22 text

( ) 2019-04-07T06:38:58+00:00 {"date":"2019-04-07T06:38:58.253Z","startTime": 297957833.29999995,"endTime":297962836.1000001,"session":"8b37d168-7343-45a1-a507- f8c230a0ebd4","location":"https://www.youtube.com","userAgent":"Mozilla/5.0 (Linux; Android 9; XXX) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.3538.124 Mobile Safari/537.36","appVersion":"5.0 (Linux; Android 9; XXX) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.3538.124 Mobile Safari/537.36","sequence":58463,"video": [{"property":{"uuid":"fd65101f-a8df-47c6-a804-3ac719e04ca3","id":"","class": ["video-stream","html5-main-video"],"src":"blob:https://www.youtube.com/a1551960- f053-492e-b945-84b075c8598f","domainName":"r7---sn-5n5ip- ioqe.googlevideo.com","width":0,"height":0,"videoWidth":1280,"videoHeight": 720,"mediaSize":82.384398,"defaultPlaybackRate":1,"playbackRate":1,"playStartTime": 1554511611888.0,"playEndTime":1554511694180.0,"currentPlayPos": 82.384398,"currentPlayTime":82.245},"playback_quality":[],"event_play": [],"event_play_delta":[],"event_pause":[],"event_pause_delta":[],"event_seeking": [],"event_seeking_delta":[],"event_seeked":[],"event_seeked_delta": [],"event_ended":[],"event_ended_delta":[],"event_stalled": [],"event_stalled_delta":[],"event_progress":[],"event_progress_delta": [],"event_waiting":[],"event_waiting_delta":[],"event_canplay": [],"event_canplay_delta":[]}],"resource_timing": [],"REMOTE_ADDR":"180.235.59.0","country":"JP","subdivision":"13","isp":"Asahi Net"} 5 (1 1 ) 22

Slide 23

Slide 23 text

https://vm.webdino.org 23

Slide 24

Slide 24 text

1st Analysis

Slide 25

Slide 25 text

( ) QoE ABR ISP 25

Slide 26

Slide 26 text

( ) 3/1 4/3 (34 ) 11925 5 ( ) 3 1000 ISP ISP 26

Slide 27

Slide 27 text

( ) (bps) ( ) 貢 ( ) 27

Slide 28

Slide 28 text

( ) QoE QoE QoE 28

Slide 29

Slide 29 text

B ( ) C ( ) ( ) 29 A B C A B C

Slide 30

Slide 30 text

B ( ) C ( ) QoE 30 A B C

Slide 31

Slide 31 text

ISP OCN ( ) Asahi Net ( ) Asahi Net ( ) WiFi OCN ( ) ( ) 31 ISP X ISP Y ISP Z ISP X ISP Y ISP Z

Slide 32

Slide 32 text

ISP ARTERIA ( ), Asahi Net ( ) PC vs Mobile QoE ( ) ISP ( ) 32 ISP X ISP Y ISP Z

Slide 33

Slide 33 text

QoE ( , ) QoE 30 貢 1080p, 720p ABR 33 720p30 480p30 A

Slide 34

Slide 34 text

QoE A PC PC QoE 5 1080p30 ( ) PC QoE PC 34 A (PC) A (mobile)

Slide 35

Slide 35 text

QoE B, C QoE 4.5 720p ( ) B QoE 4.6 QoE 5 1080p ( ) 35 B C

Slide 36

Slide 36 text

ISP QoE OCN PC 4K, 8K, 60fps ARTERIA 
 36 OCN ARTERIA

Slide 37

Slide 37 text

ISP QoE ISP X QoE Asahi Net Android 37 Asahi Net ISP X

Slide 38

Slide 38 text

ISP QoE ISP Y QoE 1 , Z QoE 38 ISP Z ISP Y

Slide 39

Slide 39 text

( , ) 2060p30, 1080p30, 720p30, 480p30 ABR (ABR ) 39 A

Slide 40

Slide 40 text

A PC PC 1080p30 FSP PC 1080p30 40 A (PC) A (mobile)

Slide 41

Slide 41 text

B, C B B 720p C 41 B C

Slide 42

Slide 42 text

ISP OCN PC 貢 42 OCN ARTERIA

Slide 43

Slide 43 text

ISP OCN Android 43 Asahi Net ISP X

Slide 44

Slide 44 text

ISP ( ) 44 ISP Z ISP Y

Slide 45

Slide 45 text

( , ) 45 A

Slide 46

Slide 46 text

A PC PC PC 46 A (PC) A (mobile)

Slide 47

Slide 47 text

B C 47 B C

Slide 48

Slide 48 text

ISP ISP ( ) 48 OCN ARTERIA

Slide 49

Slide 49 text

ISP 49 Asahi Net ISP X

Slide 50

Slide 50 text

ISP ( ) 50 ISP Z ISP Y

Slide 51

Slide 51 text

Web VideoMark ( ) ABR QoE QoE ISP ISP 51

Slide 52

Slide 52 text

Next Steps

Slide 53

Slide 53 text

( ) 較 API 53

Slide 54

Slide 54 text

( ) 較 Chrome 54

Slide 55

Slide 55 text

( ) QoE QoE RTT 55

Slide 56

Slide 56 text

( ) Web VideoMark Speed Index ( ) Net ix Speed Index Net ix MVNO Web QoE Web 56

Slide 57

Slide 57 text

6 etc... 57

Slide 58

Slide 58 text

https://vm.webdino.org 58