IIJ II seminar 201912 で使用したスライド https://iijlab-seminars.connpass.com/event/157675/
Collecting and analyzing video streamingservices' quality data with Web Browser@ IIJLab seminar on 20191210WebDINO Japan - Tomoya ASAI
View Slide
about:speakerTomoya ASAI - dynamis webdino.orgCTOdynamis @ CommunityTwitter: @dynamitterfacebook.com/dynamisspeakerdeck.com/dynamisnote: red panda (fire fox, lesser panda)2@
about: WebDINO JapanWeb, Browser, Open( : )(Chromium, Firefox )( : Gecko )Web & OpenWeb IoT: 2017 Mozilla Japan WebDINO Japanhttps://www.webdino.org/3
TopicsWeb VideoMark ProjectMeasurement and Open DataEarly Data AnalysisNext Steps4
AcknowledgmentWeb VideoMark WebDINO Japan貢(QoE )NTT貢GitHub 貢https://vm.webdino.org/notice5
Web VideoMark Project
Web VideoMarkParavi, TVer, YouTubeCQ IOThttps://vm.webdino.org/opendataWeb VideoMark Project by WebDINO Japan http://vm.webdino.org/7
(58%, sandvine ) ( )(Chrome) (Web VideoMark) Android(VideoMark Browser)( )8
Web VideoMark - EndorsementIOTIIJhttps://www.webdino.org/updates/news/201902051051/9
ಈըαʔϏεͷਪఆମײ࣭ར༻ऀͷ ϒϥβʔֶज़ݚڀ༻σʔλ ௐࠪੳ݁Ռ ΦʔϓϯσʔλʹʲΫϥΠΞϯτใʳw छผ 1$PSϞόΠϧw ϒϥβόʔδϣϯw 04όʔδϣϯࢯ໊ɾॅॴͷݸਓಛఆใؚ·ͳ͍ 6TFS"HFOU͔ΒͷਪଌʲωοτϫʔΫใʳw ௨৴ࣄۀࣾɾ*41w Ҭ ಓݝૹ৴ݩ*1ΞυϨεಗ໊Խ ඌΦΫςοτআޙʹ(FP*1Ͱਪଌʲ࠶ੜ࣭ཁҼʳw ಈըใϏοτϨʔτɺղ૾ɺϑϨʔϜϨʔτw ࠶ੜใ࠶ੜͷதஅɺόοϑΝϦϯάw ૢ࡞ใಈըͷγʔΫɺҰ࣌ఀࢭɾ࠶։8FC7JEFP.BSL֦ுػೳϒϥβʔͰࢹௌใΛऔಘಈը࠶ੜ࣌ͷମײ࣭Λ dͷͰ ਪఆͯ͠ฦ͢2P&2VBMJUZPG&YQFSJFODF8FC7JEFP.BSLαʔόʔࢹௌใΛੳಈը৴αʔϏεΞΫηε)5.-ɺಈըϑΝΠϧΛड৴௨৴ࣄۀऀɾ*41αʔϏεվળ༻ʹௐࠪσʔλΛఏڙʂಈըࢹௌ࣌ͷ2P&Λ֬ೝϓϥΠόγʔอޢॲཧ ֶज़ݚڀ༻σʔλ࡞ಗ໊Խॲཧಈը৴αʔϏεɾ$%/αʔόʔWeb VideoMark
note: (QoE)(QoE: Quality of Experience)24( )(1 5, MOS)QoE (ITU)ITU-T P SG12Web VideoMark ITU-T NTT11
Web VideoMark ( )12GCPInternetsodium.jsnginx/ uent-d sodium.js PC Chrome + (Android) endpointlog fileSodiumServerAggregateServerQoE QoE GeoIP (IP )QoE ServerQoE mongoDB QoE QoE
Web VideoMark ( )13GCPInternetsodium.jsnginx/ uent-d sodium.js PC Chrome + (Android) endpointlog fileSodiumServerAggregateServerQoE QoE GeoIP (IP )QoE ServerQoE mongoDBmongoDB QoE QoE
Web VideoMark( ) ( ): 2019 12 1014
Web VideoMark0. "videomark" ( )PC Chrome Web VideoMark Android VideoMark Browser1. VideoMark Chrome /2. YouTube3.15
( )( )( ) QoE15 QoE⭐ ( 1.0 ⭐ 5.0 ⭐⭐⭐⭐⭐)16
17
( MacBook )Paravi, TVer QoE (3.2) YouTube 3YouTube QoE 4,9, 3.5-3.6, 3.2 , Paravi TVer QoE 4.5:18
Web VideoMarkQoS QoE19
QoEISP, APN DLCMYouTube( )20
: API ( QoE)PC VM URL "stats"21
( )PC/Android Web VideoMarkhttps://vm.webdino.org/( )(Jetson Nano)LAN OK: https://vm.webdino.org/contact22
https://vm.webdino.org23
Measurement & Open Data
https://vm.webdino.org/opendataIP URLAndroid UserAgentUA(a,b,c)https://vm.webdino.org/opendata25
IPURLUser AgentUser Agent AndroidID ( 1 )26
IP ( ), , ISP (GeoIP )APN, PLMN (Android )URLCDN IP [*]URL [*][*]( )etc...Representation [**]CodecRepresentation/etc...QoE ( )(RTT) [*][*]etc...[*]etc...CM [*]etc...[*] [**]27
SIM IDGDPRIPGPSUser AgentURL28
( )2019-04-07T06:38:58+00:00 {"date":"2019-04-07T06:38:58.253Z","startTime":297957833.29999995,"endTime":297962836.1000001,"session":"8b37d168-7343-45a1-a507-f8c230a0ebd4","location":"https://www.youtube.com","userAgent":"Mozilla/5.0 (Linux;Android 9; XXX) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.3538.124 MobileSafari/537.36","appVersion":"5.0 (Linux; Android 9; XXX) AppleWebKit/537.36 (KHTML,like Gecko) Chrome/70.0.3538.124 Mobile Safari/537.36","sequence":58463,"video":[{"property":{"uuid":"fd65101f-a8df-47c6-a804-3ac719e04ca3","id":"","class":["video-stream","html5-main-video"],"src":"blob:https://www.youtube.com/a1551960-f053-492e-b945-84b075c8598f","domainName":"r7---sn-5n5ip-ioqe.googlevideo.com","width":0,"height":0,"videoWidth":1280,"videoHeight":720,"mediaSize":82.384398,"defaultPlaybackRate":1,"playbackRate":1,"playStartTime":1554511611888.0,"playEndTime":1554511694180.0,"currentPlayPos":82.384398,"currentPlayTime":82.245},"playback_quality":[],"event_play":[],"event_play_delta":[],"event_pause":[],"event_pause_delta":[],"event_seeking":[],"event_seeking_delta":[],"event_seeked":[],"event_seeked_delta":[],"event_ended":[],"event_ended_delta":[],"event_stalled":[],"event_stalled_delta":[],"event_progress":[],"event_progress_delta":[],"event_waiting":[],"event_waiting_delta":[],"event_canplay":[],"event_canplay_delta":[]}],"resource_timing":[],"REMOTE_ADDR":"180.235.59.0","country":"JP","subdivision":"13","isp":"AsahiNet"}529
( , mongo DB )session:session id: uuidvideo id: uuidservice: youtubeuser agent: XXXXXXXqoe: 4.2connection:- type: cellulareffectiveType: 4gdownlink: 1.55downlinkMax: 100rtt: 150apn: NTT DOCOMOplmn: NTT DOCOMOnetwork: # IPͱGeoIPใ- server host:xxx.yyy.comserver ip: x.y.z.0client ip: x.y.z.0location: tokyoisp: ocnvideo:video id: xxxxxxduration: 160.3representations:- resolution:height: 1080width: 1920video codec: webmaudio codec: opusvideo bitrate: 12345audio bitrate: 123play history:start time: 1234567890end time: 1234567890throughput history:# DL࣌ࠁͱɾRTT- dl time: 1234567890throughput: 123456rtt: 1234event history:- event type: seektime: 12.3representationhistory:# ৄࡉׂѪframe drop history:# ৄࡉׂѪbuffer history:# ৄࡉׂѪcm history:- duration: 12:3start time: 1234567890end time: 1234567890yml30
https://vm.webdino.org31
Initial Data Analysis
3/1 4/30 (2 )2364510 12K1000 ISPISP:33
QoEISP QoE34
( )PC/MobileISP35
( )53 9( - ) / 1.01.0 CM37
( )X 0.93-1.0 CM (CM )Y, Z 1.0 ( )Y 0-0.03 CM38YX ZY
1.0( - ) /CM 1.0Y CM 1.0-1.15Z CM 1.0-1.15Y, Z 1.539X ZY
PCPC 0.0CM40PC Mobile
QoE( ) (QoE) ( )CM41
/20 ( 130 )5, 10 5 55,10,15... 5,10,15... ( )15 /42
QoE
( )(bps) ( )( )44
( )QoEQoEQoE45
B ( )C ( ) ( )46ABCABC
B ( )C ( ) QoE47ABC
ISPOCN ( ) Asahi Net ( )Asahi Net ( ) WiFi OCN ( )( )48ISP XISP YISP ZISP XISP YISP Z
ISPARTERIA ( ), Asahi Net ( )PC vs Mobile QoE ( ) ISP( )49ISP XISP YISP Z
QoE ( , )QoE 1.0 5.0 30貢 1080p, 720pABR50A720p30 1.5~2Mbsp480p30 1M1080p 2~3Mbps1080p 5Mbps
QoEA PCPC QoE 5 1080p30 ( )PC 3.5 QoE PC51A (PC) A (mobile)
QoEB, C QoE 4.6-4.73 720p( )B QoE 4.73 1080p( )52B C
ISP QoEOCN PC4K, 8K, 60fpsARTERIA 53OCN ARTERIA
ISP QoEISP X QoEAsahi Net Android54Asahi NetISP X
ISP QoEISP Y QoE 1 , Z QoE55ISP ZISP Y
( , )2060p30, 1080p30, 720p30, 480p30ABR(ABR )57A
A PCPC 1080p30 FSPPC 1080p3058A (PC) A (mobile)
B, C BB 720p 2Mbps C 1080p 5Mbps59B C
ISPOCN PC60OCN ARTERIA
ISPAsahi Net Android61Asahi NetISP X
ISP( )62ISP ZISP Y
( , )64A
A PCPC PC65A (PC) A (mobile)
BC66B C
ISPISP( )67OCN ARTERIA
ISP68Asahi NetISP X
ISP69ISP ZISP Y
QoE()QoEQoE( )70
ISP ( )PC/Android: OSS71
OSSYouTube()72
QoEQoEQoEQoE: 1080p, 30fps, audio 128kbps ( ) video 3380kbps: 4.813 => 5000kbps: 4.882QoE ():QoE73 ...
Web VideoMark( )CM (CM CM )ISPQoEISP74
Next Steps
: APN PLMN etc. : RTT etc.CM: CM etc.CMQoE CM ()76
3 10YouTube +QoE77
( )Chrome78
mongo DB( )79
etc...: https://vm.webdino.org/contact80
( )( )PC/Android Web VideoMarkhttps://vm.webdino.org/( )(Jetson Nano)LAN OK: https://vm.webdino.org/contact81
https://vm.webdino.org82
vol.119 IEICE(IEICE )© 2019 IEICE , vol.119, no. 298, CQ-2019-92, Nov. 2019()®83
dynamis
hpprc
ykiyota
kitachan_black
tomoshige_n
cybozuinsideout
maosaeki
koheishinden
chokkan
shuntaros
enkatsu
ariaki
tatsui
pedronauck
sonatard
aki_iinuma
addyosmani
bcantrill
reverentgeek
philnash
mraible
cromwellryan
denniskardys
andyhume
samanthasiow