Open VideoMark Data

情報処理学会 IOT 研究会 (通算第 46 回) の招待講演スライド:
https://www.iot.ipsj.or.jp/meeting/46-agenda/

Transcript

1. Open VideoMark Data
   Project and Open Data Introduction @ IOT46
   WebDINO Japan - Tomoya ASAI
   

   View Slide

2. about:me
   Tomoya ASAI - dynamis webdino.org
   CTO
   dynamis @ Community
   Twitter: @dynamitter
   facebook.com/dynamis
   speakerdeck.com/dynamis
   note: Firefox = Red Panda = Petit Panda = Lesser Panda
   2
   @
   

   View Slide

3. about: WebDINO Japan
   Web, Browser, Open
   ( : )
   (Chromium, Firefox )
   ( : Gecko )
   Web & Open
   Web IoT
   2017 : Mozilla Japan WebDINO Japan
   https://www.webdino.org/
   3
   

   View Slide

4. Topics
   Web VideoMark Project
   Open Data
   1st Analysis
   Next Steps
   4
   

   View Slide

5. Acknowledgment
   Web VideoMark WebDINO Japan
   貢
   (QoE )
   NTT
   貢
   GitHub 貢
   https://vm.webdino.org/notice
   5
   

   View Slide

6. Web VideoMark
   

   View Slide

7. Web VideoMark
   Paravi, TVer, YouTube
   IOT CQ
   Web VideoMark Project by WebDINO Japan http://vm.webdino.org/
   7
   

   View Slide

8. ಈըαʔϏεͷ
   ਪఆମײ඼࣭஋
   ར༻ऀͷ

   ϒϥ΢βʔ
   ֶज़ݚڀ༻σʔλ

   ΍ௐࠪ෼ੳ݁Ռ͸

   Φʔϓϯσʔλʹ
   ʲΫϥΠΞϯτ৘ใʳ
   w ୺຤छผ

   1$PSϞόΠϧ
   
   w ϒϥ΢βόʔδϣϯ
   w 04όʔδϣϯ౳
   ஫ࢯ໊ɾॅॴ౳ͷݸਓ
   ಛఆ৘ใ͸ؚ·ͳ͍

   6TFS"HFOU͔Βਪଌ
   ʲωοτϫʔΫ৘ใʳ
   w ௨৴ࣄۀࣾɾ*41
   w ஍Ҭ ౎ಓ෎ݝ
   ౳
   ஫ૹ৴ݩ*1ΞυϨεಗ
   ໊Խ ຤ඌΦΫςοτ
   ࡟আ
   ޙʹ(FP*1Ͱਪଌ
   ʲ࠶ੜ඼࣭ύϥϝʔλʳ
   w ಈը৘ใϏοτϨʔτɺ
   ղ૾౓ɺϑϨʔϜϨʔτ౳
   w ࠶ੜ৘ใ࠶ੜͷதஅɺ
   όοϑΝϦϯά౳
   w ૢ࡞৘ใಈըͷγʔΫɺ
   Ұ࣌ఀࢭɾ࠶։౳
   8FC7JEFP.BSL֦ுػೳ΍ϒϥ΢βʔͰࢹௌ৘ใΛऔಘ
   ಈը࠶ੜ࣌ͷ
   ମײ඼࣭஋Λ

   dͷ਺஋ͱͯ͠
   ϑΟʔυόοΫ
   2P&
   2VBMJUZPG&YQFSJFODF
   8FC
   7JEFP.BSL
   αʔόʔ
   ࢹௌ৘ใΛ෼ੳ
   ಈը഑৴αʔϏε΁ΞΫηε
   )5.-ɺಈըϑΝΠϧ౳Λड৴
   ௨৴ࣄۀऀɾ*41
   αʔϏεվળ༻ʹ
   ௐࠪσʔλΛఏڙ
   ʂ
   ಈըࢹௌ࣌ͷ
   2P&౳Λ֬ೝ
   ϓϥΠόγʔอޢॲཧ ֶज़ݚڀ༻σʔλ࡞੒
   ಗ໊Խॲཧ
   ಈը഑৴αʔϏεɾ
   $%/αʔόʔ
   

   View Slide

9. (58%) ( )
   (Chrome) (Web VideoMark) Android
   (VideoMark Browser)
   ( )
   9
   

   View Slide

10. IOT
    IOT
    https://www.webdino.org/updates/news/201902051051/
    10
    

    View Slide

11. Web VideoMark
    1. Web VideoMark
    PC Chrome Web VideoMark
    Android VideoMark Browser
    2. YouTube
    3.
    11
    

    View Slide

12. Web VideoMark
    Paravi, TVer, YouTube
    12
    PC (Chrome + ) Android ( )
    

    View Slide

13. Web VideoMark
    13
    QoE 

    ( )
    

    View Slide

14. API ( QoE )
    VM URL "stats"
    14
    

    View Slide

15. (QoE)
    (QoE)
    (QoE: Quality of Experience)
    (1 5)
    QoE
    QoE (ITU)
    Web VideoMark ITU
    (NTT
    )
    15
    

    View Slide

16. https://vm.webdino.org
    16
    

    View Slide

17. Open Data
    

    View Slide

18. https://vm.webdino.org/opendata
    IP URL
    Android UserAgent
    UA
    (a,b,c)
    https://vm.webdino.org/opendata
    18
    

    View Slide

19. IP
    URL
    User Agent
    UA Android
    ID
    ( )
    19
    

    View Slide

20. IP ( )
    , , ISP (GeoIP )
    URL
    CDN IP [**]
    URL [**]
    [*]
    [**]
    [**]
    ( )
    etc...
    Representation [**]
    Representation
    /
    etc...
    QoE ( )
    [*]
    (RTT) [**]
    [**]
    etc...
    [**]
    etc...
    CM [**]
    etc...
    [*] [**]
    20
    

    View Slide

21. SIM ID
    GDPR
    IP
    GPS
    User Agent
    URL
    21
    

    View Slide

22. ( )
    2019-04-07T06:38:58+00:00 {"date":"2019-04-07T06:38:58.253Z","startTime":
    297957833.29999995,"endTime":297962836.1000001,"session":"8b37d168-7343-45a1-a507-
    f8c230a0ebd4","location":"https://www.youtube.com","userAgent":"Mozilla/5.0 (Linux;
    Android 9; XXX) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.3538.124 Mobile
    Safari/537.36","appVersion":"5.0 (Linux; Android 9; XXX) AppleWebKit/537.36 (KHTML,
    like Gecko) Chrome/70.0.3538.124 Mobile Safari/537.36","sequence":58463,"video":
    [{"property":{"uuid":"fd65101f-a8df-47c6-a804-3ac719e04ca3","id":"","class":
    ["video-stream","html5-main-video"],"src":"blob:https://www.youtube.com/a1551960-
    f053-492e-b945-84b075c8598f","domainName":"r7---sn-5n5ip-
    ioqe.googlevideo.com","width":0,"height":0,"videoWidth":1280,"videoHeight":
    720,"mediaSize":82.384398,"defaultPlaybackRate":1,"playbackRate":1,"playStartTime":
    1554511611888.0,"playEndTime":1554511694180.0,"currentPlayPos":
    82.384398,"currentPlayTime":82.245},"playback_quality":[],"event_play":
    [],"event_play_delta":[],"event_pause":[],"event_pause_delta":[],"event_seeking":
    [],"event_seeking_delta":[],"event_seeked":[],"event_seeked_delta":
    [],"event_ended":[],"event_ended_delta":[],"event_stalled":
    [],"event_stalled_delta":[],"event_progress":[],"event_progress_delta":
    [],"event_waiting":[],"event_waiting_delta":[],"event_canplay":
    [],"event_canplay_delta":[]}],"resource_timing":
    [],"REMOTE_ADDR":"180.235.59.0","country":"JP","subdivision":"13","isp":"Asahi
    Net"}
    5 (1 1 )
    22
    

    View Slide

23. https://vm.webdino.org
    23
    

    View Slide

24. 1st Analysis
    

    View Slide

25. ( )
    QoE
    ABR
    ISP
    25
    

    View Slide

26. ( )
    3/1 4/3 (34 )
    11925
    5 ( )
    3
    1000 ISP
    ISP
    26
    

    View Slide

27. ( )
    (bps) ( )
    貢
    ( )
    27
    

    View Slide

28. ( )
    QoE
    QoE
    QoE
    28
    

    View Slide

29. B ( )
    C ( )
    ( )
    29
    A
    B
    C
    A
    B
    C
    

    View Slide

30. B ( )
    C ( ) QoE
    30
    A
    B
    C
    

    View Slide

31. ISP
    OCN ( ) Asahi Net ( )
    Asahi Net ( ) WiFi OCN ( )
    ( )
    31
    ISP X
    ISP Y
    ISP Z
    ISP X
    ISP Y
    ISP Z
    

    View Slide

32. ISP
    ARTERIA ( ), Asahi Net ( )
    PC vs Mobile QoE ( ) ISP
    ( )
    32
    ISP X
    ISP Y
    ISP Z
    

    View Slide

33. QoE ( , )
    QoE 30
    貢 1080p, 720p
    ABR
    33
    720p30
    480p30
    A
    

    View Slide

34. QoE
    A PC
    PC QoE 5 1080p30 ( ) PC
    QoE PC
    34
    A (PC) A (mobile)
    

    View Slide

35. QoE
    B, C QoE 4.5 720p
    ( )
    B QoE 4.6 QoE 5 1080p
    ( )
    35
    B C
    

    View Slide

36. ISP QoE
    OCN PC
    4K, 8K, 60fps
    ARTERIA 

    36
    OCN ARTERIA
    

    View Slide

37. ISP QoE
    ISP X QoE
    Asahi Net Android
    37
    Asahi Net
    ISP X
    

    View Slide

38. ISP QoE
    ISP Y QoE 1 , Z QoE
    38
    ISP Z
    ISP Y
    

    View Slide

39. ( , )
    2060p30, 1080p30, 720p30, 480p30
    ABR
    (ABR )
    39
    A
    

    View Slide

40. A PC
    PC 1080p30 FSP
    PC 1080p30
    40
    A (PC) A (mobile)
    

    View Slide

41. B, C B
    B 720p C
    41
    B C
    

    View Slide

42. ISP
    OCN PC
    貢
    42
    OCN ARTERIA
    

    View Slide

43. ISP
    OCN Android
    43
    Asahi Net
    ISP X
    

    View Slide

44. ISP
    ( )
    44
    ISP Z
    ISP Y
    

    View Slide

45. ( , )
    45
    A
    

    View Slide

46. A PC
    PC PC
    46
    A (PC) A (mobile)
    

    View Slide

47. B
    C
    47
    B C
    

    View Slide

48. ISP
    ISP
    ( )
    48
    OCN ARTERIA
    

    View Slide

49. ISP
    49
    Asahi Net
    ISP X
    

    View Slide

50. ISP
    ( )
    50
    ISP Z
    ISP Y
    

    View Slide

51. Web VideoMark
    ( )
    ABR QoE QoE
    ISP
    ISP
    51
    

    View Slide

52. Next Steps
    

    View Slide

53. ( )
    較
    API
    53
    

    View Slide

54. ( )
    較
    Chrome
    54
    

    View Slide

55. ( )
    QoE
    QoE
    RTT
    55
    

    View Slide

56. ( )
    Web VideoMark Speed Index ( )
    Net ix Speed Index
    Net ix MVNO
    Web
    QoE Web
    56
    

    View Slide

57. 6
    etc...
    57
    

    View Slide

58. https://vm.webdino.org
    58
    

    View Slide