$30 off During Our Annual Pro Sale. View Details »

Open VideoMark Data

dynamis
June 14, 2019

Open VideoMark Data

情報処理学会 IOT 研究会 (通算第 46 回) の招待講演スライド:
https://www.iot.ipsj.or.jp/meeting/46-agenda/

dynamis

June 14, 2019
Tweet

More Decks by dynamis

Other Decks in Technology

Transcript

  1. Open VideoMark Data
    Project and Open Data Introduction @ IOT46
    WebDINO Japan - Tomoya ASAI

    View Slide

  2. about:me
    Tomoya ASAI - dynamis webdino.org
    CTO
    dynamis @ Community
    Twitter: @dynamitter
    facebook.com/dynamis
    speakerdeck.com/dynamis
    note: Firefox = Red Panda = Petit Panda = Lesser Panda
    2
    @

    View Slide

  3. about: WebDINO Japan
    Web, Browser, Open
    ( : )
    (Chromium, Firefox )
    ( : Gecko )
    Web & Open
    Web IoT
    2017 : Mozilla Japan WebDINO Japan
    https://www.webdino.org/
    3

    View Slide

  4. Topics
    Web VideoMark Project
    Open Data
    1st Analysis
    Next Steps
    4

    View Slide

  5. Acknowledgment
    Web VideoMark WebDINO Japan

    (QoE )
    NTT

    GitHub 貢
    https://vm.webdino.org/notice
    5

    View Slide

  6. Web VideoMark

    View Slide

  7. Web VideoMark
    Paravi, TVer, YouTube
    IOT CQ
    Web VideoMark Project by WebDINO Japan http://vm.webdino.org/
    7

    View Slide

  8. ಈըαʔϏεͷ
    ਪఆମײ඼࣭஋
    ར༻ऀͷ

    ϒϥ΢βʔ
    ֶज़ݚڀ༻σʔλ

    ΍ௐࠪ෼ੳ݁Ռ͸

    Φʔϓϯσʔλʹ
    ʲΫϥΠΞϯτ৘ใʳ
    w ୺຤छผ

    1$PSϞόΠϧ

    w ϒϥ΢βόʔδϣϯ
    w 04όʔδϣϯ౳
    ஫ࢯ໊ɾॅॴ౳ͷݸਓ
    ಛఆ৘ใ͸ؚ·ͳ͍

    6TFS"HFOU͔Βਪଌ
    ʲωοτϫʔΫ৘ใʳ
    w ௨৴ࣄۀࣾɾ*41
    w ஍Ҭ ౎ಓ෎ݝ

    ஫ૹ৴ݩ*1ΞυϨεಗ
    ໊Խ ຤ඌΦΫςοτ
    ࡟আ
    ޙʹ(FP*1Ͱਪଌ
    ʲ࠶ੜ඼࣭ύϥϝʔλʳ
    w ಈը৘ใϏοτϨʔτɺ
    ղ૾౓ɺϑϨʔϜϨʔτ౳
    w ࠶ੜ৘ใ࠶ੜͷதஅɺ
    όοϑΝϦϯά౳
    w ૢ࡞৘ใಈըͷγʔΫɺ
    Ұ࣌ఀࢭɾ࠶։౳
    8FC7JEFP.BSL֦ுػೳ΍ϒϥ΢βʔͰࢹௌ৘ใΛऔಘ
    ಈը࠶ੜ࣌ͷ
    ମײ඼࣭஋Λ

    dͷ਺஋ͱͯ͠
    ϑΟʔυόοΫ
    2P&
    2VBMJUZPG&YQFSJFODF
    8FC
    7JEFP.BSL
    αʔόʔ
    ࢹௌ৘ใΛ෼ੳ
    ಈը഑৴αʔϏε΁ΞΫηε
    )5.-ɺಈըϑΝΠϧ౳Λड৴
    ௨৴ࣄۀऀɾ*41
    αʔϏεվળ༻ʹ
    ௐࠪσʔλΛఏڙ
    ʂ
    ಈըࢹௌ࣌ͷ
    2P&౳Λ֬ೝ
    ϓϥΠόγʔอޢॲཧ ֶज़ݚڀ༻σʔλ࡞੒
    ಗ໊Խॲཧ
    ಈը഑৴αʔϏεɾ
    $%/αʔόʔ

    View Slide

  9. (58%) ( )
    (Chrome) (Web VideoMark) Android
    (VideoMark Browser)
    ( )
    9

    View Slide

  10. IOT
    IOT
    https://www.webdino.org/updates/news/201902051051/
    10

    View Slide

  11. Web VideoMark
    1. Web VideoMark
    PC Chrome Web VideoMark
    Android VideoMark Browser
    2. YouTube
    3.
    11

    View Slide

  12. Web VideoMark
    Paravi, TVer, YouTube
    12
    PC (Chrome + ) Android ( )

    View Slide

  13. Web VideoMark
    13
    QoE 

    ( )

    View Slide

  14. API ( QoE )
    VM URL "stats"
    14

    View Slide

  15. (QoE)
    (QoE)
    (QoE: Quality of Experience)
    (1 5)
    QoE
    QoE (ITU)
    Web VideoMark ITU
    (NTT
    )
    15

    View Slide

  16. https://vm.webdino.org
    16

    View Slide

  17. Open Data

    View Slide

  18. https://vm.webdino.org/opendata
    IP URL
    Android UserAgent
    UA
    (a,b,c)
    https://vm.webdino.org/opendata
    18

    View Slide

  19. IP
    URL
    User Agent
    UA Android
    ID
    ( )
    19

    View Slide

  20. IP ( )
    , , ISP (GeoIP )
    URL
    CDN IP [**]
    URL [**]
    [*]
    [**]
    [**]
    ( )
    etc...
    Representation [**]
    Representation
    /
    etc...
    QoE ( )
    [*]
    (RTT) [**]
    [**]
    etc...
    [**]
    etc...
    CM [**]
    etc...
    [*] [**]
    20

    View Slide

  21. SIM ID
    GDPR
    IP
    GPS
    User Agent
    URL
    21

    View Slide

  22. ( )
    2019-04-07T06:38:58+00:00 {"date":"2019-04-07T06:38:58.253Z","startTime":
    297957833.29999995,"endTime":297962836.1000001,"session":"8b37d168-7343-45a1-a507-
    f8c230a0ebd4","location":"https://www.youtube.com","userAgent":"Mozilla/5.0 (Linux;
    Android 9; XXX) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.3538.124 Mobile
    Safari/537.36","appVersion":"5.0 (Linux; Android 9; XXX) AppleWebKit/537.36 (KHTML,
    like Gecko) Chrome/70.0.3538.124 Mobile Safari/537.36","sequence":58463,"video":
    [{"property":{"uuid":"fd65101f-a8df-47c6-a804-3ac719e04ca3","id":"","class":
    ["video-stream","html5-main-video"],"src":"blob:https://www.youtube.com/a1551960-
    f053-492e-b945-84b075c8598f","domainName":"r7---sn-5n5ip-
    ioqe.googlevideo.com","width":0,"height":0,"videoWidth":1280,"videoHeight":
    720,"mediaSize":82.384398,"defaultPlaybackRate":1,"playbackRate":1,"playStartTime":
    1554511611888.0,"playEndTime":1554511694180.0,"currentPlayPos":
    82.384398,"currentPlayTime":82.245},"playback_quality":[],"event_play":
    [],"event_play_delta":[],"event_pause":[],"event_pause_delta":[],"event_seeking":
    [],"event_seeking_delta":[],"event_seeked":[],"event_seeked_delta":
    [],"event_ended":[],"event_ended_delta":[],"event_stalled":
    [],"event_stalled_delta":[],"event_progress":[],"event_progress_delta":
    [],"event_waiting":[],"event_waiting_delta":[],"event_canplay":
    [],"event_canplay_delta":[]}],"resource_timing":
    [],"REMOTE_ADDR":"180.235.59.0","country":"JP","subdivision":"13","isp":"Asahi
    Net"}
    5 (1 1 )
    22

    View Slide

  23. https://vm.webdino.org
    23

    View Slide

  24. 1st Analysis

    View Slide

  25. ( )
    QoE
    ABR
    ISP
    25

    View Slide

  26. ( )
    3/1 4/3 (34 )
    11925
    5 ( )
    3
    1000 ISP
    ISP
    26

    View Slide

  27. ( )
    (bps) ( )

    ( )
    27

    View Slide

  28. ( )
    QoE
    QoE
    QoE
    28

    View Slide

  29. B ( )
    C ( )
    ( )
    29
    A
    B
    C
    A
    B
    C

    View Slide

  30. B ( )
    C ( ) QoE
    30
    A
    B
    C

    View Slide

  31. ISP
    OCN ( ) Asahi Net ( )
    Asahi Net ( ) WiFi OCN ( )
    ( )
    31
    ISP X
    ISP Y
    ISP Z
    ISP X
    ISP Y
    ISP Z

    View Slide

  32. ISP
    ARTERIA ( ), Asahi Net ( )
    PC vs Mobile QoE ( ) ISP
    ( )
    32
    ISP X
    ISP Y
    ISP Z

    View Slide

  33. QoE ( , )
    QoE 30
    貢 1080p, 720p
    ABR
    33
    720p30
    480p30
    A

    View Slide

  34. QoE
    A PC
    PC QoE 5 1080p30 ( ) PC
    QoE PC
    34
    A (PC) A (mobile)

    View Slide

  35. QoE
    B, C QoE 4.5 720p
    ( )
    B QoE 4.6 QoE 5 1080p
    ( )
    35
    B C

    View Slide

  36. ISP QoE
    OCN PC
    4K, 8K, 60fps
    ARTERIA 

    36
    OCN ARTERIA

    View Slide

  37. ISP QoE
    ISP X QoE
    Asahi Net Android
    37
    Asahi Net
    ISP X

    View Slide

  38. ISP QoE
    ISP Y QoE 1 , Z QoE
    38
    ISP Z
    ISP Y

    View Slide

  39. ( , )
    2060p30, 1080p30, 720p30, 480p30
    ABR
    (ABR )
    39
    A

    View Slide

  40. A PC
    PC 1080p30 FSP
    PC 1080p30
    40
    A (PC) A (mobile)

    View Slide

  41. B, C B
    B 720p C
    41
    B C

    View Slide

  42. ISP
    OCN PC

    42
    OCN ARTERIA

    View Slide

  43. ISP
    OCN Android
    43
    Asahi Net
    ISP X

    View Slide

  44. ISP
    ( )
    44
    ISP Z
    ISP Y

    View Slide

  45. ( , )
    45
    A

    View Slide

  46. A PC
    PC PC
    46
    A (PC) A (mobile)

    View Slide

  47. B
    C
    47
    B C

    View Slide

  48. ISP
    ISP
    ( )
    48
    OCN ARTERIA

    View Slide

  49. ISP
    49
    Asahi Net
    ISP X

    View Slide

  50. ISP
    ( )
    50
    ISP Z
    ISP Y

    View Slide

  51. Web VideoMark
    ( )
    ABR QoE QoE
    ISP
    ISP
    51

    View Slide

  52. Next Steps

    View Slide

  53. ( )

    API
    53

    View Slide

  54. ( )

    Chrome
    54

    View Slide

  55. ( )
    QoE
    QoE
    RTT
    55

    View Slide

  56. ( )
    Web VideoMark Speed Index ( )
    Net ix Speed Index
    Net ix MVNO
    Web
    QoE Web
    56

    View Slide

  57. 6
    etc...
    57

    View Slide

  58. https://vm.webdino.org
    58

    View Slide