Post COVID-19 Network Analysis

ITU 協会 第92回 情報通信研究会で使用したスライド
https://www.ituaj.jp/?kouen=92nd_ict

Transcript

1. After COVID-19 Network Analysis with
   daily video viewing data on web browser
   @ITU-AJ - ICT 92th on 20201127
   WebDINO Japan - Tomoya ASAI
   

   View Slide

2. about:speaker
   Tomoya ASAI - dynamis webdino.org
   WebDINO Japan (ex-Mozilla Japan) CTO
   /
   Slides: speakerdeck.com/dynamis
   dynamis @ Community
   Twitter: @dynamitter
   facebook.com/dynamis
   note: firefox (= red panda, lesser panda)
   2
   @
   

   View Slide

3. about: WebDINO Japan
   Web, Browser, Open
   ( : )
   (Chromium, Firefox )
   ( : Gecko )
   Web & Open
   Web IoT 較
   : 2017 Mozilla Japan WebDINO Japan
   https://www.webdino.org/
   3
   

   View Slide

4. Topics
   about: Web VideoMark
   Measurement & Open Data
   Target Data
   緊
   Post Covid Data Analysis
   Next Steps
   4
   

   View Slide

5. Acknowledgment
   (QoE )
   NTT
   https://vm.webdino.org/notice
   5
   

   View Slide

6. about: Web VideoMark
   

   View Slide

7. Web VideoMark
   YouTube
   https://vm.webdino.org/opendata
   https://vm.webdino.org/stats
   Web VideoMark Project by WebDINO Japan http://vm.webdino.org/
   7
   

   View Slide

8. (58%, sandvine ) ( )
   ISP
   Net ix, YouTube
   (Web VideoMark) Android
   (VideoMark Browser)
   8
   

   View Slide

9. Web VideoMark - Endorsement
   IOT
   https://www.webdino.org/updates/news/201902051051/
   9
   

   View Slide

10. ಈըαʔϏεͷ
    ਪఆମײ඼࣭஋
    ར༻ऀͷ
    ϒϥ΢βʔ
    ֶज़ݚڀ༻σʔλ
    ΍ௐࠪ෼ੳ݁Ռ͸
    Φʔϓϯσʔλʹ
    ʲΫϥΠΞϯτ৘ใʳ
    w ୺຤छผ
    1$PSϞόΠϧ
    
    w ϒϥ΢βόʔδϣϯ
    w 04όʔδϣϯ౳
    ஫ࢯ໊ɾॅॴ౳ͷݸਓ
    ಛఆ৘ใ͸ؚ·ͳ͍
    6TFS"HFOU͔Βͷਪଌ
    ʲωοτϫʔΫ৘ใʳ
    w ௨৴ࣄۀࣾɾ*41
    w ஍Ҭ ౎ಓ෎ݝ
    ౳
    ஫ૹ৴ݩ*1ΞυϨεಗ
    ໊Խ ຤ඌΦΫςοτ
    ࡟আ
    ޙʹ(FP*1Ͱਪଌ
    ʲ࠶ੜ඼࣭ཁҼʳ
    w ಈը৘ใϏοτϨʔτɺ
    ղ૾౓ɺϑϨʔϜϨʔτ౳
    w ࠶ੜ৘ใ࠶ੜͷதஅɺ
    όοϑΝϦϯά౳
    w ૢ࡞৘ใಈըͷγʔΫɺ
    Ұ࣌ఀࢭɾ࠶։౳
    8FC7JEFP.BSL֦ுػೳ΍ϒϥ΢βʔͰࢹௌ৘ใΛऔಘ
    ಈը࠶ੜ࣌ͷ
    ମײ඼࣭஋Λ
    dͷ਺஋Ͱ
    ਪఆͯ͠ฦ͢
    2P&
    2VBMJUZPG&YQFSJFODF
    8FC
    7JEFP.BSL
    αʔόʔ
    ࢹௌ৘ใΛ෼ੳ
    ಈը഑৴αʔϏε΁ΞΫηε
    )5.-ɺಈըϑΝΠϧ౳Λड৴
    ௨৴ࣄۀऀɾ*41
    αʔϏεվળ༻ʹ
    ௐࠪσʔλΛఏڙ
    ʂ
    ಈըࢹௌ࣌ͷ
    2P&౳Λ֬ೝ
    ϓϥΠόγʔอޢॲཧ ֶज़ݚڀ༻σʔλ࡞੒
    ಗ໊Խॲཧ
    ಈը഑৴αʔϏεɾ
    $%/αʔόʔ
    Web VideoMark
    

    View Slide

11. note: (QoE)
    (QoE: Quality of Experience)
    24
    ( )
    (1 5, MOS)
    QoE (ITU)
    ITU-T P SG12
    Web VideoMark ITU-T NTT 頃
    11
    

    View Slide

12. Web VideoMark ( )
    12
    GCP
    Internet
    sodium.js
    nginx/ uent-d
    sodium.js
    PC + ,
    Android
    endpoint
    log file
    SodiumServer
    AggregateServer
    QoE
    QoE
    GeoIP
    (IP )
    QoE Server
    QoE
    (NTT Communications )
    Sodium DB (mongoDB)
    Salt DB(mongoDB)
    Salt DB
    QoE
    QoE
    

    View Slide

13. Web VideoMark
    ( )
    ( )
    : 2019 12 10
    13
    

    View Slide

14. Web VideoMark
    0. "videomark" ( )
    PC Chrome Web VideoMark
    Android VideoMark Browser
    1. VideoMark Chrome /
    2. YouTube
    3.
    14
    

    View Slide

15. UI
    ( )
    ( ) QoE
    15 QoE
    ⭐
    ( 1.0 ⭐ 5.0 ⭐⭐⭐⭐⭐)
    15
    

    View Slide

16. View Slide

17. Web VideoMark
    QoS QoE
    17
    

    View Slide

18. QoE
    , IPv4/v6, ISP, APN
    CM
    YouTube
    ( )
    18
    

    View Slide

19. : API ( QoE)
    PC VM URL "stats"
    19
    

    View Slide

20. ( )
    PC/Android Web VideoMark
    https://vm.webdino.org/
    ( )
    ( )
    Docker
    (Jetson Nano)
    : https://vm.webdino.org/contact
    20
    

    View Slide

21. https://vm.webdino.org
    21
    

    View Slide

22. Measurement
    & Open Data
    

    View Slide

23. QoE ( )
    ...
    ISP
    Web
    https://vm.webdino.org/stats
    23
    

    View Slide

24. IP
    ( )
    URL
    ID
    ID 30 0
    24
    

    View Slide

25. IP ( )
    , , ISP (GeoIP )
    APN, PLMN (Android )
    URL
    CDN IP [*]
    URL [*]
    [*]
    ( )
    etc...
    Representation [**]
    Codec
    Representation
    /
    etc...
    QoE ( )
    (RTT) [*]
    [*]
    etc...
    [*]
    etc...
    CM [*]
    etc...
    [*] [**]
    25
    

    View Slide

26. SIM ID
    GDPR
    IP
    GPS
    User Agent
    URL
    26
    

    View Slide

27. DB
    https://vm.webdino.org/opendata
    IP URL
    Android UserAgent
    UserAgent
    https://vm.webdino.org/opendata
    27
    

    View Slide

28. ( )
    2019-04-07T06:38:58+00:00
    {"date":"2019-04-07T06:38:58.253Z","startTime":297957833.29999995,"endTime":2979628
    36.1000001,"session":"8b37d168-7343-45a1-a507-f8c230a0ebd4","location":"https://
    www.youtube.com","userAgent":"Mozilla/5.0 (Linux; Android 9; XXX) AppleWebKit/
    537.36 (KHTML, like Gecko) Chrome/70.0.3538.124 Mobile Safari/
    537.36","appVersion":"5.0 (Linux; Android 9; XXX) AppleWebKit/537.36 (KHTML, like
    Gecko) Chrome/70.0.3538.124 Mobile Safari/537.36","sequence":58463,"video":
    [{"property":{"uuid":"fd65101f-a8df-47c6-a804-3ac719e04ca3","id":"","class":
    ["video-stream","html5-main-video"],"src":"blob:https://www.youtube.com/a1551960-
    f053-492e-b945-84b075c8598f","domainName":"r7---sn-5n5ip-
    ioqe.googlevideo.com","width":0,"height":0,"videoWidth":1280,"videoHeight":720,"med
    iaSize":82.384398,"defaultPlaybackRate":1,"playbackRate":1,"playStartTime":15545116
    11888.0,"playEndTime":1554511694180.0,"currentPlayPos":82.384398,"currentPlayTime":
    82.245},"playback_quality":[],"event_play":[],"event_play_delta":[],"event_pause":
    [],"event_pause_delta":[],"event_seeking":[],"event_seeking_delta":
    [],"event_seeked":[],"event_seeked_delta":[],"event_ended":[],"event_ended_delta":
    [],"event_stalled":[],"event_stalled_delta":[],"event_progress":
    [],"event_progress_delta":[],"event_waiting":[],"event_waiting_delta":
    [],"event_canplay":[],"event_canplay_delta":[]}],"resource_timing":
    [],"REMOTE_ADDR":"180.235.59.0","country":"JP","subdivision":"13","isp":"Asahi
    Net"}
    5
    28
    

    View Slide

29. ( , mongo DB )
    id: session-uuid
    connection:
    - type: cellular
    effectiveType: 4g
    downlink: 1.55
    downlinkMax: 100
    rtt: 150
    apn: app name
    plmn: plum name
    network: # IPͱGeoIP
    - server host: vid.jp
    serverHost: x.y.z
    clientLocation:
    country: JP
    subdivision: 13
    isp: OCN
    session:
    userAgnet:
    os: Windows10
    browser: browser
    qoe: 4.2
    video:
    videoId: xxxxxx
    duration: 160.3
    representations:
    - resolution:
    height: 1080
    width: 1920
    container: webm
    videoCodec:
    audioCodec: opus
    videoBitrate: -1
    autioBitrate: -1
    playHistory:
    - startTime: 123456
    endTime: 123456
    holiday: false
    throughput history:
    - throughput: 1234
    rtt: 123
    eventHistory:
    # ৄࡉׂѪ
    cmHistory:
    # ৄࡉׂѪ
    representationHi...
    # ৄࡉׂѪ
    yml
    29
    

    View Slide

30. https://vm.webdino.org
    30
    

    View Slide

31. Target Data
    

    View Slide

32. 2020/1/1
    140,840
    1 14,565
    ISP
    1000 ISP
    緊 ISP
    32
    

    View Slide

33. YouTube
    8 5
    AbemaTV
    music YouTube, ,
    Amazon
    TVer = CDN
    ( )
    : 貢
    33
    

    View Slide

34. Post Covid Data Analysis
    

    View Slide

35. ( ) QoE (2020 )
    COVID-19
    YouTube
    QoE
    35
    

    View Slide

36. YouTube
    6 720p
    YouTube
    YouTube
    緊 ( )
    36
    

    View Slide

37. YouTube
    6 720p
    YouTube
    YouTube
    緊 ( )
    36
    

    View Slide

38. (2020 )
    (4/7) (4/16) 9
    3 117 Mbps 7 41 Mbps 1/3
    3 340 s 9 1049 ms 3
    37
    

    View Slide

39. (4/7) (4/16)
    10
    ( )
    38
    

    View Slide

40. (2020 )
    4
    貢 ( )
    39
    

    View Slide

41. IPv4 IPv6
    IPv4
    7
    IPv6
    10
    10 v4/v6
    ( )
    40
    IPv4
    IPv6
    

    View Slide

42. IPv4 IPv6
    IPv4
    7
    IPv6
    10
    9 v4/v6
    ( )
    41
    IPv4
    IPv6
    

    View Slide

43. IPv4 IPv6
    IPv4 4
    IPv6 4 8
    10
    IPv4/v6
    42
    IPv4
    IPv6
    

    View Slide

44. ISP
    ISP
    ISP
    ISP
    ISP ...
    43
    

    View Slide

45. ISP
    4
    ( or
    )
    ISP
    44
    

    View Slide

46. ISP
    4
    ISP
    45
    

    View Slide

47. ISP
    ISP
    ISP
    ISP
    ISP ...
    46
    

    View Slide

48. ISP
    4
    ( or
    )
    ISP
    47
    

    View Slide

49. ISP
    4 5
    IPS
    48
    

    View Slide

50. :
    ISP
    ISP
    貢 ISP
    : ISP
    49
    

    View Slide

51. Next Steps
    

    View Slide

52. ( )
    Web
    頃
    https://vm.webdino.org/stats
    Web VideoMark Speed Index ( )
    Net ix Speed Index
    ISP
    51
    

    View Slide

53. TCP
    (ADSL/FTTH )
    : https://vm.webdino.org/contact
    52
    

    View Slide

54. ( )
    PC/Android Web VideoMark
    https://vm.webdino.org/
    ( )
    ( )
    Docker
    (Jetson Nano)
    : https://vm.webdino.org/contact
    53
    

    View Slide

55. https://vm.webdino.org
    54
    

    View Slide

56. https://vm.webdino.org
    54
    

    View Slide