$30 off During Our Annual Pro Sale. View Details »

Post COVID-19 Network Analysis

dynamis
November 27, 2020

Post COVID-19 Network Analysis

ITU 協会 第92回 情報通信研究会で使用したスライド
https://www.ituaj.jp/?kouen=92nd_ict

dynamis

November 27, 2020
Tweet

More Decks by dynamis

Other Decks in Technology

Transcript

  1. After COVID-19 Network Analysis with
    daily video viewing data on web browser
    @ITU-AJ - ICT 92th on 20201127
    WebDINO Japan - Tomoya ASAI

    View Slide

  2. about:speaker
    Tomoya ASAI - dynamis webdino.org
    WebDINO Japan (ex-Mozilla Japan) CTO
    /
    Slides: speakerdeck.com/dynamis
    dynamis @ Community
    Twitter: @dynamitter
    facebook.com/dynamis
    note: firefox (= red panda, lesser panda)
    2
    @

    View Slide

  3. about: WebDINO Japan
    Web, Browser, Open
    ( : )
    (Chromium, Firefox )
    ( : Gecko )
    Web & Open
    Web IoT 較
    : 2017 Mozilla Japan WebDINO Japan
    https://www.webdino.org/
    3

    View Slide

  4. Topics
    about: Web VideoMark
    Measurement & Open Data
    Target Data

    Post Covid Data Analysis
    Next Steps
    4

    View Slide

  5. Acknowledgment
    (QoE )
    NTT
    https://vm.webdino.org/notice
    5

    View Slide

  6. about: Web VideoMark

    View Slide

  7. Web VideoMark
    YouTube
    https://vm.webdino.org/opendata
    https://vm.webdino.org/stats
    Web VideoMark Project by WebDINO Japan http://vm.webdino.org/
    7

    View Slide

  8. (58%, sandvine ) ( )
    ISP
    Net ix, YouTube
    (Web VideoMark) Android
    (VideoMark Browser)
    8

    View Slide

  9. Web VideoMark - Endorsement
    IOT
    https://www.webdino.org/updates/news/201902051051/
    9

    View Slide

  10. ಈըαʔϏεͷ
    ਪఆମײ඼࣭஋
    ར༻ऀͷ
    ϒϥ΢βʔ
    ֶज़ݚڀ༻σʔλ
    ΍ௐࠪ෼ੳ݁Ռ͸
    Φʔϓϯσʔλʹ
    ʲΫϥΠΞϯτ৘ใʳ
    w ୺຤छผ
    1$PSϞόΠϧ

    w ϒϥ΢βόʔδϣϯ
    w 04όʔδϣϯ౳
    ஫ࢯ໊ɾॅॴ౳ͷݸਓ
    ಛఆ৘ใ͸ؚ·ͳ͍
    6TFS"HFOU͔Βͷਪଌ
    ʲωοτϫʔΫ৘ใʳ
    w ௨৴ࣄۀࣾɾ*41
    w ஍Ҭ ౎ಓ෎ݝ

    ஫ૹ৴ݩ*1ΞυϨεಗ
    ໊Խ ຤ඌΦΫςοτ
    ࡟আ
    ޙʹ(FP*1Ͱਪଌ
    ʲ࠶ੜ඼࣭ཁҼʳ
    w ಈը৘ใϏοτϨʔτɺ
    ղ૾౓ɺϑϨʔϜϨʔτ౳
    w ࠶ੜ৘ใ࠶ੜͷதஅɺ
    όοϑΝϦϯά౳
    w ૢ࡞৘ใಈըͷγʔΫɺ
    Ұ࣌ఀࢭɾ࠶։౳
    8FC7JEFP.BSL֦ுػೳ΍ϒϥ΢βʔͰࢹௌ৘ใΛऔಘ
    ಈը࠶ੜ࣌ͷ
    ମײ඼࣭஋Λ
    dͷ਺஋Ͱ
    ਪఆͯ͠ฦ͢
    2P&
    2VBMJUZPG&YQFSJFODF
    8FC
    7JEFP.BSL
    αʔόʔ
    ࢹௌ৘ใΛ෼ੳ
    ಈը഑৴αʔϏε΁ΞΫηε
    )5.-ɺಈըϑΝΠϧ౳Λड৴
    ௨৴ࣄۀऀɾ*41
    αʔϏεվળ༻ʹ
    ௐࠪσʔλΛఏڙ
    ʂ
    ಈըࢹௌ࣌ͷ
    2P&౳Λ֬ೝ
    ϓϥΠόγʔอޢॲཧ ֶज़ݚڀ༻σʔλ࡞੒
    ಗ໊Խॲཧ
    ಈը഑৴αʔϏεɾ
    $%/αʔόʔ
    Web VideoMark

    View Slide

  11. note: (QoE)
    (QoE: Quality of Experience)
    24
    ( )
    (1 5, MOS)
    QoE (ITU)
    ITU-T P SG12
    Web VideoMark ITU-T NTT 頃
    11

    View Slide

  12. Web VideoMark ( )
    12
    GCP
    Internet
    sodium.js
    nginx/ uent-d
    sodium.js
    PC + ,
    Android
    endpoint
    log file
    SodiumServer
    AggregateServer
    QoE
    QoE
    GeoIP
    (IP )
    QoE Server
    QoE
    (NTT Communications )
    Sodium DB (mongoDB)
    Salt DB(mongoDB)
    Salt DB
    QoE
    QoE

    View Slide

  13. Web VideoMark
    ( )
    ( )
    : 2019 12 10
    13

    View Slide

  14. Web VideoMark
    0. "videomark" ( )
    PC Chrome Web VideoMark
    Android VideoMark Browser
    1. VideoMark Chrome /
    2. YouTube
    3.
    14

    View Slide

  15. UI
    ( )
    ( ) QoE
    15 QoE

    ( 1.0 ⭐ 5.0 ⭐⭐⭐⭐⭐)
    15

    View Slide

  16. 16

    View Slide

  17. Web VideoMark
    QoS QoE
    17

    View Slide

  18. QoE
    , IPv4/v6, ISP, APN
    CM
    YouTube
    ( )
    18

    View Slide

  19. : API ( QoE)
    PC VM URL "stats"
    19

    View Slide

  20. ( )
    PC/Android Web VideoMark
    https://vm.webdino.org/
    ( )
    ( )
    Docker
    (Jetson Nano)
    : https://vm.webdino.org/contact
    20

    View Slide

  21. https://vm.webdino.org
    21

    View Slide

  22. Measurement
    & Open Data

    View Slide

  23. QoE ( )
    ...
    ISP
    Web
    https://vm.webdino.org/stats
    23

    View Slide

  24. IP
    ( )
    URL
    ID
    ID 30 0
    24

    View Slide

  25. IP ( )
    , , ISP (GeoIP )
    APN, PLMN (Android )
    URL
    CDN IP [*]
    URL [*]
    [*]
    ( )
    etc...
    Representation [**]
    Codec
    Representation
    /
    etc...
    QoE ( )
    (RTT) [*]
    [*]
    etc...
    [*]
    etc...
    CM [*]
    etc...
    [*] [**]
    25

    View Slide

  26. SIM ID
    GDPR
    IP
    GPS
    User Agent
    URL
    26

    View Slide

  27. DB
    https://vm.webdino.org/opendata
    IP URL
    Android UserAgent
    UserAgent
    https://vm.webdino.org/opendata
    27

    View Slide

  28. ( )
    2019-04-07T06:38:58+00:00
    {"date":"2019-04-07T06:38:58.253Z","startTime":297957833.29999995,"endTime":2979628
    36.1000001,"session":"8b37d168-7343-45a1-a507-f8c230a0ebd4","location":"https://
    www.youtube.com","userAgent":"Mozilla/5.0 (Linux; Android 9; XXX) AppleWebKit/
    537.36 (KHTML, like Gecko) Chrome/70.0.3538.124 Mobile Safari/
    537.36","appVersion":"5.0 (Linux; Android 9; XXX) AppleWebKit/537.36 (KHTML, like
    Gecko) Chrome/70.0.3538.124 Mobile Safari/537.36","sequence":58463,"video":
    [{"property":{"uuid":"fd65101f-a8df-47c6-a804-3ac719e04ca3","id":"","class":
    ["video-stream","html5-main-video"],"src":"blob:https://www.youtube.com/a1551960-
    f053-492e-b945-84b075c8598f","domainName":"r7---sn-5n5ip-
    ioqe.googlevideo.com","width":0,"height":0,"videoWidth":1280,"videoHeight":720,"med
    iaSize":82.384398,"defaultPlaybackRate":1,"playbackRate":1,"playStartTime":15545116
    11888.0,"playEndTime":1554511694180.0,"currentPlayPos":82.384398,"currentPlayTime":
    82.245},"playback_quality":[],"event_play":[],"event_play_delta":[],"event_pause":
    [],"event_pause_delta":[],"event_seeking":[],"event_seeking_delta":
    [],"event_seeked":[],"event_seeked_delta":[],"event_ended":[],"event_ended_delta":
    [],"event_stalled":[],"event_stalled_delta":[],"event_progress":
    [],"event_progress_delta":[],"event_waiting":[],"event_waiting_delta":
    [],"event_canplay":[],"event_canplay_delta":[]}],"resource_timing":
    [],"REMOTE_ADDR":"180.235.59.0","country":"JP","subdivision":"13","isp":"Asahi
    Net"}
    5
    28

    View Slide

  29. ( , mongo DB )
    id: session-uuid
    connection:
    - type: cellular
    effectiveType: 4g
    downlink: 1.55
    downlinkMax: 100
    rtt: 150
    apn: app name
    plmn: plum name
    network: # IPͱGeoIP
    - server host: vid.jp
    serverHost: x.y.z
    clientLocation:
    country: JP
    subdivision: 13
    isp: OCN
    session:
    userAgnet:
    os: Windows10
    browser: browser
    qoe: 4.2
    video:
    videoId: xxxxxx
    duration: 160.3
    representations:
    - resolution:
    height: 1080
    width: 1920
    container: webm
    videoCodec:
    audioCodec: opus
    videoBitrate: -1
    autioBitrate: -1
    playHistory:
    - startTime: 123456
    endTime: 123456
    holiday: false
    throughput history:
    - throughput: 1234
    rtt: 123
    eventHistory:
    # ৄࡉׂѪ
    cmHistory:
    # ৄࡉׂѪ
    representationHi...
    # ৄࡉׂѪ
    yml
    29

    View Slide

  30. https://vm.webdino.org
    30

    View Slide

  31. Target Data

    View Slide

  32. 2020/1/1
    140,840
    1 14,565
    ISP
    1000 ISP
    緊 ISP
    32

    View Slide

  33. YouTube
    8 5
    AbemaTV
    music YouTube, ,
    Amazon
    TVer = CDN
    ( )
    : 貢
    33

    View Slide

  34. Post Covid Data Analysis

    View Slide

  35. ( ) QoE (2020 )
    COVID-19
    YouTube
    QoE
    35

    View Slide

  36. YouTube
    6 720p
    YouTube
    YouTube
    緊 ( )
    36

    View Slide

  37. YouTube
    6 720p
    YouTube
    YouTube
    緊 ( )
    36

    View Slide

  38. (2020 )
    (4/7) (4/16) 9
    3 117 Mbps 7 41 Mbps 1/3
    3 340 s 9 1049 ms 3
    37

    View Slide

  39. (4/7) (4/16)
    10
    ( )
    38

    View Slide

  40. (2020 )
    4
    貢 ( )
    39

    View Slide

  41. IPv4 IPv6
    IPv4
    7
    IPv6
    10
    10 v4/v6
    ( )
    40
    IPv4
    IPv6

    View Slide

  42. IPv4 IPv6
    IPv4
    7
    IPv6
    10
    9 v4/v6
    ( )
    41
    IPv4
    IPv6

    View Slide

  43. IPv4 IPv6
    IPv4 4
    IPv6 4 8
    10
    IPv4/v6
    42
    IPv4
    IPv6

    View Slide

  44. ISP
    ISP
    ISP
    ISP
    ISP ...
    43

    View Slide

  45. ISP
    4
    ( or
    )
    ISP
    44

    View Slide

  46. ISP
    4
    ISP
    45

    View Slide

  47. ISP
    ISP
    ISP
    ISP
    ISP ...
    46

    View Slide

  48. ISP
    4
    ( or
    )
    ISP
    47

    View Slide

  49. ISP
    4 5
    IPS
    48

    View Slide

  50. :
    ISP
    ISP
    貢 ISP
    : ISP
    49

    View Slide

  51. Next Steps

    View Slide

  52. ( )
    Web

    https://vm.webdino.org/stats
    Web VideoMark Speed Index ( )
    Net ix Speed Index
    ISP
    51

    View Slide

  53. TCP
    (ADSL/FTTH )
    : https://vm.webdino.org/contact
    52

    View Slide

  54. ( )
    PC/Android Web VideoMark
    https://vm.webdino.org/
    ( )
    ( )
    Docker
    (Jetson Nano)
    : https://vm.webdino.org/contact
    53

    View Slide

  55. https://vm.webdino.org
    54

    View Slide

  56. https://vm.webdino.org
    54

    View Slide