Upgrade to Pro — share decks privately, control downloads, hide ads and more …

P3インスタンスではじめるDeep Learningと画像レコメンド

DMM.com
March 13, 2018
Programming
2
2.6k

P3インスタンスではじめるDeep Learningと画像レコメンド

AWSを利用した画像レコメンドと機械学習/ DeepLearningについて画像解析をするためにAWSを選択した理由や画像解析のデモを含めると伝えます。

この資料はJAWS DAYS 2018で発表したものになっています
【SPEAKER】
株式会社DMM.com
ラボビッグデータ部レコメンションチーム河居寛樹・杉美帆

DMM.com

March 13, 2018
Tweet

More Decks by DMM.com

See All by DMM.com
Neo4j with Spark for Big Data Analysis
dmmlabo
1
370
DMM.comのサービス開発におけるGitHub Enterprise活用の舞台裏
dmmlabo
2
760
Digdagを導入してみて
dmmlabo
8
3.3k
DMM.comラボにおける Scality Ring 活⽤事例
dmmlabo
0
790
デジタルコンテンツの安定配信とコスト削減の両立を実現したシステム刷新
dmmlabo
1
2.5k
DMM CM AWAEDS におけるフロントエンド技術選定について
dmmlabo
1
1.3k
エンジニアのパフォーマンス・モチベーション管理
dmmlabo
1
1.3k
DMMに於ける技術導入はじめの一歩
dmmlabo
1
1.2k
AWSエンジニアがオンプレミスと対峙するとき
dmmlabo
2
5.3k

Other Decks in Programming

See All in Programming
第3回 AWSとGitHub勉強会 - GitHub Actionsを使ったCI環境の構築 -
ogiwarat
0
140
ドメインを中心にしたプロダクト開発/domain-driven-product
hirodragon112
1
210
Rich UI implementation examples using Jetpack Compose (Jetpack Composeを活用した強力なUI表現の実装実例)
iimokoy
0
1.4k
新卒研修でNext.js AppRouterを導入した 学びと反省
iuchimasatoshi
1
220
RustでWasm Runtimeを書いた in WebAssembly night #11
skanehira
0
300
Jetpack Compose の Side-effect を使いこなす / DroidKaigi 2023
star_zero
2
780
Jakarta EE 10 - Simplicity for Modern and Lightweight Cloud
ivargrimstad
0
510
NSSpain 2023: An overview of different approaches to share code across platforms
terhechte
0
120
技術選定の審美眼（2023年版） / Understanding the Spiral of Technologies 2023 edition
twada
PRO
53
16k
Vitestを使った型テストの始め方
mascii
5
1.4k
Next.js × AWS App Runner × AWS AppSyncで進めるクライアントファーストのWEB開発
okaharuna
6
2.8k
Jetpack Media3로 좋은 콘텐츠 소비 경험 구현하기
workspace93
0
130

Featured

See All Featured
In The Pink: A Labor of Love
frogandcode
135
21k
Dealing with People You Can't Stand - Big Design 2015
cassininazir
352
21k
Faster Mobile Websites
deanohume
296
29k
Art, The Web, and Tiny UX
lynnandtonic
285
18k
Support Driven Design
roundedbygravity
91
9.2k
JavaScript: Past, Present, and Future - NDC Porto 2020
reverentgeek
39
3.9k
The Web Native Designer (August 2011)
paulrobertlloyd
78
2.6k
ピンチをチャンスに：未来をつくるプロダクトロードマップ #pmconf2020
aki_iinuma
36
22k
The Mythical Team-Month
searls
212
41k
Optimizing for Happiness
mojombo
368
67k
[RailsConf 2023 Opening Keynote] The Magic of Rails
eileencodes
6
7.1k
Making the Leap to Tech Lead
cromwellryan
119
8.1k

Transcript

  1. © 2018 DMM.com
    P3
    Deep Learning


    DMM.com

    View Slide

  2. © 2018 DMM.com
    a
    2
    e
    A 2 D 2
    L
    2 S
    46 0 6 71
    D 6 W

    View Slide

  3. © 2018 DMM.com
    a
    3
    D
    L
    14 7 0
    4 7
    D 2

    View Slide

  4. © 2018 DMM.com 4
    D
    D .
    o
    0
    1 9 M D
    c
    0
    About DMM.com
    m D
    4

    View Slide

  5. © 2018 DMM.com


    5





    View Slide

  6. © 2018 DMM.com 6
    ,
    ,

    View Slide

  7. © 2018 DMM.com 7
    dmm.com


    View Slide

  8. © 2018 DMM.com




    /

    View Slide

  9. © 2018 DMM.com
    9
    / /
    /

    View Slide

  10. © 2018 DMM.com 10


    …


    View Slide

  11. © 2018 DMM.com

    11

    View Slide

  12. © 2018 DMM.com 12
    #
    • + !
    • AWS
    %DL('
    • *"$
    • Grad-CAM )&
    •

    View Slide

  13. © 2018 DMM.com 13

    D A

    View Slide

  14. © 2018 DMM.com 14

    •

    • AWSDL
    •

    • Grad-CAM

    •

    View Slide

  15. © 2018 DMM.com

    15




    () ()

    View Slide

  16. © 2018 DMM.com

    !

    16


    View Slide

  17. © 2018 DMM.com
    !$
    %
    $
    17
    $#
    #
    •
    • "'
    • '
    • (&




    View Slide

  18. © 2018 DMM.com
    #
    %#
    18





    !"%
    $%

    View Slide

  19. © 2018 DMM.com

    19



    View Slide

  20. © 2018 DMM.com 20



    "
    !"



    View Slide

  21. © 2018 DMM.com
    21


    View Slide

  22. © 2018 DMM.com



    22

    View Slide

  23. © 2018 DMM.com
    $ #!
    $ "
    23

    $%

    View Slide

  24. © 2018 DMM.com

    24



    View Slide

  25. © 2018 DMM.com 25
    Deep
    Learning
    D

    View Slide

  26. © 2018 DMM.com



    !&$
    26
    Deep
    Learning

    %
    #"

    View Slide

  27. © 2018 DMM.com
    . B
    27
    B
    Deep
    Learning

    1
    1
    1
    9
    20 A

    View Slide

  28. © 2018 DMM.com 28

    • "
    • AWSDL
    • !
    • Grad-CAM

    •

    View Slide

  29. © 2018 DMM.com

    29



    View Slide

  30. © 2018 DMM.com
    30
    Deep Learning

    View Slide

  31. © 2018 DMM.com 31

    View Slide

  32. © 2018 DMM.com
    ……


    GPU
    32



    View Slide

  33. © 2018 DMM.com
    GPU
    33


    View Slide

  34. © 2018 DMM.com
    13
    34
    Maxwell Pascal Volta
    13

    View Slide

  35. © 2018 DMM.com
    8 2
    35
    Maxwell Pascal Volta
    D1
    2
    2 32

    View Slide

  36. © 2018 DMM.com

    V.S.
    GPU
    24365


    36

    View Slide

  37. © 2018 DMM.com

    V.S.
    GPU
    24365


    37
    2
    5
    3
    4

    View Slide

  38. © 2018 DMM.comD
    2
    38
    Maxwell Pascal Volta
    U3
    1 5 8
    PL 38

    View Slide

  39. © 2018 DMM.com


    •Amazon Web Services?
    •Google Cloud Platform?
    •Microsoft Azure?
    39

    View Slide

  40. © 2018 DMM.com
    GPU
    VoltaGPU
    AWS
    40
    Maxwell Pascal Volta
    GCP
    Azure

    View Slide

  41. © 2018 DMM.com
    %#!

    &
    "$
    AWS
    41



    View Slide

  42. © 2018 DMM.com
    AWS'5
    )0
    $0/GPU6
    GPU+.,(-"!
    *&GPU/AWS
    #%AWS 4
    132
    42

    View Slide

  43. © 2018 DMM.com
    Deep Learning
    43



    View Slide

  44. © 2018 DMM.com
    GPU P3 $
    NVIDIA Tesla V100 (&
    "
    GPU
    44
    V1001'(&p3.2xlarge
    !%
    #

    View Slide

  45. © 2018 DMM.com
    Deep Learning
    45


    View Slide

  46. © 2018 DMM.com
    NVIDIA Docker.#
    DockerGPU&
    '$
    46

    &
    +!
    )-,*13/
    (54
    "%
    nvidia-docker run -,*102

    View Slide

  47. © 2018 DMM.com
    Deep Learning
    47



    View Slide

  48. © 2018 DMM.com
    Keras 0'
    Python-TensorFlow
    #&$.,

    !
    48

    /%
    TensorFlow")'.,
    *(+1

    View Slide

  49. © 2018 DMM.com
    Deep Learning
    49





    View Slide

  50. © 2018 DMM.com


    50


    View Slide

  51. © 2018 DMM.com



    51

    View Slide

  52. © 2018 DMM.com





    52


    View Slide

  53. © 2018 DMM.com
    Deep Learning
    53






    View Slide

  54. © 2018 DMM.com
    3
    54

    View Slide

  55. © 2018 DMM.com
    3
    55

    View Slide

  56. © 2018 DMM.com 56
    3

    View Slide

  57. © 2018 DMM.com 57

    View Slide

  58. © 2018 DMM.com 58
    3

    View Slide

  59. © 2018 DMM.com
    .3!"+

    59
    $0
    * 1,
    (#
    .3%&
    2)/-'1,4

    View Slide

  60. © 2018 DMM.com
    Elastic File System (EFS)

    !EC2

    60

    View Slide

  61. © 2018 DMM.com 61

    View Slide

  62. © 2018 DMM.com 62

    View Slide

  63. © 2018 DMM.com
    Deep Learning
    63








    View Slide

  64. © 2018 DMM.com 64
    ChatOps
    Slack


    View Slide

  65. © 2018 DMM.com 65
    '
    ChatOps
    Slack!) (#
    '

    %+
    )$
    *&
    "

    View Slide

  66. © 2018 DMM.com 66
    +%
    • +%-(&'!#
    • )$
    " +%
    • ,*+% )

    View Slide

  67. © 2018 DMM.com 67




    View Slide

  68. © 2018 DMM.com


    1. Docker
    2. Docker
    68


    View Slide

  69. © 2018 DMM.com
    1. Docker
    2. Docker
    3. Docker
    4.
    69
    !

    View Slide

  70. © 2018 DMM.com 70
    '
    ChatOps
    Slack!) (#
    '

    %+
    )$
    *&
    "

    View Slide

  71. © 2018 DMM.com 71

    View Slide

  72. © 2018 DMM.com 72
    ChatOps

    View Slide

  73. © 2018 DMM.com 73

    • &
    • AWS
    !DL$#
    •
    • Grad-CAM %"
    •

    View Slide

  74. © 2018 DMM.com 74



    View Slide

  75. © 2018 DMM.com 75


    View Slide

  76. © 2018 DMM.com
    12
    76
    .0

    0

    View Slide

  77. © 2018 DMM.com
    . 0 7
    77
    1

    2
    8

    View Slide

  78. © 2018 DMM.com

    78




    View Slide

  79. © 2018 DMM.com

    79


    View Slide

  80. © 2018 DMM.com

    80





    View Slide

  81. © 2018 DMM.com. 81
    02

    12

    View Slide

  82. © 2018 DMM.com 82

    View Slide

  83. © 2018 DMM.com N
    OMR f
    83
    OMR C
    -
    1 : S : 1 -:
    g a
    OL R
    :
    6- -: - - : -
    i cI i d V e V h G

    View Slide

  84. © 2018 DMM.com R
    S V m
    84
    S VIG
    G S VO drC
    - 6 : 6 6:
    p M p eg lO i IoN L
    -
    a 3: 1 :: 6 : :3
    c :: 6
    : : 6:
    nfh
    6:
    S V
    - :
    : 6:

    View Slide

  85. © 2018 DMM.com
    2
    85
    .1

    01

    View Slide

  86. © 2018 DMM.com 86




    View Slide

  87. © 2018 DMM.com
    !
    !
    87

    View Slide

  88. © 2018 DMM.com 88
    !

    View Slide

  89. © 2018 DMM.com 89

    ) $+

    (!'

    * "
    &
    (!' #%

    View Slide

  90. © 2018 DMM.com 90
    D E B
    F
    T S
    T

    View Slide

  91. © 2018 DMM.com 91




    View Slide

  92. © 2018 DMM.com 92



    View Slide

  93. © 2018 DMM.com 93
    3
    1 2
    E B
    1 F
    1E

    View Slide

  94. © 2018 DMM.com 94



    View Slide

  95. © 2018 DMM.com 95






    View Slide

  96. © 2018 DMM.com


    96



    View Slide

  97. © 2018 DMM.com
    ")!-

    97


    .'
    $

    %&#*
    (, +
    $

    View Slide

  98. © 2018 DMM.com
    !%'
    (#
    98


    " &
    !%
    $

    View Slide

  99. © 2018 DMM.com
    #&!)
    '
    99


    $"(

    &!)%

    View Slide

  100. © 2018 DMM.com E
    K S
    K
    100

    View Slide

  101. © 2018 DMM.comA
    B
    101
    CE
    9
    .2

    E
    18 7 02

    View Slide

  102. © 2018 DMM.com 102





    View Slide

  103. © 2018 DMM.com
    . 0 7
    103

    . 0
    2A
    8 1
    4

    View Slide

  104. © 2018 DMM.com
    . 0 7
    104

    . 0
    2A
    8 1
    4

    View Slide

  105. © 2018 DMM.com 105






    View Slide

  106. © 2018 DMM.com


    106






    View Slide

  107. © 2018 DMM.com


    107






    View Slide

  108. © 2018 DMM.com



    108

    View Slide

  109. © 2018 DMM.com



    109
    Deep
    Learning
    %

    View Slide

  110. © 2018 DMM.com

    '#& $
    % " $
    !
    110
    Deep
    Learning
    %

    View Slide

  111. © 2018 DMM.com 111







    View Slide

  112. © 2018 DMM.com
    -
    112

    View Slide

  113. © 2018 DMM.com
    !,%'()
    !,$
    * %'
    )+"#
    (&
    113

    View Slide

  114. © 2018 DMM.com 114

    View Slide

  115. © 2018 DMM.com 115

    View Slide

  116. © 2018 DMM.com64
    . B 1
    116

    05 7
    A. 2 9
    C

    8 .

    View Slide

  117. © 2018 DMM.com 117








    View Slide

  118. © 2018 DMM.com 118

    • &
    • AWS
    "DL$#
    • %!
    • Grad-CAM

    •

    View Slide

  119. © 2018 DMM.com

    119

    View Slide

  120. © 2018 DMM.com 120
    D
    A

    View Slide

  121. © 2018 DMM.com 121
    D
    A


    View Slide

  122. © 2018 DMM.com 122
    D
    A
    3

    View Slide

  123. © 2018 DMM.com 123
    D
    A
    - A B
    E MG C A B

    View Slide