Upgrade to Pro — share decks privately, control downloads, hide ads and more …

P3インスタンスではじめるDeep Learningと画像レコメンド

DMM.com
March 13, 2018

P3インスタンスではじめるDeep Learningと画像レコメンド

AWSを利用した画像レコメンドと機械学習/ DeepLearningについて画像解析をするためにAWSを選択した理由や画像解析のデモを含めると伝えます。

この資料はJAWS DAYS 2018で発表したものになっています
【SPEAKER】
株式会社DMM.com
ラボビッグデータ部レコメンションチーム河居寛樹・杉美帆

DMM.com

March 13, 2018
Tweet

More Decks by DMM.com

Other Decks in Programming

Transcript

  1. © 2018 DMM.com
    P3
    Deep Learning


    DMM.com

    View Slide

  2. © 2018 DMM.com
    a
    2
    e
    A 2 D 2
    L
    2 S
    46 0 6 71
    D 6 W

    View Slide

  3. © 2018 DMM.com
    a
    3
    D
    L
    14 7 0
    4 7
    D 2

    View Slide

  4. © 2018 DMM.com 4
    D
    D .
    o
    0
    1 9 M D
    c
    0
    About DMM.com
    m D
    4

    View Slide

  5. © 2018 DMM.com


    5





    View Slide

  6. © 2018 DMM.com 6
    ,
    ,

    View Slide

  7. © 2018 DMM.com 7
    dmm.com


    View Slide

  8. © 2018 DMM.com




    /

    View Slide

  9. © 2018 DMM.com
    9
    / /
    /

    View Slide

  10. © 2018 DMM.com 10





    View Slide

  11. © 2018 DMM.com

    11

    View Slide

  12. © 2018 DMM.com 12
    #
    • + !
    • AWS
    %DL('
    • *"$
    • Grad-CAM )&

    View Slide

  13. © 2018 DMM.com 13

    D A

    View Slide

  14. © 2018 DMM.com 14



    • AWSDL


    • Grad-CAM


    View Slide

  15. © 2018 DMM.com

    15




    () ()

    View Slide

  16. © 2018 DMM.com

    !

    16


    View Slide

  17. © 2018 DMM.com
    !$
    %
    $
    17
    $#
    #

    • "'
    • '
    • (&




    View Slide

  18. © 2018 DMM.com
    #
    %#
    18





    !"%
    $%

    View Slide

  19. © 2018 DMM.com

    19



    View Slide

  20. © 2018 DMM.com 20



    "
    !"



    View Slide

  21. © 2018 DMM.com
    21


    View Slide

  22. © 2018 DMM.com



    22

    View Slide

  23. © 2018 DMM.com
    $ #!
    $ "
    23

    $%

    View Slide

  24. © 2018 DMM.com

    24



    View Slide

  25. © 2018 DMM.com 25
    Deep
    Learning
    D

    View Slide

  26. © 2018 DMM.com



    !&$
    26
    Deep
    Learning

    %
    #"

    View Slide

  27. © 2018 DMM.com
    . B
    27
    B
    Deep
    Learning

    1
    1
    1
    9
    20 A

    View Slide

  28. © 2018 DMM.com 28

    • "
    • AWSDL
    • !
    • Grad-CAM


    View Slide

  29. © 2018 DMM.com

    29



    View Slide

  30. © 2018 DMM.com
    30
    Deep Learning

    View Slide

  31. © 2018 DMM.com 31

    View Slide

  32. © 2018 DMM.com
    ……


    GPU
    32



    View Slide

  33. © 2018 DMM.com
    GPU
    33


    View Slide

  34. © 2018 DMM.com
    13
    34
    Maxwell Pascal Volta
    13

    View Slide

  35. © 2018 DMM.com
    8 2
    35
    Maxwell Pascal Volta
    D1
    2
    2 32

    View Slide

  36. © 2018 DMM.com

    V.S.
    GPU
    24365


    36

    View Slide

  37. © 2018 DMM.com

    V.S.
    GPU
    24365


    37
    2
    5
    3
    4

    View Slide

  38. © 2018 DMM.comD
    2
    38
    Maxwell Pascal Volta
    U3
    1 5 8
    PL 38

    View Slide

  39. © 2018 DMM.com


    •Amazon Web Services?
    •Google Cloud Platform?
    •Microsoft Azure?
    39

    View Slide

  40. © 2018 DMM.com
    GPU
    VoltaGPU
    AWS
    40
    Maxwell Pascal Volta
    GCP
    Azure

    View Slide

  41. © 2018 DMM.com
    %#!

    &
    "$
    AWS
    41



    View Slide

  42. © 2018 DMM.com
    AWS'5
    )0
    $0/GPU6
    GPU+.,(-"!
    *&GPU/AWS
    #%AWS 4
    132
    42

    View Slide

  43. © 2018 DMM.com
    Deep Learning
    43



    View Slide

  44. © 2018 DMM.com
    GPU P3 $
    NVIDIA Tesla V100 (&
    "
    GPU
    44
    V1001'(&p3.2xlarge
    !%
    #

    View Slide

  45. © 2018 DMM.com
    Deep Learning
    45


    View Slide

  46. © 2018 DMM.com
    NVIDIA Docker.#
    DockerGPU&
    '$
    46

    &
    +!
    )-,*13/
    (54
    "%
    nvidia-docker run -,*102

    View Slide

  47. © 2018 DMM.com
    Deep Learning
    47



    View Slide

  48. © 2018 DMM.com
    Keras 0'
    Python-TensorFlow
    #&$.,

    !
    48

    /%
    TensorFlow")'.,
    *(+1

    View Slide

  49. © 2018 DMM.com
    Deep Learning
    49





    View Slide

  50. © 2018 DMM.com


    50


    View Slide

  51. © 2018 DMM.com



    51

    View Slide

  52. © 2018 DMM.com





    52


    View Slide

  53. © 2018 DMM.com
    Deep Learning
    53






    View Slide

  54. © 2018 DMM.com
    3
    54

    View Slide

  55. © 2018 DMM.com
    3
    55

    View Slide

  56. © 2018 DMM.com 56
    3

    View Slide

  57. © 2018 DMM.com 57

    View Slide

  58. © 2018 DMM.com 58
    3

    View Slide

  59. © 2018 DMM.com
    .3!"+

    59
    $0
    * 1,
    (#
    .3%&
    2)/-'1,4

    View Slide

  60. © 2018 DMM.com
    Elastic File System (EFS)

    !EC2

    60

    View Slide

  61. © 2018 DMM.com 61

    View Slide

  62. © 2018 DMM.com 62

    View Slide

  63. © 2018 DMM.com
    Deep Learning
    63








    View Slide

  64. © 2018 DMM.com 64
    ChatOps
    Slack


    View Slide

  65. © 2018 DMM.com 65
    '
    ChatOps
    Slack!) (#
    '

    %+
    )$
    *&
    "

    View Slide

  66. © 2018 DMM.com 66
    +%
    • +%-(&'!#
    • )$
    " +%
    • ,*+% )

    View Slide

  67. © 2018 DMM.com 67




    View Slide

  68. © 2018 DMM.com


    1. Docker
    2. Docker
    68


    View Slide

  69. © 2018 DMM.com
    1. Docker
    2. Docker
    3. Docker
    4.
    69
    !

    View Slide

  70. © 2018 DMM.com 70
    '
    ChatOps
    Slack!) (#
    '

    %+
    )$
    *&
    "

    View Slide

  71. © 2018 DMM.com 71

    View Slide

  72. © 2018 DMM.com 72
    ChatOps

    View Slide

  73. © 2018 DMM.com 73

    • &
    • AWS
    !DL$#

    • Grad-CAM %"

    View Slide

  74. © 2018 DMM.com 74



    View Slide

  75. © 2018 DMM.com 75


    View Slide

  76. © 2018 DMM.com
    12
    76
    .0

    0

    View Slide

  77. © 2018 DMM.com
    . 0 7
    77
    1

    2
    8

    View Slide

  78. © 2018 DMM.com

    78




    View Slide

  79. © 2018 DMM.com

    79


    View Slide

  80. © 2018 DMM.com

    80





    View Slide

  81. © 2018 DMM.com. 81
    02

    12

    View Slide

  82. © 2018 DMM.com 82

    View Slide

  83. © 2018 DMM.com N
    OMR f
    83
    OMR C
    -
    1 : S : 1 -:
    g a
    OL R
    :
    6- -: - - : -
    i cI i d V e V h G

    View Slide

  84. © 2018 DMM.com R
    S V m
    84
    S VIG
    G S VO drC
    - 6 : 6 6:
    p M p eg lO i IoN L
    -
    a 3: 1 :: 6 : :3
    c :: 6
    : : 6:
    nfh
    6:
    S V
    - :
    : 6:

    View Slide

  85. © 2018 DMM.com
    2
    85
    .1

    01

    View Slide

  86. © 2018 DMM.com 86




    View Slide

  87. © 2018 DMM.com
    !
    !
    87

    View Slide

  88. © 2018 DMM.com 88
    !

    View Slide

  89. © 2018 DMM.com 89

    ) $+

    (!'

    * "
    &
    (!' #%

    View Slide

  90. © 2018 DMM.com 90
    D E B
    F
    T S
    T

    View Slide

  91. © 2018 DMM.com 91




    View Slide

  92. © 2018 DMM.com 92



    View Slide

  93. © 2018 DMM.com 93
    3
    1 2
    E B
    1 F
    1E

    View Slide

  94. © 2018 DMM.com 94



    View Slide

  95. © 2018 DMM.com 95






    View Slide

  96. © 2018 DMM.com


    96



    View Slide

  97. © 2018 DMM.com
    ")!-

    97


    .'
    $

    %&#*
    (, +
    $

    View Slide

  98. © 2018 DMM.com
    !%'
    (#
    98


    " &
    !%
    $

    View Slide

  99. © 2018 DMM.com
    #&!)
    '
    99


    $"(

    &!)%

    View Slide

  100. © 2018 DMM.com E
    K S
    K
    100

    View Slide

  101. © 2018 DMM.comA
    B
    101
    CE
    9
    .2

    E
    18 7 02

    View Slide

  102. © 2018 DMM.com 102





    View Slide

  103. © 2018 DMM.com
    . 0 7
    103

    . 0
    2A
    8 1
    4

    View Slide

  104. © 2018 DMM.com
    . 0 7
    104

    . 0
    2A
    8 1
    4

    View Slide

  105. © 2018 DMM.com 105






    View Slide

  106. © 2018 DMM.com


    106






    View Slide

  107. © 2018 DMM.com


    107






    View Slide

  108. © 2018 DMM.com



    108

    View Slide

  109. © 2018 DMM.com



    109
    Deep
    Learning
    %

    View Slide

  110. © 2018 DMM.com

    '#& $
    % " $
    !
    110
    Deep
    Learning
    %

    View Slide

  111. © 2018 DMM.com 111







    View Slide

  112. © 2018 DMM.com
    -
    112

    View Slide

  113. © 2018 DMM.com
    !,%'()
    !,$
    * %'
    )+"#
    (&
    113

    View Slide

  114. © 2018 DMM.com 114

    View Slide

  115. © 2018 DMM.com 115

    View Slide

  116. © 2018 DMM.com64
    . B 1
    116

    05 7
    A. 2 9
    C

    8 .

    View Slide

  117. © 2018 DMM.com 117








    View Slide

  118. © 2018 DMM.com 118

    • &
    • AWS
    "DL$#
    • %!
    • Grad-CAM


    View Slide

  119. © 2018 DMM.com

    119

    View Slide

  120. © 2018 DMM.com 120
    D
    A

    View Slide

  121. © 2018 DMM.com 121
    D
    A


    View Slide

  122. © 2018 DMM.com 122
    D
    A
    3

    View Slide

  123. © 2018 DMM.com 123
    D
    A
    - A B
    E MG C A B

    View Slide