Introduction to GPU Programming in Python

PyData.Okinawa Meetup #34
https://pydataokinawa.connpass.com/event/82009/

Transcript

1. Introduction to
   GPU Programming
   in Python
   2018.04.21 PyData.Okinawa #34
   @hoto17296
   

   View Slide

2. View Slide

3. View Slide

4. @hoto17296
   • ͪΎΒσʔλגࣜձࣾ
   • σʔλ෼ੳϚϯ
   • JavaScript / Python / AWS
   • IPv6 ͕Θ͔Βͳ͍ࠓ೔͜ͷ͝Ζ
   

   View Slide

5. Ͳͷ͝Ոఉʹ΋͋Δ GPU Ϛγϯ
   

   View Slide

6. ࢖͍͜ͳͯ͠·͔͢ʁʁʁ
   

   View Slide

7. ࣗ෼ͷ GPU ͷΠϝʔδ
   Λ଎͘ಈ͔ͤΔ΍ͭʂ
   

   View Slide

8. ΋͍ͬͨͳ͍
   

   View Slide

9. GPU Λ࢖͍౗ͨ͢Ίʹ
   CUDA Λ৮ͬͯΈΑ͏
   

   View Slide

10. GPU ͱ͸
    • Graphics Processing Unit
    • άϥϑΟοΫॲཧͷͨΊͷϓϩηοα
    • ୯७ͳॲཧΛฒྻԋࢉͰ͖Δ
    • άϥϑΟοΫҎ֎ʹ΋׆༻͞ΕΔ (GPGPU)
    • σΟʔϓϥʔχϯάͱ͔
    

    View Slide

11. (NVIDIA) GPU ͷத਎
    ετϦʔϛϯά
    Ϛϧνϓϩηοα
    ଞʹ΋ϝϞϦͱ͔
    Ωϟογϡͱ͔
    ৭ʑ͋Δ͚Ͳলུ
    CUDA ίΞ
    

    View Slide

12. CUDA ͱ͸
    • Compute Unified Device Architecture
    • NVIDIA GPU Λ࢖ͬͯฒྻܭࢉΛ͢ΔͨΊͷ

    ϓϩάϥϛϯάϞσϧ
    

    View Slide

13. CUDA ༻ޠ
    • ϗετͱσόΠε
    • CPU ଆΛϗετ, GPU ଆΛσόΠε ͱݺͿ
    • Χʔωϧؔ਺
    • GPU ଆͰ࣮ߦ͢ΔॲཧΛهड़ͨؔ͠਺
    

    View Slide

14. CUDA ϓϩάϥϛϯάϞσϧ
    • ฒྻ਺͕๲େʹͳΔ
    • εϨου, ϒϩοΫ, άϦου ͱ͍͏

    ·ͱ·ΓͰฒྻॲཧΛߦ͏
    

    View Slide

15. ग़యɿ http://www.nvidia.co.jp/object/cuda_education_jp_old.html
    

    View Slide

16. CUDA ϓϩάϥϛϯάϞσϧ
    • ฒྻ਺ = εϨου਺ x ϒϩοΫ਺ x άϦου਺
    • 1ϒϩοΫ͋ͨΓ࠷େ 512 εϨου
    • 1άϦου͋ͨΓ࠷େ 65536^2 ϒϩοΫ
    1GPU ͋ͨΓ࠷େ 2 ஹ ฒྻʂʂʂ

    ✌('ω'✌ )ࡾ✌('ω')✌ࡾ( ✌’ω')✌
    

    View Slide

17. CUDA ϓϩάϥϛϯά
    ΍Γͨ͘ͳ͖ͬͯ·ͨ͠Ͷ
    ʁʁʁ
    

    View Slide

18. CUDA ϓϩάϥϛϯάͷํ๏
    • C Έ͍ͨͳݴޠͰΧʔωϧؔ਺Λ࣮૷ͯ͠

    nvcc ͱ͍͏ίϯύΠϥͰίϯύΠϧ͢Δ
    • μϧ͍
    • GPU Λར༻ͨ͠ฒྻॲཧΛॻ͍ͯΈ͍͕ͨ

    C ͕ॻ͖͍ͨΘ͚Ͱ͸ͳ͍
    • Python Ͱॻ͔ͤͯ͘Ε
    

    View Slide

19. Numba
    • JIT ίϯύΠϧͯ͠

    Python Λߴ଎ԽͰ͖Δ΍ͭ
    • GPU ΋ར༻Ͱ͖Δ (Numba CUDA)
    

    View Slide

20. Χʔωϧؔ਺ͷ
    ఆٛ
    σίϨʔλΛࢦఆ͢Δ͜ͱͰ
    Χʔωϧؔ਺ͱͯ͠ఆٛ ͜ͷΧʔωϧؔ਺͕
    ฒྻ਺෼࣮ߦ͞ΕΔ
    ݱࡏͲͷҐஔ (ʁ) ͷεϨουͰ

    ࣮ߦ͍ͯ͠Δ͔औಘͰ͖Δ
    εϨουͷҐஔ৘ใ͔Β
    ॲཧ͢Δର৅ཁૉͷ࠲ඪΛܭࢉ͢Δ
    ߦྻͷର৅ཁૉʹରͯ͠ॲཧΛߦ͏
    

    View Slide

21. Χʔωϧؔ਺ͷ࣮ߦ
    ฒྻ਺ (griddim, blockdim) Λࢦఆ͔ͯ͠Β࣮ߦ͢Δ
    

    View Slide

22. ΋͏গ͠ෳࡶͳྫɿ ৞ΈࠐΈԋࢉ
    ग़యɿ http://tecmemo.wpblog.jp/category/machine-learning/deep-learning/page/2/
    

    View Slide

23. ϥϓϥγΞϯϑΟϧλ
    • ৞ΈࠐΈԋࢉͰը૾ͷΤοδݕग़Λߦ͏ख๏
    • ը૾ͷ৭ͷඍ෼ʹ૬౰͢Δ
    • ͜ͷߦྻΛϑΟϧλͱͯ͠

    ৞ΈࠐΈԋࢉΛߦ͏
    1 1 1
    1 -8 1
    1 1 1
    

    View Slide

24. ৞ΈࠐΈԋࢉΛߦ͏
    Χʔωϧؔ਺Λ
    ࣮૷
    

    View Slide

25. View Slide

26. ೖྗը૾ ϑΟϧλ݁Ռ
    

    View Slide

27. ·ͱΊ
    • Python Ͱ΋ GPU ϓϩάϥϛϯά͸Ͱ͖Δ
    • GPU Ͱ༡Ϳͷ͸ͨͷ͍͠

    ✌('ω'✌ )ࡾ✌('ω')✌ࡾ( ✌’ω')✌
    

    View Slide