Image processing with Go has great potential !!

Go Conference'19 Summer in Fukuoka での発表資料です。Goによる画像自動生成サービスを作った経験から、Goで一歩進んだ画像処理を行う方法についてお話します。画像やテキストの合成に関して知っておくべき用語やエッセンスから、任意の画像処理アルゴリズムを標準パッケージで実装する際の知見や、Go+OpenCVを使った画像解析など、入門書だけでは体感できないような、Go+画像処理の可能性をお伝えします。

Transcript

1. Image processing with Go has great potential !! Go Conference’19 Summer in Fukuoka July 13, 2019 @ po3rin
2. @po3rin Software Enginner @ Shiroyagi Corporation QBHF
    Golang / Python / Rust / Docker / AWS / Elasticsearch
3. QBHF
    നϠΪίʔϙϨʔγϣϯ͸ɺػցֶशɾࣗવ ݴޠॲཧ෼໺ͷϓϩμΫτʹྗΛೖΕ͍ͯΔձ ࣾͰ͢ɻ։ൃʹ͸ओʹ
   (P
   ΍
   1ZUIPO
   ͕࠾༻ ͞Ε͍ͯ·͢ɻ നϠΪίʔϙϨʔγϣϯ
4. QBHF
    (PͰ0(1ը૾ੜ੒αʔϏεΛ࡞Γ·͠ ͨɻ΋͠ྑ͔ͬͨΒ࢖ͬͯΈͯͩ͘͞ ͍ɻྑ͍ʂʂͱࢥͬͨΒੋඇ4UBS΋ʂ IUUQTHIMJOLDBSEDPN
5. QBHF
    Introduction \
6. QBHF
    (PͰը૾ॲཧΛॻ͍͍ͯ͘தͰ(PͰͷը૾ॲཧ ͸େ͖ͳϙςϯγϟϧ͕͋Δͱײͨ͡ɻҰํͰ ʮ(PͰը૾ॲཧʯͱ͍͏Πϝʔδ͸·ͩఆணͯ͠ ͍ͳ͍ɻͦ͜Ͱࠓճ͸ೖ໳ॻ͚ͩͰ͸ମײͰ͖ͳ ͍Α͏ͳɺ(P
   
   ը૾ॲཧͷՄೳੑΛ͓఻͑͠· ͢ɻ Introduction Ὂ
7. QBHF
    
   (P
   ʹΑΔը૾ॲཧͷجૅ Contents Ὂ 
   (P
   
   0QFO$7
   Λ࢖ͬͨը૾ॲཧ 
   (P
   
   ը૾ॲཧ
   ͷςετख๏ 
   (P
   ͔ͩΒͰ͖Δʂ
   8FC্Ͱͷը૾ॲཧ
8. QBHF
    Basics of image processing (1) \
9. QBHF
    (PͰͷը૾ॲཧͰ͸جຊతʹ JNBHF*NBHFΠϯλʔϑΣʔεΛ ࢖͏ɻը૾ͷྖҬ΍ɺըૉ஋΍Χ ϥʔϞʔυͳͲɺը૾ͷ৘ใ͸ج ຊશͯ͜͜ͰॴಘͰ͖Δɻ Basics of image processing (1) Ὂ
10. QBHF
     ը૾ॲཧͰ͸ϐΫηϧ͝ͱʹॲཧ ͍ͯ͘͠ͷ͸మ൘ͷॲཧ
    
    ӈͷྫ͸ը૾ΛάϨʔεέʔϧʹ ม׵͢Δίʔυɻ͜ͷύλʔϯͰ ଟ͘ͷը૾ॲཧ͕Մೳ Basics of image processing (2) Ὂ
11. QBHF
     ͜͜·Ͱͷ஌͚ࣝͩͰ(PͰྨࣅը૾൑ఆ ύοέʔδΛ࡞Ε·͢ɻ؆୯Ͱ͠ΐʁ
    Լͷ(PQIFS܅ͷը૾͸ҧ͏ը૾Ͱ͢ ͕ɺ͜ͷύοέʔδΛ࢖͏ͱྨࣅը૾Ͱ ͋Δ͜ͱΛݕ஌Ͱ͖·͢ɻ ࣗ෼ͷ݁ࠗࣜ ͷը૾αʔόʔͰ࿈ࣸࣸਅͷഉআͷҝʹ ࡞Γ·ͨ͠ Example Ὂ
12. QBHF
     "WFSBHF
    )BTI
    ΞϧΰϦζϜ͸ը૾ͷྨࣅ౓ݕग़ΞϧΰϦζϜɻલॲཧ͕ ؆୯ͰͦΕͳΓͷਫ਼౓Ͱྨࣅͨ͠ը૾Λ୳͢͜ͱ͕Ͱ͖Δɻ
    
    
    άϨʔεέʔϧԽ
    
    
    ը૾Λॖখ
    º
    
    
    ֤ըૉΛ૸ࠪͯ͠ฏۉ஋ΑΓ্ͳΒɺԼͳΒͱ͍͏༷ʹϋογϡԽ
    ޙ͸)BTIͷ஋ΛϕΫτϧͱݟͳ͠ɺͭͷϕΫτϧͷϋϛϯάڑ཭Λऔ ཧɺϋϛϯάڑ཭͕ᮢ஋ҎԼͳΒྨࣅը૾ͱ൑ఆͰ͖Δʂʂ Average Hash Ὂ
13. QBHF
     Gray Scale Ὂ ઌ΄Ͳͷॲཧͱಉ͡ɺϐΫ ηϧ͝ͱʹըૉ஋ͷΧϥʔ Λม͑ͯݩͷը૾ʹηοτ
14. QBHF
     Get Hash Ὂ ͜͜Ͱ΋ϐΫηϧ͝ ͱʹ૸ࠪ͢Δύλʔ ϯͰըૉ஋ͷฏۉ஋ Λग़͍ͯ͠Δ
15. QBHF
     ը૾ॲཧΞϧΰϦζϜʹཁٻ͞ΕΔ஋Λ
    JNBHF*NBHF
    ͷϝιου͔Βॴಘ͢Ε ͹ޙ͸ΞϧΰϦζϜΛͦͷ··࣮૷͢Δ͚ͩɻޙ͸ը૾ॲཧಛ༗ͷϐΫηϧ͝ ͱͷ૸ࠪͷ΍Γํ͑͞஌ͬͯΕ͹ɺ΄ͱΜͲ΍Γ͍ͨࣄ͸Մೳʂ
    (P
    
    ը૾ॲཧͬͯҙ֎ʹ؆୯ʂʂ Conclusion Ὂ
16. QBHF
     Basics of image processing (2) \
17. QBHF
     ը૾ΛॏͶΔͱ͖͸ESBXύοέʔ δΛ࢖͍·͢ɻETUʹNBTLͨ͠ TSDΛॏͶ·͢ɻ Basics of Draw (1) Ὂ
18. QBHF
     (JU)VC
    $BSE
    $SFUPS
    Ͱ͸ϓϩϑΟʔϧը૾ͷؙ͵͖ Λߦͳ͍ͬͯΔɻ͜Ε΋
    ESBX%SBX.BTL
    ͰՄೳ Basics of draw (2) Ὂ ETU TSD NBTL SFTVMU
19. QBHF
     ԁܗͷϚεΫ͸ԁΛදݱ ͢Δ*NBHFΠϯλʔ ϑΣʔεΛ࣮૷͢Δ͜ͱ ͰදݱՄೳɻͭ·Γɺ *NBHFΠϯλʔϑΣʔε ࣮͑͞૷͢Ε͹͍ΖΜͳ ը૾දݱ͕Մೳ Circle Ὂ NBTL
20. QBHF
     Image processing using Go + OpenCV \
21. QBHF
     (PͰ͞Βʹߴ౓ͳը૾ॲཧΛߦ͍͍ͨͱ͖͸ 0QFO$7Λར༻͠·͢ɻ0QFO$7͸ը૾ॲཧɾը ૾ղੳ͓Αͼػցֶश౳ͷػೳΛ࣋ͭϥΠϒϥϦͰ ͢ɻ(PݴޠͰ͸(P$7ύοέʔδ͕ศརɻ೥ ݄ʹ0QFO$7
    ͕ϦϦʔε͞Εɺ(P$7΋ ʹରԠ͍ͯ͠·͢ɻ Go + OpenCV Ὂ IUUQTHPDWJP
22. QBHF
     0QFO$7ͷ࢖͍ํ΍ҖྗΛ஌ΔͨΊʹɺ(P
    $POGFSFODF
    'VLVPLB
    ͷϩΰΛ୊ࡐʹྠֲ੾Γൈ͖Λ΍ͬ ͯΈ·͠ΐ͏ʂϩΰ͔Βྠֲநग़͠ɺதऱͰϥʔϝϯΛָ͠Ή(PQIFS͘Μͷը૾Λ࡞Γ·͢ɻ Go + OpenCV (3) Ὂ Go + OpenCV (1) Ὂ
23. QBHF
     ίʔυྫ͸্هͷϦϙδτϦͷʮʯʹ͋Γ·͢ɻٕज़ॻయͷίʔυڞ༗༻ͷϦϙδτϦͰ͢ɻ Go + OpenCV (2) Ὂ
24. QBHF
     ํ਑ͱͯ͠͸ΩϟϥΫλʔΛ੾Γൈ ͍ͨϚεΫΛ࡞ͬͯ
    ESBX%SBX
    ϝ ιουͰETUʹॏͶΔɻ໰୊͸NBTL ͷ࡞੒ʂ͜͜Λ0QFO$7Ͱ࣮૷͢Δ Go + OpenCV (3) Ὂ
25. QBHF
     ྠֲͰϚεΫΛ࡞ΔͨΊʹ͸ɺάϨʔεέʔϧɺೋ஋Խɺྠֲநग़ɺྠֲͷ಺ଆͷϕλృΓ ͷεςοϓΛܦΔඞཁ͕͋Δ Go + OpenCV (4) Ὂ $WU$PMPS 5ISFTIPME 'JOE$POUPVST %SBX$POUPVST
26. QBHF
     HPDW5ISFTIPMEͰ͸ը૾ͷ஋ԽΛߦͳ͍ͬͯ ·͢ɻҾ਺ʹ౉͢ᮢ஋UISFTIʹΑͬͯͲͷըૉ஋ Λڥʹ஋Խ͢Δ͔ܾఆ͠·͢ Go + OpenCV (4) Ὂ 5ISFTIPME
27. QBHF
     HPDW'JOE$POUPVSTͰ͸ྠֲநग़Λߦͳ͍ͬͯ· ͢ɻҾ਺ͷNPEFͰྠֲநग़͢ΔϞʔυΛબͿ͜ͱ͕ Ͱ͖·͢ɻྠֲநग़ͷ݁ՌΛHPDW%SBX$POUPVST ʹ౉ͯ͠ྠֲͷதΛന৭ͰృΓͭͿ͠·͢ɻ Go + OpenCV (5) Ὂ 'JOE$POUPVST
    
    %SBX$POUPVST
28. QBHF
     (P$7ͷυΩϡϝϯτ΍ &YBNQMF͸ຆͲͳ͍ແ͍͕ɺ (P$7ͷؔ਺͸0QFO$7ͷؔ਺ ͱ΄ͱΜͲಉ͡ܗΛ౿ऻ͍ͯ͠ ΔͷͰɺ$΍1ZUIPOͷ࣮૷ྫͰ ΍Γ͍ͨ͜ͱΛ୳ͤ͹ɺ͍ͩͨ ͍(PͰ΋࣮૷Ͱ͖Δɻ
    (P
    
    0QFO$7
    ͷղઆগͳ͍͚ Ͳେৎ෉ͩΑʂʂ Go + OpenCV (6) Ὂ
29. QBHF
     How to test image processing \
30. QBHF
     (PͰը૾ॲཧΛॻ͘ͱςετ΋ॻ͖ͨ͘ͳ Δɻ͔͠͠ɺ(Pͷը૾ςετͷ஌ݟ͸΄ͱ ΜͲެ։͞Ε͍ͯͳ͍ɻ͜ͷηΫγϣϯͰ͸ ଞͷը૾ॲཧύοέʔδ͔ΒֶΜͩ
    (P
    
    ը ૾ॲཧͷςετख๏ʹ͍͓ͭͯ࿩͠͠·͢ɻ Test of image processing Ὂ
31. QBHF
     جຊతʹɺඪ४ύοέʔδ΋ؚΊ ༷ͨʑͳύοέʔδ͸3(#"Λϐ Ϋηϧ͝ͱݕ͍ࠪͯ͠Δ How to test image match (1) Ὂ
32. QBHF
     ۪௚ʹ3(#"ΛϐΫηϧ͝ͱݕࠪ͢Δͱ͕͔͔࣌ؒΔͷͰɺඪ४ύοέʔδͰ͸ॳΊʹϐΫ ηϧ͚ͩςετ͍ͯ͠Δςετ΋͋Δɻ How to test image match (2) Ὂ
33. QBHF
     BOUIPOZOTJNPOCJME
    ͷςετͰ͸ίετ Λ཈͑Δ޻෉͕ͳ͞Ε͍ͯΔɻετϥΠυͷ஋ ࣍ݩ഑ྻͷͲ͜·Ͱ͕ԣҰྻ෼͔ Λ࢖ͬͯ Ұ࣍ݩ഑ྻʹ௚ͰΞΫηε͍ͯ͠Δɻ http://neareal.net/index.php?ComputerGraphics%2FImageProcessing%2FTheStructureOfImageData How to test image match (3) Ὂ
34. QBHF
     JNBHF3(#"1JY
    ͸
    <>VJOU
    ͳͷͰ
    CZUFT&RVBM
    Ͱ΋͍͚Δɻ࣮ࡍʹ EJTJOUFHSBUJPOHJGU
    Ͱ͸ԼͷΑ͏ͳؔ਺ͰBTTFSU͍ͯ͠Δɻͨͩ͜Εͩ ͱɺͲ͜ͷϐΫηϧ͕ؒҧ͍ͬͯͨͷ͔ͷ৘ใ͕ࣦΘΕͯ͠·͏ɻ How to test image match (4) Ὂ
35. QBHF
     SFqFDU%FFQ&RVBM
    Ͱ΍ͬͯ͠·͏ͱ͍͏ख΋͋Δɻ࣮ࡍʹ
    HPMBOHJNBHF
    Ͱ͸
    SFqFDU%FFQ&RVBM
    Λ࢖ͬͯςετ͍ͯ͠Δ΋ͷ΋͋Δɻ͔͠͠ɺࣦഊ࣌ʹͦ΋ͦ΋ ըૉ͕ҧ͏ͷ͔ॎԣͷେ͖͕͞ҧ͏ͷ͔શ͘৘ใΛऔΕͳ͘ͳΔɻ How to test image match (5) Ὂ
36. QBHF
     #FODINBSL&R/PSNBM
    
    
    
    
    
    
    
    
    
    
    
    
    
    
    
    
    ୯७ʹϐΫηϧΛ̍ͭͮͭBTTFSU
    #FODINBSL&R8JUI4USJEF
    
    
    
    
    
    
    
    
    
    
    
    4USJEFͷ஋͔ΒҰ࣍ݩ഑ྻʹ௚ͰΞΫηεͯ͠BTTFSU
    #FODINBSL&R8JUI#ZUFT&RVBM
    
    
    
    CZUFT&RVBMΛ࢖ͬͨBTTFSU
    #FODINBSL&R8JUI3FqFDU
    
    
    
    
    
    
    
    
    
    SFqFDU%FFQ&RVBMΛ࢖ͬͨBTTFSU 5FTU
    JNBHF
    
    
    Y
    
    
    KQFH How to test image match (6) Ὂ
37. QBHF
     Αͬͯը૾ͷςετͰ͸ςετͷࣦഊ࣌ʹͲͷ͘Β͍ৄࡉʹ৘ ใ͕ཉ͍͔͠ʹΑͬͯը૾ςετख๏͕มΘͬͯ͘Δɻ
    ͱʹ͔͘εϐʔυॏࢹɺࣦഊ࣌ͷཧ༝͸͋Μ·Γؾʹ͠ͳ͍
    
    SFqFDU%FFQ&RVBM
    ΍
    CZUFT&RVBM
    ͱʹ͔͘ৄࡉʹࣦഊཧ༝Λ஌Γ͍ͨ
    
    4USJEFͷ஋Λ࢖ͬͨ࣍ݩ഑ྻ΁ͷΞΫηε How to test image match (7) Ὂ
38. QBHF
     جຊతͳը૾ॲཧͷςετʹ͓ ͍ͯ͸
    JNBHF3(#"
    ͷςετ έʔεΛ४උ͢Δͷ͕͋ͳ͕ͪ మ൘
    ͔͠͠0(1౳ͷੜ੒ςετʹ͓ ͍ͯ͸͜ͷΑ͏ͳܗͰςετ σʔλΛ༻ҙ͢Δͷ͸݁ߏ໘ ౗ɻɻ Test data (1) Ὂ
39. QBHF
     ը૾ॲཧͷੜ੒෺ͷςετ ʹ͓͍ͯ͸HPMEFOpMFΛ༻ҙ ͓ͯ͘͠ͱָɻͦͷࡍʹ͸ HPMEFOpMFΛੜ੒͢Δϑϥο άΛ༻ҙ͓ͯ͘͠ͱศརɻ
    ࣮ࡍʹ
    HPMBOHJNBHF
    ύοέʔδͰ͸͜ͷΑ͏ͳ ςετ͕࣮૷͞Ε͍ͯΔɻ Test data (2) Ὂ
40. QBHF
     ը૾ॲཧͷςετʹ͓͚ΔHPMEFOpMF͸1/(Ͱ͋Δ͜ͱ͕๬·ΕΔɻ+1&(ࣗମ͕ MPTTZ ৘ใ͕ܽམ͢Δ ͳඇՄٯ ݩʹ໭ͤͳ͍ ѹॖํࣜͳͷͰɺҰ౓JNBHF*NBHFΛ+1&( ʹม׵ͯ͠͠·͏ͱɺݩͷը૾ʹ෮ݩ͢Δ͜ͱ͸Ͱ͖ͳ͍ҝɺHPMEFOpMF
    UFTU
    ʹෆ޲͖ JNBHF*NBHF 1/( +1&( ෮ݩՄೳ ෮ݩෆՄ ॻ͖ग़͠ ॻ͖ग़͠ Test data (3) Ὂ
41. QBHF
     Image processing on WEB \
42. QBHF
     (PͰը૾ॲཧ͕Ͱ͖Δͱݴ͏͜ͱ ͸8FC"TTFNCMZͰ΋ը૾ॲཧ͕ ಈ࡞Մೳͱ͍͏͜ͱ
    ʂʂ Go + Image processing + WebAssembly (1) Ὂ
43. QBHF
     Go + Image processing + WebAssembly (2) Ὂ ࣗ࡞ͷ(Pը૾ॲཧύοέʔδ ը૾ʹ దͨ͠τϦϛϯάΛࣗಈͰܾఆ͢Δؙ ͵͖ύοέʔδ Ͱ͸ը૾ॲཧσϞͱ ͯ͠8FC"TTFNCMZͰ8FC্Ͱ͙͢ ʹࢼͤΔ༷ʹͯ͋͠Δɻ
44. QBHF
     Demo of smartcircle Ὂ ը૾ॲཧύοέʔδ͕ͲΜͳײ͡ʹಈ ͔͘ͷσϞΛ଎߈࡞ΕΔͷ΋(PͰը ૾ॲཧ͢ΔϝϦοτʂ
    ͨͩը૾αΠζ͕σΧΠͱগ͠ॲཧ࣌ ͕͔͔ؒΔɻɻ
45. QBHF
     How to Pass Image to Go (1) Ὂ एׯ೉͍͠ͷ͸+BWB4DSJQU͔Β(P΁ͷ ը૾ड͚౉͠ɻ͍ΖΜͳํ๏͕͋Δ͕ɺ ࠓճ͸VOTBGFύοέʔδΛ࢖ͬͯϙΠϯ λܦ༝Ͱը૾σʔλΛड͚౉͢ํ๏Λ঺ հ͠·͢ɻ
46. QBHF
     Ὂ ը૾഑ྻόοϑΝͷ௕͕͞౉͞Ε·͢ɻ CZUFTMFOHUI How to Pass Image to Go (2)
47. QBHF
     Ὂ ͦͷޙɺը૾σʔλΛೖΕΔثͱͯ͠ buffer slice Λը૾αΠζͰॳظԽ͠ɺͦͷϙΠϯλ Λ JavaScript ʹฦ͠·͢ɻ CZUFTMFOHUI VJOUQUS How to Pass Image to Go (3)
48. QBHF
     Ὂ JavaScript ଆͰGo͔Β౉͞ΕͨϙΠϯλͷઌʹը૾σʔλΛ٧ΊΕ͹ड͚౉͠׬ྃʂʂ CZUFTMFOHUI VJOUQUS How to Pass Image to Go (4)
49. QBHF
     Ὂ ޙ͸ϙΠϯλઌʹ͍Εͯ΋Βͬͨը૾σʔλΛσίʔυ͢Ε͹ޙ͸ͬͪ͜ͷ͓޷͖ͳը૾ ॲཧָ͕͠ΊΔʂʂ CZUFTMFOHUI VJOUQUS DBMM
    (P
    GVODUJPO How to Pass Image to Go (5)
50. QBHF
     Awesome Go Image Processing Package \
51. QBHF
     ࠷ޙʹڧ͍(Pը૾ॲཧύοέʔδ Λ঺հ͠·͢ɻ(PʹΑΔը૾ॲཧ ͷϙςϯγϟϧΛײ͡·͠ΐ͏ Awesome Go Image Processing Package Ὂ
52. QBHF
     Awesome Go Image Processing Package Ὂ TNBSUDSPQ͸ɺ೚ҙͷαΠζʹର͠ ͯద੾ͳը૾τϦϛϯάΛݟ͚ͭ· ͢ɻ
53. QBHF
     Awesome Go Image Processing Package Ὂ ͍ࣸͬͯΔ΋ͷΛҙࣝͨ͠ը૾αΠ ζมߋख๏
    4FBN
    $BSWJOH
    ʹجͮ ͍ͨը૾αΠζมߋύοέʔδ
54. QBHF
     Conclusion \
55. QBHF
     (Pͷඪ४ύοέʔδ͚ͩͰ΋৭Μͳը૾ॲཧ͕ ࣮૷Մೳɻ·ͨ0QFO$7ͱ࢖͏͜ͱͰɺը૾ॲཧ ͷ෯͸ແݶେʹ޿͕Δɻ·ͨɺ(PͰ࣮૷͢Δ͜ ͱͰ8BTNΛ࢖ͬͯ8FC্Ͱಈ͔ͤΔɻ
    (P
    
    ը૾ॲཧ͸ϙςϯγϟϧ͕͍͢͝ʂʂʂ
    (P
    Ͱը૾ॲཧͲΜͲΜ΍͍ͬͯ͜͏ʂʂʂ Conclusion Ὂ
56. Image processing with Go has great potential !! Otemachi.go July 13, 2019 @ po3rin