長い機械学習／画像処理でも メモリ不足を起こさないElixir新技術

～ 膨大なデータが当たり前となる未来に必要なElixirとht_pipe ～

LiveView JP 2022年6月

Transcript

1. ௕͍ػցֶशʗը૾ॲཧͰ΋ 
 ϝϞϦෆ଍Λى͜͞ͳ͍Elixir৽ٕज़ ʙ ๲େͳσʔλ͕౰ͨΓલͱͳΔະདྷʹඞཁͳElixirͱht_pipe ʙ ZACKY ͜ͱ ࢁ࡚ ਐ@๺۝भࢢཱେֶ 1 ©︎ 2022 Susumu Yamazaki
2. ։ൃಈػ 2 ©︎ 2022 Susumu Yamazaki
3. ։ൃಈػ ਓ޻Ӵ੕ը૾(਺ສx਺ສpixel)Λevision(Elixir൛OpenCV)Ͱ 
 ॲཧ͠Α͏ͱͨ͠ΒɼVM͝ͱམͪͨ(T^T) 3 ©︎ 2022 Susumu Yamazaki
4. ։ൃಈػ ਓ޻Ӵ੕ը૾(਺ສx਺ສpixel)Λevision(Elixir൛OpenCV)Ͱ 
 ॲཧ͠Α͏ͱͨ͠ΒɼVM͝ͱམͪͨ(T^T) → SuperVisorͰԿͱ͔ͳΒͳΜʁ 4 ©︎ 2022 Susumu Yamazaki
5. ࣮ݧͯ͠Έͨ 5 ©︎ 2022 Susumu Yamazaki
6. ࣮ݧͯ͠Έͨ 1. SuperVisorΛηοτΞοϓ 2. NIFΛηοτΞοϓ 
 3. NIFͰabortؔ਺Λݺͼग़͢Α͏ʹͯ͠VM͝ͱམͱ͢ 6 ©︎ 2022 Susumu Yamazaki
7. ࣮ݧͯ͠Έͨ 1. SuperVisorΛηοτΞοϓ 2. NIFΛηοτΞοϓ 
 3. NIFͰabortؔ਺Λݺͼग़͢Α͏ʹͯ͠VM͝ͱམͱ͢ →SuperVisor͕͋ͬͯ΋VM͝ͱམͪͨ 7 ©︎ 2022 Susumu Yamazaki
8. ࢥҊ 8 ©︎ 2022 Susumu Yamazaki
9. ࢥҊ 1. SuperVisor഑ԼͰࢠElixirϓϩηεΛىಈ͢Δ 2. NodeͰࢠElixirͱ௨৴͢ΔΑ͏ʹ͢Δ 
 3.ࢠElixirͰabortͤͨ͞ΒͲ͏ͳΔʁ 9 ©︎ 2022 Susumu Yamazaki
10. ΍ͬͯΈͨ 10 ©︎ 2022 Susumu Yamazaki
11. ΍ͬͯΈͨ 1. SuperVisor഑ԼͰࢠElixirϓϩηεΛىಈ͢Δ 2. NodeͰࢠElixirͱ௨৴͢ΔΑ͏ʹ͢Δ 
 3.ࢠElixirͰabortͤͨ͞ΒͲ͏ͳΔʁ →ࠓ౓͸਌Elixir͕མͪΔ͜ͱ͸ͳ͔ͬͨʂ 11 ©︎ 2022 Susumu Yamazaki
12. ࣮૷ͯ͠Έͨ 12 ©︎ 2022 Susumu Yamazaki
13. ࣮૷ͯ͠Έͨ ίʔυΛઆ໌͠·͢ 13 ©︎ 2022 Susumu Yamazaki
14. σϞϯετϨʔγϣϯ ͕࣌ؒ͋Ε͹ 14 ©︎ 2022 Susumu Yamazaki
15. Ԡ༻ 15 ©︎ 2022 Susumu Yamazaki
16. Ԡ༻ ௕͍ػցֶशʗը૾ॲཧͰ͸ɼϝϞϦෆ଍ͰམͪΔ͜ͱ͸ʮ͋Δ͋Δʯ →๲େͳσʔλΛॲཧ͢Δͱ͖ʹht_pipeΛ׆༻͢Δͱhappy 16 ©︎ 2022 Susumu Yamazaki
17. ల๬ 17 ©︎ 2022 Susumu Yamazaki
18. ల๬ ී௨ʹύΠϓϥΠϯͰϓϩάϥϛϯάΛͨ͠Β 
 ͍͍ײ͡Ͱॲཧͯ͘͠Εͳ͍͔ͳ →ϚΫϩͰϝλϓϩάϥϛϯά 18 ©︎ 2022 Susumu Yamazaki
19. One more thing… 19 ©︎ 2022 Susumu Yamazaki
20. ElixirConf US 2022 20 ©︎ 2022 Susumu Yamazaki
21. Call for Speaker Presentation (CFP) 21 ©︎ 2022 Susumu Yamazaki
22. ElixirConf US 2022ʹSubmit͠·ͨ͠! Robust, Distributed, and Parallel Processing 
 for Enormous Images 
 Using SuperVisor, Node, Flow, Nx, and evision Acceptفئ! 22 ©︎ 2022 Susumu Yamazaki