長い機械学習／画像処理でも メモリ不足を起こさないElixir新技術

Slide 1

Slide 1 text

௕͍ػցֶशʗը૾ॲཧͰ΋   ϝϞϦෆ଍Λى͜͞ͳ͍Elixir৽ٕज़ ʙ ๲େͳσʔλ͕౰ͨΓલͱͳΔະདྷʹඞཁͳElixirͱht_pipe ʙ ZACKY ͜ͱ ࢁ࡚ ਐ@๺۝भࢢཱେֶ 1 ©︎ 2022 Susumu Yamazaki

Slide 2

Slide 2 text

։ൃಈػ 2 ©︎ 2022 Susumu Yamazaki

Slide 3

Slide 3 text

։ൃಈػ ਓ޻Ӵ੕ը૾(਺ສx਺ສpixel)Λevision(Elixir൛OpenCV)Ͱ   ॲཧ͠Α͏ͱͨ͠ΒɼVM͝ͱམͪͨ(T^T) 3 ©︎ 2022 Susumu Yamazaki

Slide 4

Slide 4 text

։ൃಈػ ਓ޻Ӵ੕ը૾(਺ສx਺ສpixel)Λevision(Elixir൛OpenCV)Ͱ   ॲཧ͠Α͏ͱͨ͠ΒɼVM͝ͱམͪͨ(T^T) → SuperVisorͰԿͱ͔ͳΒͳΜʁ 4 ©︎ 2022 Susumu Yamazaki

Slide 5

Slide 5 text

࣮ݧͯ͠Έͨ 5 ©︎ 2022 Susumu Yamazaki

Slide 6

Slide 6 text

࣮ݧͯ͠Έͨ 1. SuperVisorΛηοτΞοϓ 2. NIFΛηοτΞοϓ   3. NIFͰabortؔ਺Λݺͼग़͢Α͏ʹͯ͠VM͝ͱམͱ͢ 6 ©︎ 2022 Susumu Yamazaki

Slide 7

Slide 7 text

࣮ݧͯ͠Έͨ 1. SuperVisorΛηοτΞοϓ 2. NIFΛηοτΞοϓ   3. NIFͰabortؔ਺Λݺͼग़͢Α͏ʹͯ͠VM͝ͱམͱ͢ →SuperVisor͕͋ͬͯ΋VM͝ͱམͪͨ 7 ©︎ 2022 Susumu Yamazaki

Slide 8

Slide 8 text

ࢥҊ 8 ©︎ 2022 Susumu Yamazaki

Slide 9

Slide 9 text

ࢥҊ 1. SuperVisor഑ԼͰࢠElixirϓϩηεΛىಈ͢Δ 2. NodeͰࢠElixirͱ௨৴͢ΔΑ͏ʹ͢Δ   3.ࢠElixirͰabortͤͨ͞ΒͲ͏ͳΔʁ 9 ©︎ 2022 Susumu Yamazaki

Slide 10

Slide 10 text

΍ͬͯΈͨ 10 ©︎ 2022 Susumu Yamazaki

Slide 11

Slide 11 text

΍ͬͯΈͨ 1. SuperVisor഑ԼͰࢠElixirϓϩηεΛىಈ͢Δ 2. NodeͰࢠElixirͱ௨৴͢ΔΑ͏ʹ͢Δ   3.ࢠElixirͰabortͤͨ͞ΒͲ͏ͳΔʁ →ࠓ౓͸਌Elixir͕མͪΔ͜ͱ͸ͳ͔ͬͨʂ 11 ©︎ 2022 Susumu Yamazaki

Slide 12

Slide 12 text

࣮૷ͯ͠Έͨ 12 ©︎ 2022 Susumu Yamazaki

Slide 13

Slide 13 text

࣮૷ͯ͠Έͨ ίʔυΛઆ໌͠·͢ 13 ©︎ 2022 Susumu Yamazaki

Slide 14

Slide 14 text

σϞϯετϨʔγϣϯ ͕࣌ؒ͋Ε͹ 14 ©︎ 2022 Susumu Yamazaki

Slide 15

Slide 15 text

Ԡ༻ 15 ©︎ 2022 Susumu Yamazaki

Slide 16

Slide 16 text

Slide 17

Slide 17 text

Slide 18

Slide 18 text

Slide 19

Slide 19 text

Slide 20

Slide 20 text

Slide 21

Slide 21 text

Slide 22

Slide 22 text

ElixirConf US 2022ʹSubmit͠·ͨ͠! Robust, Distributed, and Parallel Processing   for Enormous Images   Using SuperVisor, Node, Flow, Nx, and evision Acceptفئ! 22 ©︎ 2022 Susumu Yamazaki