Upgrade to Pro — share decks privately, control downloads, hide ads and more …
Sign up for free

長い機械学習／画像処理でも
メモリ不足を起こさないElixir新技術

Sponsored · Ship Features Fearlessly Turn features on and off without deploys. Used by thousands of Ruby developers. →
Avatar for Susumu Yamazaki (ZACKY) Susumu Yamazaki (ZACKY)
June 28, 2022
Programming
340
0

 長い機械学習／画像処理でも
メモリ不足を起こさないElixir新技術

～ 膨大なデータが当たり前となる未来に必要なElixirとht_pipe ～

LiveView JP 2022年6月

Avatar for Susumu Yamazaki (ZACKY)

Susumu Yamazaki (ZACKY)

June 28, 2022

More Decks by Susumu Yamazaki (ZACKY)

See All by Susumu Yamazaki (ZACKY)
新規のC言語処理系を実装することによる
組込みシステム研究にもたらす価値
についての考察
Avatar for Susumu Yamazaki (ZACKY) zacky1972
1
590
Pelemay Backend: A memory-saving, fault-tolerant and distributed collection of Nx compilers and backends for embedded systems
Avatar for Susumu Yamazaki (ZACKY) zacky1972
2
290
ザキ研Elixir研究動向2023
Avatar for Susumu Yamazaki (ZACKY) zacky1972
0
450
Elixir/Nerves衛星を打ち上げる日
Avatar for Susumu Yamazaki (ZACKY) zacky1972
1
380
Robust, Distributed, and Parallel Processing for Enormous Images Using Supervisor, Node, Flow, Nx, and Evision
Avatar for Susumu Yamazaki (ZACKY) zacky1972
0
450
人工衛星高速画像処理で
社会問題を解決しよう
Avatar for Susumu Yamazaki (ZACKY) zacky1972
0
430
Future Possibilities and Effectiveness of JIT from Elixir Code of Image Processing and Machine Learning into Native Code with SIMD Instructions
Avatar for Susumu Yamazaki (ZACKY) zacky1972
0
410

世界は意外と近い!? 「遠くへ行くならみんなで行こう」 次は貴方が発表する番だ
Avatar for Susumu Yamazaki (ZACKY) zacky1972
0
140
スーパーコンピュータが組込みシステムに降りてくる！
〜新時代の高性能組込みシステムの
SIMD／ベクトル処理の要点を押さえる
Avatar for Susumu Yamazaki (ZACKY) zacky1972
0
410

Other Decks in Programming

See All in Programming
Next.js: The final boss of Web Performance
Avatar for Estela Franco guaca
0
280
re:Inventに行く前に知っておきたい現地参加のノウハウ
Avatar for nokomoro3 nokomoro3
0
440
外から家のPCの電源入れたい！をＰＨＰで解決する
Avatar for かわしも（Shimokawa Shion） kawashimo0
1
140
Domain-Driven Transformation
Avatar for Henning Schwentner hschwentner
2
2.3k
Everything will be SERVERLESS — 信じて運用した10年の経験値 / Everything Will be Serverless — Lessons Learned from 10 Years of Operational Experience
Avatar for shiro seike seike460
PRO
1
1.1k
[ハンズオン]AIへの指示だけで「五目並べ」を作ってみよう
Avatar for Satoshi Kaneyasu satoshi256kbyte
1
380
パズルゲームの作り方 / how to make puzzle games
Avatar for kaityo256 kaityo256
PRO
2
300
npm との違いを手がかりにGo の依存管理を理解したい
Avatar for OPTiM optim
0
820
最近”作らせてる” ローカルAIアプリの話
Avatar for ITO Akihiro akit37
0
480
Agentic Software Factoryに、すごく賢いIF文を。 / super smart IF statement into the Agentic Software Factory.
Avatar for r-kagaya rkaga
8
2.3k
Simple Storage Service(S3) is not simple
Avatar for Yura Iwatsuka iwatsukayura
0
290
Performance Optimization With LLMs
Avatar for xLeitix xleitix
0
150

Featured

See All Featured
Building a Modern Day 
E-commerce SEO Strategy
Avatar for Aleyda Solis aleyda
45
9.3k
Game over? The fight for quality and originality in the time of robots
Avatar for Wayne Barker wayneb77
1
310
How to build a perfect <img>
Avatar for Jono Alderson jonoalderson
1
6.1k
Fantastic passwords and where to find them - at NoRuKo
Avatar for Phil Nash philnash
53
4k
What’s in a name? Adding method to the madness
Avatar for The Alliance productmarketing
PRO
24
4.2k
Why Mistakes Are the Best Teachers: Turning Failure into a Pathway for Growth
Avatar for Umar Saidu Auna auna
0
330
Lightning talk: Run Django tests with GitHub Actions
Avatar for Sarah Abderemane sabderemane
0
300
Automating Front-end Workflow
Avatar for Addy Osmani addyosmani
1369
210k
Designing for humans not robots
Avatar for Tammie Lister tammielis
254
26k
Dominate Local Search Results - an insider guide to GBP, reviews, and Local SEO
Avatar for Greg Gifford greggifford
PRO
0
370
Measuring Dark Social's Impact On Conversion and Attribution
Avatar for Stephen Akadiri stephenakadiri
2
310
Typedesign – Prime Four
Avatar for Hannes Fritz hannesfritz
42
3.2k

Transcript

  1. ௕͍ػցֶशʗը૾ॲཧͰ΋ 
 ϝϞϦෆ଍Λى͜͞ͳ͍Elixir৽ٕज़ ʙ ๲େͳσʔλ͕౰ͨΓલͱͳΔະདྷʹඞཁͳElixirͱht_pipe ʙ ZACKY ͜ͱ ࢁ࡚ ਐ@๺۝भࢢཱେֶ

    1 ©︎ 2022 Susumu Yamazaki

  2. ։ൃಈػ 2 ©︎ 2022 Susumu Yamazaki

  3. ։ൃಈػ ਓ޻Ӵ੕ը૾(਺ສx਺ສpixel)Λevision(Elixir൛OpenCV)Ͱ 
 ॲཧ͠Α͏ͱͨ͠ΒɼVM͝ͱམͪͨ(T^T) 3 ©︎ 2022 Susumu Yamazaki

  4. ։ൃಈػ ਓ޻Ӵ੕ը૾(਺ສx਺ສpixel)Λevision(Elixir൛OpenCV)Ͱ 
 ॲཧ͠Α͏ͱͨ͠ΒɼVM͝ͱམͪͨ(T^T) → SuperVisorͰԿͱ͔ͳΒͳΜʁ 4 ©︎ 2022 Susumu

    Yamazaki

  5. ࣮ݧͯ͠Έͨ 5 ©︎ 2022 Susumu Yamazaki

  6. ࣮ݧͯ͠Έͨ 1. SuperVisorΛηοτΞοϓ 2. NIFΛηοτΞοϓ 
 3. NIFͰabortؔ਺Λݺͼग़͢Α͏ʹͯ͠VM͝ͱམͱ͢ 6 ©︎

    2022 Susumu Yamazaki

  7. ࣮ݧͯ͠Έͨ 1. SuperVisorΛηοτΞοϓ 2. NIFΛηοτΞοϓ 
 3. NIFͰabortؔ਺Λݺͼग़͢Α͏ʹͯ͠VM͝ͱམͱ͢ →SuperVisor͕͋ͬͯ΋VM͝ͱམͪͨ 7

    ©︎ 2022 Susumu Yamazaki

  8. ࢥҊ 8 ©︎ 2022 Susumu Yamazaki

  9. ࢥҊ 1. SuperVisor഑ԼͰࢠElixirϓϩηεΛىಈ͢Δ 2. NodeͰࢠElixirͱ௨৴͢ΔΑ͏ʹ͢Δ 
 3.ࢠElixirͰabortͤͨ͞ΒͲ͏ͳΔʁ 9 ©︎ 2022

    Susumu Yamazaki

  10. ΍ͬͯΈͨ 10 ©︎ 2022 Susumu Yamazaki

  11. ΍ͬͯΈͨ 1. SuperVisor഑ԼͰࢠElixirϓϩηεΛىಈ͢Δ 2. NodeͰࢠElixirͱ௨৴͢ΔΑ͏ʹ͢Δ 
 3.ࢠElixirͰabortͤͨ͞ΒͲ͏ͳΔʁ →ࠓ౓͸਌Elixir͕མͪΔ͜ͱ͸ͳ͔ͬͨʂ 11 ©︎

    2022 Susumu Yamazaki

  12. ࣮૷ͯ͠Έͨ 12 ©︎ 2022 Susumu Yamazaki

  13. ࣮૷ͯ͠Έͨ ίʔυΛઆ໌͠·͢ 13 ©︎ 2022 Susumu Yamazaki

  14. σϞϯετϨʔγϣϯ ͕࣌ؒ͋Ε͹ 14 ©︎ 2022 Susumu Yamazaki

  15. Ԡ༻ 15 ©︎ 2022 Susumu Yamazaki

  16. Ԡ༻ ௕͍ػցֶशʗը૾ॲཧͰ͸ɼϝϞϦෆ଍ͰམͪΔ͜ͱ͸ʮ͋Δ͋Δʯ →๲େͳσʔλΛॲཧ͢Δͱ͖ʹht_pipeΛ׆༻͢Δͱhappy 16 ©︎ 2022 Susumu Yamazaki

  17. ల๬ 17 ©︎ 2022 Susumu Yamazaki

  18. ల๬ ී௨ʹύΠϓϥΠϯͰϓϩάϥϛϯάΛͨ͠Β 
 ͍͍ײ͡Ͱॲཧͯ͘͠Εͳ͍͔ͳ →ϚΫϩͰϝλϓϩάϥϛϯά 18 ©︎ 2022 Susumu Yamazaki

  19. One more thing… 19 ©︎ 2022 Susumu Yamazaki

  20. ElixirConf US 2022 20 ©︎ 2022 Susumu Yamazaki

  21. Call for Speaker Presentation (CFP) 21 ©︎ 2022 Susumu Yamazaki

  22. ElixirConf US 2022ʹSubmit͠·ͨ͠! Robust, Distributed, and Parallel Processing 
 for

    Enormous Images 
 Using SuperVisor, Node, Flow, Nx, and evision Acceptفئ! 22 ©︎ 2022 Susumu Yamazaki