Upgrade to Pro — share decks privately, control downloads, hide ads and more …

長い機械学習／画像処理でも
メモリ不足を起こさないElixir新技術

Sponsored · SiteGround - Reliable hosting with speed, security, and support you can count on. →
Avatar for Susumu Yamazaki (ZACKY) Susumu Yamazaki (ZACKY)
June 28, 2022
Programming
340
0

 長い機械学習／画像処理でも
メモリ不足を起こさないElixir新技術

～ 膨大なデータが当たり前となる未来に必要なElixirとht_pipe ～

LiveView JP 2022年6月

Avatar for Susumu Yamazaki (ZACKY)

Susumu Yamazaki (ZACKY)

June 28, 2022

More Decks by Susumu Yamazaki (ZACKY)

See All by Susumu Yamazaki (ZACKY)
新規のC言語処理系を実装することによる
組込みシステム研究にもたらす価値
についての考察
Avatar for Susumu Yamazaki (ZACKY) zacky1972
1
580
Pelemay Backend: A memory-saving, fault-tolerant and distributed collection of Nx compilers and backends for embedded systems
Avatar for Susumu Yamazaki (ZACKY) zacky1972
2
280
ザキ研Elixir研究動向2023
Avatar for Susumu Yamazaki (ZACKY) zacky1972
0
450
Elixir/Nerves衛星を打ち上げる日
Avatar for Susumu Yamazaki (ZACKY) zacky1972
1
380
Robust, Distributed, and Parallel Processing for Enormous Images Using Supervisor, Node, Flow, Nx, and Evision
Avatar for Susumu Yamazaki (ZACKY) zacky1972
0
440
人工衛星高速画像処理で
社会問題を解決しよう
Avatar for Susumu Yamazaki (ZACKY) zacky1972
0
430
Future Possibilities and Effectiveness of JIT from Elixir Code of Image Processing and Machine Learning into Native Code with SIMD Instructions
Avatar for Susumu Yamazaki (ZACKY) zacky1972
0
400

世界は意外と近い!? 「遠くへ行くならみんなで行こう」 次は貴方が発表する番だ
Avatar for Susumu Yamazaki (ZACKY) zacky1972
0
130
スーパーコンピュータが組込みシステムに降りてくる！
〜新時代の高性能組込みシステムの
SIMD／ベクトル処理の要点を押さえる
Avatar for Susumu Yamazaki (ZACKY) zacky1972
0
400

Other Decks in Programming

See All in Programming
How I Won Prize Money at a Hackathon Using Codex and Symphony Alpha
Avatar for yasei no otoko yasei_no_otoko
0
130
AI Engineeringは、AIプロダクトだけのものか？ 〜AIがソフトウェアを作る時代の新しい当たり前〜 / No AI in your product. AI Engineering in your development.
Avatar for r-kagaya rkaga
5
550
VibeCodingからAgenticWorkflowへ
Avatar for starfish719 starfish719
0
960
仕様駆動開発へのトライを機に チームに適合する手法を模索し続けている話
Avatar for freee freee
PRO
0
670
TSX の <Hoge<Fuga>> という構文に驚いた話 / tsx-type-argument-syntax
Avatar for Kanaru kanaru0928
0
240
ハーネス設計入門 〜プロンプト、コンテキストの次〜
Avatar for kinopee kinopeee
44
28k
レビュー履歴をAIに食わせて、 Compose移行を加速するs
Avatar for Yuki Shiho shihochan
0
240
不幸な GC
Avatar for Chen chencmd
0
830
Jindong: Introducing Declarative Haptics in Compose Multiplatform
Avatar for HyunWoo Lee l2hyunwoo
0
130
Go 1.27 における memory allocation の高速化
Avatar for ANDPAD inc andpad
0
350
片田舎のおっさん、 Swift Buildのダイアモンド問題解決の不具合修正PRを出すが、解決方法がキャッシュをしないようにすることであり、ビルド時間が伸びると言われてマージされないので高速化もする/swiftbuild
Avatar for yimajo yimajo
0
320
AI時代に学ぶ 好きなルール 嫌いなルール Linter編
Avatar for Shota Nemoto shorty5121
0
230

Featured

See All Featured
Large-scale JavaScript Application Architecture
Avatar for Addy Osmani addyosmani
515
110k
16th Malabo Montpellier Forum Presentation
Avatar for AKADEMIYA2063 akademiya2063
PRO
0
360
Abbi's Birthday
Avatar for Violet Bock coloredviolet
3
9.6k
Leading Effective Engineering Teams in the AI Era
Avatar for Addy Osmani addyosmani
9
2.5k
How to Build an AI Search Optimization Roadmap - Criteria and Steps to Take #SEOIRL
Avatar for Aleyda Solis aleyda
1
2.2k
Design of three-dimensional binary manipulators for pick-and-place task avoiding obstacles (IECON2024)
Avatar for konakalab konakalab
0
560
Hiding What from Whom? A Critical Review of the History of Programming languages for Music
Avatar for Tomoya Matsuura tomoyanonymous
3
1.2k
How Software Deployment tools have changed in the past 20 years
Avatar for Geshan Manandhar geshan
1
34k
Navigating the moral maze — ethical principles for Al-driven product design
Avatar for Skipper Chong Warson skipperchong
2
500
How to train your dragon (web standard)
Avatar for Monica Dinculescu notwaldorf
97
6.8k
Claude Code どこまでも/ Claude Code Everywhere
Avatar for nwiizo nwiizo
67
57k
Embracing the Ebb and Flow
Avatar for Simon Collison colly
88
5.1k

Transcript

  1. ௕͍ػցֶशʗը૾ॲཧͰ΋ 
 ϝϞϦෆ଍Λى͜͞ͳ͍Elixir৽ٕज़ ʙ ๲େͳσʔλ͕౰ͨΓલͱͳΔະདྷʹඞཁͳElixirͱht_pipe ʙ ZACKY ͜ͱ ࢁ࡚ ਐ@๺۝भࢢཱେֶ

    1 ©︎ 2022 Susumu Yamazaki

  2. ։ൃಈػ 2 ©︎ 2022 Susumu Yamazaki

  3. ։ൃಈػ ਓ޻Ӵ੕ը૾(਺ສx਺ສpixel)Λevision(Elixir൛OpenCV)Ͱ 
 ॲཧ͠Α͏ͱͨ͠ΒɼVM͝ͱམͪͨ(T^T) 3 ©︎ 2022 Susumu Yamazaki

  4. ։ൃಈػ ਓ޻Ӵ੕ը૾(਺ສx਺ສpixel)Λevision(Elixir൛OpenCV)Ͱ 
 ॲཧ͠Α͏ͱͨ͠ΒɼVM͝ͱམͪͨ(T^T) → SuperVisorͰԿͱ͔ͳΒͳΜʁ 4 ©︎ 2022 Susumu

    Yamazaki

  5. ࣮ݧͯ͠Έͨ 5 ©︎ 2022 Susumu Yamazaki

  6. ࣮ݧͯ͠Έͨ 1. SuperVisorΛηοτΞοϓ 2. NIFΛηοτΞοϓ 
 3. NIFͰabortؔ਺Λݺͼग़͢Α͏ʹͯ͠VM͝ͱམͱ͢ 6 ©︎

    2022 Susumu Yamazaki

  7. ࣮ݧͯ͠Έͨ 1. SuperVisorΛηοτΞοϓ 2. NIFΛηοτΞοϓ 
 3. NIFͰabortؔ਺Λݺͼग़͢Α͏ʹͯ͠VM͝ͱམͱ͢ →SuperVisor͕͋ͬͯ΋VM͝ͱམͪͨ 7

    ©︎ 2022 Susumu Yamazaki

  8. ࢥҊ 8 ©︎ 2022 Susumu Yamazaki

  9. ࢥҊ 1. SuperVisor഑ԼͰࢠElixirϓϩηεΛىಈ͢Δ 2. NodeͰࢠElixirͱ௨৴͢ΔΑ͏ʹ͢Δ 
 3.ࢠElixirͰabortͤͨ͞ΒͲ͏ͳΔʁ 9 ©︎ 2022

    Susumu Yamazaki

  10. ΍ͬͯΈͨ 10 ©︎ 2022 Susumu Yamazaki

  11. ΍ͬͯΈͨ 1. SuperVisor഑ԼͰࢠElixirϓϩηεΛىಈ͢Δ 2. NodeͰࢠElixirͱ௨৴͢ΔΑ͏ʹ͢Δ 
 3.ࢠElixirͰabortͤͨ͞ΒͲ͏ͳΔʁ →ࠓ౓͸਌Elixir͕མͪΔ͜ͱ͸ͳ͔ͬͨʂ 11 ©︎

    2022 Susumu Yamazaki

  12. ࣮૷ͯ͠Έͨ 12 ©︎ 2022 Susumu Yamazaki

  13. ࣮૷ͯ͠Έͨ ίʔυΛઆ໌͠·͢ 13 ©︎ 2022 Susumu Yamazaki

  14. σϞϯετϨʔγϣϯ ͕࣌ؒ͋Ε͹ 14 ©︎ 2022 Susumu Yamazaki

  15. Ԡ༻ 15 ©︎ 2022 Susumu Yamazaki

  16. Ԡ༻ ௕͍ػցֶशʗը૾ॲཧͰ͸ɼϝϞϦෆ଍ͰམͪΔ͜ͱ͸ʮ͋Δ͋Δʯ →๲େͳσʔλΛॲཧ͢Δͱ͖ʹht_pipeΛ׆༻͢Δͱhappy 16 ©︎ 2022 Susumu Yamazaki

  17. ల๬ 17 ©︎ 2022 Susumu Yamazaki

  18. ల๬ ී௨ʹύΠϓϥΠϯͰϓϩάϥϛϯάΛͨ͠Β 
 ͍͍ײ͡Ͱॲཧͯ͘͠Εͳ͍͔ͳ →ϚΫϩͰϝλϓϩάϥϛϯά 18 ©︎ 2022 Susumu Yamazaki

  19. One more thing… 19 ©︎ 2022 Susumu Yamazaki

  20. ElixirConf US 2022 20 ©︎ 2022 Susumu Yamazaki

  21. Call for Speaker Presentation (CFP) 21 ©︎ 2022 Susumu Yamazaki

  22. ElixirConf US 2022ʹSubmit͠·ͨ͠! Robust, Distributed, and Parallel Processing 
 for

    Enormous Images 
 Using SuperVisor, Node, Flow, Nx, and evision Acceptفئ! 22 ©︎ 2022 Susumu Yamazaki