Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Continuous Simplicial Neural Networks

Sponsored · Your Podcast. Everywhere. Effortlessly. Share. Educate. Inspire. Entertain. You do you. We'll handle the rest. →
Avatar for horiem horiem
June 29, 2025
750
1

Continuous Simplicial Neural Networks

第 2 回 Spatial AI 勉強会

Avatar for horiem

horiem

June 29, 2025

More Decks by horiem

See All by horiem
局所保存性・相似変換対称性を満たす機械学習モデルによる数値流体力学
Avatar for horiem yellowshippo
1
450
ICML 読み会: Graph Neural PDE Solvers with Conservation and Similarity-Equivariance
Avatar for horiem yellowshippo
1
620
物理シミュレーションと数理最適化の知見を導入した機械学習手法
Avatar for horiem yellowshippo
1
1.8k
対称性のある機械学習による物理現象の解析
Avatar for horiem yellowshippo
5
3.3k
Physics-Embedded Neural Networks: Graph Neural PDE Solvers with Mixed Boundary Conditions
Avatar for horiem yellowshippo
1
830
物理現象の性質を反映させたグラフニューラルネットワークによる偏微分方程式の学習
Avatar for horiem yellowshippo
2
1.3k
物理シミュレーションの機械学習
に関する近年の動向と研究紹介
Avatar for horiem yellowshippo
4
16k
有限要素法を機械学習したい！
Avatar for horiem yellowshippo
0
3.9k
Julia と微分方程式でメシを食う
Avatar for horiem yellowshippo
1
3.1k

Featured

See All Featured
The Spectacular Lies of Maps
Avatar for Per Axbom axbom
PRO
1
800
HDC tutorial
Avatar for Michiel Stock michielstock
2
700
The AI Revolution Will Not Be Monopolized: How open-source beats economies of scale, even for LLMs
Avatar for Ines Montani inesmontani
PRO
3
3.5k
The Art of Delivering Value - GDevCon NA Keynote
Avatar for David Neal reverentgeek
16
2k
Jamie Indigo - Trashchat’s Guide to Black Boxes: Technical SEO Tactics for LLMs
Avatar for Tech SEO Connect techseoconnect
PRO
0
160
Crafting Experiences
Avatar for Bethany Jepchumba bethany
1
180
Highjacked: Video Game Concept Design
Avatar for Ryan Kendrick rkendrick25
PRO
1
390
The Cult of Friendly URLs
Avatar for Andy Hume andyhume
79
6.9k
Rails Girls Zürich Keynote
Avatar for Gregor Martynus gr2m
96
14k
Bootstrapping a Software Product
Avatar for Garrett Dimon garrettdimon
PRO
307
120k
A Soul's Torment
Avatar for Nat Ma seathinner
6
2.9k
Large-scale JavaScript Application Architecture
Avatar for Addy Osmani addyosmani
515
110k

Transcript

  1. $POUJOVPVT4JNQMJDJBM/FVSBM/FUXPSLT "SFG&JOJ[BEF %PSJOB5IBOPV 'SBHLJTLPT%.BMMJBSPT +IPOZ)(JSBMEP BS9JW ୈճ4QBUJBM"*ษڧձ ೥݄೔ ൃදऀງߐਖ਼৴ 3*$04

  2.  ࣗݾ঺հ • ໊લງߐਖ਼৴ • ॴଐגࣜձࣾ3*$04ɺཧݚ"*1 ٬һݚڀһ  • ઐ໳

    - ෺ཧγϛϡϨʔγϣϯ ภඍ෼ํఔࣜ ͷ ͨΊͷػցֶश - ܈ಉมχϡʔϥϧωοτϫʔΫ - άϥϑχϡʔϥϧωοτϫʔΫ (//  • ͓΋ͳ࿦จ - Horie+ ICML 2024 อଘଇΛݫີʹຬͨ͢(//  - Horie+ NeurIPS 2022 ڥք৚݅Λݫີʹຬͨ͢ (//ɺHMPCBMQPPMJOHͱγϛϡϨʔγϣϯख๏ͱͷ ؔ࿈ͷղ໌  - Horie+ ICLR 2021 ߹ಉม׵ରশੑΛݫີʹຬͨ͠ߴ ଎ͳ(//  .11%& [Brandstetter+ 2022] ఏҊख๏ [Horie & Mitsume 2024] 5FTU 5FTUΛ ճస ྖҬͷ ֎ૠ 5FTUΛ ֦େ ྲྀ଎ ࢀরղ ࢀরղ ఏҊख๏

  3.  ·ͱΊ • ୯ମෳମ ܗঢ়ͷτϙϩδʔΛ཭ࢄతʹද͢σʔλߏ଄ ʹର͢Δ৞ΈࠐΈԋࢉΛ ඍ෼ํఔࣜͷ஌ݟΛ΋ͱʹ࿈ଓԽͨ͠ $04*.0 DPOUJOVPVTTJNQMJDJBMOFVSBMOFUXPSL ΛఏҊ

    • ࣮໰୊Ͱͷ࣮ݧʹ͓͍ͯ4PU"΋͘͠͸ͦΕʹ͍ۙੑೳ • $04*.0ʹ͓͍ͯܗঢ়ͷϊΠζʹର͢Δޡࠩͷ্քΛಋग़͠ɺ࣮ݧతʹ΋֬ೝ • $04*.0͸PWFSTNPPUIJOH (//ʹΑΔܗঢ়ೝࣝͰ໰୊ͱͳΓ΍͍͢৘ใͷࢄҳ ͷ ఔ౓Λ੍ޚͰ͖Δ͜ͱΛূ໌͠ɺ࣮ݧతʹ΋֬ೝ  ୯ମෳମͷྫ[Einizade+ 20025]

  4.  ໨࣍  • Ϟνϕʔγϣϯ • ४උ • %JTDSFUF4JNQMJDJBM// •

    $04*.0 • ਺஋࣮ݧ • ·ͱΊ

  5.  ໨࣍ • Ϟνϕʔγϣϯ • ४උ • %JTDSFUF4JNQMJDJBM// • $04*.0

    • ਺஋࣮ݧ • ·ͱΊ 

  6.  Ϟνϕʔγϣϯ • ࣍ݩܗঢ়Λޮ཰తʹදݱ͢Δʹ͸ϝογϡ·ͨ͸ ͦͷऔΓѻ͍΍͍͢ϞσϧͰ͋Δ୯ମෳମ͕༗༻ • ࣍ݩܗঢ়ͷػցֶशʹ(//͕༻͍ΒΕ͖͕ͯͨ (//͸άϥϑͷ௖఺Ͳ͏͠ͷ૬ޓ࡞༻ͷΈΛ ߟྀ͓ͯ͠ΓΑΓߴ࣍ͷ૬ޓ࡞༻͕ݟಀ͞Ε͕ͪ -

    ࡾ֯ܗͷ໘ੵΛٻΊΔૢ࡞͸ ʮ఺ͷಛ௃ྔˠ໘ͷಛ௃ྔʯ ͷࣸ૾͕ͩ(//ͰͦͷΑ͏ͳૢ࡞͸ඇࣗ໌ • ୯ମෳମΛऔΓѻ͑Δ//΋ग़͖͍ͯͯΔ͕ (//ͷ՝୊Ͱ͋ΔPWFSTNPPUIJOH΍ ܗঢ়ͷϊΠζʹର͢Δݎ࿚ੑ͸ґવͱͯ͠՝୊ ➡ ৞ΈࠐΈԋࢉΛ࿈ଓԽ͠ਫ਼៛Խ͢Δ͜ͱͰ ͜ΕΒͷ՝୊ΛղܾͰ͖ͳ͍͔ʁ  ϝογϡͷྫ ୯ମෳମͷྫ [Einizade+ 20025]

  7.  ໨࣍ • Ϟνϕʔγϣϯ • ४උ • %JTDSFUF4JNQMJDJBM// • $04*.0

    • ਺஋࣮ݧ • ·ͱΊ 

  8.  ໨࣍ • Ϟνϕʔγϣϯ • ४උ • %JTDSFUF4JNQMJDJBM// • $04*.0

    • ਺஋࣮ݧ • ·ͱΊ 

  9.  ४උ୯ମෳମ ఆٛ ୯ମෳମTJNQMJDJBMDPNQMFY  ۭͰͳ͍༗ݶू߹ ʹର͠ɺ ͰҎԼͷ৚݅Λຬͨ͢΋ͷΛ ୯ମෳମ TJNQMJDJBMDPNQMFY

    ͱ͍͏ • ͷ֤ݩ ʹରͯ͠ɺ  • ੍ݶʹ͍ͭͯด͍ͯ͡Δɺ͢ͳΘͪ 𝒱 ( 𝒱 , 𝒳 ⊂ 2 𝒱 ∖{∅}) 𝒱 v {v} ∈ 𝒳  ఆٛ ୯ମTJNQMFY  ୯ମෳମ ʹରͯ͠ɺ Λ୯ମ TJNQMFY ͱ͍͍ɺ ͷͱ͖ɺಛʹL୯ମ LTJNQMFY ͱ͍͏ɻ ( 𝒱 , 𝒳 ) sk ∈ 𝒳 |sk | = k + 1 ୯ମ ୯ମ ୯ମ ୯ମ

  10.  ४උ઀ଓߦྻ  ఆٛ ઀ଓߦྻTJNQMFY  ୯ମෳମ ʹରͯ͠ɺL୯ମͷΈΛूΊͨ΋ͷΛ ͱॻ͘ɻߦྻ 

    ͷ ੒෼ʹ͍ͭͯɺJ൪໨ͷ L ୯ମ͕K൪໨ͷL୯ମͷ໘ʹͳ͓ͬͯΓɺ޲͖͕ἧ͍ͬͯ Δ L୯ମͷۮஔ׵Λͯ͠ઌ಄ L ྻΛൈ͖ग़ͯ͠ L ୯ମͱҰக͢Δ ͱ͖ɺٯ޲͖ͷͱ ͖ɺͦΕҎ֎ͷͱ͖ΛׂΓ౰ͯͨ΋ͷΛ઀ଓߦྻͱ͍͏ɻ ( 𝒱 , 𝒳 ) 𝒳 k Bk ∈ {−1,0,1}| 𝒳 k−1 |×| 𝒳 k | (i, j) ఆٛ ୯ମͷ޲͖  ͷݩʹॱংΛఆΊ͓ͯ͘ɻL୯ମ ΛλϓϧͱΈͳͨ͠΋ͷ  ʹରͯ͠ɺۮஔ ׵ͰঢॱʹͰ͖Δͱ͖ɺͦ͏Ͱͳ͍ͱ͖ΛׂΓ౰ͯͨ΋ͷΛ୯ମͷ޲͖ͱ͍͏ɻ 𝒱 s = (v0 , v1 , …, vk ) ఆٛ )PEHF-BQMBDJBO  Λ)PEHF-BQMBDJBOͱݺͼɺୈҰ߲ΛMPXFS-BQMBDJBO ɺୈೋ߲ΛVQQFS -BQMBDJBO ͱݺͿɻಛʹ ͸άϥϑϥϓϥγΞϯͰ͋Δɻ Lk = B⊤ k Bk + Bk+1 B⊤ k+1 Lk,d Lk,u L0 = B1 B⊤ 1

  11.  ४උ઀ଓߦྻ ۩ମྫ       

                                   

  12.  ४උ୯ମ৴߸  ఆٛ ୯ମ৴߸TJNQMJDJBMTJHOBM  Λ ࣍ݩ L୯ମ৴߸ LTJNQMJDJBM

    TJHOBM ͱݺͼɺ ͱಉҰࢹ͢Δɻ xk : 𝒳 k → ℝ xk ∈ ℝ| 𝒳 k | ஫ҙ ͸ޯ഑ɺ ͸ൃࢄɺ ͸ϥϓϥγΞϯ ʹରԠ͍ͯ͠Δɻ B⊤ 1 x0 B1 x1 L0 x0 ఆٛ %JSJDIMFUΤωϧΪʔ  Λ%JSJDIMFU ΤωϧΪʔͱݺͿɻ%JSJDIMFUΤωϧΪʔ͕খ͍͞ ΄Ͳɺ৔͕ۉҰͱͳ͍ͬͯΔɻ E(xk ) = x⊤ k Lk xk = ∥Bk xk ∥2 2 + ∥B⊤ k+1 xk ∥2 2

  13.  ໨࣍ • Ϟνϕʔγϣϯ • ४උ • %JTDSFUF4JNQMJDJBM// • $04*.0

    • ਺஋࣮ݧ • ·ͱΊ 

  14.  ໨࣍ • Ϟνϕʔγϣϯ • ४උ • %JTDSFUF4JNQMJDJBM// • $04*.0

    • ਺஋࣮ݧ • ·ͱΊ 

  15.  %JTDSFUF4JNQMJDJBM//4JNQMJDJBM'JMUFS • 4JNQMJDJBMGJMUFS ͸ҎԼͷΑ͏ʹॻ͚Δ ЋɺЌ͸ύϥϝʔλ  • )PEHF-BQMBDJBOͷ΂͖৐ͷॏͶ߹ΘͤͰؔ਺Λදݱ DG,SZMPW෦෼ۭؒ๏

     • )PEHF-BQMBDJBOΛLճ͔͚Δͱ Lϗοϓઌ·Ͱͷ৘ใΛऔΓࠐΊΔ - L ϗοϓҎ্ͷ৘ใ͸ݟ͑ͳ͍ VOEFSSFBDIJOH  - )PEHF-BQMBDJBOΛॏͶΔ΄Ͳ ৘ใ͕֦ࢄ͍͖ࣦͯ͠ΘΕͯ͠·͏ PWFSTNPPUIJOH f : ℝ| 𝒳 k | → ℝ| 𝒳 k |  l = 0 l = 1 l = 2

  16.  %JTDSFUF4JNQMJDJBM//࣍ݩͷ৔߹ • %JTDSFUF4JNQMJDJBM//ͷϨΠϠ ͔Β ΁Ϛοϐϯά ͸ɺ ߴ࣍ݩ΁ͷϓϩδΣΫγϣϯ ͱ௿࣍ݩ΁ͷϓϩδΣΫγϣϯ Λ༻͍ͯҎԼͷΑ͏ʹॻ͚Δ[Isufi+

    2022] (l − 1) l xl k,d = BT k xl k−1 xl k,u = Bk+1 xl k+1 

  17.  %JTDSFUF4JNQMJDJBM//ଟ࣍ݩͷ৔߹ • ߴ࣍ݩͷTJNQMJDJBMTJHOBMΛ ͱͯ͠ɺ%JTDSFUF4JNQMJDJBM//ͷϨΠϠ ͔Β ΁Ϛοϐϯά ͸ ҎԼͷΑ͏ʹॻ͚Δ[Isufi+ 2022]

    (l − 1) l 

  18.  ໨࣍ • Ϟνϕʔγϣϯ • ४උ • %JTDSFUF4JNQMJDJBM// • $04*.0

    • ਺஋࣮ݧ • ·ͱΊ 

  19.  ໨࣍ • Ϟνϕʔγϣϯ • ४උ • %JTDSFUF4JNQMJDJBM// • $04*.0

    • ਺஋࣮ݧ • ·ͱΊ 

  20.  $04*.0ภඍ෼ํఔࣜʹΑΔߟ࡯ • %JTDSFUF4JNQMJDJBM//Λ૚ํ޲ʹ࿈ଓԽ͠ภඍ෼ํఔࣜΛಘΔ DG/FVSBM0%&  • ఆ਺܎਺࣌ؒൃలํఔࣜͷղ͸ߦྻࢦ਺ؔ਺Ͱهड़Ͱ͖Δ

  21.  $04*.0ภඍ෼ํఔࣜʹΑΔߟ࡯  • ఆ਺܎਺࣌ؒൃలํఔࣜͷղ͸ߦྻࢦ਺ؔ਺Ͱهड़Ͱ͖Δ • ͨͩ͠ɺߦྻࢦ਺ؔ਺͸ҎԼͷΑ͏ʹఆٛ͞ΕΔ

  22.  $04*.0ϞσϧͷఆࣜԽ  • ఆ਺܎਺࣌ؒൃలํఔࣜͷղ͸ߦྻࢦ਺ؔ਺Ͱهड़Ͱ͖Δ • Ҏ্ΑΓɺ$04*.0ͷϨΠϠʔΛҎԼͷΑ͏ʹߏ੒͢Δ - ࣮ࡍʹ͸ɺߦྻࢦ਺ؔ਺Λ௿ϥϯΫۙࣅͯ͠ܭࢉ͢Δ

  23.  $04*.0ܗঢ়ͷϊΠζʹର͢Δݎ࿚ੑ • ઀ଓߦྻʹઁಈΛ༩͑ͨͱ͖ͷ༧ଌ݁ՌͷͣΕ ͷ্ք͕ಘΒΕ͍ͯΔ δXk  • ઁಈ͕े෼খ͍͞ͱ͖ɺ༧ଌ݁ՌͷͣΕ͸ઁಈʹରͯ͠ઢܗʹൺྫ

  24.  $04*.00WFS4NPPUIJOHʹର͢Δߟ࡯ ཭ࢄͷ৔߹ • %JTDSFUF4JNQMJDJBM//ͷ৔߹͸%JSJDIMFUΤωϧΪʔͷ্ք͕ )PEHF-BQMBDJBOͷݻ༗஋ͷଟ߲ࣜͱͳΔ - ೚ҙͷॏΈʹରͯ͠PWFSTNPPUIJOHΛ཈੍͢ΔͨΊʹ͸)PEHF-BQMBDJBO ͷݻ༗஋Λେ͖ͤ͘Ͷ͹ͳΒͣɺ୯ମෳମΛमਖ਼͠ͳ͚Ε͹ͳΒͳ͍ 

  25.  $04*.00WFS4NPPUIJOHʹର͢Δߟ࡯ ࿈ଓͷ৔߹ • ࿈ଓͷ৔߹͸%JSJDIMFUΤωϧΪʔͷ্քΛθϩʹऩଋ͠ͳ͍Α͏ʹ ͢Δ͜ͱ͕Մೳ 1SPQ 

  26.  ໨࣍ • Ϟνϕʔγϣϯ • ४උ • %JTDSFUF4JNQMJDJBM// • $04*.0

    • ਺஋࣮ݧ • ·ͱΊ 

  27.  ໨࣍ • Ϟνϕʔγϣϯ • ४උ • %JTDSFUF4JNQMJDJBM// • $04*.0

    • ਺஋࣮ݧ • ·ͱΊ 

  28.  ਺஋࣮ݧ࣮໰୊Ͱͷݕূ • ͞·͟·ͳ࣮໰୊Ͱ4PU"΋͘͠͸ͦΕʹ४͡ΔੑೳΛ࣮ݱ  [Einizade+ 20025]

  29.  ਺஋࣮ݧܗঢ়ͷϊΠζʹର͢Δݎ࿚ੑ • ୯ମෳମ΁ͷϊΠζ 4/3@ ͱ୯ମෳମ΁ͷϊΠζ 4/3@ Λ ͞·͟·ʹมԽͤ͞ਫ਼౓ΛධՁ -

    ͞·͟·ͳ࣍ݩͷ৘ใΛෳ߹ͤͯ͞࢖༻͍ͯ͠ΔͨΊɺ 4/3@࠷খ/43@࠷େ·ͨ͸4/3@࠷େ/43@࠷খͷͱ͖ʹੑೳͷྼԽ͕গͳ͍  [Einizade+ 20025]

  30.  ਺஋࣮ݧ0WFS4NPPUIJOHͷ੍ޚ • U ࢦ਺ؔ਺ͷݞʹͷ͍ͬͯΔύϥϝʔλ Λখ͘͢͞Δ ʙ ͜ͱʹΑͬͯ EJTDSFUFTJNQMJDJBM//ΑΓ΋PWFSTNPPUIJOHΛ཈੍͢Δ͜ͱ͕Մೳ 

    [Einizade+ 20025]

  31.  ໨࣍ • Ϟνϕʔγϣϯ • ४උ • %JTDSFUF4JNQMJDJBM// • $04*.0

    • ਺஋࣮ݧ • ·ͱΊ 

  32.  ໨࣍ • Ϟνϕʔγϣϯ • ४උ • %JTDSFUF4JNQMJDJBM// • $04*.0

    • ਺஋࣮ݧ • ·ͱΊ 

  33.  ·ͱΊ • ୯ମෳମ ܗঢ়ͷτϙϩδʔΛ཭ࢄతʹද͢σʔλߏ଄ ʹର͢Δ৞ΈࠐΈԋࢉ Λ࿈ଓԽͨ͠$04*.0 DPOUJOVPVTTJNQMJDJBMOFVSBMOFUXPSL ΛఏҊ •

    ࣮໰୊Ͱͷ࣮ݧʹ͓͍ͯ4PU"΋͘͠͸ͦΕʹ͍ۙੑೳ • $04*.0ʹ͓͍ͯܗঢ়ͷϊΠζʹର͢Δޡࠩͷ্քΛಋग़͠ɺ࣮ݧతʹ΋֬ೝ • $04*.0͸PWFSTNPPUIJOH (//ʹΑΔܗঢ়ೝࣝͰ໰୊ͱͳΓ΍͍͢৘ใͷ ࢄҳ ͷఔ౓Λ੍ޚͰ͖Δ͜ͱΛূ໌͠ɺ࣮ݧతʹ΋࣮ূ  ୯ମෳମͷྫ[Einizade+ 20025]