Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Sign up for free
Menu
Search
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Pricing
Search
Sign in
Sign up for free
[email protected]
参加レポ
Search
kzmssk
March 26, 2020
Research
1.2k
0
Share
Embed
Copy iframe code
Copy JS code
Copy link
Start on current slide
[email protected]
参加レポ
アメリカ人工知能学会の国際会議AAAI2020のレポートです。聴講した中で面白いと思った研究を紹介しています。
kzmssk
March 26, 2020
More Decks by kzmssk
See All by kzmssk
SAM3を用いたコマ・吹き出しの 領域検出と分割構造からの読み順推定
kzmssk
0
130
実例から見るLLMのマンガ理解:実務VQAタスクによる長期的文脈と視覚情報の定性評価
kzmssk
0
130
Dwangoでの漫画データ活用〜漫画理解と動画作成〜@コミック工学シンポジウム2025
kzmssk
0
390
マールタスの仕組みを解説
kzmssk
0
3.9k
強化学習による3Dキャラクターの モーション生成@SIGGRAPH ASIA2018
kzmssk
0
1.5k
Montezuma’s Revenge Solved by Go-Explore, a New Algorithm for Hard-Exploration Problems
kzmssk
0
470
深層学習を用いた3D仮想物理環境における キャラクターの動的な行動生成
kzmssk
0
360
Other Decks in Research
See All in Research
PGDM: Physically Guided Diffusion Model for L Downscaling
satai
3
470
クラウド・AI 時代の研究開発 DX / R&D Digital Transformation
hariby
0
140
「AIとWhyを深堀る」をAIと深堀る
iflection
0
610
LLM の Attention 機構まとめ — 数式・計算量・メモリ
puwaer
8
2.7k
RS-Agent: Automating Remote Sensing Tasks through Intelligent Agent
satai
3
540
Fukui Shibiten 39 - AI Art
butchi
0
190
最先端NLP勉強会2026 論文紹介:Reasoning with Sampling: Your Base Model is Smarter Than You Think (ICLR 2026 paper)
kogoro
4
610
Research Engineerという仕事 / Research Engineering: Bridging Research and Business
chck
1
310
Karkada さんの論文 × 2 の紹介: (1) Closed-Form Training Dynamics Reveal Learned Features and Linear Structure in Word2Vec-like Models, (2) Symmetry in language statistics shapes the geometry of model representations
eumesy
PRO
1
730
SOTAのさらに先へ:厳しい推論制約下での高性能モデルのPost-Training
analokmaus
0
1.5k
医療LLMの現在地〜最新研究から社会実装までを考える〜
kento1109
1
1.7k
HackSick vol.7 LT資料【LLMアーキテクチャ入門・事前学習時の躓き所解説】 スパースなAttention・状態空間モデル
rikkabotan7
0
180
Featured
See All Featured
Code Review Best Practice
trishagee
74
20k
Side Projects
sachag
456
43k
Impact Scores and Hybrid Strategies: The future of link building
tamaranovitovic
0
440
Lessons Learnt from Crawling 1000+ Websites
charlesmeaden
PRO
1
1.6k
From Legacy to Launchpad: Building Startup-Ready Communities
dugsong
0
330
Unlocking the hidden potential of vector embeddings in international SEO
frankvandijk
0
930
From π to Pie charts
rasagy
0
360
XXLCSS - How to scale CSS and keep your sanity
sugarenia
249
1.3M
How to Think Like a Performance Engineer
csswizardry
28
2.8k
Raft: Consensus for Rubyists
vanstee
141
7.7k
10 Git Anti Patterns You Should be Aware of
lemiorhan
PRO
659
62k
I Don’t Have Time: Getting Over the Fear to Launch Your Podcast
jcasabona
35
2.8k
Transcript
[email protected]
ࢀՃϨϙ %XBOHP.FEJB7JMMBHF ࠤʑɹҰຏ
4QFDJBMFWFOUGFBUVSJOHUIF5VSJOH"XBSE8JOOFST :PTIVB#FOHJPਓؒͷແҙࣝతͳػೳʢʹݱࡏͷ"*ʣ͔ΒҙࣝతͳػೳΛ࣋ͬͨγεςϜʹ͚ͯ (FP⒎SFZ&)JOUPOɿ$BQTVMF/FUͷ :BOO-F$VO4FMGTVQFSWJTFEMFBSOJOHJTGVUVSFʢະདྷ༧ଌͷʣ "*)JTUPSZ1BOFM"EWBODJOH"*CZ1MBZJOH(BNFT ήʔϜ͕"*ٕज़ͷൃలʹͲ͏د༩͖ͯͨ͠ͷ͔ Πϕϯτ
%FFQ.JOEͷݚڀऀͨͪʹΑΔXPSLTIPQɻگɻ "UBSJ)&"%"UBSJ)VNBO&ZF5SBDLJOHBOE%FNPOTUSBUJPO%BUBTFU "UBSJͷήʔϜΛਓ͕ؒϓϨΠ͢ΔࡍͷࢹઢσʔλΛऩूͨ͠ݚڀ ࢹઢσʔλ3-ΤʔδΣϯτͷֶशੑೳ্ʹཱͭ͜ͱ͕Θ͔ͬͨ *OWJUFE5BMLCZ(FSSZ5FTBVSP 5%(BNNPO ڧԽֶशͰόοΫΪϟϞϯΛͬͨਓʣ ྺ࢙ͷ FHڧԽֶशΛ࠷ॳʹͬͨͷ୭͔ʁ$MBVEF4IBOOPJO
*OWJUFE5BMLCZ.JDIBFM#PXMJOH ଟਓڠྗήʔϜʮ)BOBCJʯͷઆ໌ 5IFPSZPG.JOE͕ඞཁͳήʔϜσβΠϯͩͱ͍͏ओு *OWJUFE5BMLCZ%BWJE4JMWFS NV;FSPͷ 2"ʮ࿈ଓߦಈͷ֦ுՄೳʁʯˠʮ.$54Λ࿈ଓߦಈʹ֦ுͰ͖Εग़དྷͦ͏ʯ 8PSLTIPQ3FJOGPSDFNFOU-FBSOJOHJO(BNFT [1]
໘ന͍ͱࢥͬͨݚڀͨͪ
ɿ%FFQ2-FBSOJOHͷֶश͕ෆ҆ఆ Ξϓϩʔνͱ࣮ ෳͷ5FBDIFSํࡦΛ༻ҙͦ͠ΕͧΕ͕5%ֶश 3FQMBZ#V⒎FSڞ༗ 4UVEFOUํࡦʹ5FBDIFS͔Βৠཹ ࣮ݧ "5"3*ͷͭͷήʔϜ 5FBDIFSͭΑΓෳͷํ͕ྑ͍݁Ռ ײ 0⒎QPMJDZͷಛΛ׆͔ͨ͠ݚڀ
5FBDIFSํࡦΛͦΕͧΕҧ͏ͷʹม͑ͨΒͲ͏ͳΔ͔ؾʹͳͬͨ &OTFNCMF1PMJDZ%JTUJMMBUJPOJO%FFQ3FJOGPSDFNFOU-FBSOJOH จ Fig.1 ΑΓ [2]
ɿ&YQFSJFODF3FQMBZʹ͓͚Δഁ໓త٫ Ξϓϩʔνͱ࣮ ͨ͘͞Μ๚ΕΔঢ়ଶΛΑΓ༏ઌతʹαϯϓϦϯά͢Δ ๚සʢಛʹ࿈ଓঢ়ଶͷ߹ʹʣܭࢉࠔ 3FQMBZCV⒎FS͔Βͨ͘͞ΜऔΔˠPOQPMJDZͷঢ়ଶͱͷڑ͕͍ۙUPQ,ݸΛͬͯํࡦߋ৽ ڑίαΠϯྨࣅೋޡࠩ ࣮ݧ .V+P$P "UBSJ ੑೳগ͠ྑ͘ͳΔ͕ɺ࠷దԽʹ͔͔Δ͕࣌ؒ༨ܭʹ͔͔ΔʢαϯϓϧΛͨ͘͞Μࣺ͍ͯͯΔͷͰʣ
ײ อकతͳํ๏ 1SJPSJUZΛ5%ޡࠩҎ֎ͷํ๏Ͱܭࢉ͢Δͷྑ͍ΞΠσΞ "UUFOUJWF&YQFSJFODF3FQMBZ [3]
ɿ4BNQMFDPNQMFYJUZ ҰఆͷੑೳΛୡ͢ΔͨΊʹඞཁͳαϯϓϧʣͷߴ͞ ਓؒͷσʔλͳͲͷσϞϯετϨʔγϣϯΛ͏ͱऩଋૣ͍͕σϞΛ͑ΒΕͳ͍ Ξϓϩʔνͱ࣮ɿ ༧ଌͨ͠Ձʹ৴པੑ͕ͳ͍ͱ͖σϞϯετϨʔγϣϯͷ༧ଌΛ͏ʢΞυόΠεʣ ৴པੑՁͷࢄͰଌΔ ࣮ݧ (SJEXPSME 1POH "5"3*
1POHͷ߹ࣄલֶशͨ͠ڧ͍BHFOUΛEFNPOTUSBUPSʹ͢Δ ͲͪΒΞυόΠεͳ͠ɺϥϯμϜͳΞυόΠεͷ߹ΑΓੑೳ্͕ ײ 2"ͰʮֶशରͷํࡦΞυόΠεΛˋड͚ೖΕΔͨΊσϞҎ্ͷੑೳ͕ग़ͳ͍ͷͰͳ͍͔ʯ ͱ͍͏͕ٞ͋ͬͨͷ͕ڵຯਂ͔ͬͨ ऩଋ͖ͯͨ͠ΒٯʹΞυόΠεΛཪΔํ๏Λࢼ͢Α͏ͳώϡʔϦεςΟοΫಋೖͰ͖ͦ͏ 6ODFSUBJOUZ"XBSF"DUJPO"EWJTJOHGPS%FFQ3FJOGPSDFNFOU-FBSOJOH"HFOUT6ODFSUBJOUZ "XBSF"DUJPO"EWJTJOHGPS%FFQ3FJOGPSDFNFOU-FBSOJOH"HFOUT [4]
ɿ4FRVFOUJBMͳܭࢉάϥϑΛޮతʹ࣮ߦͰ͖ΔΑ͏ʹෳͷ$16ʹׂΓ͍ͯͨ ྫɿ5FOTPSqPXͷܭࢉάϥϑͷ࣮ߦσόΠεׂΓͯ εϧʔϓοτ͕࠷େԽ͢ΔΑ͏ͳׂΓͯΛ୳ࡧ͢Δͷ/1ࠔ Ξϓϩʔνͱ࣮ɿ ڧԽֶशͱͯ͠ଊ͑ΔɿσόΠεʢ$16 ͷׂΓͯΛߦಈɺঢ়ଶΛάϥϑɺใुΛεϧʔϓοτ (SBQIDPOWͨ͠ಛྔΛ-45.ͰΈࠐΜͩϞσϧΛ3&*/'03$&Ͱ࠷దԽ γϛϡϨʔλʔΛͬͯεϧʔϓοτΛܭࢉ ࣮ݧɿγϛϡϨʔλʔͰධՁɻܶతʹվળ͠ͳ͔͕ͬͨˋͷྫͰ)FVSJTUJDΑΓྑ͍݁Ռ ײɿ࣮ݧͰ༻ͨ͠άϥϑ͕؆୯͗͢Δؾ͕͢Δ͕ɺγϛϡϨʔλͷਫ਼͕Α͚Εྑͦ͞͏
(FOFSBMJ[BCMF3FTPVSDF"MMPDBUJPOJO4USFBN1SPDFTTJOHWJB%FFQ3FJOGPSDFNFOU-FBSOJOH [5]
ɿϚϧνΤʔδΣϯτͷܥʹ͓͚ΔΤʔδΣϯτؒͷΠϯλϥΫγϣϯΛϞσϦϯά͍ͨ͠ ΠϯλϥΫγϣϯ0 /?E Ͱେม Ξϓϩʔνͱ࣮ ΤʔδΣϯτͷঢ়ଶભҠͱଞΤʔδΣϯτͷग़ྗʢߦಈʣΛͦΕͧΕχϡʔϥϧωοτͰϞσϦϯά ঢ়ଶΨεʹै͏ͱԾఆ͢Δ ΠϯλϥΫγϣϯग़ྗʹʮͲͷΤʔδΣϯτʹରͯ͠ΑΓಇ͖͔͚Δ͔ʯͷ֬Λ͔͚ͨઢܗͱͯ͠දݱ "UUFOUJPOʹͳ͍ͬͯΔɻ0 /
ͷܭࢉྔɻ ࣮ݧ όωͰܨ͕࣭ͬͨɺόεέοτબखͷಈ͖ͳͲͷσʔλΛϞσϦϯάͨ͠ࡍͷ༧ଌޡࠩΛධՁ γϯϓϧͳ-45.ͳͲʹൺͯྑ͍݁Ռ ײ ֬తͳঢ়ଶભҠΛಋೖ͢Δ͜ͱʹΑͬͯγεςϜͷྗֶతͳੑ࣭͕Ͳ͏มΘΔͷ͔͕ؾʹͳͬͨ (FOFSBUJWF"UUFOUJPO/FUXPSLTGPS.VMUJ"HFOU#FIBWJPSBM.PEFMJOH [6]
ϊʔυ͕ؒ౸ୡՄೳ͔Ͳ͏͔͕࣌ؒมԽ͢Δಈతͳແࢦੑάϥϑ Ұఆ࣌ؒʹ9͔Β౸ୡՄೳͰ͋Δͷू߹ʢSFBDIBCJMJUZTFUTʣΛߟ͑Δ άϥϑߏͷΑΓʮࣗવʯͰʮJOGSBTUSVDUVSFGSJFOEMZʯͳૢ࡞ʹΑͬͯSFBDIBCJMJUZTFUT Λ࠷దԽ͍ͨ͠ Ξϓϩʔνͱ࣮ ఏҊૢ࡞ɿ.FSHJOHʢपลͷΤοδͷ౸ୡՄೳ࣌ؒΛϚʔδ͢Δʣ ఏҊૢ࡞ɿ%FMBZJOHʢಛఆͷΤοδͷ౸ୡՄೳ࣌ؒʹΕΛೖΕΔʣ ࣮ݧ .FSHJOH
%FMBZJOHڞʹ/1ࠔͰ͋Δ͜ͱΛূ໌ͨ͠ ͨͩ͠%FMBZJOHͷΕʹ੍ݶ͕ͳ͚ΕۙࣅΞϧΰϦζϜ͕ଘࡏ ײ ఏىతͳจɻಈతͳάϥϑྺ࢙͕ઙ͍ɻ ੩తͳάϥϑʹൺ͍͕ͯ͠ɺϒϥβ্ͷϖʔδભҠϢʔβʔྲྀಈͷղੳͳͲԠ༻ઌ ͨ͘͞Μ͋Γͦ͏ 0QUJNJ[JOH3FBDIBCJMJUZ4FUTJO5FNQPSBM(SBQITCZ%FMBZJOH จ Fig.6 ΑΓ [7]
γʔέϯγϟϧͳϨίϝϯυͰ"UUFOUJPO͖ͷϞσϧ͕ߴ͍ੑೳΛग़͍ͯ͠Δ ͔͠͠طଘख๏Ͱ"UUFOUJPOͷߏ͕λεΫґଘʹͳ͍ͬͯΔ Ξϓϩʔνͱ࣮ "UUFOUJPOϕΫτϧΛϢʔβʔɺΞΠςϜɺΞΠςϜͷڞىߦྻʢΞΠςϜ"Λબͨ͠Ϣʔβʔ#બ͢ΔʣΛͬ ͯٻΊΔ "UUFOUJPOਖ਼نʢ4LFXOPSNBMEJTUSJCVUJPOʣʹै͏ͱԾఆɻ3FQBSBNFUFSJ[BUJPOUSJDL͏ ΞΠςϜͷڞىߦྻΞΠςϜͷϖΞසɺΞΠςϜͷFNCFEEJOHɺϢʔβͷFNCFEEJOHͷͭͷઢܗͰύϥϝλϥ Πζ ࣮ݧ
ଞͷطଘख๏ʹൺͯ༏Ґͳ݁Ռ ֶशʹΑͬͯಘΒΕͨڞىߦྻදݱͰಉ͡өըγϦʔζ͕ߴ͍ʹͳΔ͜ͱ͕؍͞Εͨ ײ "UUFOUJPOʹΛԾఆ͢Δํ๏ଞͷλεΫʹԠ༻Ͱ͖ͦ͏ 4FRVFOUJBM3FDPNNFOEBUJPOXJUI3FMBUJPO"XBSF,FSOFMJ[FE4FMG"UUFOUJPO [8]
େͳΞΠςϜͷϨίϝϯυͷͨΊʹಛྔϕΫτϧΛྨࣅੑΛอͬͨ· ·࣍ݩݮ͍ͨ͠ -PDBMJUZTFOTJUJWFIBTIJOH -4) 3FDPNNFOEBUJPO3FUSJFWBM ͔͠͠ϋογϡؔΦϑϥΠϯͰ֫ಘ͞ΕΔͷͰΞΠςϜϢʔβʔ͕ม ΘΔͱਫ਼͕Լ͕Δ Ξϓϩʔνͱ࣮ ϋογϡʹϕϧψʔΠΛԾఆ
ϢʔβʔͱΞΠςϜͷಛྔϕΫτϧΛޯ๏Ͱ࠷దԽͯ͠ಘΔ ײ U4/&ʹࣅ͍ͯΔ .FUSJDMFBSOJOHͱͷ͕ؔؾʹͳΔ 4UPDIBTUJDBMMZ3PCVTU1FSTPOBMJ[FE3BOLJOHGPS-4)3FDPNNFOEBUJPO3FUSJFWBM จ Fig.3 ΑΓ [9]
<>;IBOH 3VPIBO $BMFO8BMTIF ;IVPEF-JV -JO(VBO ,BSM4.VMMFS +BLF"8ISJUOFS -VYJO;IBOH .BSZ.)BZIPF BOE
%BOB)#BMMBSEl"UBSJ)&"%"UBSJ)VNBO&ZF5SBDLJOHBOE%FNPOTUSBUJPO%BUBTFUz*O"""*/FX:PSL64" <>4VO :VYJBOHl&OTFNCMF1PMJDZ%JTUJMMBUJPOJO%FFQ3FJOGPSDFNFOU-FBSOJOH6ODFSUBJOUZ3FEVDUJPOWJB3FWFSTF,-z*O """* /FX:PSL64" <>4VO 1FJRVBO 8FOHBOH;IPV BOE)PVRJBOH-Jl"UUFOUJWF&YQFSJFODF3FQMBZz*O"""*/FX:PSL64" <>4JMWB 'FMJQF-FOP%B 1BCMP)FSOBOEF[-FBM #JMBM,BSUBM BOE.BUUIFX&5BZMPSl6ODFSUBJOUZ"XBSF"DUJPO"EWJTJOHGPS%FFQ 3FJOGPSDFNFOU-FBSOJOH"HFOUTz*O"""*/FX:PSL64" <>/J 9JBOH +JOH-J .P:V 8BOH;IPV BOE,VO-VOH8Vl(FOFSBMJ[BCMF3FTPVSDF"MMPDBUJPOJO4USFBN1SPDFTTJOHWJB%FFQ 3FJOGPSDFNFOU-FBSOJOHz*O"""*/FX:PSL64" <>-J (VBOHZV #P+JBOH )BP;IV ;IFOHQJOH$IF BOE:BO-JVl(FOFSBUJWF"UUFOUJPO/FUXPSLTGPS.VMUJ"HFOU#FIBWJPSBM .PEFMJOHz*O"""*/FX:PSL64" <>%FMJHLBT "SHZSJPT BOE*HPS1PUBQPWl0QUJNJ[JOH3FBDIBCJMJUZ4FUTJO5FNQPSBM(SBQITCZ%FMBZJOHz*O"""*/FX:PSL 64" <>%FMJHLBT "SHZSJPT BOE*HPS1PUBQPWl0QUJNJ[JOH3FBDIBCJMJUZ4FUTJO5FNQPSBM(SBQITCZ%FMBZJOHz*O"""*/FX:PSL 64" <>-F %VOH% BOE)BEZ8-BVXl4UPDIBTUJDBMMZ3PCVTU1FSTPOBMJ[FE3BOLJOHGPS-4)3FDPNNFOEBUJPO3FUSJFWBMz*O"""* /FX:PSL64" จݙใ