Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
技術力で世界と戦う機械学習コンペティション「Kaggle」の魅力 / Attractiveness of Kaggle
Search
Shotaro Ishihara
September 07, 2019
Technology
3
2.7k
技術力で世界と戦う 機械学習コンペティション「Kaggle」の魅力 / Attractiveness of Kaggle
AIchi勉強会での登壇資料
https://connpass.com/event/134720/
Shotaro Ishihara
September 07, 2019
Tweet
Share
More Decks by Shotaro Ishihara
See All by Shotaro Ishihara
Quantifying Memorization of Domain-Specific Pre-trained Language Models using Japanese Newspaper and Paywalls
upura
0
23
「極意本」サンプルコードをクラウド上で動かそう
upura
1
2.1k
論文紹介: Generating News-Centric Crossword Puzzles As A Constraint Satisfaction and Optimization Problem
upura
0
240
関東 Kaggler 会スポンサー資料
upura
0
1.6k
論文紹介 Quantifying attention via dwell time and engagement in a social media browsing environment / web-socialmedia-study-8th
upura
0
220
Quantifying Diachronic Language Change via Word Embeddings: Analysis of Social Events using 11 Years News Articles in Japanese and English
upura
1
400
Training Data Extraction From Pre-trained Language Models: A Survey
upura
0
240
論文紹介 Discovering and Categorising Language Biases in Reddit / web-socialmedia-study-5th
upura
0
320
AMA (Ask me anything) 『Kaggleに挑む深層学習プログラミングの極意』 / Ask me anything
upura
0
320
Other Decks in Technology
See All in Technology
Amazon FSx for NetApp ONTAPのパフォーマンスチューニング要素をまとめてみた #cm_odyssey #devio2024
non97
0
220
サービス開発を前に進めるために 新米リードエンジニアが 取り組んだこと / Steps Taken by a Novice Lead Engineer to Advance Service Development
nologyance
0
180
Github Actions 로 Android 팀의 효율성 극대화
hadonghyun
0
160
Git 研修 Advanced【MIXI 24新卒技術研修】
mixi_engineers
PRO
0
200
「単なる OAuth 2.0 を認証に使うと、車が通れるほどのどでかいセキュリティー・ホールができる」のか検証してみた
terara
0
380
MySQLのロックの種類とその競合
yoku0825
6
1.6k
Classmethod流のPlatform Engineering / classmethod-platform-engineering-devio2024
tomoki10
0
470
コンテナ・K8s研修 - 後半 Kubernetes 基礎&ハンズオン【MIXI 24新卒技術研修】
mixi_engineers
PRO
1
120
運用改善、不都合な真実 / 20240722-ssmjp-kaizen
opelab
17
8.1k
「我々はどこに向かっているのか」を問い続けるための仕組みづくり / Establishing a System for Continuous Inquiry about where we are
daitasu
0
170
OSSコミットしてZennの課題を解決した話
dyoshikawa1993
0
150
Flutter研修【MIXI 24新卒技術研修】
mixi_engineers
PRO
0
160
Featured
See All Featured
Building Effective Engineering Teams - LeadDev
addyosmani
47
2.2k
Rebuilding a faster, lazier Slack
samanthasiow
78
8.5k
Building Applications with DynamoDB
mza
89
5.8k
Rails Girls Zürich Keynote
gr2m
93
13k
Visualizing Your Data: Incorporating Mongo into Loggly Infrastructure
mongodb
36
9.1k
Let's Do A Bunch of Simple Stuff to Make Websites Faster
chriscoyier
502
140k
For a Future-Friendly Web
brad_frost
173
9.2k
Leading Effective Engineering Teams 2024
addyosmani
3
300
Save Time (by Creating Custom Rails Generators)
garrettdimon
PRO
13
430
Faster Mobile Websites
deanohume
303
30k
Creatively Recalculating Your Daily Design Routine
revolveconf
214
11k
Understanding Cognitive Biases in Performance Measurement
bluesmoon
18
1.2k
Transcript
ٕज़ྗͰੈքͱઓ͏ ػցֶशίϯϖςΟγϣϯ ʮ,BHHMFʯͷັྗ V !VQVSB ݄ "JDIJษڧձ
ͬͨ͜ͱ͋Δ 2
ฉ͍ͨ͜ͱ͋Δ 3
ຊͷ • ਓೳ "* ͷதͷʮػցֶशʯͱʁ • ػցֶशͷதͷʮڭࢣ͋Γֶशʯͱʁ • ػցֶशίϯϖςΟγϣϯʮ,BHHMFʯͱʁ
ࣗݾհʛV • ͷࣄۀձࣾͰσʔλαΠΤϯςΟετ • ,BHHMF.BTUFS • ࠷ߴϥϯΫҐɺҐೖܦݧ͋Γ • Ѫݝग़
• ౦ւߴߍˠ౦ژେֶˠݱ৬ • ࡢ൩౦ژͰొஃˠࠓேʹ໊ݹʹҠಈ
ࣗݾհʛV
ຊͷ • ਓೳ "* ͷதͷʮػցֶशʯͱʁ • ػցֶशͷதͷʮڭࢣ͋Γֶशʯͱʁ • ػցֶशίϯϖςΟγϣϯʮ,BHHMFʯͱʁ
ਓೳ "* • େ͖͘ྲྀʢ͜ͷྨࣗମʹ͕ٞ͋Δʣ ਓؒͷೳͦͷͷΛͭػցΛ࡞Ζ͏ͱ͢Δཱ ਓ͕ؒೳΛͬͯ͢Δ͜ͱΛػցʹͤ͞Α͏ͱ͢ Δཱ
• ࣮ࡍͷݚڀ΄ͱΜͲޙऀͷཱʢͳͷʹ͔ͬͯ Β͔ͣલऀͷҙຯͰ૽ཱ͗ͯΔք۾͕͋Δʣ ਓೳֶձਓೳͬͯԿʁ IUUQTXXXBJHBLLBJPSKQXIBUTBJ"*XIBUTIUNM
ػցֶश • ίϯϐϡʔλʹώτͷΑ͏ͳֶशೳྗΛ֫ಘ ͤ͞ΔͨΊͷٕज़ͷ૯শ • ਓೳ ∋ ػցֶश •
࠷ۙͷਓೳ ػցֶश ਿࢁক ʰΠϥετͰֶͿػցֶशʱ ߨஊࣾ
ຊͷ • ਓೳ "* ͷதͷʮػցֶशʯͱʁ • ػցֶशͷதͷʮڭࢣ͋Γֶशʯͱʁ • ػցֶशίϯϖςΟγϣϯʮ,BHHMFʯͱʁ
ػցֶशͷྨ • ֶशํ๏ʹґͬͯେ͖͘ྨ • ڭࢣ͋Γֶश • ڭࢣͳֶ͠श • ڧԽֶश
ਿࢁক ʰΠϥετͰֶͿػցֶशʱ ߨஊࣾ
ڭࢣ͋Γֶश • ίϯϐϡʔλʹͱ͑ͷରΛ͍͔ͭ͘ ڭ͑Δ͜ͱʹΑΓɼڭΘ͍ͬͯͳ͍ʹ ਖ਼͘͠ճͰ͖Δ൚ԽೳྗΛίϯϐϡʔ λʹ֫ಘͤ͞Δ ਿࢁক ʰΠϥετͰֶͿػցֶशʱ ߨஊࣾ
ڭࢣ͋Γֶशͷ۩ମྫ • खॻ͖จࣈೝࣝɼԻೝࣝɼը૾ೝࣝɼ໎ ϝʔϧͷࣗಈྨͳͲ
ֶशͷΞϧΰϦζϜ • ͍Ζ͍ΖͳΞϧΰϦζϜ͕։ൃ͞Ε͍ͯΔ • ͦͷҰ͕ͭɺσΟʔϓϥʔχϯά
࡞ͬͯΈͨʢσϞʣ • ʮ໊ݹ౦ژʯͷը૾ྨΞϓϦ • ωοτͰऩूͨ͠ը૾ͦΕͧΕຕ • 7((ʢσΟʔϓϥʔχϯάʣΛར༻ IUUQTXXXNEQJDPNIUN
࡞ͬͯΈͨʢσϞʣ IUUQTVQVSBIBUFOBCMPHDPN FOUSZ
ڭࢣͳֶ͠श • ͑ͷ͔͍ͬͯͳ͍σʔλͷू߹͔Βɺ ༗ӹͳࣝΛ֫ಘ͠Α͏ͱ͢Δ • ੈͷதʹਖ਼ղϥϕϧͷͳ͍σʔλͷํ͕ ѹతʹଟ͍ • ۩ମྫɿΫϥελϦϯάҟৗݕ
ਿࢁক ʰΠϥετͰֶͿػցֶशʱ ߨஊࣾ
ڧԽֶश • ڭࢣ͋Γֶशͱಉ͘͡൚ԽੑೳΛίϯϐϡʔ λʹ֫ಘͤ͞Δ͜ͱ͕ඪ • ͑Λڭ͑ΔΘΓʹɼ༧ଌͨ͑͠ͷ ྑ͞ΛධՁ • ධՁ͕࠷ߴ·ΔΑ͏ʹֶश͢Δ
ਿࢁক ʰΠϥετͰֶͿػցֶशʱ ߨஊࣾ
ڧԽֶशͷ۩ମྫ • ϩϘοτͷࣗಈ੍ޚɼίϯϐϡʔλήʔϜͳͲ • ໌֬ʹਖ਼ղσʔλ͕༩͑ͮΒ͍߹ʹ༻͍ΒΕΔ • ྫɿғޟͰʮͱ͋Δ൫໘ͰԿΛଧͭͷ͕ਖ਼ղʯ͔ ݴ͍Δͷ͍͠ ˠͱ͋ΔखΛଧͬͨΒউͬͨෛ͚ͨͱ͍͏ධՁ
Λͱʹֶश͍ͤͯ͘͜͞ͱͰ͖ͦ͏
ຊͷ • ਓೳ "* ͷதͷʮػցֶशʯͱʁ • ػցֶशͷதͷʮڭࢣ͋Γֶशʯͱʁ • ػցֶशίϯϖςΟγϣϯʮ,BHHMFʯͱʁ
,BHHMFͱ • ओʹڭࢣ͋Γֶश͕ରͷػցֶशϞσϧͷ ੑೳΛڝ͏ίϯϖςΟγϣϯ • (PPHMFࡿԼͷ,BHHMF͕ओ࠵ • ੈքதͷσʔλαΠΤϯςΟετ͕ू͏
(PPHMFτϨϯυ • ۙɺຊͰਓؾ͕ߴ·͍ͬͯΔ
,BHHMFͱ IUUQTXXXTMJEFTIBSFOFU)BSBEB,FJEFWTVNJTVNNFS
,BHHMFϥϯΩϯά IUUQTXXXLBHHMFDPNTJTIJIBSB • ֤ίϯϖͷ্Ґ ˠۚɿ ۜɿ ಔɿ • ۚݸۜݸҎ্
ˠ,BHHMF .BTUFS
,FSOFM%JTDVTTJPO • ,FSOFMʢ࣮ͷެ։ɺࢲ͜Μͳ࣮ͩʂʣ • %JTDVTTJPOʢ͜͏ΔͱείΞ্͕͕Δʂʣ • ੈքதͷࢀՃऀ͕࢛࣌த͍ٞͯ͠Δ • ˞ίϯϖͷॱҐ͚ͩͰͳ͘ɺ,FSOFM
%JTDVTTJPOͰͦΕͧΕϙΠϯτ͕͘
1FU'JOEFSίϯϖ
1FU'JOEFSίϯϖ IUUQTXXXLBHHMFDPNDQFUGJOEFSBEPQUJPOQSFEJDUJPO • 1FU'JOEFSNZ"EPQUJPO1SFEJDUJPO • ݄ʙ݄ʹ։࠵ • ʮػցֶशΛ༻͍ͯɺϚϨʔγΞͷϖοτ γϣοϓͰͷݘɾೣ͕Ҿ͖औΒΕΔૣ͞Λ
༧ଌ͢Δʯͱ͍͏͓
ར༻Ͱ͖Δσʔλ • ϖοτͷը૾ܗࣜσʔλ • આ໌จϖοτͷ໊લͳͲͷςΩετܗࣜσʔλ • ɾମॏɾଐੑͳͲͷςʔϒϧܗࣜσʔλ • ඞཁʹԠͯ͡֎෦σʔλར༻Մೳ
ྨ • ݘɾೣ͕Ҿ͖औΒΕΔ͞ • ϦετΞοϓͷʢʣ • ϦετΞοϓͷʙ
• ϦετΞοϓͷʙ • ϦετΞοϓͷʙ • Ҿ͖औΒΕͳ͍
.PEFM1JQFMJOF IUUQTXXXLBHHMFDPNDQFUGJOEFSBEPQUJPOQSFEJDUJPOEJTDVTTJPO
,BHHMFཱ͕ͭ ͱʹ͔ࣗ͘ͰखΛಈ͔ͤΔΑ͏ʹͳΔ ࣗࣗͷ٬؍తࢦඪͷҰͭʹ ࣾ֎ͷਓ͕૿͑Δ
ࣗͰखΛಈ͔͢ • είΞΛ্͛Δʹʮ%PFWFSZUIJOHʯ • ػցֶशۀͰඞͣ͠Θͳ͍͕ ಛྔΛ࡞Δ෦ʢσʔλͷՄࢹԽɾܗɾूܭ ͳͲʣɺ௨ৗͷۀʹਂؔ͘ΘΔ • ,BHHMFͷίʔυΛίϐϖ͢ΔͷͰࣄ͕͘ͳΔ
• σʔλʹର͢Δצॴʹͭ͘ʢ"*࠷ڧͰͳ͍ʣ
٬؍తࢦඪ • ࣾ֎ͷਓ͔Βʮ͜͏͍͏ͷ͕͖ͳͭʯ ͱೝͯ͠Β͑Δʢָͦ͠͏ͳ͕͋Δͱ ༠ͬͯΒ͑Δ͜ͱʣ • ࣾ֎ͷਓͱൺֱͯࣗ͘͠ͷ࣮ྗ͕͔Δ ͷͰɺ͞ΒͳΔษֶͷϞνϕʔγϣϯʹ
ࣾ֎ͷਓ • LBHHMFSKBTMBDLʢਓҎ্ʣ ˠσʔλੳʹؔ͢Δݟͷڞ༗ • ,BHHMF5PLZP.FFUVQ ˠ Ͱొஃ
• ͦͷଞɺTMBDLUXJUUFSͳͲͰࠃࡍަྲྀ
8JOOFS`T$BMM
ຊͰ,BHHMFºاۀ • ࣾ,BHHMF੍ʢ%F/"ʣ ˠ࠾༻ɾϒϥϯυઓུͷҰͰ͋Δ • ,BHHMFͰͷίϯϖ։࠵ʢϦΫϧʔτɺϝϧΧϦʣ ˠϒϥϯυઓུɺ༏উϞσϧͷ׆༻ • ,BHHMFҎ֎ͷίϯϖʢ4JHOBUFɺΦϯαΠτʣ
ˠ࠾༻ɾϒϥϯυઓུɺ༏উϞσϧͷ׆༻
%F/"ͷ,BHHMF੍ IUUQTEFOBBJLBHHMF
ຊاۀͷ։࠵࣮ ϦΫϧʔτ • Ϩετϥϯͷདྷऀ༧ଌ IUUQTXXXLBHHMFDPNDSFDSVJUSFTUBVSBOUWJTJUPSGPSFDBTUJOH ϝϧΧϦ • ग़Ձ֨ͷਪఆ IUUQTXXXLBHHMFDPNDNFSDBSJQSJDFTVHHFTUJPODIBMMFOHF
ϝϧΧϦͷࣄྫ IUUQTUFDINFSDBSJDPNFOUSZ
։࠵අ༻ɿສԁʁ IUUQTXXXLBHHMFDPNTUBUJDTMJEFTNFFULBHHMFQEG
ϗετ͚ϦϯΫू • IUUQTXXXLBHHMFDPNTUBUJDTMJEFT NFFULBHHMFQEG • IUUQTXXXLBHHMFDPNIPTUJOH JORVJSZ • IUUQTXXXLBHHMFDPNIPTUCVTJOFTT
4JHOBUF • ຊ൛ͷ,BHHMFʁ IUUQTTJHOBUFKQ
ΦϯαΠτ • ΠϕϯτܗࣜͰձʹࢀՃऀΛूΊΔܗࣜ • ύɾϦʔάɺ"CFNB57ɺ%F/" ͳͲଟ IUUQTEBUBTIJQKQQMN
·ͱΊ • ਓೳ "* ͷதͷʮػցֶशʯͱʁ • ػցֶशͷதͷʮڭࢣ͋Γֶशʯͱʁ • ػցֶशίϯϖςΟγϣϯʮ,BHHMFʯͱʁ
,BHHMFͬͯΈ͍ͨਓ