Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
BERTでのテキスト分類
Search
kassy11
April 17, 2024
0
5
BERTでのテキスト分類
kassy11
April 17, 2024
Tweet
Share
More Decks by kassy11
See All by kassy11
Git入門
kassy11
0
6
『IT Text自然言語処理』第1章
kassy11
0
10
過学習と未学習について
kassy11
0
6
LLMアプリケーション開発 ~シンとくぽんTalkと論文要約くんの開発について~
kassy11
0
26
Featured
See All Featured
Build The Right Thing And Hit Your Dates
maggiecrowley
28
2.2k
Agile that works and the tools we love
rasmusluckow
325
20k
Save Time (by Creating Custom Rails Generators)
garrettdimon
PRO
13
430
Building a Scalable Design System with Sketch
lauravandoore
458
32k
Rails Girls Zürich Keynote
gr2m
93
13k
Designing for humans not robots
tammielis
247
25k
The Cult of Friendly URLs
andyhume
75
5.9k
Into the Great Unknown - MozCon
thekraken
20
1.3k
Why You Should Never Use an ORM
jnunemaker
PRO
51
8.9k
Stop Working from a Prison Cell
hatefulcrawdad
266
20k
From Idea to $5000 a Month in 5 Months
shpigford
377
46k
I Don’t Have Time: Getting Over the Fear to Launch Your Podcast
jcasabona
26
1.8k
Transcript
.ദݪޭଠ #&35ͰͷςΩετྨ
࣍ ਂֶशʹΑΔࣗવݴޠॲཧͷجૅ τʔΫφΠζ ೖྗ·Ͱ &NCFEEJOH
5SBOTGPSNFSͱ "UUFOUJPOͱ 5SBOTGPSNFSΛͬͨϞσϧ #&35ͱ #&35ͷੜϞσϧ ԋश
ਂֶशʹΑΔࣗવݴޠॲཧͷجૅ • ैདྷͷࣗવݴޠॲཧͷྲྀΕɺ ܗଶૉղੳղੳˠߏจղੳˠҙຯղੳˠจ຺ղੳ • ਂֶशΛ༻͍ͨࣗવݴޠॲཧͷྲྀΕɺ τʔΫφΠζʢܗଶૉղੳͳͲʣ*%ԽˠਂֶशϞσϧʢ#&35ͳͲʣ IUUQTTQFBLFSEFDLDPNLZPVOBUVUPSJBMPOOMQBOEWJTJPOBOEMBOHVBHF IUUQTBJMBCMBQSBTDPNEFFQMFBSOJOHEFQFOEFODZQBSTJOH
τʔΫφΠζ • จষΛτʔΫϯͱݺΕΔ୯Ґʹׂ͢Δ͜ͱ • τʔΫϯͱͯ͠ɺ୯ޠɾจࣈɾαϒϫʔυ͕͋Γɺαϒϫʔυ͕ओྲྀ • τʔΫϯͱͯ͠୯ޠΛͬͨ߹ΛܗଶૉղੳͱݺͿ
τʔΫφΠζ͔ΒਂֶशϞσϧͷೖྗ·ͰͷྲྀΕ ೖྗςΩετΛτʔΫφΠζ͢Δ ֶशσʔλʹؚ·ΕΔτʔΫϯͷࣙॻʢτʔΫϯͱ*%ͷରԠදʣΛͭ͘Δ w ࣄલֶशࡁΈϞσϧͩͱطʹ͋Δ
ೖྗςΩετΛ*%ྻʹม͢Δ ෳςΩετΛೖྗ͢Δͱ͖͞Λଗ͑ΔʢQBEEJOHʣ w Ұ൪͍ͷʹ߹ΘͤΔPS͞ΛઌʹܾΊΔ IUUQTZPVUVCFL8;:B5O#ZD
&NCFEEJOH • ςΩετΛ*%ྻʹมͨ͠ͷΛϞσϧʹೖྗ͢Δͱɺʹ͋Δ&NCFEEJOHͰτʔΫϯ ͷϕΫτϧʹม͞ΕΔ • 8PSE7FDͷ୯ޠϕΫτϧͷΑ͏ͳͷ • ม༻ͷߦྻΛϧοΫΞοϓςʔϒϧͱݺͿ •
5SBOTGPSNFS#&35ͳͲͰɺࣄલֶशͰ&NCFEEJOHֶश͢Δ • ੲ୯ޠຒΊࠐΈͱݴޠϞσϧผʑʹֶश͍͕ͯͨ͠ɺࠓͰಉ࣌ʹʢ&OEUP&OEͰʣֶ श͢Δ͜ͱ͕ओྲྀ IUUQTZPVUVCFL8;:B5O#ZD
5SBOTGPSNFSͱ • 3//$//Λ༻͍ͣʹɺ"UUFOUJPOʢҙػߏʣͷΈͰߏ͞Εͨ&ODPEFS %FDPEFSܕͷϞσϧ • ݴޠσʔλΛ3//Ͱॲཧ͠Α͏ͱ͢Δͱɺஞ࣍ॲཧʢલͷग़ྗΛೖྗʹ͏ʣ͠ ͔Ͱ͖ͳ͍ͷͰ͕͔͔࣌ؒͬͨ • "UUFOUJPOͷΈʹ͢Δ͜ͱͰ
• ฒྻॲཧՄೳʢશ෦Ұؾʹೖྗʣ • ԕ͘ͷใΛऔΓೖΕͯɺ ΑΓྑ͍ϕΫτϧ IUUQTTQFBLFSEFDLDPNLZPVOBUVUPSJBMPOOMQBOEWJTJPOBOEMBOHVBHF
"UUFOUJPOͱ • 5SBOTGPSNFSͰ༻͍ΒΕΔ"UUFOUJPOೋछྨ͋Δ • $SPTT"UUFOUJPOɿ&ODPEFSଆͷେࣄͳใʹΑΓͯ͠ɺ%FDPEFSଆ͔Β ग़ྗ • ผ໊4PVSDF5BSHFU"UUFOUJPO &ODPEFS%FDPEFS"UUFOUJPO
• 4FMG"UUFOUJPOɿࣗͷܥྻʹ͍ͭͯपΓΛݟͯɺΑΓྑ͍ϕΫτϧʹ͢Δ IUUQTTQFBLFSEFDLDPNTFJWJTJPOBOEMBOHVBHFUPGFOZFXPRVSJKVBOLVTIFODFOHYVFYJTIPVGBGBMTFTIBPKJF IUUQTTQFBLFSEFDLDPNLZPVOBUVUPSJBMPOOMQBOEWJTJPOBOEMBOHVBHF
5SBOTGPSNFSΛͬͨϞσϧ • 5SBOTGPSNFSͷ&ODPEFS%FDPEFSͷͲ͜Λ͏ʹΑͬͯϞσϧ༷ʑɺڧΈ ҟͳΔ • &ODPEFSͷΈΛ͏ʢ#&35ͳͲʣɿࣗવݴޠཧղʢྨ/&3ͳͲʣʹڧ͍ • %FDPEFSͷΈΛ͏ʢ(15ͳͲʣɿࣗવݴޠੜʢରͳͲʣʹڧ͍ •
&ODPEFS%FDPEFS྆ํΛ͏ʢ5#"35ͳͲʣɿܥྻͷม ʢػց༁ཁͳͲʣʹڧ͍ IUUQTTQFBLFSEFDLDPNLZPVOBUVUPSJBMPOOMQBOEWJTJPOBOEMBOHVBHF
#&35ͱ • #JEJSFDUJPOBM&ODPEFS3FQSFTFOUBUJPOGSPN5SBOTGPSNFSTͷུ • 5SBOTGPSNFSͷ&ODPEFSͷΈͰֶशͨ͠Ϟσϧ • ͭͷํ๏Ͱࣄલֶश • .BTLFE-BOHVBHF.PEFMɿೖྗΛҰ෦ϚεΫͯ͠༧ଌ
• /FYU4FOUFODF1SFEJDUJPOɿจೖྗͯͦ͠ΕΒྡจ͔൱͔ • ˢͷํ๏ͷ͓͔͛Ͱࣗવݴޠཧղʹڧ͍ IUUQTTQFBLFSEFDLDPNLZPVOBUVUPSJBMPOOMQBOEWJTJPOBOEMBOHVBHF
#&35ͷੜϞσϧ • #&35ʹ༷ʑͳΛΓࠐΜͩΓɺੑೳҡ࣋ͯ͠ϞσϧαΠζͷখܕԽͳͲͷੜϞσϧ͕ଘࡏ͢Δ • ֶशํ๏Λ • 3P#&35B • %F#&35B
• &-&$53" • 9-/FU • খܕԽ • "-#&35 • %JTUJM#&35 • ϚϧνϞʔμϧ • 7-#&35 IUUQTHJUIVCDPNUIVOMQ1-.QBQFST
༨ஊɿैདྷͷྲྀΕͱͷରԠ • ैདྷͷྲྀΕͱτʔΫφΠζʢܗଶૉղੳͳͲʣڞ௨ • ߏจղੳҎ߱ͷྲྀΕਂֶशϞσϧͷதͰ҉తʹߦΘΕ͍ͯΔʁ • "UUFOUJPOߏจղੳɾΓड͚ղੳΛߦ͍ͬͯΔΑ͏ʹݟΕΔ͠ɺ τʔΫϯͷϕΫτϧԽҙຯղੳΛߦ͍ͬͯΔΑ͏ʹݟΕΔ͠ɺ ෳจΛಛघτʔΫϯΛͬͯϞσϧʹೖྗ͢Δ͜ͱͰจ຺ղੳΛߦ͍ͬͯΔΑ
͏ʹݟΕΔʁ • ҉తʹߏจղੳҎ߱ͷྲྀΕ͕ߦΘΕΔ͕ɺ໌ࣔతʹߦ͍͍ͨͱ͖ͷΈTQB$Z ʢ(J/;"ʣͳͲͷπʔϧΛ͏
ࢀߟจݙ • ࣗવݴޠॲཧͱ7JTJPOBOE-BOHVBHF • ຒΊࠐΈ • ܥྻσʔλϞσϦϯά 3//-45.5SBOTGPSNFS ɹୈ̎ճʮܥྻσʔλΛ
ѻ͏ͨΊͷલॲཧʯ • ܥྻσʔλϞσϦϯά 3//-45.5SBOTGPSNFS ɹୈ̍̍ճʮ#&35 5ʯ • 5IF*MMVTUSBUFE5SBOTGPSNFS • #&358JLJQFEJB