Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
BERTでのテキスト分類
Search
kassy11
April 17, 2024
0
4
BERTでのテキスト分類
kassy11
April 17, 2024
Tweet
Share
More Decks by kassy11
See All by kassy11
Git入門
kassy11
0
5
『IT Text自然言語処理』第1章
kassy11
0
6
過学習と未学習について
kassy11
0
5
LLMアプリケーション開発 ~シンとくぽんTalkと論文要約くんの開発について~
kassy11
0
18
Featured
See All Featured
Rebuilding a faster, lazier Slack
samanthasiow
74
8.3k
RailsConf & Balkan Ruby 2019: The Past, Present, and Future of Rails at GitHub
eileencodes
126
32k
Building Better People: How to give real-time feedback that sticks.
wjessup
356
18k
A Philosophy of Restraint
colly
197
16k
GitHub's CSS Performance
jonrohan
1025
450k
Fontdeck: Realign not Redesign
paulrobertlloyd
76
4.9k
Java REST API Framework Comparison - PWX 2021
mraible
PRO
18
7k
[Rails World 2023 - Day 1 Closing Keynote] - The Magic of Rails
eileencodes
9
1.3k
Embracing the Ebb and Flow
colly
80
4.2k
The Cost Of JavaScript in 2023
addyosmani
21
4k
Designing for humans not robots
tammielis
247
25k
4 Signs Your Business is Dying
shpigford
176
21k
Transcript
.ദݪޭଠ #&35ͰͷςΩετྨ
࣍ ਂֶशʹΑΔࣗવݴޠॲཧͷجૅ τʔΫφΠζ ೖྗ·Ͱ &NCFEEJOH
5SBOTGPSNFSͱ "UUFOUJPOͱ 5SBOTGPSNFSΛͬͨϞσϧ #&35ͱ #&35ͷੜϞσϧ ԋश
ਂֶशʹΑΔࣗવݴޠॲཧͷجૅ • ैདྷͷࣗવݴޠॲཧͷྲྀΕɺ ܗଶૉղੳղੳˠߏจղੳˠҙຯղੳˠจ຺ղੳ • ਂֶशΛ༻͍ͨࣗવݴޠॲཧͷྲྀΕɺ τʔΫφΠζʢܗଶૉղੳͳͲʣ*%ԽˠਂֶशϞσϧʢ#&35ͳͲʣ IUUQTTQFBLFSEFDLDPNLZPVOBUVUPSJBMPOOMQBOEWJTJPOBOEMBOHVBHF IUUQTBJMBCMBQSBTDPNEFFQMFBSOJOHEFQFOEFODZQBSTJOH
τʔΫφΠζ • จষΛτʔΫϯͱݺΕΔ୯Ґʹׂ͢Δ͜ͱ • τʔΫϯͱͯ͠ɺ୯ޠɾจࣈɾαϒϫʔυ͕͋Γɺαϒϫʔυ͕ओྲྀ • τʔΫϯͱͯ͠୯ޠΛͬͨ߹ΛܗଶૉղੳͱݺͿ
τʔΫφΠζ͔ΒਂֶशϞσϧͷೖྗ·ͰͷྲྀΕ ೖྗςΩετΛτʔΫφΠζ͢Δ ֶशσʔλʹؚ·ΕΔτʔΫϯͷࣙॻʢτʔΫϯͱ*%ͷରԠදʣΛͭ͘Δ w ࣄલֶशࡁΈϞσϧͩͱطʹ͋Δ
ೖྗςΩετΛ*%ྻʹม͢Δ ෳςΩετΛೖྗ͢Δͱ͖͞Λଗ͑ΔʢQBEEJOHʣ w Ұ൪͍ͷʹ߹ΘͤΔPS͞ΛઌʹܾΊΔ IUUQTZPVUVCFL8;:B5O#ZD
&NCFEEJOH • ςΩετΛ*%ྻʹมͨ͠ͷΛϞσϧʹೖྗ͢Δͱɺʹ͋Δ&NCFEEJOHͰτʔΫϯ ͷϕΫτϧʹม͞ΕΔ • 8PSE7FDͷ୯ޠϕΫτϧͷΑ͏ͳͷ • ม༻ͷߦྻΛϧοΫΞοϓςʔϒϧͱݺͿ •
5SBOTGPSNFS#&35ͳͲͰɺࣄલֶशͰ&NCFEEJOHֶश͢Δ • ੲ୯ޠຒΊࠐΈͱݴޠϞσϧผʑʹֶश͍͕ͯͨ͠ɺࠓͰಉ࣌ʹʢ&OEUP&OEͰʣֶ श͢Δ͜ͱ͕ओྲྀ IUUQTZPVUVCFL8;:B5O#ZD
5SBOTGPSNFSͱ • 3//$//Λ༻͍ͣʹɺ"UUFOUJPOʢҙػߏʣͷΈͰߏ͞Εͨ&ODPEFS %FDPEFSܕͷϞσϧ • ݴޠσʔλΛ3//Ͱॲཧ͠Α͏ͱ͢Δͱɺஞ࣍ॲཧʢલͷग़ྗΛೖྗʹ͏ʣ͠ ͔Ͱ͖ͳ͍ͷͰ͕͔͔࣌ؒͬͨ • "UUFOUJPOͷΈʹ͢Δ͜ͱͰ
• ฒྻॲཧՄೳʢશ෦Ұؾʹೖྗʣ • ԕ͘ͷใΛऔΓೖΕͯɺ ΑΓྑ͍ϕΫτϧ IUUQTTQFBLFSEFDLDPNLZPVOBUVUPSJBMPOOMQBOEWJTJPOBOEMBOHVBHF
"UUFOUJPOͱ • 5SBOTGPSNFSͰ༻͍ΒΕΔ"UUFOUJPOೋछྨ͋Δ • $SPTT"UUFOUJPOɿ&ODPEFSଆͷେࣄͳใʹΑΓͯ͠ɺ%FDPEFSଆ͔Β ग़ྗ • ผ໊4PVSDF5BSHFU"UUFOUJPO &ODPEFS%FDPEFS"UUFOUJPO
• 4FMG"UUFOUJPOɿࣗͷܥྻʹ͍ͭͯपΓΛݟͯɺΑΓྑ͍ϕΫτϧʹ͢Δ IUUQTTQFBLFSEFDLDPNTFJWJTJPOBOEMBOHVBHFUPGFOZFXPRVSJKVBOLVTIFODFOHYVFYJTIPVGBGBMTFTIBPKJF IUUQTTQFBLFSEFDLDPNLZPVOBUVUPSJBMPOOMQBOEWJTJPOBOEMBOHVBHF
5SBOTGPSNFSΛͬͨϞσϧ • 5SBOTGPSNFSͷ&ODPEFS%FDPEFSͷͲ͜Λ͏ʹΑͬͯϞσϧ༷ʑɺڧΈ ҟͳΔ • &ODPEFSͷΈΛ͏ʢ#&35ͳͲʣɿࣗવݴޠཧղʢྨ/&3ͳͲʣʹڧ͍ • %FDPEFSͷΈΛ͏ʢ(15ͳͲʣɿࣗવݴޠੜʢରͳͲʣʹڧ͍ •
&ODPEFS%FDPEFS྆ํΛ͏ʢ5#"35ͳͲʣɿܥྻͷม ʢػց༁ཁͳͲʣʹڧ͍ IUUQTTQFBLFSEFDLDPNLZPVOBUVUPSJBMPOOMQBOEWJTJPOBOEMBOHVBHF
#&35ͱ • #JEJSFDUJPOBM&ODPEFS3FQSFTFOUBUJPOGSPN5SBOTGPSNFSTͷུ • 5SBOTGPSNFSͷ&ODPEFSͷΈͰֶशͨ͠Ϟσϧ • ͭͷํ๏Ͱࣄલֶश • .BTLFE-BOHVBHF.PEFMɿೖྗΛҰ෦ϚεΫͯ͠༧ଌ
• /FYU4FOUFODF1SFEJDUJPOɿจೖྗͯͦ͠ΕΒྡจ͔൱͔ • ˢͷํ๏ͷ͓͔͛Ͱࣗવݴޠཧղʹڧ͍ IUUQTTQFBLFSEFDLDPNLZPVOBUVUPSJBMPOOMQBOEWJTJPOBOEMBOHVBHF
#&35ͷੜϞσϧ • #&35ʹ༷ʑͳΛΓࠐΜͩΓɺੑೳҡ࣋ͯ͠ϞσϧαΠζͷখܕԽͳͲͷੜϞσϧ͕ଘࡏ͢Δ • ֶशํ๏Λ • 3P#&35B • %F#&35B
• &-&$53" • 9-/FU • খܕԽ • "-#&35 • %JTUJM#&35 • ϚϧνϞʔμϧ • 7-#&35 IUUQTHJUIVCDPNUIVOMQ1-.QBQFST
༨ஊɿैདྷͷྲྀΕͱͷରԠ • ैདྷͷྲྀΕͱτʔΫφΠζʢܗଶૉղੳͳͲʣڞ௨ • ߏจղੳҎ߱ͷྲྀΕਂֶशϞσϧͷதͰ҉తʹߦΘΕ͍ͯΔʁ • "UUFOUJPOߏจղੳɾΓड͚ղੳΛߦ͍ͬͯΔΑ͏ʹݟΕΔ͠ɺ τʔΫϯͷϕΫτϧԽҙຯղੳΛߦ͍ͬͯΔΑ͏ʹݟΕΔ͠ɺ ෳจΛಛघτʔΫϯΛͬͯϞσϧʹೖྗ͢Δ͜ͱͰจ຺ղੳΛߦ͍ͬͯΔΑ
͏ʹݟΕΔʁ • ҉తʹߏจղੳҎ߱ͷྲྀΕ͕ߦΘΕΔ͕ɺ໌ࣔతʹߦ͍͍ͨͱ͖ͷΈTQB$Z ʢ(J/;"ʣͳͲͷπʔϧΛ͏
ࢀߟจݙ • ࣗવݴޠॲཧͱ7JTJPOBOE-BOHVBHF • ຒΊࠐΈ • ܥྻσʔλϞσϦϯά 3//-45.5SBOTGPSNFS ɹୈ̎ճʮܥྻσʔλΛ
ѻ͏ͨΊͷલॲཧʯ • ܥྻσʔλϞσϦϯά 3//-45.5SBOTGPSNFS ɹୈ̍̍ճʮ#&35 5ʯ • 5IF*MMVTUSBUFE5SBOTGPSNFS • #&358JLJQFEJB