Upgrade to Pro — share decks privately, control downloads, hide ads and more …

BERTでのテキスト分類

kassy11
April 17, 2024
7

 BERTでのテキスト分類

kassy11

April 17, 2024
Tweet

Transcript

  1. ໨࣍   ਂ૚ֶशʹΑΔࣗવݴޠॲཧͷجૅ  τʔΫφΠζ  ೖྗ·Ͱ  &NCFEEJOH૚

     5SBOTGPSNFSͱ͸  "UUFOUJPOͱ͸  5SBOTGPSNFSΛ࢖ͬͨϞσϧ  #&35ͱ͸  #&35ͷ೿ੜϞσϧ  ԋश
  2. τʔΫφΠζ͔Βਂ૚ֶशϞσϧ΁ͷೖྗ·ͰͷྲྀΕ   ೖྗςΩετΛτʔΫφΠζ͢Δ  ֶशσʔλʹؚ·ΕΔτʔΫϯͷࣙॻʢτʔΫϯͱ*%ͷରԠදʣΛͭ͘Δ w ࣄલֶशࡁΈϞσϧͩͱطʹ͋Δ  

    ೖྗςΩετΛ*%ྻʹม׵͢Δ    ෳ਺ςΩετΛೖྗ͢Δͱ͖͸௕͞Λଗ͑ΔʢQBEEJOHʣ w Ұ൪௕͍΋ͷʹ߹ΘͤΔPS௕͞ΛઌʹܾΊΔ   IUUQTZPVUVCFL8;:B5O#ZD
  3. &NCFEEJOH૚  • ςΩετΛ*%ྻʹม׵ͨ͠΋ͷΛϞσϧʹೖྗ͢Δͱɺ૚໨ʹ͋Δ&NCFEEJOH૚ͰτʔΫϯ ͷϕΫτϧʹม׵͞ΕΔ • 8PSE7FDͷ୯ޠϕΫτϧͷΑ͏ͳ΋ͷ • ม׵༻ͷߦྻΛϧοΫΞοϓςʔϒϧͱ΋ݺͿ •

    5SBOTGPSNFS΍#&35ͳͲͰ͸ɺࣄલֶशͰ&NCFEEJOH૚΋ֶश͢Δ • ੲ͸୯ޠຒΊࠐΈͱݴޠϞσϧ͸ผʑʹֶश͍͕ͯͨ͠ɺࠓͰ͸ಉ࣌ʹʢ&OEUP&OEͰʣֶ श͢Δ͜ͱ͕ओྲྀ IUUQTZPVUVCFL8;:B5O#ZD
  4. "UUFOUJPOͱ͸  • 5SBOTGPSNFSͰ༻͍ΒΕΔ"UUFOUJPO͸ೋछྨ͋Δ • $SPTT"UUFOUJPOɿ&ODPEFSଆͷେࣄͳ৘ใʹΑΓ஫໨ͯ͠ɺ%FDPEFSଆ͔Β ग़ྗ • ผ໊4PVSDF5BSHFU"UUFOUJPO &ODPEFS%FDPEFS"UUFOUJPO

    • 4FMG"UUFOUJPOɿࣗ਎ͷܥྻʹ͍ͭͯपΓΛݟͯɺΑΓྑ͍ϕΫτϧʹ͢Δ IUUQTTQFBLFSEFDLDPNTFJWJTJPOBOEMBOHVBHFUPGFOZFXPRVSJKVBOLVTIFODFOHYVFYJTIPVGBGBMTFTIBPKJF IUUQTTQFBLFSEFDLDPNLZPVOBUVUPSJBMPOOMQBOEWJTJPOBOEMBOHVBHF
  5. #&35ͱ͸  • #JEJSFDUJPOBM&ODPEFS3FQSFTFOUBUJPOGSPN5SBOTGPSNFSTͷུ • 5SBOTGPSNFSͷ&ODPEFSͷΈͰֶशͨ͠Ϟσϧ • ͭͷํ๏Ͱࣄલֶश • .BTLFE-BOHVBHF.PEFMɿೖྗΛҰ෦ϚεΫͯ͠༧ଌ

    • /FYU4FOUFODF1SFEJDUJPOɿจೖྗͯͦ͠ΕΒ͸ྡ઀จ͔൱͔ • ˢͷํ๏ͷ͓͔͛Ͱࣗવݴޠཧղʹڧ͍ IUUQTTQFBLFSEFDLDPNLZPVOBUVUPSJBMPOOMQBOEWJTJPOBOEMBOHVBHF
  6. #&35ͷ೿ੜϞσϧ  • #&35ʹ༷ʑͳ޻෉Λ੝ΓࠐΜͩΓɺੑೳҡ࣋ͯ͠ϞσϧαΠζͷখܕԽͳͲͷ೿ੜϞσϧ͕ଘࡏ͢Δ • ֶशํ๏Λ޻෉ • 3P#&35B • %F#&35B

    • &-&$53" • 9-/FU • খܕԽ • "-#&35 • %JTUJM#&35 • ϚϧνϞʔμϧ • 7-#&35 IUUQTHJUIVCDPNUIVOMQ1-.QBQFST
  7. ࢀߟจݙ  • ࣗવݴޠॲཧͱ7JTJPOBOE-BOHVBHF • ຒΊࠐΈ૚ • ܥྻσʔλϞσϦϯά 3//-45.5SBOTGPSNFS ɹୈ̎ճʮܥྻσʔλΛ

    ѻ͏ͨΊͷલॲཧʯ • ܥྻσʔλϞσϦϯά 3//-45.5SBOTGPSNFS ɹୈ̍̍ճʮ#&35 5ʯ • 5IF*MMVTUSBUFE5SBOTGPSNFS • #&358JLJQFEJB