vampire.pdf

A3ea3bc5dde6ae2dd6eae71da9c418b0?s=47 MARUYAMA
February 25, 2020
46

 vampire.pdf

A3ea3bc5dde6ae2dd6eae71da9c418b0?s=128

MARUYAMA

February 25, 2020
Tweet

Transcript

  1. Variational Pretraining for Semi-supervised Text Classification จݙ঺հ Suchin Gururangan, Tam

    Dang, Dallas Card, Noah A. Smith ACL2019, pages 5880–5894
  2. Abstract ⾣ܰྔͳࣄલֶशख๏ΛఏҊ ɾখن໛σʔλͰޮ཰తʹֶशՄೳ ɾߴ଎ʹಈ࡞ ⾣ςΩετ෼ྨλεΫʹ͓͍ͯɺ ɹ&-.P #&35ʹඖఢ͢ΔੑೳΛୡ੒

  3. Introduction ⾣&-.P #&35౳ͷࣄલֶशϞσϧ͕ ɹ޿͘ར༻͞Ε͍ͯΔ ⾣େن໛ͳίʔύεɾܭࢉࢿݯ͕ඞཁ ⾣ܰྔ͔ͭޮՌతͳࣄલֶशํ๏ΛఏҊ

  4. Model ⾣1SFUSBJOJOH ɾ7BSJBUJPOBM"VUP&ODPEFS

  5. Model ⾣1SFUSBJOJOH ɾ7BSJBUJPOBM"VUP&ODPEFS

  6. Model ⾣5FYUDMBTTJpDBUJPO

  7. Model ⾣5FYUDMBTTJpDBUJPO ɾ7".1*3&FNCFEEJOH݁߹ ɾ%FFQ"WFSBHF/FUXPSLͰ Τϯίʔυ

  8. Experimental setup ⾣%BUB ɾࣄલֶशσʔλ ɾ෼ྨثֶशςετ  d FYBNQMFT JOEPNBJO d

    FYBNQMFT
  9. Experimental setup ⾣-PXSFTPVSDFTFUUJOH ɾ#BTFMJOFڭࢣσʔλͷΈͰֶश ɾ4FMGUSBJOJOH൒ڭࢣ͋Γֶश  ڭࢣσʔλ Ϟσϧͷ༧ଌ݁Ռ ɾ(-07& *%

    JOEPNBJOσʔλͰֶश ɾ(-07& 0% .XPSETͷίʔύεͰֶश
  10. Results ⾣-PXSFTPVSDFTFUUJOH

  11. Results ⾣-PXSFTPVSDFTFUUJOH

  12. Experimental setup ⾣)JHISFTPVSDFTFUUJOH ɾ5SBOTGPSNFSCBTFE&-.P ɾ#&35 GSP[FO pOFUVOJOH QSFUSBJOJOH JOEPNBJO GSP[FO

    pOFUVOJOH
  13. Results ⾣)JHISFTPVSDFTFUUJOH

  14. Results ⾣)JHISFTPVSDFTFUUJOH

  15. Results ⾣$PNQVUBUJPOBM3FRVJSFNFOUT

  16. Conclusions ⾣ܰྔͳࣄલֶशख๏ΛఏҊ ɾখن໛σʔλͰޮ཰తʹֶशՄೳ ɾߴ଎ʹಈ࡞ ⾣ςΩετ෼ྨλεΫʹ͓͍ͯɺ ɹ&-.P #&35ʹඖఢ͢ΔੑೳΛୡ੒