Share
Embed
Another Diversity-Promoting Objective Function for Neural Dialogue Generation
My oral presentation slide at AAAI 2019 Workshop on Reasoning and Learning for Human-Machine Dialogues (DEEP-DIAL 2019).
paper: https://arxiv.org/abs/1811.08100
workshop site: https://sites.google.com/view/deep-dial-2019/program
Ryobot
January 27, 2019
Transcript
15 slides
-
IUUQTBSYJWPSHBCT "OPUIFS%JWFSTJUZ1SPNPUJOH0CKFDUJWF'VODUJPOGPS/FVSBM%JBMPHVF(FOFSBUJPO /BLBNVSBFUBM """*%&&1%*"-XPSLTIPQ "OPUIFS%JWFSTJUZ1SPNPUJOH0CKFDUJWF'VODUJPO GPS/FVSBM%JBMPHVF(FOFSBUJPO 3ZP/BLBNVSB ,BUTVIJUP4VEPI ,PJDIJSP:PTIJOP 4BUPTIJ/BLBNVSB
(SBEVBUF4DIPPMPG*OGPSNBUJPO4DJFODF /BSB*OTUJUVUFPG4DJFODFBOE5FDIPOPMPHZ +BQBO 3*,&/ $FOUFSGPS"EWBODFE*OUFMMJHFODF1SPKFDU"*1 +BQBO \OBLBNVSBSZPON TVEPI LPJDIJSP TOBLBNVSB^!JTOBJTUKQ !1 -
IUUQTBSYJWPSHBCT "OPUIFS%JWFSTJUZ1SPNPUJOH0CKFDUJWF'VODUJPOGPS/FVSBM%JBMPHVF(FOFSBUJPO /BLBNVSBFUBM """*%&&1%*"-XPSLTIPQ w"OPQFOEPNBJOEJBMPHVFTZTUFNUIBUHFOFSBUFTBSFTQPOTFXPSE CZXPSEVTJOHBUSBJOFEOFVSBMOFUXPSL FH TFRTFR w(FOFSBUJPOCBTFJTNPSFqFYJCMFUIBOSFUSJFWBMCBTF
CVUqVFODZ DPOTJTUFODZBSFOPUHPPE /FVSBM%JBMPHVF(FOFSBUJPO (P /PUIJOH NVDI 8IBU`T /PUIJOH NVDI VQ !2 w*OQBSUJDVMBS UIFHFOFSBUFESFTQPOTFIBTMPXEJWFSTJUZBOE UFOETUPCFBHFOFSJDSFTQPOTFMJLF*EPO`ULOPXz8IZ -
IUUQTBSYJWPSHBCT "OPUIFS%JWFSTJUZ1SPNPUJOH0CKFDUJWF'VODUJPOGPS/FVSBM%JBMPHVF(FOFSBUJPO /BLBNVSBFUBM """*%&&1%*"-XPSLTIPQ w'SFRVFOUXPSETJOUSBJOJOHTFUTVQQMZNPSFUSBJOJOHQFOBMUJFTUIBO SBSFXPSET w5IFSFGPSF MBSHFPDDVSSFODFQSPCBCJMJUJFTJTBTTJHOFEUPGSFRVFOU XPSET %VSJOHUSBJOJOH
EBUBEJTUSJCVUJPO POFIPUUBSHFUEJTUSJCVUJPO 4UVQJEJTBTTUVQJEEPFT QPPSUSBJOJOHTJHOBM XSPOHNPEFMEJTUSJCVUJPO SJDIUSBJOJOHTJHOBM !3 -
IUUQTBSYJWPSHBCT "OPUIFS%JWFSTJUZ1SPNPUJOH0CKFDUJWF'VODUJPOGPS/FVSBM%JBMPHVF(FOFSBUJPO /BLBNVSBFUBM """*%&&1%*"-XPSLTIPQ )FZ XIBU`TVQ )PXBSFZPV )FZ
&SJO8IBU`TVQ )J 4FBO)PXBSFZPVEPJOH /PUNVDI %PZPVIBWFBOZQMBOTUPOJHIU EBUBUSBOTEVDUJPO FOPSNPVTDBOEJEBUFTJOSFBMEJBMPHVF ."1QSFEJDUJPOBGUFS.-&USBJOJOH w%JBMPHVFHFOFSBUJPOJTBNBOZUPNBOZUSBOTEVDUJPOUBTLJO XIJDIDPOUFOUTWBSZEFQFOEJOHPOUIFDPOUFYU w'SFRVFOUXPSETBSFBQQMJDBCMFJOBOZDPOUFYU TPUIFZUFOEUPCF DBOEJEBUFTGPSHFOFSBUJPO w"TBSFTVMU POMZUIFNPTUMJLFMZSFTQPOTFJTHFOFSBUFE %VSJOHFWBMVBUJPO !4 -
IUUQTBSYJWPSHBCT "OPUIFS%JWFSTJUZ1SPNPUJOH0CKFDUJWF'VODUJPOGPS/FVSBM%JBMPHVF(FOFSBUJPO /BLBNVSBFUBM """*%&&1%*"-XPSLTIPQ w%VFUPMBDLPGEBUBBOEEBUBJNCBMBODF 4FSCBOFUBM w4PGUNBY$SPTT&OUSPQZ 4$& MPTTJTOPUHPPECFDBVTFBMMXPSET
BSFIBOEMFEFRVBMMZSFHBSEMFTTPGMBDLBOEJNCBMBODF #SFBLEPXOMPXEJWFSTJUZQSPCMFN .FBTVSFTBMSFBEZTVHHFTUFE /PTVHHFTUJPO8FDIBMMFOHFEJU !5 w'SFRVFOUXPSETTVQQMZNPSFQFOBMUJFTUIBOSBSFXPSET %VSJOHUSBJOJOH %VSJOHFWBMVBUJPO w.BYJNVN"1PTUFSJPSJ ."1 QSFEJDUTUIFNPTUMJLFMZ SFTQPOTFPOMZ w"XBZUPHFOFSBUFVOMJLFMZSFTQPOTFVTJOH.BYJNVN.VUVBM *OGPSNBUJPO ..* JTSFQPSUFEJO -JFUBM -
IUUQTBSYJWPSHBCT "OPUIFS%JWFSTJUZ1SPNPUJOH0CKFDUJWF'VODUJPOGPS/FVSBM%JBMPHVF(FOFSBUJPO /BLBNVSBFUBM """*%&&1%*"-XPSLTIPQ w5IFZVTFE.-&EVSJOHUSBJOJOHBOEVTFE..*BOUJ-.EVSJOH FWBMVBUJPO 1SFWJPVTSFTFBSDI w.BYJNVN.VUVBM*OGPSNBUJPO -JFUBM w..*BOUJ-.TVQQSFTTFTMBOHVBHFNPEFMMJLFHFOFSBUJPOCZ
TVCUSBDUJOHBMBOHVBHFNPEFMUFSNGSPNUSBOTEVDUJPO NPEFMUFSN !6 w*OQSBDUJDF ..*BOUJ-.HFOFSBUFTUPLFOZ -
IUUQTBSYJWPSHBCT "OPUIFS%JWFSTJUZ1SPNPUJOH0CKFDUJWF'VODUJPOGPS/FVSBM%JBMPHVF(FOFSBUJPO /BLBNVSBFUBM """*%&&1%*"-XPSLTIPQ w4$&MPTTUSFBUTFBDIUPLFO ɹDMBTTFRVBMMZ :PV EP OPU UBML
BCPVU 'JHIU $MVC :PV EP OPU UBML BCPVU 'JHIU $MVC !7 1SPQPTFENFUIPE w *5'MPTTTDBMFTTNBMMFSMPTT ɹGPSGSFRVFOUUPLFODMBTTFT 4PGUNBY$SPTT&OUSPQZMPTT *OWFSTF5PLFO'SFRVFODZMPTT -
IUUQTBSYJWPSHBCT "OPUIFS%JWFSTJUZ1SPNPUJOH0CKFDUJWF'VODUJPOGPS/FVSBM%JBMPHVF(FOFSBUJPO /BLBNVSBFUBM """*%&&1%*"-XPSLTIPQ #BTFMJOFT w4FR4FRMBZFST#J-45.XSFTJEVBMDPOOFDUJPOT w4FR4FR "UUFOUJPO w4FR4FR ..*
w.FN//DPOTJEFSJOHEJBMPHVFIJTUPSZVTJOHNFNPSZ &WBMVBUJPONFUSJDT w#-&6OHSBNTNBUDIJOHCFUXFFOBMMIZQPBOEBMMSFG w%*45EJTUJODUOHSBNTJOBMMHFOFSBUFESFTQPOTFT &YQFSJNFOUTFUVQT !10 %BUBTFUT w0QFO4VCUJUMFT &O .UVSOTBOE.FQJTPEFT w5XJUUFS &O+B ..UVSOTBOE..FQJTPEFT