Upgrade to Pro — share decks privately, control downloads, hide ads and more …

A Survey: Sounding Board & Gunrock

A Survey: Sounding Board & Gunrock

Scatter Lab Inc.

May 08, 2019
Tweet

More Decks by Scatter Lab Inc.

Other Decks in Research

Transcript

  1. ML Seminar 2 1 21 1- 0 1 2 ੉

    ઱ ഘ "MFYB1SJ[F 4PVOEJOH#PBSE(VOSPDL
  2. *OUSPEVDUJPO 3FMBUFE8PSL $PODMVTJPO &YQFSJNFOUT .PEFM • "MFYB1SJ[F 4PDJBMCPU (SBOE$IBMMFOHF •

    ࢎۈҗ ࠙زউ ੌҙغҊ ݒ۱੸ਵ۽ ؀ചೞח t4PDBJMCPUuਸ ݅٘ח ؀ഥ • ো৘ झನஎ ੿஖ ӝࣿ ಁ࣌ ١੄ അ੤ ੉߮౟ա ؀઺੸ੋ ઱ઁܳ ׮ܚ • ֙ ୡ؀ ਋थ੗ 4PVOEJOH#PBSE৬ ֙ ਋थ੗ (VOSPDLী ؀೧ࢲ ঌইࠁ੗ *OUSPEVDUJPO
  3. *OUSPEVDUJPO 3FMBUFE8PSL $PODMVTJPO &YQFSJNFOUT .PEFM 5FBN4PVOEJOH#PBSE • ֙ TU "MFYB1SJ[F8JOOFS

    • 6OJWFSTJUZPG8BTIJOHUPO؀೟ਗࢤ ݺҗ Үࣻש BEWJTPS ࠙ਵ۽ ౱ ҳࢿ • ߃߄ׯࠗఠ द੘ %JBMPHTZTUFNب ઁ؀۽ হҊ ೟णؘ੉ఠب হ঻਺ • ୡ߈ীח 4FR4FR۽ ೧ࠁ۰׮о ੜ উظࢲ 3VMFCBTFE "QQSPBDI۽ ߄Է
  4. *OUSPEVDUJPO 3FMBUFE8PSL $PODMVTJPO &YQFSJNFOUT .PEFM %FTJHO1IJMPTPQIZ • $POUFOUESJWFO • %BJMZDPOUFOU

    NJOJOH MBSHFEZOBNJDDPOUFOUDPMMFDUJPO • ,OPXMFEHFHSBQI • %JBMPHNBOBHFNFOU %. UIBUQSPNPUFTQPQVMBSDPOUFOU • 6TFSDFOUSJD • -BOHVBHFVOEFSTUBOEJOHUIBUEFUFDUTVTFSTFOUJNFOU • %.UIBUUSJFTUPMFBSOVTFSQFSTPOBMJUZ IBOEMFTSBQJEUPQJDDIBOHFT  USBDLTFOHBHFNFOU  • -BOHVBHFHFOFSBUJPOXJUIQSPTPEZBQQSPQSJBUF HSPVOEJOH
  5. *OUSPEVDUJPO 3FMBUFE8PSL $PODMVTJPO &YQFSJNFOUT .PEFM /BUVSBM-BOHVBHF6OEFSTUBOEJOH /-6 • .VMUJEJNFOTJPOBM/-63FQSFTFOUBUJPO Commands

    Questions Topics User Reactions Tell me a joke. What is your favorite color? Let’s talk about technology. That’s really interesting! approve, reject, unsure, null agree, disagree, unsure/neutral, null like, dislike, neutral, null Type(5) of Question 1) 질문형 명령 2) 봇정보 질문 3) 팩트 질문 4) 조언 요청 5) 질문 아님 Intents Nouns in sentence
  6. *OUSPEVDUJPO 3FMBUFE8PSL $PODMVTJPO &YQFSJNFOUT .PEFM %JBMPH.BOBHFNFOU %. • )JFSBSDIJDBM%. MFWFM

    • .BTUFS (MPCBM • ੹୓੸ੋ ؀ച ߂ .JOJTLJMMTਸ ҙܻ • 3BOLUPQJDT NJOJTLJMMT DPOUFOU • $POTJEFSUPQJDDPIFSFODF VTFSFOHBHFNFOU DPOUFOUBWBJMBCJMJUZ • .JOJTLJMMT -PDBM • ׮নೠ ઙܨ۽ աఋաח ೞա੄ ؀ച TFHNFOUী ؀ೠ ୊ܻ * Input: NLU Features Output: Speech act + Content
  7. *OUSPEVDUJPO 3FMBUFE8PSL $PODMVTJPO &YQFSJNFOUT .PEFM %JBMPH.BOBHFNFOU %. • .BTUFS •

    $POUFOU3FUSJFWBM • /-6ীࢲ ੉೧ೠ ઱ઁ৬ ੄بܳ ӝ߈ਵ۽ ࢜۽਍ ஶబஎ Ѩ࢝ • &SSPS)BOEMJOH • 4ZTUFN&SSPSSFRVFTUUJNFPVU 48CVH١ à SFTFUEJBMPHTUBUFSFTUBSUDPOWFSTBUJPO • "43&SSPS਺ࢿ ੋध੉ ੜޅػ Ѫী ؀೧ࢲ ୊ܻ • 4BUJTGBDUJPO%FUFDUJPO • ਬ੷ ҃೷ী ؀ೠ ୊ܻ • ਬ੷੄ х੿ ࢤпਸ ੟ইն FYഅ੤ ష೗ਸ ૑ܖ೧ೞח Ѫ э਷ؘ • рױೠ OHSBNӝ߈ MPHJTUJDSFHSFTTJPOCJOBSZDMBTTJGJFSࢎਊ
  8. *OUSPEVDUJPO 3FMBUFE8PSL $PODMVTJPO &YQFSJNFOUT .PEFM %JBMPH.BOBHFNFOU %. • .JOJTLJMMT •

    $POUFOUPSJFOUFENJOJTLJMMT • 5SFOEJOH5PQJDT 'BDUT 0QJOJPOT /FXT 4QPSUT +PLFT١੄ ҃਋ ஶబஎо ઺ਃೞѱ ੘ਊೣ • ৻ࠗ ,# "1*١ਸ ੉ਊೞৈ ஶబஎܳ оઉ৬ࢲ ঌݏח ߊച ղਊਸ ࢤࢿ • 1FSTPOBMJUZ"TTFTTNFOU • ࢎۈ੄ ࢿѺ ١ਸ Ҋ۰ೞӝ ਤೠ ߊച ղਊਸ ࢤࢿ • &Yt%PZPVUBMLBMPU u • (FOFSBMNJOJTLJMMT • ੋࢎ ઙܐ ١ী ؀ೠ ୊ܻ
  9. *OUSPEVDUJPO 3FMBUFE8PSL $PODMVTJPO &YQFSJNFOUT .PEFM %JBMPH.BOBHFNFOU %. • Content Management

    • ݒੌ ৡۄੋ ࢚੄ ஶబஎ ׏झ 4/4١ ਸ ௼܀݂ • ࠗ੸੺ೠ ஶబஎٜ਷ ೙ఠ݂ • ఃਕ٘ ӝ߈ ੋؙयਸ ೞҊ ,OPXMFEHF(SBQI ഋక۽ ҙܻ
  10. *OUSPEVDUJPO 3FMBUFE8PSL $PODMVTJPO &YQFSJNFOUT .PEFM %JBMPH.BOBHFNFOU %. • 4QFFDIBDUTFMFDUJPO •

    ૑Әө૑੄ /-6'FBUVSFT৬ %.੄ TUBHFTܳ Ѣ஘ Ѿҗܳ ష؀۽ ѐ (SPVOEJOH *OGPSN 3FRVFTU *OTUSVDUJPO ੄ ఋੑਸ ыח TQFFDIBDUܳ ݅ٞ
  11. *OUSPEVDUJPO 3FMBUFE8PSL $PODMVTJPO &YQFSJNFOUT .PEFM /BUVSBM-BOHVBHF(FOFSBUJPO /-( • ਽׹ SFTQPOTF

    ਸ TQFFDIBDU۽ࠗఠ మ೒݁ ӝ߈ਵ۽ ࢤࢿ೧ն • 4QFFDIBDUח ѐ੄ ఋੑਸ о૗ HSPVOEJOH JOGPSNSFRVFTU JOTUSVDUJPO • ৘ܳ ٜয Grounding Interesting Inform the IMDB rating Request Do you like the movie’s director? Instruction null Speech Act • ୭ઙ੸ਵ۽ח 1SPTPEZ 6UUFSBODF1VSJGJDBUJPO ୊ܻܳ ೞৈ ߊച ࢤࢿ
  12. *OUSPEVDUJPO 3FMBUFE8PSL $PODMVTJPO &YQFSJNFOUT .PEFM 4PVOEJOH#PBSEו՛੼ • ইޖېب ؀ഥ੉׮ࠁפ /FVSBM"QQSPBDIࠁ׮

    3VMFী ҭ੢൤ ੄ઓ੸ੋ Ѫ э׮ • Ӓېࢲ Ӓ۠૑ п ݽٕ੄ ٣పੌ੉ ੜ ࢸݺغ૑ ঋইࢲ ੉೧ೞӝ য۰ਛ׮ &Yżżݽٕ਷ ࢎਊ੗੄ ӝ࠙җ ஶబஎܳ Ҋ۰೧ࢲ żżܳ ౸ױೠ׮ • ஶబஎ ,OPXMFEHF(SBQI о ؀ചী ؀ೠ ਬ੷੄ ݅઒ী ݒ਋ ݒ਋ ઺ਃೠ ৔ೱਸ ޷஖ח Ѫ э׮ • ੉ दझమ੉ ইޖېب మ೒݁ܙ ӝ߈੉ۄ ࢤࢿ੉ա ੉೧ী ؀ೠ ࠗ׸੉ ݆੉ ઴যٜয Ӓ۠ Ѫ эӝب ೞ׮ • п ݽٕী ૘઺೧ࢲ ੘সೞח Ѫ݅ఀ ௾ Ӓܿী ؀ೠ ҳ࢚੉ ઺ਃೡ Ѫ э׮
  13. *OUSPEVDUJPO 3FMBUFE8PSL $PODMVTJPO &YQFSJNFOUT .PEFM (VOSPDL • $POUFYUBXBSF)JFSBSDIJDBM%JBMPH.BOBHFS • ؀ച੄

    ߑೱী ؀ೠ ౸ױਸ ೞҊ • ҳ୓੸ੋ ੄ب৬ ஶబஎܳ ೤ೞৈ ߊചܳ ݅ٞ • TUFQ/-6 • 4FOUFODF4FHNFOUBUJPO • /PVO1ISBTFT%FUFDUJPO • п /PVO1ISBTFী ؀ೠ /-1DPNQPOFOUT୊ܻ • 4QFFDI4ZOUIFTJT QSPTPEJD
  14. *OUSPEVDUJPO 3FMBUFE8PSL $PODMVTJPO &YQFSJNFOUT .PEFM /BUVSBM-BOHVBHF6OEFSTUBOEJOH /-6  4FOUFODF4FHNFOUBUJPO 

    /PVO1ISBTF&YUSBDUJPO  &OUJUZ3FDPHOJUJPO  $PSFGFSFODF3FTPMVUJPO  "43$PSSFDUJPO  %JBMPH"DU1SFEJDUJPO  5PQJD&YQBOTJPO
  15. *OUSPEVDUJPO 3FMBUFE8PSL $PODMVTJPO &YQFSJNFOUT .PEFM /-6m 4FOUFODF4FHNFOUBUJPO • ࢎۈٜ੉ ӡҊ

    ࠂ੟ೞѱ ݈ೞח Ѫب ୊ܻ೧ঠ ೠ׮ • $PSOFMM.PWJF2VPUFT$PSQVT੄ ݅ѐ੄ ؀ച ઺ ড ݅ѐ੄ ߊചী ؀೧ CSFBLJOHQPJOUܳ ૒੽ MBCFMJOH • &YBNQMF • “Alexa that is cool what do you think of the Avengers” à “Alexa <BRK> that is cool <BRK> what do you think of the Avengers <BRK>” • .PEFM • GBTU5FYU XPSEFNCFEEJOH • "UUFOUJPO4FR4FR • MBZFS#J-45.&ODPEFS • MBZFS3//%FDPEFS • FQPDIT ੿ب ೟णदௌਸ ٸ ੄ 5FTUࢿמਸ ࠁ੐
  16. *OUSPEVDUJPO 3FMBUFE8PSL $PODMVTJPO &YQFSJNFOUT .PEFM /-6m /PVO1ISBTF&YUSBDUJPO • 4UBOGPSE$PSF/-1 DPOTUJUVFODZQBSTFS

    ࢎਊ • ॶݽহח 4UPQXPSE FHJU BMM ઁѢ • 'VUVSF8PSLਵ۽ EFQFOEFODZQBSTFSܳ ੉ਊೞח ߑߨਸ Ҋ۰઺
  17. *OUSPEVDUJPO 3FMBUFE8PSL $PODMVTJPO &YQFSJNFOUT .PEFM /-6m &OUJUZ3FDPHOJUJPO • ӝઓ੄ /&3ో

    4UBOGPSE$PSF/-1 TQB$Z ਷ ؀ࣗޙ੗ী ݒ਋ ੄ઓ੸੐ • ژೠ HFOFSBMೠ FOUJUZܳ ੟ইղӝ औ૑ ঋ਺ • ٮۄࢲ ӝઓ /&3ਸ উॳҊ ୶୹ೠ /PVO1ISBTFী ؀೧ ,OPXMFEHF(SBQIܳ ా೧ FOUJUZܳ ੟ইն • (PPHMF,OPXMFEHF(SBQI .JDSPTPGU$PODFQU (SBQI ١ী ؀೧ࢲ /PVO1ISBTFܳ Ѩ࢝ೞҊ न܉بо ֫਷ ҃਋ ੉ܳ FOUJUZ۽ ੋध • ৘ܳ ٜয tUPNCSBJEFSuܳ Ѩ࢝ೞݶ tWJEFPHBNF TFSJFTuۄח MBCFM੉ ֫਷ न܉بܳ ыҊ ੓Ҋ ٮۄࢲ uUPNCSBJEFSuܳ tWJEFPHBNFTFSJFTuۄҊ కӦ
  18. *OUSPEVDUJPO 3FMBUFE8PSL $PODMVTJPO &YQFSJNFOUT .PEFM /-6m $PSFGFSFODF3FTPMVUJPO • ੌઙ੄ ؀ݺࢎ

    ୊ܻ ੿ب۽ ੉೧ೞݶ ؽ • ӝઓ ݽ؛ٜ $PSF/-1 /FVSBM$PSFG ח ؀ച ؘ੉ఠ۽ ೟णػ Ѫ੉ ইפӝী ੜ ੘زೞ૑ ঋ਺ • Ӓېࢲ ࢜۽ MBCFMJOHਸ ೧ࢲ ೟णदఅ٠ೣ
  19. *OUSPEVDUJPO 3FMBUFE8PSL $PODMVTJPO &YQFSJNFOUT .PEFM /-6m %JBMPH"DU1SFEJDUJPO • "OOPUBUFE؀ച ؘ੉ఠо

    হӝ ٸޙী 4XJUDICPBSE %JBMPH"DU$PSQVT 4X%" ܳ ࢎਊ • MBZFS#J-45. MBZFS$//١ਸ ࢎਊ XGBTU5FYU • ࢿמ਷ ل׮  ੿ب۽ ࠺तೣ • അ੤ &-.P৬ 3FDVSSFOU$POWPMVUJPOBM//ਵ۽ ҅ࣘ प೷ਸ ૓೯ ઺੉ۄҊ ೣ
  20. *OUSPEVDUJPO 3FMBUFE8PSL $PODMVTJPO &YQFSJNFOUT .PEFM /-6m 5PQJD&YQBOTJPO • ,OPXMFEHF(SBQI۽ࢲ $PODFQU/FUਸ

    ੉ਊ • അ੤ ফӝೞח ష೗ FOUJUZ ਵ۽ࠗఠ ഛ੢दெоݴ ؀ചܳ ੉যт ࣻ ੓ب۾ ೣ • ৘ܳ ٜয അ੤ ੗زରী ؀೧ ফӝೞҊ ੓׮ݶ ,OPXMFEHF(SBQI ࢚ীࢲ ഛ੢ SFUSJFWF оמೠ t7PMWPuী ؀ೠ ফӝ۽ ઱ઁܳ ഛ੢೧ࠅ ࣻ ੓਺ • /-6о ইפҊ %. ଃীࢲ ୊ܻೞח ѱ ݏ૑ ঋա
  21. *OUSPEVDUJPO 3FMBUFE8PSL $PODMVTJPO &YQFSJNFOUT .PEFM %JBMPH.BOBHFNFOU %. • MFWFM )JFSBSDIJDBM%JBMPH

    .BOBHFSо ؀ചܳ ҙܻೣ • )JHIMFWFMীࢲח /-6੄ PVUQVUਸ ӝ߈ਵ۽ ੸੺ೠ UPQJDEJBMPH NPEVMFਸ ࢶఖೣ • -PXMFWFMীࢲח ࢶఖػ UPQJD EJBMPH NPEVMF੉ प೯ؽ High Low
  22. *OUSPEVDUJPO 3FMBUFE8PSL $PODMVTJPO &YQFSJNFOUT .PEFM %.m )JHIMFWFM4ZTUFN • *OUFOU$MBTTJGJFS •

    $PNNPO"MFYB1SJ[F$IBUT $"1$ EBUBTFUܳ ࢎਊ ֙ ؀ഥ ؘ੉ఠ۽ ݅ٞ • 4ZTUFN3FRVFTU tQMBZNVTJDu tUVSOPOUIFMJHIUTu ٮ۽ ୊ܻ • ӝࠄ੸ੋ *OUFOU౵ঈҗ ೣԋ ,(١ਸ ӝ߈ਵ۽ ష೗ UPQJDJOUFOU ਸ ੟ইն • %JBMPH.PEVMF4FMFDUPS • *OUFOU$MBTTJGJFS۽ࠗఠ ଺ইմ UPQJDJOUFOUܳ ా೧ EJBMPHNPEVMFਸ ࢶఖ • ৘ܳ ٜয tMFUsTUBMLBCPVUNPWJFTuۄח ߊചо ٜযয়ݶ tNPWJFuۄח Ѧ *OUFOU$MBTTJGJFSо ನ଱ೞҊ 4FMFDUPSח NPWJFNPEVMFਸ ࢶఖೣ
  23. *OUSPEVDUJPO 3FMBUFE8PSL $PODMVTJPO &YQFSJNFOUT .PEFM %.m -PXMFWFM4ZTUFN • 5PQJD%JBMPH.PEVMFT ѐ

    • "OJNBM3FEEJU"1*ਸ ੉ਊ೧ ਽׹ਸ ଺ইࢲ ࢎਊ • .PWJFBOE#PPL5.%#"1* (PPESFBET"1* *.%# ١ਸ ੉ਊ • .VTJD4QPUJGZsTNJMMJPO1MBZMJTUEBUBTFUী ੓ח BSUJTUী ؀೧ ফӝܳ ೣ • 4QPSU୭न ੿ࠁо ઺ਃ3FEEJU 5XJUUFS .PNFOUT /FXT١ ഝਊ • (BNF*(%. • 1TZDIPMPHZBOE1IJMPTPQIZ5&%UBML • )PMJEBZ 5SBWFM 5FDIOPMPHZBOE4DJFODF /FXT 3FUSJFWBM • ݈ਸ ݅٘ח Ѫ੉ ইפۄ ೧׼ ઱ઁীࢲ ൜޷۽਍ ੿ࠁܳ t଺ח Ѫu • ੿ࠁܳ ୶۰ࢲ /-(ী ઱ݶ మ೒݁ ӝ߈ਵ۽ ߊച ࢤࢿਸ ૓೯
  24. *OUSPEVDUJPO 3FMBUFE8PSL $PODMVTJPO &YQFSJNFOUT .PEFM /BUVSBM-BOHVBHF(FOFSBUJPO /-( • э਷ ݈ਸ

    غಽ੉ೞ૑ ঋҊ ׮নࢿਸ ઱ӝ ਤ೧ మ೒݁ ӝ߈ਵ۽ ࢤࢿ • 1SPTPEZ١ਸ Ҋ۰ೞৈ ߊചܳ ࢤࢿೞҊ ਺ࢿ ೤ࢿ TZOUIFTJT ୊ܻ
  25. *OUSPEVDUJPO 3FMBUFE8PSL $PODMVTJPO &YQFSJNFOUT .PEFM (VOSPDL ו՛੼ • ௾ ݓۅ਷

    4PVOEJOH#PBSE৬ ௼ѱ ׮ܰ૑ ঋ׮ • ୍೟ दझమ ইఃఫ୛ ஹನք౟ ١ Ѣ੄ ਬࢎೠ ו՝ • ׮݅ ইఃఫ୛ ࢸ҅ա ࢲࣿ ߑध੉ (VOSPDL੉ ખ ؊ ֤ܻ੸੉Ҋ ੉೧ೞӝ एਛ਺ • 4PVOEJOH#PBSE৬ח ׮ܰѱ /FVSBM"QQSPBDI੄ ࠺઺੉ ખ ؊ ழ઎׮ • 4FHNFOUBUJPO੉ա %JBMPHBDU࠙ܨীࢲ ա੉࠳ೞ૑݅ ੸ਊؽ • ೞ૑݅ Ӓ ޖ঺ࠁ׮ب ஶబஎ੄ ઺ਃبо ௼૑ ঋա ࢤпೣ