Upgrade to Pro — share decks privately, control downloads, hide ads and more …

업무 효율화를 위한 카카오 사내봇 개발기

kakao
October 29, 2024

업무 효율화를 위한 카카오 사내봇 개발기

#Data #AI #LLM #RAG

카카오 내에 수많은 데이터에서 원하는 데이터를 빠르게 찾아주는 '0depth 사내봇 개발기'를 공유합니다.
1. hybrid search를 넘은 multiple pool retriever
2. 비용효율적인 domain specific LLM
3. 히스토리 관리로 성능을 극대화한 multi-turn 처리

발표자 : tory.lee, jennie.py
tory.lee - 카카오 데이터 조직의 tory 입니다. 실용적이고 사용자 친화적인 AI Application을 만드는 것에 관심이 많습니다.
jennie.py - 다양한 AI 프로덕트를 생산하는 jennie입니다.

kakao

October 29, 2024
Tweet

More Decks by kakao

Other Decks in Programming

Transcript

  1. ੜ੿تػప੉࠶%PDVNFOUTࢤࢿ ੉ܴ ప੉࠶ ࢸݺ ணۢ j ੉ݽ౭௑ ೒۞झ UC@FNPUJDPO@QMVT ੉ݽ౭௑೒۞झ੿ࠁীҙ۲ػ

    ప੉࠶ੑפ׮ ೨ब૑಴۽חоѺ ౸ݒ۝ ݒ୹੉੓Ҋ  QSJDF TBMFT@WPMVNF BNUীࢲ ഛੋೡࣻ੓णפ׮ • QSJDFоѺ • TUBUVTоੑ࢚క • TBMFT@WPMVNF౸ݒ۝ • BNUݒ୹ j j ஠஠য়ࣳೝ UC@HJGU ஠஠য়ࣳೝ੿ࠁীҙ۲ػప੉࠶ੑפ׮ j • JUFN@JE ই੉మই੉٣ • QSJDFоѺ j j j j j j
  2. Ѩ࢝ߑߨۿ ªفߑߨਸݽفࢎਊೠ)ZCSJE4FBSDI -FYJDBM4FBSDI 4FNBOUJD4FBSDI ࢸݺ ࢎਊ੗оੑ۱ೠఃਕ٘ܳನೣೠޙࢲܳ଺ইղחѨ࢝ ߑध /-1ݽ؛ਸ੉ਊೞৈ੄޷ޙݓਸҊ۰ೞחѨ࢝ߑध ੢੼ ◦

    рױೞҊ૒ҙ੸ ◦ ࡅܲ୊ܻࣘب ◦ ੄޷ޙݓ੉೧ ◦ য়ఋী؏޹х ױ੼ ◦ ޙݓޖद ◦ য়ఋী޹х ◦ ࠺Ү੸וܽ୊ܻࣘب ◦ ੿ഛبޙઁ
  3. ணۢݺਸ੿ഛ൤Ѩ࢝೮਺ীب ప੉࠶ਸ଺૑ޅೣ ౠ੿૕੄ী؀೧Ѩ࢝ਸੜޅೣ UC@FNPUJDPO@QMVT ప੉࠶੉ޤפ ప੉࠶ݺਸ੿ഛ൤Ѩ࢝೮਺ীب ծ਷झ௏য۽Ѩ࢝ؽ TBMFT@WPMVNF ணۢਸо૓ప੉࠶੉੓য ࣽਤ

    ప੉࠶੉ܴ झ௏য  UC@LBLBPU   UC@OBWJ   UC@CVT  ணۢݺਸ੿ഛ൤Ѩ࢝೮਺ীب ప੉࠶ਸ଺૑ޅೣ UC@FNPUJDPO@QMVT ప੉࠶੉ޤפ TBMFT@WPMVNF ணۢਸо૓ప੉࠶੉੓য UC@FNPUJDPO@QMVT ప੉࠶੉ޤפ ప੉࠶ݺਸ੿ഛ൤Ѩ࢝೮਺ীب ծ਷झ௏য۽Ѩ࢝ؽ TBMFT@WPMVNF ணۢਸо૓ప੉࠶੉੓য ணۢݺਸ੿ഛ൤Ѩ࢝೮਺ীب ప੉࠶ਸ଺૑ޅೣ ࣽਤ ప੉࠶੉ܴ झ௏য  UC@FNPUJDPO@JUFN   UC@FNPUJDPO   UC@FNPUJDPO@QMVT  ࣽਤ ప੉࠶੉ܴ झ௏য  UC@FNPUJDPO@JUFN   UC@FNPUJDPO   UC@FNPUJDPO@QMVT 
  4. ؘ੉ఠ ౠ૚ী ٮۄ ܻ࠙೧ࢲ 1PPMਸࢤࢿ TBMFT@WPMVNFчਸо૓ప੉࠶੉੓য UC@FNPUJDPO@QMVT ప੉࠶੉ޤפ ੉ݽ౭௑೒۞झݒ୹ؘ੉ఠয٣ࢲࠊ 1PPM

    1PPM 1PPM ؘ੉ఠ੉ܴ੉ݽ౭௑೒۞झ ؘ੉ఠࢸݺ੉ݽ౭௑೒۞झ੿ࠁী ҙ۲ػప੉࠶ੑפ׮ ೨ब૑಴۽חоѺ ౸ݒ۝ ݒ୹੉ ੓Ҋ j TBMFT@WPMVNFчਸо૓ప੉࠶੉੓য ੉ݽ౭௑೒۞झݒ୹ؘ੉ఠয٣ࢲࠊ UC@FNPUJDPO@QMVT ప੉࠶੉ޤפ TBMFT@WPMVNFчਸо૓ప੉࠶੉੓য ప੉࠶੉ܴUC@FNPUJDPO@QMVT ੉ݽ౭௑೒۞झݒ୹ؘ੉ఠয٣ࢲࠊ TBMFT@WPMVNFчਸо૓ప੉࠶੉੓য ஸۢQSJDFоѺ TUBUVTоੑ࢚క TBMFT@WPMVNF ౸ݒ۝ j
  5.  5BCMF1PPM ੉ܴ ప੉࠶ ࢸݺ ணۢ j ੉ݽ౭௑ ೒۞झ UC@FNPUJDPO@QM

    VT ੉ݽ౭௑೒۞झ੿ࠁীҙ۲ػ ప੉࠶ੑפ׮ ೨ब૑಴۽חоѺ ౸ݒ۝ ݒ୹੉੓Ҋ QSJDF TBMFT@WPMVNF BNUীࢲ ഛੋೡࣻ੓णפ׮ • QSJDFоѺ • TUBUVTоੑ࢚క • TBMFT@WPMVNF  ౸ݒ۝ • BNUݒ୹ j j ஠஠য়ࣳೝ UC@HJGU ஠஠য়ࣳೝ੿ࠁীҙ۲ػప੉࠶ੑפ׮ j • JUFN@JE ই੉మ ই੉٣ • QSJDFоѺ j j 5BCMF1PPM Ҋਬప੉࠶ݺӒ؀۽ਬ૑ UC@FNPUJDPO@QMVT ప੉࠶੉ޤפ ప੉࠶ؘ੉ఠо઺ਃ
  6.  %FTDSJQUJPO1PPM ੉ݽ౭௑೒۞झݒ୹ؘ੉ఠয٣ࢲࠊ ࢸݺؘ੉ఠо઺ਃ ੉ܴ ప੉࠶ ࢸݺ ணۢ j ੉ݽ౭௑

    ೒۞झ UC@FNPUJDPO@QM VT ੉ݽ౭௑೒۞झ੿ࠁীҙ۲ػ ప੉࠶ੑפ׮ ೨ब૑಴۽חоѺ ౸ݒ۝ ݒ୹੉੓Ҋ QSJDF TBMFT@WPMVNF BNUীࢲ ഛੋೡࣻ੓णפ׮ • QSJDFоѺ • TUBUVTоੑ࢚క • TBMFT@WPMVNF  ౸ݒ۝ • BNUݒ୹ j j ஠஠য়ࣳೝ UC@HJGU ஠஠য়ࣳೝ੿ࠁীҙ۲ػప੉࠶ੑפ׮ j • JUFN@JE ই੉మ ই੉٣ • QSJDFоѺ j j %FTDSJQUJPO1PPM ప੉࠶ೠӖ੉ܴ ࢸݺݽفࢎਊ ࢎղష௼ա੉੷੉ਊ
  7.  $PMVNO1PPM TBMFT@WPMVNFчਸо૓ప੉࠶੉੓য ணؘۢ੉ఠо઺ਃ ੉ܴ ప੉࠶ ࢸݺ ணۢ j ੉ݽ౭௑

    ೒۞झ UC@FNPUJDPO@QM VT ੉ݽ౭௑೒۞झ੿ࠁীҙ۲ػ ప੉࠶ੑפ׮ ೨ब૑಴۽חоѺ ౸ݒ۝ ݒ୹੉੓Ҋ QSJDF TBMFT@WPMVNF BNUীࢲ ഛੋೡࣻ੓णפ׮ • QSJDFоѺ • TUBUVTоੑ࢚క • TBMFT@WPMVNF  ౸ݒ۝ • BNUݒ୹ j j ஠஠য়ࣳೝ UC@HJGU ஠஠য়ࣳೝ੿ࠁীҙ۲ػప੉࠶ੑפ׮ j • JUFN@JE ই੉మ ই੉٣ • QSJDFоѺ j j $PMVNO1PPM Ҋਬணۢݺ਷ਬ૑ೞݴ ࢎղష௼ա੉੷੉ਊ
  8. Ѩ࢝೒۽਋ $PMVNO1PPM )ZCSJE4FBSDI %FTDSJQUJPO1PPM 5BCMF1PPM $PMVNO1PPM %FTDSJQUJPO1PPM 5BCMF1PPM 4DPSJOH -FYJDBM

    4FBSDI 4FNBOUJD 4FBSDI 5BCMFUD@HJGU ೧׼ప੉࠶਷ࢶޛೞӝప੉࠶ ੑפ׮ 5BCMFUD@TIPQQJOH ೧׼ప੉࠶਷ࣳೝೞӝప੉࠶ ੑפ׮ 5BCMFUD@FNPUJDPO ೧׼ప੉࠶਷੉ݽ౭௑ ప੉࠶ੑפ׮ Ѩ࢝Ѿҗ 5BCMFUC@HJGU - ೧׼ప੉࠶਷ࢶޛೞӝ ప੉࠶ੑפ׮ - j 5BCMFUC@TIPQQJOH - ೧׼ప੉࠶਷ࣳೝೞӝ ప੉࠶ੑפ׮ - j 5BCMFUC@FNPUJDPO - ೧׼ప੉࠶਷੉ݽ౭௑ ప੉࠶ੑפ׮ - j tࢶޛೞӝݒ୹ప੉࠶ ঌ۰઻u
  9. ಿ૕֫਷ؘ੉ఠࣇҳ୷ਸਤ೧֢۱ 5BCMFUD@HJGU ೧׼ప੉࠶਷ࢶޛೞӝప੉࠶ੑפ׮ 5BCMFUD@TIPQQJOH ೧׼ప੉࠶਷ࣳೝೞӝప੉࠶ੑפ׮ 5BCMFUD@FNPUJDPO ೧׼ప੉࠶਷੉ݽ౭௑ప੉࠶ੑפ׮ 5BCMFUC@HJGU - ೧׼ప੉࠶਷ࢶޛೞӝప੉࠶ੑפ׮

    - j 5BCMFUC@TIPQQJOH - ೧׼ప੉࠶਷ࣳೝೞӝప੉࠶ੑפ׮ - j 5BCMFUC@FNPUJDPO - ೧׼ప੉࠶਷੉ݽ౭௑ప੉࠶ੑפ׮ - j Ѩ࢝Ѿҗ3BOLীъѤೞب۾ള۲ ೟णؘ੉ఠࣇ૒੽ҳ୷ ;IPV $ FUBMt-*."-FTTJTNPSFGPSBMJHONFOUu  
  10.    80% 82% 84% 86% 88% 90% 92%

    94% 96% ݾ಴ࢿמ 4'5NPEFM CBTFNPEFM # Q Ӓ۞աইए਍--.ࢿמ ಣо૑಴"DDVSBDZ - पઁ੿׹ਸӝળਵ۽׹߸੉ৢ߄ܲ૑ഛੋ - ಣоؘ੉ఠডѐ2O" 4FU
  11. 5BTL߹੹ޙݽ؛ҳ୷ਵ۽ ੿ഛب࢚थ ੌ࢚ ૕ޙ ప੉࠶ ਤ஖ࢸݺ 42-ࢤࢿ 5SBJOEBUB ప੉࠶ਤ஖ࢸݺ 1SPNQU

    42-ࢤࢿ1SPNQU ੌ࢚૕ޙ1SPNQU 1SPNQU ੌ࢚૕ޙ--. ప੉࠶ਤ஖ࢸݺ --. 42-ࢤࢿ--. 4'5 4'5 4'5 --.T ;IBOH 5 FUBMt3"'5"EBQUJOH-BOHVBHF.PEFMUP%PNBJO4QFDJGJD3"(u   8FJ + FUBMt$IBJOPG5IPVHIU1SPNQUJOH&MJDJUT3FBTPOJOHJO-BSHF-BOHVBHF.PEFMTu  
  12. -P3""EBQUFS -P3""EBQUFS -P3""EBQUFS CBTFNPEFM # .VMUJQMF-P3" "EBQUFSTҳઑ۽࠺ਊബਯച 42-ࢤࢿ--. ప੉࠶ਤ஖ࢸݺ --.

    ੌ࢚૕ޙ--. .# .# .# (# )V &+ FUBMt-P3"-PXSBOLBEBQUBUJPOPGMBSHFMBOHVBHFNPEFMTu  
  13. .VMUJQMF-P3" "EBQUFSTҳઑ۽࠺ਊബਯച SPXT DPMVNOT DPMVNOT DPMVNOT SPXT SPXT  

           )V &+ FUBMt-P3"-PXSBOLBEBQUBUJPOPGMBSHFMBOHVBHFNPEFMTu  
  14. .VMUJQMF-P3" "EBQUFSTҳઑ۽࠺ਊബਯച 4'5.PEFM (# 4'5.PEFM 4'5.PEFM (# (# (# -P3""EBQUFS

    -P3""EBQUFS -P3""EBQUFS CBTFNPEFM # .# .# .# (# (# )V &+ FUBMt-P3"-PXSBOLBEBQUBUJPOPGMBSHFMBOHVBHFNPEFMTu  
  15.      (15PNJOJ (15P CBTFNPEFM # ؝झ5BTLܻ࠙੹

    ؝झ୭ઙ--. ੿ഛبড_Q࢚थ ಣо૑಴"DDVSBDZ - पઁ੿׹ਸӝળਵ۽׹߸੉ৢ߄ܲ૑ഛੋ - ಣоؘ੉ఠডѐ2O" 4FU
  16. ൤झషܻоӡয૑ݶ ࣘبݫݽܻࢎਊܫ ୭؀ߓૐо EFQUICPU ࢶޛೞӝݒ୹ঌ۰઻ ௪ܻب૞઻ 4&-&$5TVN BNU BNU '30.UC@HJGU

    8)&3&ZFBSrs ҙ۲Ѩ࢝Ѿҗ5PQ ࢶޛೞӝݒ୹਷UC@HJGU੄ BNUணۢчਸ೤ೞݶؾפ׮ ҙ۲Ѩ࢝Ѿҗ5PQ UC@NFMPO ప੉࠶ਸ ࢸݺ೧઻
  17. EFQUICPU ൤झషܻоӡয૑ݶ UC@NFMPO ప੉࠶ਸ ࢸݺ೧઻ UC@NFMPO਷ ࢶޛೞӝ ప੉࠶ੑפ׮ ઱ਃணۢ਷ ୨о૑۽

     NVTJD@OBNF ֢ېઁݾ BSUJTU оࣻ j ׹߸ಿ૕੷ೞ ҙ۲Ѩ࢝Ѿҗ5PQ ࢶޛೞӝݒ୹਷UC@HJGU੄ BNUணۢчਸ೤ೞݶؾפ׮ ࢶޛೞӝݒ୹ঌ۰઻ ҙ۲Ѩ࢝Ѿҗ5PQ
  18. EFQUICPU ஠సQW 42-૞઻ 4&-&$5DPVOU '30.UC@UBML@WJTJU 8)&3&8)&3& ZFBSrs ҙ۲Ѩ࢝Ѿҗ5PQ ҙ۲Ѩ࢝Ѿҗ5PQ ࢜۽਍ݓۅ૕੄

    ªҗѢ൤झషܻ࢏ઁ ࢶޛೞӝݒ୹਷UC@HJGU੄ BNUணۢчਸ೤ೞݶؾפ׮  ࢶޛೞӝݒ୹ঌ۰઻
  19. EFQUICPU ੉ݽ౭௑೒۞झ ҳة੗ࣻܳঌҊरয UC@FNPUJDPO@QMVTীࢲ JT@BDUJWF ணۢਵ۽ઑഥ оמ೤פ׮ ҙ۲Ѩ࢝Ѿҗ5PQ ୶оప੉࠶೙ਃ 9

    ª ঱әػప੉࠶੿ࠁ݅୶о ߑӘప੉࠶ ؊੗ࣁೞѱࢸݺ೧઻ UC@FNPUJDPO@QMVTח ੉ݽ౭௑೒۞झҳة੗ ప੉࠶۽ ݒ઱షਃੌ݃׮ ੸੤ؾפ׮ ઱ਃணۢਵ۽חj ঱әػప੉࠶੿ࠁ
  20. EFQUICPU ҙ۲Ѩ࢝Ѿҗ5PQ ୶оప੉࠶೙ਃ ª ӝઓݓۅӝ߈ਵ۽Ѩ࢝ Ӓప੉࠶੉ی ࠺तೠѢ୶ୌ೧઻ ੉ݽ౭௑೒۞झ ҳة੗ࣻܳঌҊरয UC@FNPUJDPO@QMVTীࢲ

    JT@BDUJWF ணۢਵ۽ઑഥ оמ೤פ׮ о૑ప੉࠶ਸ ୶ୌ٘݀פ׮  UC@FNPUJDPO  UC@FNPUJDPO@JOGP j ҙ۲Ѩ࢝Ѿҗ5PQ Ѩ࢝௪ܻ
  21. ୭ઙইఃఫ୊ ప੉࠶ਤ஖ࢸݺ 42-ࢤࢿ ੌ࢚૕ޙ റࣘ૕ޙѨ࢝9 "OTXFS 7BMJEBUPS (FOFSBUJPO 3FUSJFWBM 6TFS

    റࣘ૕ޙmѨ࢝0 ࢜۽਍ݓۅ૕੄ 5BTLਬഋ .VMUJUVSO ਬഋ )JTUPSZ 1SFQSPDFTTPS 3PVUFS 1PPM 1PPM 1PPM 3FUSJFWFS --. --. --.
  22. ୭ઙࢿמ     *OJUJBM3FUSJFWFS 9(15P ؝झ3FUSJFWFS 9CBTFNPEFM ؝झ3FUSJFWFS

    9(15P ؝झ3FUSJFWFS 9؝झ--. ಣоӝળ"DDVSBDZ - ׹߸ী੿׹ప੉࠶੉ನೣغয੓ח૑ഛੋ - ಣоؘ੉ఠডѐ2O" 4FU Q
  23. 2"