“머신러닝 엔지니어가 다녀온 F8” 김준성 - F8 2019 Meetup:Seoul

“머신러닝 엔지니어가 다녀온 F8” 김준성 - F8 2019 Meetup:Seoul

B389eb128688072da7124603ef406524?s=128

Junseong

May 15, 2019
Tweet

Transcript

  1. 1.

    ݠन۞׬ ূ૑פযо ׮֗ৡ Facebook F8 ӣળࢿ Developer Circles Seoul F8

    Viewing Meetup ScatterLab 
 Machine Learning Engineer
  2. 3.

    Source: Optional source placeholder. Delete if not used. ӣળࢿ (Junseong

    Kim) fb.com/codertimo ScatterLab Machine Learning Engineer ੌ࢚؀ച ੋҕ૑מ ೝಯ Machine Learning Team (࢑সӝמਃਗ) Naver Clova AI Research Intern Atlas Guide NLP/Machine Learning Engineer General Domain Dialog System/Chatbot (Chitchat) General Sentence Embedding (BERT, ElMo) And Diverse Natural Language Processing Tasks… Neural Machine Translation codertimo/BERT-pytorch 2.4k+ stars Research Domain Experience 2017, 2014 Intel ISEF Computer Science Finalist 2016, 2014 Intel KSEF Computer Science Grand Award Working Experience
  3. 5.
  4. 6.

    2019 Facebook F8 Overview ױࣽ൤ ࢎۈр੄ connectionਸ ֈয ழޭפ౭ܳ ҳࢿೞחؘ

    ௾ ನழझ ࢎۈр੄ ழޭפா੉࣌ਸ ೞחؘী ઺ब੉ ؼ ࣻ ੓ب۾ Facebook UI/UX with Community | Dev Circle Messenger, WhatsApp, Portal
  5. 7.

    2019 Facebook F8 Overview ױࣽ൤ ࢎۈр੄ connectionਸ ֈয ழޭפ౭ܳ ҳࢿೞחؘ

    ௾ ನழझ ࢎۈٜ੄ ೐ۄ੉ߡदܳ ୭؀ೠ ࠁഐೡ ࣻ ੓ب۾ ࢎۈр੄ ழޭפா੉࣌ਸ ೞחؘী ઺ब੉ ؼ ࣻ ੓ب۾ Facebook UI/UX with Community | Dev Circle Messenger, WhatsApp, Portal On-Device Model, Encryption
  6. 8.

    2019 Facebook F8 Overview ױࣽ൤ ࢎۈр੄ connectionਸ ֈয ழޭפ౭ܳ ҳࢿೞחؘ

    ௾ ನழझ ࢎۈٜ੄ ೐ۄ੉ߡदܳ ୭؀ೠ ࠁഐೡ ࣻ ੓ب۾ ࢎۈр੄ ழޭפா੉࣌ਸ ೞחؘী ઺ब੉ ؼ ࣻ ੓ب۾ ݠन۞׬ ݽ؛ਸ ా೧ ࠁ׮ ڙڙೠ Facebook UI/UX with Community | Dev Circle Messenger, WhatsApp, Portal On-Device Model, Encryption NLP, Vision, Audio
  7. 9.

    2019 Facebook F8 Overview ױࣽ൤ ࢎۈр੄ connectionਸ ֈয ழޭפ౭ܳ ҳࢿೞחؘ

    ௾ ನழझ ࢎۈٜ੄ ೐ۄ੉ߡदܳ ୭؀ೠ ࠁഐೡ ࣻ ੓ب۾ ࢎۈр੄ ழޭפா੉࣌ਸ ೞחؘী ઺ब੉ ؼ ࣻ ੓ب۾ ݠन۞׬ ݽ؛ਸ ా೧ ࠁ׮ ڙڙೠ ࢎۈٜীѱ ࢜۽਍ ҃೷ਸ Facebook UI/UX with Community | Dev Circle Messenger, WhatsApp, Portal On-Device Model, Encryption NLP, Vision, Audio Oculus
  8. 10.

    2019 Facebook F8 Overview ױࣽ൤ ࢎۈр੄ connectionਸ ֈয ழޭפ౭ܳ ҳࢿೞחؘ

    ௾ ನழझ ࢎۈٜ੄ ೐ۄ੉ߡदܳ ୭؀ೠ ࠁഐೡ ࣻ ੓ب۾ ࢎۈр੄ ழޭפா੉࣌ਸ ೞחؘী ઺ब੉ ؼ ࣻ ੓ب۾ ݠन۞׬ ݽ؛ਸ ా೧ ࠁ׮ ڙڙೠ ࢎۈٜীѱ ࢜۽਍ ҃೷ਸ Facebook UI/UX with Community | Dev Circle Messenger, WhatsApp, Portal On-Device Model, Encryption NLP, Vision, Audio Oculus ৮੹൤ ࢜܂ѱ Facebook
  9. 11.
  10. 12.

    Facebook F8ীࢲ ࠁৈળ ಕ੉झ࠘੄ AI Research to Production : Pytorch

    v1.0 stable release Social Protection: աࢂ ѱदޛ, ؆Ӗٜ ೙ఠ݂ ׮Ҵয ӝ҅ߣ৉ NMT(Neural Machine Translation) Video, Image Recognition & Captioning: ੉޷૑੄ ݫఋؘ੉ఠ ୶୹ Semi-Supervised Learning : ࣗӏݽ ۨ੉࠶ ؘ੉ఠ + ؀ӏݽ ೟णؘ੉ఠ ਺ࢿ & ച੗ ੋध ….
  11. 13.

    Facebook F8ীࢲ ࠁৈળ ಕ੉झ࠘੄ AI Research to Production : Pytorch

    v1.0 stable release Social Protection: աࢂ ѱदޛ, ؆Ӗٜ ೙ఠ݂ ׮Ҵয ӝ҅ߣ৉ NMT(Neural Machine Translation) Video, Image Recognition & Captioning: ੉޷૑੄ ݫఋؘ੉ఠ ୶୹ Semi-Supervised Learning : ࣗӏݽ ۨ੉࠶ ؘ੉ఠ + ؀ӏݽ ೟णؘ੉ఠ ਺ࢿ & ച੗ ੋध …. Ӓ઺ীب ࡳਵۄҊ ೞݶ
  12. 14.

    Facebook F8ীࢲ ࠁৈળ ಕ੉झ࠘੄ AI Research to Production : Pytorch

    v1.0 stable release ׮Ҵয ӝ҅ߣ৉ NMT(Neural Machine Translation) Semi-Supervised Learning : ࣗӏݽ ۨ੉࠶ ؘ੉ఠ + ؀ӏݽ ೟णؘ੉ఠ Ӓ઺ীب ࡳਵۄҊ ೞݶ
  13. 15.

    Semi-Supervision Learning: ળ૑ب ೟ण ࣚ൜޹਷ ష౟ֈ ୭Ҋ੄ ҕѺࣻ۽ ੗ܻ ੟ও׮

    BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
  14. 16.

    Semi-Supervision Learning: ળ૑ب ೟ण ࣚ൜޹਷ ష౟ֈ ୭Ҋ੄ ҕѺࣻ۽ ੗ܻ ੟ও׮

    BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding ࣚ൜޹਷ ష౟ֈ ୭Ҋ੄ ҕѺࣻ۽ ੗ܻ ੟ও׮ ݠन۞׬ই ੉۠Ѣ ݏ୶ݶࢲ ঱যખ ҕࠗ೧ࠊۄ! ݃!
  15. 17.

    Semi-Supervision Learning: ળ૑ب ೟ण ࣚ൜޹਷ ష౟ֈ ୭Ҋ੄ ҕѺࣻ۽ ੗ܻ ੟ও׮

    BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding ࣚ൜޹਷ ష౟ֈ ୭Ҋ੄ ҕѺࣻ۽ ੗ܻ ੟ও׮ ݠन۞׬ই ੉۠Ѣ ݏ୶ݶࢲ ঱যખ ҕࠗ೧ࠊۄ! ݃! ֎ ޤ ੉۠ѩפ׮
  16. 18.
  17. 19.

    Semi-Supervision Learning: ળ૑ب ೟ण BERT: Pre-training of Deep Bidirectional Transformers

    for Language Understanding https://github.com/codertiimo/BERT-pytorch ӵঌഘࠁ
  18. 20.

    Semi-Supervision Learning: ળ૑ب ೟ण BERT: Pre-training of Deep Bidirectional Transformers

    for Language Understanding য় Ӓ۞ݶ ۨ੉࠶݂੉ Ѣ੄ হযب ৮੹ ૨ ੜغ੗ա? ੉Ѥ ഄݺ੉ঠ!! ੉޷૑ա য়٣য়ب ੜغա?????
  19. 21.

    Semi-Supervision Learning: ળ૑ب ೟ण BERT: Pre-training of Deep Bidirectional Transformers

    for Language Understanding ֎ Ӓۗणפ׮. ੹ࠗ׮ ֫਷ ࢿמਸ ঳঻যਃ ݆ࣻ਷ ࢎۈ੉ ࣻরѤ੄ ؘ੉ఠܳ ੌੌ੉ ۨ੉࠶݂ೞח ߑधਸ ୭ࣗച ೣ
  20. 22.

    ׮Ҵয ӝ҅ߣ৉ NMT(Neural Machine Translation) ࣚ൜޹਷ ష౟ֈ ୭Ҋ੄ ҕѺࣻ۽ ੗ܻ

    ੟ও׮ Sonny has became the best striker in Tottenham ટોનીહેમમાં સોની +ે, -.ાઈકર બ3યા છ ે ಕ੉झ࠘਷ ੹ࣁ҅ 100+ ੉࢚੄ ঱যܳ ૑ਗೞח ࢲ࠺झ ׮Ҵয ߣ৉਷ ಕ੉झ࠘੄ য়ے োҳ җઁ
  21. 23.

    ׮Ҵয ӝ҅ߣ৉ NMT(Neural Machine Translation) ೞ૑݅ ߣ৉ NMTח زੌೠ ੄޷੄

    ׮Ҵয੄ ޙ੢੉ ؀۝ਵ۽ ೙ਃೣ ੉۠ ؘ੉ఠܳ ݅٘ח Ѫ਷ Ѣ੄ ࠛоמী оӰҊ ցޖ ݆਷ दрҗ ࠺ਊ੉ ೙ਃೣ
  22. 24.

    ׮Ҵয ӝ҅ߣ৉ NMT(Neural Machine Translation) ೞ૑݅ ߣ৉ NMTח زੌೠ ੄޷੄

    ׮Ҵয੄ ޙ੢੉ ؀۝ਵ۽ ೙ਃೣ ੉۠ ؘ੉ఠܳ ݅٘ח Ѫ਷ Ѣ੄ ࠛоמী оӰҊ ցޖ ݆਷ दрҗ ࠺ਊ੉ ೙ਃೣ Semi-Supervision Learningਵ۽ ߓ਍ ঱য੄ ੉೧ܳ ׮Ҵয۽ ഛ੢ೞח ݽ؛ ѐߊ п ঱য Representation Space ܳ Matchingೞח ߑߨۿਸ ઁदೣ + On-device ীࢲ प೯оמೞب۾
  23. 26.

    Research to Production : Pytorch v1.0 stable release ѐߊীࢲח ୭ъ

    UXܳ ੗یೞ૑݅ Production Scaleীࢲח ୭ড੗৓؍ Pytorch Pythonࢿמҗ Dynamic Graph Computation੄ ࣘب ੷ೞ ޙઁ
  24. 27.

    Research to Production : Pytorch v1.0 stable release ONNX, Caffe2,

    Jit compile Production ޙઁ ೧Ѿ + MOBILE-ML
  25. 29.

    ࢎप ݈ب উغח ੹ѐ ׮਺઱ী Google I/O୹੢੉ ੓যࢲ ҕ૞۽ ࠺೯ӝ಴

    ஘ҳੋ ਌੤ש੄ ೧ழహ ଵо + ਌੤ש੄ ഐభীࢲ ࣼ߅ ࣃ೐ۆоח ࠺೯ӝীࢲ F8оח Ҋ١೟Ү ߓ೐ ୡ਋ো ੤ഥ ݃ஜژ ҳӖীࢲ Ӕޖೞन ࢶߓ৬ ୡ ߣѐ ޷౴ & ైয ಕ੉झ࠘ীࢲ ࠌ؍ ٜ࠙ਸ ؀ӏݽ۽ য়೐ۄੋ ੽ࢶ ਮഄש੄ ֎౟ਕ௼ী ઑੋ೧ పठۄ য়ష౵ੌۤب प೷
  26. 31.
  27. 35.

    ੿݈ ੤޷੓Ҋ ਬ੊ೞҊ જ਷ ࢎۈٜਸ ࢎӈҊ ڪয֥ ࣻ ੓Ҋ ׮নೠ

    ҃೷ਸ ೡ ࣻ ੓Ҋ ৈ۞ ੉ঠӝܳ ա־ݴ ৈ۞ ࢎ૓ਸ ନਵݴ ಕ੉झ࠘ Ҷૉܳ Ѷೞݴ ೞܖೞܖо ೯ࠂೞҊ ੤޷੓ח ࣁ࣌੉ ցޖ ݆Ҋ ݡਸѪ ݃पѪ੉ օ۰੓णפ׮ ࢎی೤פ׮❤ хࢎ೤פ׮ Facebook F8 +Dev Circle ղ֙ী ࢎ࠺۽ۄب ԙ ׮द য়Ҋरযਃ ੺؀ റഥ উೞपѩפ׮ ƃƃ
  28. 36.