Upgrade to Pro — share decks privately, control downloads, hide ads and more …

“머신러닝 엔지니어가 다녀온 F8” 김준성 - F8 2019 Meetup:Seoul

“머신러닝 엔지니어가 다녀온 F8” 김준성 - F8 2019 Meetup:Seoul

B389eb128688072da7124603ef406524?s=128

Junseong

May 15, 2019
Tweet

Transcript

  1. ݠन۞׬ ূ૑פযо ׮֗ৡ Facebook F8 ӣળࢿ Developer Circles Seoul F8

    Viewing Meetup ScatterLab 
 Machine Learning Engineer
  2. F8 & ML F8 Overview Introduction # Timeline Experience Total

    Review 1. 2. 3. 4. 5.
  3. Source: Optional source placeholder. Delete if not used. ӣળࢿ (Junseong

    Kim) fb.com/codertimo ScatterLab Machine Learning Engineer ੌ࢚؀ച ੋҕ૑מ ೝಯ Machine Learning Team (࢑সӝמਃਗ) Naver Clova AI Research Intern Atlas Guide NLP/Machine Learning Engineer General Domain Dialog System/Chatbot (Chitchat) General Sentence Embedding (BERT, ElMo) And Diverse Natural Language Processing Tasks… Neural Machine Translation codertimo/BERT-pytorch 2.4k+ stars Research Domain Experience 2017, 2014 Intel ISEF Computer Science Finalist 2016, 2014 Intel KSEF Computer Science Grand Award Working Experience
  4. F8 Overview

  5. 2019 Facebook F8 Overview ױࣽ൤ ࢎۈр੄ connectionਸ ֈয ழޭפ౭ܳ ҳࢿೞחؘ

    ௾ ನழझ Facebook UI/UX with Community | Dev Circle
  6. 2019 Facebook F8 Overview ױࣽ൤ ࢎۈр੄ connectionਸ ֈয ழޭפ౭ܳ ҳࢿೞחؘ

    ௾ ನழझ ࢎۈр੄ ழޭפா੉࣌ਸ ೞחؘী ઺ब੉ ؼ ࣻ ੓ب۾ Facebook UI/UX with Community | Dev Circle Messenger, WhatsApp, Portal
  7. 2019 Facebook F8 Overview ױࣽ൤ ࢎۈр੄ connectionਸ ֈয ழޭפ౭ܳ ҳࢿೞחؘ

    ௾ ನழझ ࢎۈٜ੄ ೐ۄ੉ߡदܳ ୭؀ೠ ࠁഐೡ ࣻ ੓ب۾ ࢎۈр੄ ழޭפா੉࣌ਸ ೞחؘী ઺ब੉ ؼ ࣻ ੓ب۾ Facebook UI/UX with Community | Dev Circle Messenger, WhatsApp, Portal On-Device Model, Encryption
  8. 2019 Facebook F8 Overview ױࣽ൤ ࢎۈр੄ connectionਸ ֈয ழޭפ౭ܳ ҳࢿೞחؘ

    ௾ ನழझ ࢎۈٜ੄ ೐ۄ੉ߡदܳ ୭؀ೠ ࠁഐೡ ࣻ ੓ب۾ ࢎۈр੄ ழޭפா੉࣌ਸ ೞחؘী ઺ब੉ ؼ ࣻ ੓ب۾ ݠन۞׬ ݽ؛ਸ ా೧ ࠁ׮ ڙڙೠ Facebook UI/UX with Community | Dev Circle Messenger, WhatsApp, Portal On-Device Model, Encryption NLP, Vision, Audio
  9. 2019 Facebook F8 Overview ױࣽ൤ ࢎۈр੄ connectionਸ ֈয ழޭפ౭ܳ ҳࢿೞחؘ

    ௾ ನழझ ࢎۈٜ੄ ೐ۄ੉ߡदܳ ୭؀ೠ ࠁഐೡ ࣻ ੓ب۾ ࢎۈр੄ ழޭפா੉࣌ਸ ೞחؘী ઺ब੉ ؼ ࣻ ੓ب۾ ݠन۞׬ ݽ؛ਸ ా೧ ࠁ׮ ڙڙೠ ࢎۈٜীѱ ࢜۽਍ ҃೷ਸ Facebook UI/UX with Community | Dev Circle Messenger, WhatsApp, Portal On-Device Model, Encryption NLP, Vision, Audio Oculus
  10. 2019 Facebook F8 Overview ױࣽ൤ ࢎۈр੄ connectionਸ ֈয ழޭפ౭ܳ ҳࢿೞחؘ

    ௾ ನழझ ࢎۈٜ੄ ೐ۄ੉ߡदܳ ୭؀ೠ ࠁഐೡ ࣻ ੓ب۾ ࢎۈр੄ ழޭפா੉࣌ਸ ೞחؘী ઺ब੉ ؼ ࣻ ੓ب۾ ݠन۞׬ ݽ؛ਸ ా೧ ࠁ׮ ڙڙೠ ࢎۈٜীѱ ࢜۽਍ ҃೷ਸ Facebook UI/UX with Community | Dev Circle Messenger, WhatsApp, Portal On-Device Model, Encryption NLP, Vision, Audio Oculus ৮੹൤ ࢜܂ѱ Facebook
  11. F8 & ML

  12. Facebook F8ীࢲ ࠁৈળ ಕ੉झ࠘੄ AI Research to Production : Pytorch

    v1.0 stable release Social Protection: աࢂ ѱदޛ, ؆Ӗٜ ೙ఠ݂ ׮Ҵয ӝ҅ߣ৉ NMT(Neural Machine Translation) Video, Image Recognition & Captioning: ੉޷૑੄ ݫఋؘ੉ఠ ୶୹ Semi-Supervised Learning : ࣗӏݽ ۨ੉࠶ ؘ੉ఠ + ؀ӏݽ ೟णؘ੉ఠ ਺ࢿ & ച੗ ੋध ….
  13. Facebook F8ীࢲ ࠁৈળ ಕ੉झ࠘੄ AI Research to Production : Pytorch

    v1.0 stable release Social Protection: աࢂ ѱदޛ, ؆Ӗٜ ೙ఠ݂ ׮Ҵয ӝ҅ߣ৉ NMT(Neural Machine Translation) Video, Image Recognition & Captioning: ੉޷૑੄ ݫఋؘ੉ఠ ୶୹ Semi-Supervised Learning : ࣗӏݽ ۨ੉࠶ ؘ੉ఠ + ؀ӏݽ ೟णؘ੉ఠ ਺ࢿ & ച੗ ੋध …. Ӓ઺ীب ࡳਵۄҊ ೞݶ
  14. Facebook F8ীࢲ ࠁৈળ ಕ੉झ࠘੄ AI Research to Production : Pytorch

    v1.0 stable release ׮Ҵয ӝ҅ߣ৉ NMT(Neural Machine Translation) Semi-Supervised Learning : ࣗӏݽ ۨ੉࠶ ؘ੉ఠ + ؀ӏݽ ೟णؘ੉ఠ Ӓ઺ীب ࡳਵۄҊ ೞݶ
  15. Semi-Supervision Learning: ળ૑ب ೟ण ࣚ൜޹਷ ష౟ֈ ୭Ҋ੄ ҕѺࣻ۽ ੗ܻ ੟ও׮

    BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
  16. Semi-Supervision Learning: ળ૑ب ೟ण ࣚ൜޹਷ ష౟ֈ ୭Ҋ੄ ҕѺࣻ۽ ੗ܻ ੟ও׮

    BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding ࣚ൜޹਷ ష౟ֈ ୭Ҋ੄ ҕѺࣻ۽ ੗ܻ ੟ও׮ ݠन۞׬ই ੉۠Ѣ ݏ୶ݶࢲ ঱যખ ҕࠗ೧ࠊۄ! ݃!
  17. Semi-Supervision Learning: ળ૑ب ೟ण ࣚ൜޹਷ ష౟ֈ ୭Ҋ੄ ҕѺࣻ۽ ੗ܻ ੟ও׮

    BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding ࣚ൜޹਷ ష౟ֈ ୭Ҋ੄ ҕѺࣻ۽ ੗ܻ ੟ও׮ ݠन۞׬ই ੉۠Ѣ ݏ୶ݶࢲ ঱যખ ҕࠗ೧ࠊۄ! ݃! ֎ ޤ ੉۠ѩפ׮
  18. Semi-Supervision Learning: ળ૑ب ೟ण BERT: Pre-training of Deep Bidirectional Transformers

    for Language Understanding ֎ Ӓۗ؊פ ࢎۈਸ ੉҂যਃ
  19. Semi-Supervision Learning: ળ૑ب ೟ण BERT: Pre-training of Deep Bidirectional Transformers

    for Language Understanding https://github.com/codertiimo/BERT-pytorch ӵঌഘࠁ
  20. Semi-Supervision Learning: ળ૑ب ೟ण BERT: Pre-training of Deep Bidirectional Transformers

    for Language Understanding য় Ӓ۞ݶ ۨ੉࠶݂੉ Ѣ੄ হযب ৮੹ ૨ ੜغ੗ա? ੉Ѥ ഄݺ੉ঠ!! ੉޷૑ա য়٣য়ب ੜغա?????
  21. Semi-Supervision Learning: ળ૑ب ೟ण BERT: Pre-training of Deep Bidirectional Transformers

    for Language Understanding ֎ Ӓۗणפ׮. ੹ࠗ׮ ֫਷ ࢿמਸ ঳঻যਃ ݆ࣻ਷ ࢎۈ੉ ࣻরѤ੄ ؘ੉ఠܳ ੌੌ੉ ۨ੉࠶݂ೞח ߑधਸ ୭ࣗച ೣ
  22. ׮Ҵয ӝ҅ߣ৉ NMT(Neural Machine Translation) ࣚ൜޹਷ ష౟ֈ ୭Ҋ੄ ҕѺࣻ۽ ੗ܻ

    ੟ও׮ Sonny has became the best striker in Tottenham ટોનીહેમમાં સોની +ે, -.ાઈકર બ3યા છ ે ಕ੉झ࠘਷ ੹ࣁ҅ 100+ ੉࢚੄ ঱যܳ ૑ਗೞח ࢲ࠺झ ׮Ҵয ߣ৉਷ ಕ੉झ࠘੄ য়ے োҳ җઁ
  23. ׮Ҵয ӝ҅ߣ৉ NMT(Neural Machine Translation) ೞ૑݅ ߣ৉ NMTח زੌೠ ੄޷੄

    ׮Ҵয੄ ޙ੢੉ ؀۝ਵ۽ ೙ਃೣ ੉۠ ؘ੉ఠܳ ݅٘ח Ѫ਷ Ѣ੄ ࠛоמী оӰҊ ցޖ ݆਷ दрҗ ࠺ਊ੉ ೙ਃೣ
  24. ׮Ҵয ӝ҅ߣ৉ NMT(Neural Machine Translation) ೞ૑݅ ߣ৉ NMTח زੌೠ ੄޷੄

    ׮Ҵয੄ ޙ੢੉ ؀۝ਵ۽ ೙ਃೣ ੉۠ ؘ੉ఠܳ ݅٘ח Ѫ਷ Ѣ੄ ࠛоמী оӰҊ ցޖ ݆਷ दрҗ ࠺ਊ੉ ೙ਃೣ Semi-Supervision Learningਵ۽ ߓ਍ ঱য੄ ੉೧ܳ ׮Ҵয۽ ഛ੢ೞח ݽ؛ ѐߊ п ঱য Representation Space ܳ Matchingೞח ߑߨۿਸ ઁदೣ + On-device ীࢲ प೯оמೞب۾
  25. ׮Ҵয ӝ҅ߣ৉ NMT(Neural Machine Translation) https://code.fb.com/ai-research/laser-multilingual-sentence-embeddings/

  26. Research to Production : Pytorch v1.0 stable release ѐߊীࢲח ୭ъ

    UXܳ ੗یೞ૑݅ Production Scaleীࢲח ୭ড੗৓؍ Pytorch Pythonࢿמҗ Dynamic Graph Computation੄ ࣘب ੷ೞ ޙઁ
  27. Research to Production : Pytorch v1.0 stable release ONNX, Caffe2,

    Jit compile Production ޙઁ ೧Ѿ + MOBILE-ML
  28. Experience

  29. ࢎप ݈ب উغח ੹ѐ ׮਺઱ী Google I/O୹੢੉ ੓যࢲ ҕ૞۽ ࠺೯ӝ಴

    ஘ҳੋ ਌੤ש੄ ೧ழహ ଵо + ਌੤ש੄ ഐభীࢲ ࣼ߅ ࣃ೐ۆоח ࠺೯ӝীࢲ F8оח Ҋ١೟Ү ߓ೐ ୡ਋ো ੤ഥ ݃ஜژ ҳӖীࢲ Ӕޖೞन ࢶߓ৬ ୡ ߣѐ ޷౴ & ైয ಕ੉झ࠘ীࢲ ࠌ؍ ٜ࠙ਸ ؀ӏݽ۽ য়೐ۄੋ ੽ࢶ ਮഄש੄ ֎౟ਕ௼ী ઑੋ೧ పठۄ য়ష౵ੌۤب प೷
  30. ழޭפ౭

  31. ࣁ࣌

  32. ഥࢎ ഘࠁ(?) ੌ࢚؀ച ੋҕ૑מ ೝಯ

  33. ઱߸ైয

  34. Total Review

  35. ੿݈ ੤޷੓Ҋ ਬ੊ೞҊ જ਷ ࢎۈٜਸ ࢎӈҊ ڪয֥ ࣻ ੓Ҋ ׮নೠ

    ҃೷ਸ ೡ ࣻ ੓Ҋ ৈ۞ ੉ঠӝܳ ա־ݴ ৈ۞ ࢎ૓ਸ ନਵݴ ಕ੉झ࠘ Ҷૉܳ Ѷೞݴ ೞܖೞܖо ೯ࠂೞҊ ੤޷੓ח ࣁ࣌੉ ցޖ ݆Ҋ ݡਸѪ ݃पѪ੉ օ۰੓णפ׮ ࢎی೤פ׮❤ хࢎ೤פ׮ Facebook F8 +Dev Circle ղ֙ী ࢎ࠺۽ۄب ԙ ׮द য়Ҋरযਃ ੺؀ റഥ উೞपѩפ׮ ƃƃ
  36. Thank you