“머신러닝 엔지니어가 다녀온 F8” 김준성 - F8 2019 Meetup:Seoul

Transcript

1. ݠन۞׬ ূ૑פযо ׮֗ৡ Facebook F8 ӣળࢿ Developer Circles Seoul F8 Viewing Meetup ScatterLab 
 Machine Learning Engineer
2. F8 & ML F8 Overview Introduction # Timeline Experience Total Review 1. 2. 3. 4. 5.
3. Source: Optional source placeholder. Delete if not used. ӣળࢿ (Junseong Kim) fb.com/codertimo ScatterLab Machine Learning Engineer ੌ࢚؀ച ੋҕ૑מ ೝಯ Machine Learning Team (࢑সӝמਃਗ) Naver Clova AI Research Intern Atlas Guide NLP/Machine Learning Engineer General Domain Dialog System/Chatbot (Chitchat) General Sentence Embedding (BERT, ElMo) And Diverse Natural Language Processing Tasks… Neural Machine Translation codertimo/BERT-pytorch 2.4k+ stars Research Domain Experience 2017, 2014 Intel ISEF Computer Science Finalist 2016, 2014 Intel KSEF Computer Science Grand Award Working Experience
4. F8 Overview
5. 2019 Facebook F8 Overview ױࣽ൤ ࢎۈр੄ connectionਸ ֈয ழޭפ౭ܳ ҳࢿೞחؘ ௾ ನழझ Facebook UI/UX with Community | Dev Circle
6. 2019 Facebook F8 Overview ױࣽ൤ ࢎۈр੄ connectionਸ ֈয ழޭפ౭ܳ ҳࢿೞחؘ ௾ ನழझ ࢎۈр੄ ழޭפா੉࣌ਸ ೞחؘী ઺ब੉ ؼ ࣻ ੓ب۾ Facebook UI/UX with Community | Dev Circle Messenger, WhatsApp, Portal
7. 2019 Facebook F8 Overview ױࣽ൤ ࢎۈр੄ connectionਸ ֈয ழޭפ౭ܳ ҳࢿೞחؘ ௾ ನழझ ࢎۈٜ੄ ೐ۄ੉ߡदܳ ୭؀ೠ ࠁഐೡ ࣻ ੓ب۾ ࢎۈр੄ ழޭפா੉࣌ਸ ೞחؘী ઺ब੉ ؼ ࣻ ੓ب۾ Facebook UI/UX with Community | Dev Circle Messenger, WhatsApp, Portal On-Device Model, Encryption
8. 2019 Facebook F8 Overview ױࣽ൤ ࢎۈр੄ connectionਸ ֈয ழޭפ౭ܳ ҳࢿೞחؘ ௾ ನழझ ࢎۈٜ੄ ೐ۄ੉ߡदܳ ୭؀ೠ ࠁഐೡ ࣻ ੓ب۾ ࢎۈр੄ ழޭפா੉࣌ਸ ೞחؘী ઺ब੉ ؼ ࣻ ੓ب۾ ݠन۞׬ ݽ؛ਸ ా೧ ࠁ׮ ڙڙೠ Facebook UI/UX with Community | Dev Circle Messenger, WhatsApp, Portal On-Device Model, Encryption NLP, Vision, Audio
9. 2019 Facebook F8 Overview ױࣽ൤ ࢎۈр੄ connectionਸ ֈয ழޭפ౭ܳ ҳࢿೞחؘ ௾ ನழझ ࢎۈٜ੄ ೐ۄ੉ߡदܳ ୭؀ೠ ࠁഐೡ ࣻ ੓ب۾ ࢎۈр੄ ழޭפா੉࣌ਸ ೞחؘী ઺ब੉ ؼ ࣻ ੓ب۾ ݠन۞׬ ݽ؛ਸ ా೧ ࠁ׮ ڙڙೠ ࢎۈٜীѱ ࢜۽਍ ҃೷ਸ Facebook UI/UX with Community | Dev Circle Messenger, WhatsApp, Portal On-Device Model, Encryption NLP, Vision, Audio Oculus
10. 2019 Facebook F8 Overview ױࣽ൤ ࢎۈр੄ connectionਸ ֈয ழޭפ౭ܳ ҳࢿೞחؘ ௾ ನழझ ࢎۈٜ੄ ೐ۄ੉ߡदܳ ୭؀ೠ ࠁഐೡ ࣻ ੓ب۾ ࢎۈр੄ ழޭפா੉࣌ਸ ೞחؘী ઺ब੉ ؼ ࣻ ੓ب۾ ݠन۞׬ ݽ؛ਸ ా೧ ࠁ׮ ڙڙೠ ࢎۈٜীѱ ࢜۽਍ ҃೷ਸ Facebook UI/UX with Community | Dev Circle Messenger, WhatsApp, Portal On-Device Model, Encryption NLP, Vision, Audio Oculus ৮੹൤ ࢜܂ѱ Facebook
11. F8 & ML
12. Facebook F8ীࢲ ࠁৈળ ಕ੉झ࠘੄ AI Research to Production : Pytorch v1.0 stable release Social Protection: աࢂ ѱदޛ, ؆Ӗٜ ೙ఠ݂ ׮Ҵয ӝ҅ߣ৉ NMT(Neural Machine Translation) Video, Image Recognition & Captioning: ੉޷૑੄ ݫఋؘ੉ఠ ୶୹ Semi-Supervised Learning : ࣗӏݽ ۨ੉࠶ ؘ੉ఠ + ؀ӏݽ ೟णؘ੉ఠ ਺ࢿ & ച੗ ੋध ….
13. Facebook F8ীࢲ ࠁৈળ ಕ੉झ࠘੄ AI Research to Production : Pytorch v1.0 stable release Social Protection: աࢂ ѱदޛ, ؆Ӗٜ ೙ఠ݂ ׮Ҵয ӝ҅ߣ৉ NMT(Neural Machine Translation) Video, Image Recognition & Captioning: ੉޷૑੄ ݫఋؘ੉ఠ ୶୹ Semi-Supervised Learning : ࣗӏݽ ۨ੉࠶ ؘ੉ఠ + ؀ӏݽ ೟णؘ੉ఠ ਺ࢿ & ച੗ ੋध …. Ӓ઺ীب ࡳਵۄҊ ೞݶ
14. Facebook F8ীࢲ ࠁৈળ ಕ੉झ࠘੄ AI Research to Production : Pytorch v1.0 stable release ׮Ҵয ӝ҅ߣ৉ NMT(Neural Machine Translation) Semi-Supervised Learning : ࣗӏݽ ۨ੉࠶ ؘ੉ఠ + ؀ӏݽ ೟णؘ੉ఠ Ӓ઺ীب ࡳਵۄҊ ೞݶ
15. Semi-Supervision Learning: ળ૑ب ೟ण ࣚ൜޹਷ ష౟ֈ ୭Ҋ੄ ҕѺࣻ۽ ੗ܻ ੟ও׮ BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
16. Semi-Supervision Learning: ળ૑ب ೟ण ࣚ൜޹਷ ష౟ֈ ୭Ҋ੄ ҕѺࣻ۽ ੗ܻ ੟ও׮ BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding ࣚ൜޹਷ ష౟ֈ ୭Ҋ੄ ҕѺࣻ۽ ੗ܻ ੟ও׮ ݠन۞׬ই ੉۠Ѣ ݏ୶ݶࢲ ঱যખ ҕࠗ೧ࠊۄ! ݃!
17. Semi-Supervision Learning: ળ૑ب ೟ण ࣚ൜޹਷ ష౟ֈ ୭Ҋ੄ ҕѺࣻ۽ ੗ܻ ੟ও׮ BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding ࣚ൜޹਷ ష౟ֈ ୭Ҋ੄ ҕѺࣻ۽ ੗ܻ ੟ও׮ ݠन۞׬ই ੉۠Ѣ ݏ୶ݶࢲ ঱যખ ҕࠗ೧ࠊۄ! ݃! ֎ ޤ ੉۠ѩפ׮
18. Semi-Supervision Learning: ળ૑ب ೟ण BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding ֎ Ӓۗ؊פ ࢎۈਸ ੉҂যਃ
19. Semi-Supervision Learning: ળ૑ب ೟ण BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding https://github.com/codertiimo/BERT-pytorch ӵঌഘࠁ
20. Semi-Supervision Learning: ળ૑ب ೟ण BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding য় Ӓ۞ݶ ۨ੉࠶݂੉ Ѣ੄ হযب ৮੹ ૨ ੜغ੗ա? ੉Ѥ ഄݺ੉ঠ!! ੉޷૑ա য়٣য়ب ੜغա?????
21. Semi-Supervision Learning: ળ૑ب ೟ण BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding ֎ Ӓۗणפ׮. ੹ࠗ׮ ֫਷ ࢿמਸ ঳঻যਃ ݆ࣻ਷ ࢎۈ੉ ࣻরѤ੄ ؘ੉ఠܳ ੌੌ੉ ۨ੉࠶݂ೞח ߑधਸ ୭ࣗച ೣ
22. ׮Ҵয ӝ҅ߣ৉ NMT(Neural Machine Translation) ࣚ൜޹਷ ష౟ֈ ୭Ҋ੄ ҕѺࣻ۽ ੗ܻ ੟ও׮ Sonny has became the best striker in Tottenham ટોનીહેમમાં સોની +ે, -.ાઈકર બ3યા છ ે ಕ੉झ࠘਷ ੹ࣁ҅ 100+ ੉࢚੄ ঱যܳ ૑ਗೞח ࢲ࠺झ ׮Ҵয ߣ৉਷ ಕ੉झ࠘੄ য়ے োҳ җઁ
23. ׮Ҵয ӝ҅ߣ৉ NMT(Neural Machine Translation) ೞ૑݅ ߣ৉ NMTח زੌೠ ੄޷੄ ׮Ҵয੄ ޙ੢੉ ؀۝ਵ۽ ೙ਃೣ ੉۠ ؘ੉ఠܳ ݅٘ח Ѫ਷ Ѣ੄ ࠛоמী оӰҊ ցޖ ݆਷ दрҗ ࠺ਊ੉ ೙ਃೣ
24. ׮Ҵয ӝ҅ߣ৉ NMT(Neural Machine Translation) ೞ૑݅ ߣ৉ NMTח زੌೠ ੄޷੄ ׮Ҵয੄ ޙ੢੉ ؀۝ਵ۽ ೙ਃೣ ੉۠ ؘ੉ఠܳ ݅٘ח Ѫ਷ Ѣ੄ ࠛоמী оӰҊ ցޖ ݆਷ दрҗ ࠺ਊ੉ ೙ਃೣ Semi-Supervision Learningਵ۽ ߓ਍ ঱য੄ ੉೧ܳ ׮Ҵয۽ ഛ੢ೞח ݽ؛ ѐߊ п ঱য Representation Space ܳ Matchingೞח ߑߨۿਸ ઁदೣ + On-device ীࢲ प೯оמೞب۾
25. ׮Ҵয ӝ҅ߣ৉ NMT(Neural Machine Translation) https://code.fb.com/ai-research/laser-multilingual-sentence-embeddings/
26. Research to Production : Pytorch v1.0 stable release ѐߊীࢲח ୭ъ UXܳ ੗یೞ૑݅ Production Scaleীࢲח ୭ড੗৓؍ Pytorch Pythonࢿמҗ Dynamic Graph Computation੄ ࣘب ੷ೞ ޙઁ
27. Research to Production : Pytorch v1.0 stable release ONNX, Caffe2, Jit compile Production ޙઁ ೧Ѿ + MOBILE-ML
28. Experience
29. ࢎप ݈ب উغח ੹ѐ ׮਺઱ী Google I/O୹੢੉ ੓যࢲ ҕ૞۽ ࠺೯ӝ಴ ஘ҳੋ ਌੤ש੄ ೧ழహ ଵо + ਌੤ש੄ ഐభীࢲ ࣼ߅ ࣃ೐ۆоח ࠺೯ӝীࢲ F8оח Ҋ١೟Ү ߓ೐ ୡ਋ো ੤ഥ ݃ஜژ ҳӖীࢲ Ӕޖೞन ࢶߓ৬ ୡ ߣѐ ޷౴ & ైয ಕ੉झ࠘ীࢲ ࠌ؍ ٜ࠙ਸ ؀ӏݽ۽ য়೐ۄੋ ੽ࢶ ਮഄש੄ ֎౟ਕ௼ী ઑੋ೧ పठۄ য়ష౵ੌۤب प೷
30. ழޭפ౭
31. ࣁ࣌
32. ഥࢎ ഘࠁ(?) ੌ࢚؀ച ੋҕ૑מ ೝಯ
33. ઱߸ైয
34. Total Review
35. ੿݈ ੤޷੓Ҋ ਬ੊ೞҊ જ਷ ࢎۈٜਸ ࢎӈҊ ڪয֥ ࣻ ੓Ҋ ׮নೠ ҃೷ਸ ೡ ࣻ ੓Ҋ ৈ۞ ੉ঠӝܳ ա־ݴ ৈ۞ ࢎ૓ਸ ନਵݴ ಕ੉झ࠘ Ҷૉܳ Ѷೞݴ ೞܖೞܖо ೯ࠂೞҊ ੤޷੓ח ࣁ࣌੉ ցޖ ݆Ҋ ݡਸѪ ݃पѪ੉ օ۰੓णפ׮ ࢎی೤פ׮❤ хࢎ೤פ׮ Facebook F8 +Dev Circle ղ֙ী ࢎ࠺۽ۄب ԙ ׮द য়Ҋरযਃ ੺؀ റഥ উೞपѩפ׮ ƃƃ
36. Thank you