Introduction LINE Taiwan Data Engineering Team

Transcript

1. Shawn Tsai 2019.5.18 1

2. • , , , , , , , , ,

   ,, , , , , , , , ,
3. None

4. • - , - B , B • , -

   B - - - - , • , B - B , ,

5. 
     A NLP-enabled chatbot to provide customer services

   #POS #CNN #Tokenizer #Word2Vec #SiameseNet #LSTM

6. F E I C Build a system to identify unreliable

   messages - - - - - #BERT #Word2Vec #TFIDF #POS #Tokenizer #Classifier #NER

7. Provide related products - - - #ANN #Tokenizer #POS #Word2Vec

   #Clustering #NER

8. - Build a scalable ML platform to transform raw data

   into predictive models to solve real-world problems #Evaluation #ETL #Hadoop #SQL #Visualize #Spark #Streaming #Monitoring

9. - • , - • , • ( , •

   ) , • - , ,
10. None

11. https://career.linecorp.com/

12. Data Engineer • Role • Develop, construct, test and maintain

    big data architecture • Skills • Data warehousing and ETL • Experience with big data tools: Hadoop, Spark, Kafka, etc. • In-depth knowledge of SQL and NoSQL databases • Data architecture , Data Scientist (ML Engineer) • Role • Clean, process and organize big data • Skills • Statistical and analytical skills • Good understanding of machine learning techniques • Experience with common data science toolkits • Good scripting and programming skills Data Analyst • Role • Identify, analyze, and interpret patterns in complex data sets • Skills • Data warehousing • Scripting and statistical skills • Reporting and data visualization skills • SQL knowledge NLP Engineer • • - - • • - • A - - - - - -

13. - - - -

14. None