Introduction LINE Taiwan Data Engineering Team

Shawn Tsai
LINE Developer Recruitment Day at Taiwan #1
https://engineering.linecorp.com/zh-hant/blog/2019-line-taiwan-technical-recruitment-day/

Transcript

1. Shawn Tsai 2019.5.18 1
2. • , , , , , , , , , ,, , , , , , , , ,
4. • - , - B , B • , - B - - - - , • , B - B , ,
5. 
     A NLP-enabled chatbot to provide customer services #POS #CNN #Tokenizer #Word2Vec #SiameseNet #LSTM
6. F E I C Build a system to identify unreliable messages - - - - - #BERT #Word2Vec #TFIDF #POS #Tokenizer #Classifier #NER
7. Provide related products - - - #ANN #Tokenizer #POS #Word2Vec #Clustering #NER
8. - Build a scalable ML platform to transform raw data into predictive models to solve real-world problems #Evaluation #ETL #Hadoop #SQL #Visualize #Spark #Streaming #Monitoring
9. - • , - • , • ( , • ) , • - , ,
11. https://career.linecorp.com/
12. Data Engineer • Role • Develop, construct, test and maintain big data architecture • Skills • Data warehousing and ETL • Experience with big data tools: Hadoop, Spark, Kafka, etc. • In-depth knowledge of SQL and NoSQL databases • Data architecture , Data Scientist (ML Engineer) • Role • Clean, process and organize big data • Skills • Statistical and analytical skills • Good understanding of machine learning techniques • Experience with common data science toolkits • Good scripting and programming skills Data Analyst • Role • Identify, analyze, and interpret patterns in complex data sets • Skills • Data warehousing • Scripting and statistical skills • Reporting and data visualization skills • SQL knowledge NLP Engineer • • - - • • - • A - - - - - -
13. - - - -