Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Introduction LINE Taiwan Data Engineering Team

Introduction LINE Taiwan Data Engineering Team

53850955f15249a1a9dc49df6113e400?s=128

LINE Developers
PRO

May 18, 2019
Tweet

Transcript

  1. Shawn Tsai 2019.5.18 1

  2. • , , , , , , , , ,

    ,, , , , , , , , ,
  3. None
  4. • - , - B , B • , -

    B - - - - , • , B - B , ,
  5.    A NLP-enabled chatbot to provide customer services

    #POS #CNN #Tokenizer #Word2Vec #SiameseNet #LSTM
  6. F E I C Build a system to identify unreliable

    messages - - - - - #BERT #Word2Vec #TFIDF #POS #Tokenizer #Classifier #NER
  7. Provide related products - - - #ANN #Tokenizer #POS #Word2Vec

    #Clustering #NER
  8. - Build a scalable ML platform to transform raw data

    into predictive models to solve real-world problems #Evaluation #ETL #Hadoop #SQL #Visualize #Spark #Streaming #Monitoring
  9. - • , - • , • ( , •

    ) , • - , ,
  10. None
  11. https://career.linecorp.com/

  12. Data Engineer • Role • Develop, construct, test and maintain

    big data architecture • Skills • Data warehousing and ETL • Experience with big data tools: Hadoop, Spark, Kafka, etc. • In-depth knowledge of SQL and NoSQL databases • Data architecture , Data Scientist (ML Engineer) • Role • Clean, process and organize big data • Skills • Statistical and analytical skills • Good understanding of machine learning techniques • Experience with common data science toolkits • Good scripting and programming skills Data Analyst • Role • Identify, analyze, and interpret patterns in complex data sets • Skills • Data warehousing • Scripting and statistical skills • Reporting and data visualization skills • SQL knowledge NLP Engineer • • - - • • - • A - - - - - -
  13. - - - -

  14. None