Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Introduction LINE Taiwan Data Engineering Team

Introduction LINE Taiwan Data Engineering Team

LINE Developers

May 18, 2019
Tweet

More Decks by LINE Developers

Other Decks in Technology

Transcript

  1. • , , , , , , , , ,

    ,, , , , , , , , ,
  2. • - , - B , B • , -

    B - - - - , • , B - B , ,
  3.    A NLP-enabled chatbot to provide customer services

    #POS #CNN #Tokenizer #Word2Vec #SiameseNet #LSTM
  4. F E I C Build a system to identify unreliable

    messages - - - - - #BERT #Word2Vec #TFIDF #POS #Tokenizer #Classifier #NER
  5. - Build a scalable ML platform to transform raw data

    into predictive models to solve real-world problems #Evaluation #ETL #Hadoop #SQL #Visualize #Spark #Streaming #Monitoring
  6. Data Engineer • Role • Develop, construct, test and maintain

    big data architecture • Skills • Data warehousing and ETL • Experience with big data tools: Hadoop, Spark, Kafka, etc. • In-depth knowledge of SQL and NoSQL databases • Data architecture , Data Scientist (ML Engineer) • Role • Clean, process and organize big data • Skills • Statistical and analytical skills • Good understanding of machine learning techniques • Experience with common data science toolkits • Good scripting and programming skills Data Analyst • Role • Identify, analyze, and interpret patterns in complex data sets • Skills • Data warehousing • Scripting and statistical skills • Reporting and data visualization skills • SQL knowledge NLP Engineer • • - - • • - • A - - - - - -