Slide 1
Slide 1 text
No content
Slide 2
Slide 2 text
蔡EC：
24歲開發⼀次成功
Slide 3
Slide 3 text
Winnie Chiu
LINE TECH FRESH
NCCU MIS
NTU IM
Slide 4
Slide 4 text
What is
LINE SHOPPING ?
Slide 5
Slide 5 text
EC Data Team Responsibility
Search Application
Recommendation
Slide 6
Slide 6 text
Roles in EC Data Team
Data Engineer Data Scientist Machine learning
Engineer
• Analysis
• Algorithm Design
• Evaluation
• Data Pipeline
• Database
• Platform
• Model Implementation
• Performance Tuning
• MLOps
Slide 7
Slide 7 text
Machine Learning Solution Flow
Paper
research
Solution
comparison
Dataset
preparation
Model
design and
implement
Model
evaluation
Serve
model
Slide 8
Slide 8 text
Paper Research
and Solution Comparison
1. Find papers and Study 2. Compare
Slide 9
Slide 9 text
Dataset Preparation
and Model implement
1. Use EC product data as dataset
2. Use dataset to fine-tuning models
3. Find the most suitable model
Input Output
Slide 10
Slide 10 text
Model evaluation
More evaluation for selected model
Performance • Response time
• Accuracy, Recall, Precision, F1 score
• Handle cases with mixed Chinese/English
Ability
• Easy to maintain or not
• Retrain cost
Maintenance
Slide 11
Slide 11 text
Serve Model
Production code Implement API
Slide 12
Slide 12 text
1. Time Management and Prioritization 🌟
• Focus on project milestones and team objectives
2. Project Continuity 🌟
• Require ongoing maintenance and continuous optimization
3. Processes and Standards🌟🌟
• Strict adherence to standards for quality and collaboration
4. Monitoring and Alerting🌟🌟
• Quickly detect and resolve issues
Difference from School
Slide 13
Slide 13 text
Lauren Yang
• NCU IM / NTHU ISA
• Shipment/Payment Microservice Team
EC Backend / TECH FRESH
2023.07 - Now
Slide 14
Slide 14 text
Shipment/Payment
Microservice
Slide 15
Slide 15 text
Image from https://blog.gemfind.com/blog/4-reasons-your-store-needs-an-ecommerce-website
Slide 16
Slide 16 text
Image from https://goingdigitalx.wordpress.com/2020/08/17/the-generation-of-mobile-payment-technology/
Slide 17
Slide 17 text
Image from https://dribbble.com/shots/4459638-Delivery-Animation/attachments/10407209?mode=media
Slide 18
Slide 18 text
Technical
Stack
Application Development
Database Management
Code Quality & Continuous Integration
Containerization & Orchestration
Monitoring & Observability Others
Slide 19
Slide 19 text
No content
Slide 20
Slide 20 text
What is
Apache Kafka?
Slide 21
Slide 21 text
No content
Slide 22
Slide 22 text
Before After
Slide 23
Slide 23 text
How does
Kafka Work?
Slide 24
Slide 24 text
Kafka Architecture
Image from https://www.cloudkarafka.com/blog/2016-11-30-part1-kafka-for-beginners-what-is-apache-kafka.html
Slide 25
Slide 25 text
Message Queue
Slide 26
Slide 26 text
Message Queue
Slide 27
Slide 27 text
Message Queue
Slide 28
Slide 28 text
Message Queue
Slide 29
Slide 29 text
Message Queue
Slide 30
Slide 30 text
Message Queue
Slide 31
Slide 31 text
Message Queue
Slide 32
Slide 32 text
Message Queue
Slide 33
Slide 33 text
Message Queue
Slide 34
Slide 34 text
Kafka Architecture
Image from https://www.cloudkarafka.com/blog/2016-11-30-part1-kafka-for-beginners-what-is-apache-kafka.html
Slide 35
Slide 35 text
Kafka Architecture
Image from https://www.cloudkarafka.com/blog/2016-11-30-part1-kafka-for-beginners-what-is-apache-kafka.html
Slide 36
Slide 36 text
Kafka Architecture
Image from https://www.cloudkarafka.com/blog/2016-11-30-part1-kafka-for-beginners-what-is-apache-kafka.html
Slide 37
Slide 37 text
Kafka Architecture
Image from https://www.cloudkarafka.com/blog/2016-11-30-part1-kafka-for-beginners-what-is-apache-kafka.html
Slide 38
Slide 38 text
How did we apply
Kafka in our projects?
Slide 39
Slide 39 text
2024 農曆新年
好運籤詩
Slide 40
Slide 40 text
2024 農曆新年
好運賀圖
Slide 41
Slide 41 text
2024 Lunar New Year
System Overview
Slide 42
Slide 42 text
2024 Lunar New Year
System Overview
Enter
Slide 43
Slide 43 text
2024 Lunar New Year
System Overview
Enter
Send
Request
Slide 44
Slide 44 text
2024 Lunar New Year
System Overview
Send
Slide 45
Slide 45 text
2024 Lunar New Year
System Overview
Send
Slide 46
Slide 46 text
2024 Lunar New Year
System Overview
Slide 47
Slide 47 text
2024 Lunar New Year
System Overview
Slide 48
Slide 48 text
2024 Lunar New Year
System Overview
Type of
Lottery
Lottery
Start
Process
Event
Consumer
After the user clicks on the fortune type, this request
is sent through our API server as a Kafka event to the
broker, allowing the message to queue for processing.
Slide 49
Slide 49 text
2024 Lunar New Year
System Overview
Consumer
Push Message
The consumer processes the message and sends a push message request to the LINE
chatbot webhook, guiding the user to continue selecting a fortune character.
Slide 50
Slide 50 text
2024 Lunar New Year
System Overview
LNY API Server
After the user clicks, the API server receives a
message from the webhook and begins processing
the event related to the user's character selection.
Slide 51
Slide 51 text
2024 Lunar New Year
System Overview
LNY API Server
Type of
Character
Con
At this point, the API server also sends the character selection event to the
Kafka broker, just like the previous fortune type event, waiting for processing.
Slide 52
Slide 52 text
2024 Lunar New Year
System Overview
Type of
Character
Consumer
Push Message
The consumer starts processing this
message, creates a fortune lottery,
and returns it to the user via the
LINE chatbot.
Slide 53
Slide 53 text
How effective is
the application of Kafka?
Slide 54
Slide 54 text
By Utilizing Kafka…
228,000
requests per five minutes
requests per five minutes
Slide 55
Slide 55 text
By Utilizing Kafka…
Millions
of requests per second
Slide 56
Slide 56 text
Do you want to learn
tools rarely taught in class?
Slide 57
Slide 57 text
Engaging in workshops and training sessions for skill enhancement
1. Professional Development Opportunities
2. Supportive Work Environment
Working within cross-functional teams to broaden perspectives
3. Diverse Team Experience
Collaborating with experience mentors and supportive colleagues
Why choose LINE?
Advantages
Learning about the latest trends and methodologies in the tech industry
4. Exposure to Industry Best Practices
Slide 58
Slide 58 text
Actively participating in the creation of products that reach consumers
1. Direct Involvement with B2C Products
2. Contribution Go Live
Playing a role in how consumers interact with technology, making a real-world impact
3. Chances to Influence Consumer Experience
The excitement of seeing your own work being used by real users in the market
Why choose LINE?
The Standout Advantages
Slide 59
Slide 59 text
No content