蔡EC： 24歲開發一次成功

Speaker: Winnie Chiu, Lauren Yang
Event: LINE TECH FRESH 畢業分享會

Transcript

2. 蔡EC： 24歲開發⼀次成功
3. Winnie Chiu LINE TECH FRESH NCCU MIS NTU IM
4. What is LINE SHOPPING ?
5. EC Data Team Responsibility Search Application Recommendation
6. Roles in EC Data Team Data Engineer Data Scientist Machine learning Engineer • Analysis • Algorithm Design • Evaluation • Data Pipeline • Database • Platform • Model Implementation • Performance Tuning • MLOps
7. Machine Learning Solution Flow Paper research Solution comparison Dataset preparation Model design and implement Model evaluation Serve model
8. Paper Research and Solution Comparison 1. Find papers and Study 2. Compare
9. Dataset Preparation and Model implement 1. Use EC product data as dataset 2. Use dataset to fine-tuning models 3. Find the most suitable model Input Output
10. Model evaluation More evaluation for selected model Performance • Response time • Accuracy, Recall, Precision, F1 score • Handle cases with mixed Chinese/English Ability • Easy to maintain or not • Retrain cost Maintenance
11. Serve Model Production code Implement API
12. 1. Time Management and Prioritization 🌟 • Focus on project milestones and team objectives 2. Project Continuity 🌟 • Require ongoing maintenance and continuous optimization 3. Processes and Standards🌟🌟 • Strict adherence to standards for quality and collaboration 4. Monitoring and Alerting🌟🌟 • Quickly detect and resolve issues Difference from School
13. Lauren Yang • NCU IM / NTHU ISA • Shipment/Payment Microservice Team EC Backend / TECH FRESH 2023.07 - Now
14. Shipment/Payment Microservice
15. Image from https://blog.gemfind.com/blog/4-reasons-your-store-needs-an-ecommerce-website
16. Image from https://goingdigitalx.wordpress.com/2020/08/17/the-generation-of-mobile-payment-technology/
17. Image from https://dribbble.com/shots/4459638-Delivery-Animation/attachments/10407209?mode=media
18. Technical Stack Application Development Database Management Code Quality & Continuous Integration Containerization & Orchestration Monitoring & Observability Others
20. What is Apache Kafka?
22. Before After
23. How does Kafka Work?
24. Kafka Architecture Image from https://www.cloudkarafka.com/blog/2016-11-30-part1-kafka-for-beginners-what-is-apache-kafka.html
25. Message Queue
26. Message Queue
27. Message Queue
28. Message Queue
29. Message Queue
30. Message Queue
31. Message Queue
32. Message Queue
33. Message Queue
34. Kafka Architecture Image from https://www.cloudkarafka.com/blog/2016-11-30-part1-kafka-for-beginners-what-is-apache-kafka.html
35. Kafka Architecture Image from https://www.cloudkarafka.com/blog/2016-11-30-part1-kafka-for-beginners-what-is-apache-kafka.html
36. Kafka Architecture Image from https://www.cloudkarafka.com/blog/2016-11-30-part1-kafka-for-beginners-what-is-apache-kafka.html
37. Kafka Architecture Image from https://www.cloudkarafka.com/blog/2016-11-30-part1-kafka-for-beginners-what-is-apache-kafka.html
38. How did we apply Kafka in our projects?
39. 2024 農曆新年 好運籤詩
40. 2024 農曆新年 好運賀圖
41. 2024 Lunar New Year System Overview
42. 2024 Lunar New Year System Overview Enter
43. 2024 Lunar New Year System Overview Enter Send Request
44. 2024 Lunar New Year System Overview Send
45. 2024 Lunar New Year System Overview Send
46. 2024 Lunar New Year System Overview
47. 2024 Lunar New Year System Overview
48. 2024 Lunar New Year System Overview Type of Lottery Lottery Start Process Event Consumer After the user clicks on the fortune type, this request is sent through our API server as a Kafka event to the broker, allowing the message to queue for processing.
49. 2024 Lunar New Year System Overview Consumer Push Message The consumer processes the message and sends a push message request to the LINE chatbot webhook, guiding the user to continue selecting a fortune character.
50. 2024 Lunar New Year System Overview LNY API Server After the user clicks, the API server receives a message from the webhook and begins processing the event related to the user's character selection.
51. 2024 Lunar New Year System Overview LNY API Server Type of Character Con At this point, the API server also sends the character selection event to the Kafka broker, just like the previous fortune type event, waiting for processing.
52. 2024 Lunar New Year System Overview Type of Character Consumer Push Message The consumer starts processing this message, creates a fortune lottery, and returns it to the user via the LINE chatbot.
53. How effective is the application of Kafka?
54. By Utilizing Kafka… 228,000 requests per five minutes requests per five minutes
55. By Utilizing Kafka… Millions of requests per second
56. Do you want to learn tools rarely taught in class?
57. Engaging in workshops and training sessions for skill enhancement 1. Professional Development Opportunities 2. Supportive Work Environment Working within cross-functional teams to broaden perspectives 3. Diverse Team Experience Collaborating with experience mentors and supportive colleagues Why choose LINE? Advantages Learning about the latest trends and methodologies in the tech industry 4. Exposure to Industry Best Practices
58. Actively participating in the creation of products that reach consumers 1. Direct Involvement with B2C Products 2. Contribution Go Live Playing a role in how consumers interact with technology, making a real-world impact 3. Chances to Influence Consumer Experience The excitement of seeing your own work being used by real users in the market Why choose LINE? The Standout Advantages