Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
QA 蝦米 QA?我的扣超讚的啊
Search
LINE Developers Taiwan
PRO
June 19, 2024
Technology
0
1.3k
QA 蝦米 QA?我的扣超讚的啊
Speaker: Lawrence Tsai, YT Chen
Event: LINE TECH FRESH 畢業分享會
LINE Developers Taiwan
PRO
June 19, 2024
Tweet
Share
More Decks by LINE Developers Taiwan
See All by LINE Developers Taiwan
Scaling The E-Commerce Recommendation System
line_developers_tw
PRO
0
9
Enhanced EC Recommendations: Trustworthy Validation with Large Language Models for Two-Tower Model
line_developers_tw
PRO
0
5
揭秘LLMOps: 讓LLM服務像火箭 般穩定高效的祕密!
line_developers_tw
PRO
0
16
ML Life Cycle for LINE SHOPPING Recommender
line_developers_tw
PRO
0
9
Review AI from LINE EC NLP
line_developers_tw
PRO
0
6
LINE購物 App x ATDD: 利用 ATDD 改善開發流程
line_developers_tw
PRO
0
17
Grafana Alloy Best Practice
line_developers_tw
PRO
0
900
Distributed Tracing in LINE Taiwan
line_developers_tw
PRO
0
28
只有 Status page 還不夠!講人話才知道 Infra 發生什麼事
line_developers_tw
PRO
2
260
Other Decks in Technology
See All in Technology
k6を活用した再現性・拡張性の高い負荷試験基盤の構築
biwashi
9
2.4k
Technology that powers Lambda / AWS Lambda を支える技術
_kensh
22
5k
Valuable Software Engineering
avandeursen
0
200
ビジネスに必要な全てを担い、 自分の専門性を見つけ出す フルサイクル開発者のあり方@技育祭 秋 / how-find-own-speciality-in-full-cycle
pei0804
6
840
FastAPIでのasync defとdefの使い分け
takashi1029
5
1.1k
GraphQLを安全に使うためにやっていること
hayashikengo
1
190
社内でのサーバーレスアプリケーション開発を、プラットフォームエンジニアリングを整備して 迅速化・安定化させる取り組み
wakatsuki
0
2.6k
Extending kotlin-inject for fun & profit
vrallev
0
120
Passkey Autofill に賭けるマネーフォワード ID - Money Forward Tech Day 2024
nov
1
840
Difyを活用した「内省支援」エージェント開発の所感
gmoriki
2
860
製造の課題に立ち向かう Manufacturing Data Engine と Manufacturing Connect の ご紹介
kongmingstrap
0
510
Understanding and Optimising INP
akshayysharma
0
130
Featured
See All Featured
Debugging Ruby Performance
tmm1
72
12k
YesSQL, Process and Tooling at Scale
rocio
167
14k
Let's Do A Bunch of Simple Stuff to Make Websites Faster
chriscoyier
502
140k
What’s in a name? Adding method to the madness
productmarketing
PRO
21
3k
GraphQLの誤解/rethinking-graphql
sonatard
65
9.8k
The Psychology of Web Performance [Beyond Tellerrand 2023]
tammyeverts
36
2.1k
Bash Introduction
62gerente
608
210k
Designing on Purpose - Digital PM Summit 2013
jponch
114
6.9k
Cheating the UX When There Is Nothing More to Optimize - PixelPioneers
stephaniewalter
278
13k
5 minutes of I Can Smell Your CMS
philhawksworth
202
19k
Sharpening the Axe: The Primacy of Toolmaking
bcantrill
36
1.7k
How to Think Like a Performance Engineer
csswizardry
16
980
Transcript
QA 蝦米 QA? 我的扣超讚的啊
01 02 03 04 Development Process Job Responsibility 專案分享:Test Case
⾃動分類 Introduction 05 專案分享:Release 流程優化 CONTENT
01 Introduction
Lawrence Tsai Education • M.S. in Management Information Systems @
NTU • B.S.S. in Journalism & Communication @ CUHK Experience • 2023 LINE Taiwan | TECH FRESH @ LINE TRAVEL • 2022 Dcard | QA Intern @ EC TECH FRESH @ LINE
機票 住宿 體驗 團旅 Logo 取⾃ Flaticon
YT Chen Education • M.S. in Computer Science @ NTUT
• B.B.A in Finance @ TKU Experience • 2023 | TECH FRESH @ LINE Taiwan • 2022 | Backend Engineer Intern @ thingnario • 2020-2021 | Data Engineer @ iiNumbers TECH FRESH @ LINE
A mobile ecommerce alliance platform for shopping guide and point
reward.
02 Development Process
Software Development Life Cycle 1 ANALYSIS 2 DESIGN 3 DEVELOPMENT
4 TESTING 5 DEPLOYMENT 6 MAINTENANCE Business Designer Developer QA Operations Technical Support
Development Process for QA 1 ANALYSIS 2 DESIGN 3 DEVELOPMENT
4 TESTING 5 DEPLOYMENT 6 MAINTENANCE Test Requirement Analysis Automation Script Development E2E Testing Stress Testing CUJ Testing Test Case Writing Performance Monitoring Regression Testing Continuous Development (CD) Continuous Integration (CI)
03 Job Responsibility
Test Case & Test Run Test Case Test Run Test
Case 1 2 3 Test Case 3 明確的⽬的&可執⾏的步驟 預期結果 vs 實際結果? 清楚涵蓋特定的功能或問題點 ⼀系列的多 Test Cases 組合 根據某種具體的使⽤者場景所定義 記錄測試點以評估軟體品質
Job Responsibility Test Case Preparation Automation Manual Testing 2 DESIGN
3 DEVELOPMENT 圖片取⾃ TestRail
Manual Testing Job Responsibility 確認⾴⾯上有「LINE 購物」的 logo Test Case 1
2 確認⾴⾯上有「搜尋框」的元素 Test Run 3 DEVELOPMENT 4 TESTING Test Case Logo 取⾃網路 Automation
Job Responsibility 5 DEPLOYMENT 6 MAINTENANCE Continuous Integration (CI) 圖片取⾃網路
Job Responsibility 圖片取⾃網路 Continuous Deployment (CD) 5 DEPLOYMENT 6 MAINTENANCE
Job Responsibility 5 DEPLOYMENT 6 MAINTENANCE 圖片取⾃網路 Monitoring
04 專案分享: Test Case ⾃動分類
寫 Test Case 也會有技術債? Epic:⾸⾴標題 Banner 確認⾴⾯上有「LINE 購物」的 logo 2000~3000
筆 確認⾴⾯上有「搜尋框」的元素 確認「搜尋框」旁是「相機」的 icon 確認⾴⾯上有「購物⾞」的 icon 確認跳轉⾴⾯可以導購成功 確認商店⾴⾯上有「專屬推薦」 Epic:??? Test Case Solution: 舉辦 workshop 讓⼤家⼀起償還歷史共業 🥳
架構圖 testrail- backup build-pipeline TestRail Cloud Preprocess & Modeling GitHub
Actions Test Cases (TC) Test Runs (TR) Prediction Result Request Export Pull Data Upload Upload
建立模型 P N P • True Positives (TP) • False
Negatives (FN) N • False Positives (FP) • True Negatives (TN) Baseline • Text preprocessing:TF-IDF • Model:Naive Bayes classifier Optimized • Text preprocessing:TF-IDF • Model:Random Forest classifier Performance = Naïve Bayes Classifier
模型效能 0.54 0.63 0.85 0.89 0 0.1 0.2 0.3 0.4
0.5 0.6 0.7 0.8 0.9 1 標完的資料 標完的資料 + Test Run 資料 Baseline Optimized
05 專案分享: Release 流程優化
Release Calendar • 公司有多個團隊及產品 • 每個產品有 Maintenance、Resolved 等不同狀態 • 需要有
Calendar 記錄更新時間、Release 的產品、 Release 版號等訊息⽅便統⼀管理
架構圖 Trigger Jenkins Deployment Manifests Pull Changes Sync Cluster Status
Pull Image & Update Containers Trigger Python code Logo 取⾃ Flaticon、網路 Update Calendar
ArgoCD 在 ArgoCD Sync 以及 Sync Success 的時候更新 Calendar 圖⽚取⾃網路
K8s 利⽤ ArgoCD Hook 在 Sync 時觸發 Job Curl Jenkins
執⾏任務並 帶入 Parameters
Jenkins 可⼿動選擇⾏為,或通過 parameters 決定
None