Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
QA 蝦米 QA?我的扣超讚的啊
Search
LINE Developers Taiwan
PRO
June 19, 2024
Technology
0
2k
QA 蝦米 QA?我的扣超讚的啊
Speaker: Lawrence Tsai, YT Chen
Event: LINE TECH FRESH 畢業分享會
LINE Developers Taiwan
PRO
June 19, 2024
Tweet
Share
More Decks by LINE Developers Taiwan
See All by LINE Developers Taiwan
掌握 Feature Toggle 與 OpenFeature 規範
line_developers_tw
PRO
0
69
用 AI 和 LINE Bot 簡化生活:讓圖片告訴你何時該忙!-- LINE 工作坊
line_developers_tw
PRO
0
360
Scaling The E-Commerce Recommendation System
line_developers_tw
PRO
0
17
Enhanced EC Recommendations: Trustworthy Validation with Large Language Models for Two-Tower Model
line_developers_tw
PRO
0
8
揭秘LLMOps: 讓LLM服務像火箭 般穩定高效的祕密!
line_developers_tw
PRO
0
45
ML Life Cycle for LINE SHOPPING Recommender
line_developers_tw
PRO
0
12
Review AI from LINE EC NLP
line_developers_tw
PRO
0
7
LINE購物 App x ATDD: 利用 ATDD 改善開發流程
line_developers_tw
PRO
0
30
Grafana Alloy Best Practice
line_developers_tw
PRO
0
3.7k
Other Decks in Technology
See All in Technology
MobileActOsaka_241018.pdf
akaitadaaki
0
110
LLMOps : ΔMLOps
shuntaito
13
2.1k
Road to Single Activity Uncovered
yurihondo
0
110
自然言語処理を役立てるのはなぜ難しいのか
pfn
PRO
17
4.5k
まだ間に合う! 生成AIトレンド一挙おさらい & AWSのBedrockに入門しよう
minorun365
PRO
4
310
Cosmos DB で持続可能な RAG を実現しよう!~ AOAI Dev Day ふりかえりを添えて / Sustainable RAG with Cosmos DB with recap AOAI Dev Day
miyake
0
180
フェンリルの SwiftUI の研修を覗いてみる / Fenrir SwiftUI Training
studio_rookery
0
160
実は仲良し?Amplify Gen2と生成AI
mkdev10
0
150
APIs for AI: Have we failed?
zdne
0
130
SOLID - Architecture and Architectural Decisions - Devfest Goa 2024
rivuchk
0
160
塩野義製薬様のAWS統合管理戦略:Organizations設計と運用の具体例
tkikuchi
0
320
全社を巻き込んだ業務オペレーション改善と、それは事業成長に貢献しているのか?を実感した話
marroooon
0
150
Featured
See All Featured
The Power of CSS Pseudo Elements
geoffreycrofte
71
5.3k
It's Worth the Effort
3n
183
27k
A Tale of Four Properties
chriscoyier
156
22k
CSS Pre-Processors: Stylus, Less & Sass
bermonpainter
355
29k
A Modern Web Designer's Workflow
chriscoyier
692
190k
Designing on Purpose - Digital PM Summit 2013
jponch
114
6.9k
Typedesign – Prime Four
hannesfritz
39
2.4k
The Success of Rails: Ensuring Growth for the Next 100 Years
eileencodes
43
6.6k
The Straight Up "How To Draw Better" Workshop
denniskardys
232
130k
Designing the Hi-DPI Web
ddemaree
280
34k
Testing 201, or: Great Expectations
jmmastey
38
7k
Rebuilding a faster, lazier Slack
samanthasiow
79
8.6k
Transcript
QA 蝦米 QA? 我的扣超讚的啊
01 02 03 04 Development Process Job Responsibility 專案分享:Test Case
⾃動分類 Introduction 05 專案分享:Release 流程優化 CONTENT
01 Introduction
Lawrence Tsai Education • M.S. in Management Information Systems @
NTU • B.S.S. in Journalism & Communication @ CUHK Experience • 2023 LINE Taiwan | TECH FRESH @ LINE TRAVEL • 2022 Dcard | QA Intern @ EC TECH FRESH @ LINE
機票 住宿 體驗 團旅 Logo 取⾃ Flaticon
YT Chen Education • M.S. in Computer Science @ NTUT
• B.B.A in Finance @ TKU Experience • 2023 | TECH FRESH @ LINE Taiwan • 2022 | Backend Engineer Intern @ thingnario • 2020-2021 | Data Engineer @ iiNumbers TECH FRESH @ LINE
A mobile ecommerce alliance platform for shopping guide and point
reward.
02 Development Process
Software Development Life Cycle 1 ANALYSIS 2 DESIGN 3 DEVELOPMENT
4 TESTING 5 DEPLOYMENT 6 MAINTENANCE Business Designer Developer QA Operations Technical Support
Development Process for QA 1 ANALYSIS 2 DESIGN 3 DEVELOPMENT
4 TESTING 5 DEPLOYMENT 6 MAINTENANCE Test Requirement Analysis Automation Script Development E2E Testing Stress Testing CUJ Testing Test Case Writing Performance Monitoring Regression Testing Continuous Development (CD) Continuous Integration (CI)
03 Job Responsibility
Test Case & Test Run Test Case Test Run Test
Case 1 2 3 Test Case 3 明確的⽬的&可執⾏的步驟 預期結果 vs 實際結果? 清楚涵蓋特定的功能或問題點 ⼀系列的多 Test Cases 組合 根據某種具體的使⽤者場景所定義 記錄測試點以評估軟體品質
Job Responsibility Test Case Preparation Automation Manual Testing 2 DESIGN
3 DEVELOPMENT 圖片取⾃ TestRail
Manual Testing Job Responsibility 確認⾴⾯上有「LINE 購物」的 logo Test Case 1
2 確認⾴⾯上有「搜尋框」的元素 Test Run 3 DEVELOPMENT 4 TESTING Test Case Logo 取⾃網路 Automation
Job Responsibility 5 DEPLOYMENT 6 MAINTENANCE Continuous Integration (CI) 圖片取⾃網路
Job Responsibility 圖片取⾃網路 Continuous Deployment (CD) 5 DEPLOYMENT 6 MAINTENANCE
Job Responsibility 5 DEPLOYMENT 6 MAINTENANCE 圖片取⾃網路 Monitoring
04 專案分享: Test Case ⾃動分類
寫 Test Case 也會有技術債? Epic:⾸⾴標題 Banner 確認⾴⾯上有「LINE 購物」的 logo 2000~3000
筆 確認⾴⾯上有「搜尋框」的元素 確認「搜尋框」旁是「相機」的 icon 確認⾴⾯上有「購物⾞」的 icon 確認跳轉⾴⾯可以導購成功 確認商店⾴⾯上有「專屬推薦」 Epic:??? Test Case Solution: 舉辦 workshop 讓⼤家⼀起償還歷史共業 🥳
架構圖 testrail- backup build-pipeline TestRail Cloud Preprocess & Modeling GitHub
Actions Test Cases (TC) Test Runs (TR) Prediction Result Request Export Pull Data Upload Upload
建立模型 P N P • True Positives (TP) • False
Negatives (FN) N • False Positives (FP) • True Negatives (TN) Baseline • Text preprocessing:TF-IDF • Model:Naive Bayes classifier Optimized • Text preprocessing:TF-IDF • Model:Random Forest classifier Performance = Naïve Bayes Classifier
模型效能 0.54 0.63 0.85 0.89 0 0.1 0.2 0.3 0.4
0.5 0.6 0.7 0.8 0.9 1 標完的資料 標完的資料 + Test Run 資料 Baseline Optimized
05 專案分享: Release 流程優化
Release Calendar • 公司有多個團隊及產品 • 每個產品有 Maintenance、Resolved 等不同狀態 • 需要有
Calendar 記錄更新時間、Release 的產品、 Release 版號等訊息⽅便統⼀管理
架構圖 Trigger Jenkins Deployment Manifests Pull Changes Sync Cluster Status
Pull Image & Update Containers Trigger Python code Logo 取⾃ Flaticon、網路 Update Calendar
ArgoCD 在 ArgoCD Sync 以及 Sync Success 的時候更新 Calendar 圖⽚取⾃網路
K8s 利⽤ ArgoCD Hook 在 Sync 時觸發 Job Curl Jenkins
執⾏任務並 帶入 Parameters
Jenkins 可⼿動選擇⾏為,或通過 parameters 決定
None