Avgust: Automating Usage-Based Test Generation from Videos of App Executions
Presentation slides of our paper "Avgust: Automating Usage-Based Test Generation from Videos of App Executions" at ESEC/FSE 2022.
Presentation: https://youtu.be/LB-TrLhQcvI
AVGUST: Automating Usage-Based Test Generation from Videos of App Executions ESEC/FSE 2022, Singapore Yixue Zhao Saghar Talebipour, Kesina Baral, Hyojae Park, Leon Yee, Safwat Ali Khan, Yuriy Brun, Nenad Medvidović, Kevin Moran
▪ 6.64 billion smartphone users worldwide (80%+) ▪ 230 billion downloads in 2021 worldwide ▪ Avg American spends over 5h/day on mobile devices ▪ Avg American checks phone 96 times/day, or once every 10min 2 Source: Statista, ZIPPIA
11 Usage-based Test ▪ Test usage scenarios of an app (e.g., sign in, add item to the shopping cart) ▪ Highly preferred by developers ▪ Mimics realistic user behaviors
12 Usage-based Test, How? ▪ Test Transfer □ GTM ISSTA 2018 □ ATM ASE 2019 □ CraftDroid ASE 2019 □ FrUITeR ESEC/FSE 2020 (our work J) □ MAPIT ASE 2021 (our work J) □ …
13 Usage-based Test, How? ▪ Test Transfer □ GTM ISSTA 2018 □ ATM ASE 2019 □ CraftDroid ASE 2019 □ FrUITeR ESEC/FSE 2020 (our work J) □ MAPIT ASE 2021 (our work J) □ … Limitation Rely on existing tests □ Unavailable □ Low quality □ Too different
14 AVGUST ▪ Developer-in-the-loop tool ▪ AVGUST = App-video-based generation of usage tests ▪ Only relies on videos □ Easy to get (e.g., public, crowdsourcing) □ Vison-only (pixel-based) □ Cross platform (any apps!)
32 AVGUST Contributions ▪ First usage-based test generation based on videos ▪ Effective image classification (videos à formal models) ▪ Ready-to-use trained models
33 AVGUST Contributions ▪ First usage-based test generation based on videos ▪ Effective image classification (videos à formal models) ▪ Ready-to-use trained models Crowd Workers Community Database Usage-based Tests, and more!