Conglomeration” - Proposal for Test Design Notation Like Class Diagram(論文) http://ieeexplore.ieee.org/document/7899074/ OSC2017 in Hokkaido : 「もしかして、テストって誰でもできると思っちゃってませんか? 最新のテストの動向を知りたくないですか?」 https://www.slideshare.net/tef-do/tefdo-osc2017-in-hokkaido-07152017
Appli- cation Application Process Process Process Function Function Function Class Class Func Class Method Method ・・・ テスト技法 テストプロセス テスト方針 テスト設計 システムテスト 回帰テスト モンキー テスト 探索的テスト 性能テスト 機能テスト 負荷テスト 巨大で複雑
テスト 設計 Test Case Test Case Test Case Test Case Test Case Test Case Test CaseTest Case Test Case Test Case Test Case Test Case Test Case Test Case Test Case Test Case Test Case Test Case A B C ばらつきが 発生する
テスト 設計 Test Case Test Case Test Case Test Case Test Case Test Case Test CaseTest Case Test Case Test Case Test Case Test Case Test Case Test Case Test Case Test Case Test Case Test Case A B C ≠ 異なるテスト設計 再検討することは 非常に困難 テスト 設計 テスト 設計
Document Document Document Document Document Document Additional Feature Additional Feature Additional Feature Additional Feature Document Document Document Test Design Test Design Test Design Test Case Test Case Test Case Test Case Test Case Test Case Test CaseTest Case Test Case Test Case Test Case Test Case Test Case Test Case Test Case Test Case Test Case Test Case A B C システム テスト テストケース テストケース テストケース テストケース テストケース テストケース ドキュメントレビューで 漏れの検出は難しい ばらつきによって テストケースが漏れる テストケースが 漏れてしまう
Document Document Document Document Document Document Additional Feature Additional Feature Additional Feature Additional Feature Document Document Document Test Design Test Design Test Design Test Case Test Case Test Case Test Case Test Case Test Case Test CaseTest Case Test Case Test Case Test Case Test Case Test Case Test Case Test Case Test Case Test Case Test Case A B C システム テスト テストケース テストケース テストケース テストケース テストケース テストケース ドキュメントレビューで 漏れの検出は難しい ばらつきによって テストケースが漏れる レビューで漏れを 見つけにくい 製品不具合
Document Document Document Document Document Document Additional Feature Additional Feature Additional Feature Additional Feature Document Document Document Test Design Test Design Test Design Test Case Test Case Test Case Test Case Test Case Test Case Test CaseTest Case Test Case Test Case Test Case Test Case Test Case Test Case Test Case Test Case Test Case Test Case A B C テストケースまたは テスト設計のばらつき ソフトウェアテストの概要を 文書で表現するのは難しい
Document Document Document Document Document Document Additional Feature Additional Feature Additional Feature Additional Feature Document Document Document Test Design Test Design Test Design Test Case Test Case Test Case Test Case Test Case Test Case Test CaseTest Case Test Case Test Case Test Case Test Case Test Case Test Case Test Case Test Case Test Case Test Case A B C Quality Attributes + Guideline Suitability : Userbility Userbility + Other OS : Compatibility Compatibility Feature/UI ~ Alert in the background : Compatibility + Confirm each function : FunctionalSuitability <<Alert>> Timer + Unfavorable Stress : PerformanceEfficiency + Number of data : PerformanceEfficiency + Confirm each function : FunctionalSuitability Stopwatch 1.グラフィカルな 表現 2. モデルを使うことで メンテナンスが向上
Document Document Document Document Document Document Document Additional Feature Additional Feature Additional Feature Additional Feature Document Document Document Test Design Test Design Test Design Test Case Test Case Test Case Test Case Test Case Test Case Test CaseTest Case Test Case Test Case Test Case Test Case Test Case Test Case Test Case Test Case Test Case Test Case A B C Quality Attributes + Guideline Suitability : Userbility Userbility + Other OS : Compatibility Compatibility Feature/UI ~ Alert in the background : Compatibility + Confirm each function : FunctionalSuitability <<Alert>> Timer + Unfavorable Stress : PerformanceEfficiency + Number of data : PerformanceEfficiency + Confirm each function : FunctionalSuitability Stopwatch 1.グラフィカルな 表現 2. モデルを使うことで メンテナンスが向上 + XXXX() + XXXX Timer + XXXX() + XXXX Timer TimerBehabior SelectMusic 「Timer」テストの詳細とテストケースの関連 Concrete Test Case Concrete Test Case Concrete Test Case Concrete Test Case Concrete Test Case Concrete Test Case 3.一貫した表記を使用した 段階的なデザイン
Test Conglomeration - Proposal for Test Design Notation Like Class Diagram(論文) http://ieeexplore.ieee.org/document/7899074/ OSC2017 in Hokkaido 「もしかして、テストって誰でもできると思っちゃってませんか? 最新のテストの動向を知りたくないですか?」 https://www.slideshare.net/tef-do/tefdo-osc2017-in-hokkaido-07152017 テスト設計コンテスト'17 OPENクラス 決勝戦レポート http://aster.or.jp/business/contest/contest2017.html あんがい 情報ある
詳細 塊 Divided Test Scope 全体的なテスト範囲が、 1枚の絵で描ける Quality Attributes + Guideline Suitability : Userbility Userbility + Other OS : Compatibility Compatibility Feature/UI ~ Alert in the background : Compatibility + Confirm each function : FunctionalSuitability <<Alert>> Timer + Unfavorable Stress : PerformanceEfficiency + Number of data : PerformanceEfficiency + Confirm each function : FunctionalSuitability Stopwatch
: Compatibility App Compatibility + Navigation : Usability + Guideline Suitability : Usability App Userbility + Memory Leak : Performance efficiency + Long Run Process : Reliability Long Run + Process Multiple App : Compatibility + Multiple process in an App : Compatibility Co-Existence Feature/UI + Cooperate with other Apps : Compatibility ~ Unfavorable Stress : Performance efficiency ~ Alert in the background : Compatibility + Correctness of analysis : Functional suitability + Confirm each function : Functional suitability <<Alert>> Bedtime ~ Operation Response : Performance efficiency ~ Number of data : Performance efficiency + Confirm each function : Functional suitability <<Resister/Edit/Delete Data>> World Clock + Cooperate with other Apps : Compatibility ~ Unfavorable Stress : Performance efficiency ~ Alert in the background : Performance efficiency ~ Operation Response : Performance efficiency ~ Number of data : Performance efficiency + Confirm each function : Functional suitability <<Alert>> <<Resister/Edit/Delete Data>> Alarm ~ Operation Response : Performance efficiency ~ Number of data : Performance efficiency <<pattern>> Resister/Edit/Delete Data ~ Unfavorable Stress : Performance efficiency ~ Alert in the background : Compatibility <<pattern>> Alert ~ Alert in the background : Compatibility + Confirm each function : Functional suitability <<Alert>> Timer + Unfavorable Stress : Performance efficiency + Number of data : Performance efficiency + Confirm each function : Functional suitability Stopwatch <全体俯瞰:カタマリー全体図> ~ Operation Response : Performance efficiency ~ Number of data : Performance efficiency <<pattern>> Resister/Edit/Delete Data + Cooperate with other Apps : Compatibility ~ Unfavorable Stress : Performance efficiency ~ Alert in the background : Performance efficiency ~ Operation Response : Performance efficiency ~ Number of data : Performance efficiency + Confirm each function : Functional suitability <<Alert>> <<Resister/Edit/Delete Data>> Alarm ~ Unfavorable Stress : Performance efficiency ~ Alert in the background : Compatibility <<pattern>> Alert + Check with Stress() : Unfavorable Stress + Check with other Apps() : Alert in the background + Confirm Snooze() : Confirm each function ~ Unfavorable Stress : Performance efficiency ~ Alert in the background : Compatibility + Confirm each function : Functional suitability + Confirm Alerm() : Confirm each function Notify Alarm + Operate from Siri() : Cooperate with other Apps + Check max registration data() : Operation Responce + Delete Alarm() : Confirm each function + Edit Alarm() : Confirm each function + Register Alarm() : Confirm each function + Cooperate with other Apps : Compatibility ~ Operation Response : Performance efficiency ~ Number of data : Performance efficiency + Confirm each function : Functional suitability Register/Display Alarm <詳細確認:カタマリー詳細図>
Number of data : Performance efficiency <<pattern>> Resister/Edit/Delete Data + Cooperate with other Apps : Compatibility ~ Unfavorable Stress : Performance efficiency ~ Alert in the background : Performance efficiency ~ Operation Response : Performance efficiency ~ Number of data : Performance efficiency + Confirm each function : Functional suitability <<Alert>> <<Resister/Edit/Delete Data>> Alarm ~ Unfavorable Stress : Performance efficiency ~ Alert in the background : Compatibility <<pattern>> Alert + Check with Stress() : Unfavorable Stress + Check with other Apps() : Alert in the background + Confirm Snooze() : Confirm each function ~ Unfavorable Stress : Performance efficiency ~ Alert in the background : Compatibility + Confirm each function : Functional suitability + Confirm Alerm() : Confirm each function Notify Alarm + Operate from Siri() : Cooperate with other Apps + Check max registration data() : Operation Responce + Delete Alarm() : Confirm each function + Edit Alarm() : Confirm each function + Register Alarm() : Confirm each function + Cooperate with other Apps : Compatibility ~ Operation Response : Performance efficiency ~ Number of data : Performance efficiency + Confirm each function : Functional suitability Register/Display Alarm テストカタマリー:超簡単まとめ ざっくりと次の内容くらいです。 Quality Attriutes + Other OS : Compatibility App Compatibility + Navigation : Usability + Guideline Suitability : Usability App Userbility + Memory Leak : Performance efficiency + Long Run Process : Reliability Long Run + Process Multiple App : Compatibility + Multiple process in an App : Compatibility Co-Existence Feature/UI + Cooperate with other Apps : Compatibility ~ Unfavorable Stress : Performance efficiency ~ Alert in the background : Compatibility + Correctness of analysis : Functional suitability + Confirm each function : Functional suitability <<Alert>> Bedtime ~ Operation Response : Performance efficiency ~ Number of data : Performance efficiency + Confirm each function : Functional suitability <<Resister/Edit/Delete Data>> World Clock + Cooperate with other Apps : Compatibility ~ Unfavorable Stress : Performance efficiency ~ Alert in the background : Performance efficiency ~ Operation Response : Performance efficiency ~ Number of data : Performance efficiency + Confirm each function : Functional suitability <<Alert>> <<Resister/Edit/Delete Data>> Alarm ~ Operation Response : Performance efficiency ~ Number of data : Performance efficiency <<pattern>> Resister/Edit/Delete Data ~ Unfavorable Stress : Performance efficiency ~ Alert in the background : Compatibility <<pattern>> Alert ~ Alert in the background : Compatibility + Confirm each function : Functional suitability <<Alert>> Timer + Unfavorable Stress : Performance efficiency + Number of data : Performance efficiency + Confirm each function : Functional suitability Stopwatch 全体を俯瞰して 表現ができる 編集画面にて登録解除 アラーム画面にて登録解除 未登録のときに登録解除 複数のテストケースに対応 全体俯瞰内の 1つのカタマリーを 詳細に表現できる 最下層に抽象 (ロジカル)テスト ケースを並べる 1つのロジカル テストケースは 複数の具体的 テストケースに対応