Upgrade to Pro — share decks privately, control downloads, hide ads and more …

210107_RSGT2021_独立QAチーム1年戦記/210107_RSGT2021_An_...

mkwrd
January 07, 2021
7.6k

 210107_RSGT2021_独立QAチーム1年戦記/210107_RSGT2021_An_Independent_QA_Teams_1_Years_War

RSGT2021で登壇した資料です。
Scrum@Scaleの会社で独立QAチームが経験した1年間と教訓をまとめたものです。

This slide was provided on RSGT2021.
1 Year's real story of a QA team which fought in Scrum@Scale company, and some precepts.

Written in both English and Japanese

mkwrd

January 07, 2021
Tweet

More Decks by mkwrd

Transcript

  1. Masanori Kawarada QA Brain in GLOBIS Thoughts and Experience :

    ৽͍͠ఏҊ΍࣮ݧ Online Interpretation : ೔ӳಉ࣌௨༁ 2021-01-07 14:00 - 14:45 @mkwrd ಠཱQAνʔϜ εΫϥϜͷ֎͔Β νʔϜͱ૊৫ͷ ඼࣭Λ૑Δಓ An Independent QA Team’s 1 Year’s War Way to Create Quality of the Teams and the Organization from the Outside of Scrum 1೥ઓه Design Inspired by Eesti Vabariik, the Country of Andrei Solntsev.
  2. Տݪా੓యʢϚʔΫɾ΢Υʔυʣ Masanori Kawarada (Mark Ward) 2"஌ܙାʢϒϨΠϯʣ QA Brain / Evangelist

    ΤϯδχΞྺ೥ 8 Years Exp. as an Engineer @mkwrd ւ֎ΧϯϑΝϨϯεϑϦʔΫ International Conf. Freak ొஃऀ঺հ About Speaker 1 2 3 4 5 Working for גࣜձࣾάϩʔϏεʢڭҭࣄۀʣ
  3. @mkwrd ࢀՃΧϯϑΝϨϯε Conferences 1 2 3 4 5 6 7

    8 9 2017 2018 2019 2020 1. SeleniumConf Berlin 2. Selenium Camp 2018 3. AppiumConf London 4. HeisenBug Moscow 2018 5. SeleniumConf Tokyo 6. SeleniumConf London 7. HeisenBug Moscow 2019 8. European Testing Conference 2020 9. OnlineTestConf 2020 Spring
  4. @mkwrd 1 2 3 4 5 6 7 8 9

    2017 2018 2019 2020 JanetɾLisaͱͷࣸਅ 8. European Testing Conference 2020 Lisa Crispin Janet Gregory Me ”Agile Testing” Japanese Edition ੈքͷΤϯδχΞ Engineers in the World
  5. 10 @mkwrd 1 2 3 4 5 6 7 8

    9 2017 2018 2019 2020 Daria Ramberg Maaike & OIiver Andrei Solntsev Ingo Philipp Petra Boušková Ivan & Natali Peter Andrei Domitriev ੈքͷΤϯδχΞ Engineers in the World
  6. εΫϥϜ࣮ફऀ Scrum Practitioner @mkwrd ͜ͷεϥΠυ In this slide, ςελʔ Tester

    ʹ޲͚ͯ࡞ͬͨ΋ͷͰ͢ɻ I assume that will be the audience. ͓Αͼ and ͸ɺ
  7. https://en.wikipedia.org/wiki/William_Shakespeare @mkwrd ΅͘Β͕ߟ͑Δ໰͍ Issue To Be Discussed in Scrum εΫϥϜʹೖΔͷ͔ɺೖΒͳ͍ͷ͔ɺ

    ςελʔ Tester ? ։ൃऀ Developers εΫϥϜϚελʔ Scrum Master ϓϩμΫτΦʔφʔ Product Owner εΫϥϜνʔϜ Scrum Team ςελʔͷ Tester’s ͦΕ͕ ໰୊ͩɻ question. or not to be, To be that is the
  8. ։ൃऀ Developers εΫϥϜϚελʔ Scrum Master ϓϩμΫτΦʔφʔ Product Owner εΫϥϜνʔϜ Scrum

    Team ςελʔ Tester ςε λ ʔ ͕ ײ ͡ ͯ ͍ Δ ͜ ͱ W hat Tester Feels @mkwrd
  9. ։ൃऀ Developers εΫϥϜϚελʔ Scrum Master ϓϩμΫτΦʔφʔ Product Owner εΫϥϜνʔϜ Scrum

    Team ςελʔ Tester εΫϥϜνʔϜͷҰମײ͕࡞Δݟ͑ͳ͍น Invisible Wall of Scrum Team Unity ෑډͷߴ͞ Feeling Hard to Work with @mkwrd ແݶʹݟ͔ͭΔ ෆ۩߹ɾҧ࿨ײ Infinitive Bugs and Incongruity
  10. ։ൃऀ Developers εΫϥϜϚελʔ Scrum Master ϓϩμΫτΦʔφʔ Product Owner εΫϥϜνʔϜ Scrum

    Team ςελʔ Tester ε Ϋ ϥϜ ν ʔϜ ͕ ײ ͡ ͯ ͍ Δ ͜ ͱ W hat Scrum Team Feels @mkwrd
  11. ։ൃऀ Developers εΫϥϜϚελʔ Scrum Master ϓϩμΫτΦʔφʔ Product Owner εΫϥϜνʔϜ Scrum

    Team ςελʔ Tester ൥ࡶͳίϛϡχέʔγϣϯ Complicated Communication ࣌ؒͷϩε Loss of Time ͯ͞͠ॏཁͳΘ͚Ͱ΋ͳ͍ෆ۩߹ใࠂͷཛྷ Massive Number of Trivial Bug Reports @mkwrd
  12. ςελʔ Tester @mkwrd ։ൃऀ Developers εΫϥϜϚελʔ Scrum Master ϓϩμΫτΦʔφʔ Product

    Owner εΫϥϜνʔϜ Scrum Team Ͳ͏΍ͬͯղܾ͠·͠ΐ͏ʁ How to Solve the Problem?
  13. ςελʔ QAνʔϜ QA Team @mkwrd ։ൃऀ Developers εΫϥϜϚελʔ Scrum Master

    ϓϩμΫτΦʔφʔ Product Owner εΫϥϜνʔϜ Scrum Team ςελʔ Tester ಠཱͨ͠2"νʔϜ Independent QA Team
  14. @mkwrd Testers Join Scrum Team as Developers. ςελʔ͕։ൃऀͱͯ͠ εΫϥϜνʔϜʹࢀՃ͢Δ ϝϦοτ

    Pros. σϝϦοτ Cons. ίϛϡχέʔγϣϯ ϩεΛ࠷খʹͰ͖Δ εΫϥϜͰ͸ δΣωϥϦετͷ ಇ͖͕ٻΊΒΕΔ Minimized Communication Loss Obligation to Work as Generalist in Scrum, Not Specialist ʢҰྫͰ͢ʣ (An Example) 1
  15. @mkwrd An Independent QA Team Supports Scrum. ಠཱͨ͠2"νʔϜ͕ εΫϥϜνʔϜΛࢧԉ͢Δ ϝϦοτ

    Pros. σϝϦοτ Cons. தɾ௕ظʹΘͨΔ ඼࣭޲্ʹ ߩݙ͠΍͍͢ ίϛϡχέʔγϣϯ ϩε͕େ͖͘ͳΔ Contribution to The Quality Improvement in The Long Run Bigger Communication Loss ʢҰྫͰ͢ʣ (An Example) 2
  16. @mkwrd ೥૑ۀͷڭҭࣄۀձࣾ Educational Company since 1992 Developing Web/Mobile App, LMS,

    etc. ೥ʹ։ൃ෦໳ઃཱɺ4DSVN!4DBMF 8FCɾϞόΠϧΞϓϦ΍-.4ͳͲΛ։ൃ Dev. Dept. since 2016, Scrum@Scale 2"νʔϜ QA Team ೥݄ɺςελʔ໊ೖࣾ ೥݄ɺ໊ͰνʔϜཱ֬ গ਺ਫ਼ӶͷʮϏδϣφϦʔɾ2"ʯ 1st Tester Joined in Jan. 2019 Started with 4 testers in Jan. 2020 Elite Corps as “Visionary QA”
  17. @mkwrd Can’t assign Testers to each Scrum Team due to

    shortage ͦ΋ͦ΋ਓ਺͕ গͳ͘ɺ෺ཧతʹ શεΫϥϜνʔϜʹ ΞαΠϯͰ͖ͳ͍ 1
  18. ςελʔ @mkwrd ςελʔ Tester QAνʔϜ QA Team ։ൃऀ Developers εΫϥϜϚελʔ

    Scrum Master ϓϩμΫτΦʔφʔ Product Owner εΫϥϜνʔϜ Scrum Team
  19. Would like to make the QA team who contributes quality

    from not only testing but all aspects 2 Can’t assign Testers to each Scrum Team due to shortage @mkwrd ͦ΋ͦ΋ਓ਺͕ গͳ͘ɺ෺ཧతʹ શεΫϥϜνʔϜʹ ΞαΠϯͰ͖ͳ͍ ςετ͚ͩͰͳ͘ ͋ΒΏΔଆ໘͔Β ඼࣭ʹߩݙ͢Δ2" νʔϜʹͳΓ͍ͨ 1
  20. ςετ Test ඼࣭޲্΁ͷ औΓ૊Έ Efforts to Improve Quality ςετʹͱΒΘΕͣ ඼࣭ʹूத͠Α͏

    ⾣ @mkwrd https://testcon.lt/wp-content/uploads/2020/11/Joel-Montvelisky-TestCon-Europe-2020-Focus-on-Quality-Not-Testing.pdf
  21. @mkwrd ͦ΋ͦ΋ਓ਺͕ গͳ͘ɺ෺ཧతʹ શεΫϥϜνʔϜʹ ΞαΠϯͰ͖ͳ͍ 1 ςετ͚ͩͰͳ͘ ͋ΒΏΔଆ໘͔Β ඼࣭ʹߩݙ͢Δ2" νʔϜʹͳΓ͍ͨ

    2 Would like to create “QA team free” organization, ultimately! ڀۃతʹ͸ 2"νʔϜෆཁͷ ૊৫ʹ࢓্͍͛ͨ 3 Would like to make the QA team who contributes quality from not only testing but all aspects Can’t assign Testers to each Scrum Team due to shortage
  22. Changing Billing System Platform ՝ۚ1'੾ସ 1 ՝ۚP/F [B] New Billing

    System Platform ޿ൣͳϦάϨογϣϯςετ Extensive Regression Testing ՝ۚP/F [A] Old Billing System Platform طଘސ٬ Existing Customer ৽نސ٬ New Customer @mkwrd ։ൃऀ͕࡞ͬͨςετέʔε Test Case provided by Dev. ςελʔ͕࡞ͬͨςετνϟʔλʔ Test Charter provided by Tester ܗࣜతςετ Formal Testing ୳ࡧతςετ Exploratory Testing
  23. Changing Billing System Platform ՝ۚ1'੾ସ 1 @mkwrd ։ൃऀ͕࡞ͬͨςετέʔε Test Case

    provided by Dev. ςελʔ͕࡞ͬͨςετνϟʔλʔ Test Charter provided by Tester ܗࣜతςετ Formal Testing ୳ࡧతςετ Exploratory Testing LEARNING DESIGN EXECUTION ෆ۩߹ͷ܏޲ Tendency of Defects Finding Many Bugs in Short Term & Reporting Selected Ones ୹࣌ؒͰଟ͘ͷෆ۩߹Λݕग़͠ɺݫબͯ͠ใࠂ ςελʔͷ࢓ࣄΛՃ଎ To Accelerate Tester’s Work
  24. @mkwrd Data Table Renewal σʔλ ςʔϒϧߋվ 2 ϦϦʔε͸1ϲ݄ޙ Only 1

    Month until Release ޿ൣͳϦάϨογϣϯςετ Extensive Regression Testing Dev SM PO Scrum QA Team Tester Shared Idea, “Testing Enough to Get a Peace of Mind” ʮ҆৺ײΛಘΒΕΔ·Ͱͷςετʯͷڞ௨ೝࣝ @mkwrd Close Communi- cation ີ઀ͳ ίϛϡχ έʔγϣϯ
  25. Major Update of iOS App J04ΞϓϦ େܕΞοϓ σʔτ 3 ৽ΞϓϦ΁ͷߋ৽

    App Renewal Phase. 1 @mkwrd Apple՝ۚ΁ͷରԠ In-App Billing Purchase Phase. 2
  26. Major Update of iOS App J04ΞϓϦ େܕΞοϓ σʔτ 3 ৽ΞϓϦ΁ͷߋ৽

    App Renewal Phase. 1 ୳ࡧతςετ Exploratory Testing Ensuring Transparency & Building a Peace of Mind ಁ໌ੑͷ୲อͱ҆৺ײͷৢ੒ @mkwrd
  27. Major Update of iOS App J04ΞϓϦ େܕΞοϓ σʔτ 3 Apple՝ۚ΁ͷରԠ

    In-App Billing Purchase Phase. 2 Problems to Be Resolved vs Scrum-QA Connected Team ղܾ͢΂͖՝୊ vs εΫϥϜνʔϜ & QAνʔϜ @mkwrd Dev SM PO Scrum QA Team Tester SANDBOX ࢓༷ॻʹແ͍ڍಈ ͔͠΋ͨ͘͞Μ Many Behaviors Undefined in the Specification
  28. Contribution to Scrum@Scale 4DSVN!4DBMF ΁ͷߩݙ 4 @mkwrd https://scrumatscale.scruminc.com/scrum-at-scale-guide/ Defining Common

    DoD Providing Quality Knowledge ڞ௨ͷDoD੍ఆΛϦʔυ ඼࣭ͷٕज़৘ใఏڙ Scrum Master’s Cycle
  29. Contribution to Scrum@Scale 4DSVN!4DBMF ΁ͷߩݙ 4 @mkwrd https://scrumatscale.scruminc.com/scrum-at-scale-guide/ ϢʔβʔετʔϦʔɺಛʹ डೖ৚݅΁ͷΞϓϩʔν

    Approaching to User Stories Refinement, especially Acceptance Criteria Product Owner’s Cycle Defining Common DoD Providing Quality Knowledge ڞ௨ͷDoD੍ఆΛϦʔυ ඼࣭ͷٕज़৘ใఏڙ Scrum Master’s Cycle
  30. Changing Billing System Platform ՝ۚ1'੾ସ 1 Data Table Renewal σʔλ

    ςʔϒϧߋվ 2 Major Update of iOS App J04ΞϓϦ େܕΞοϓ σʔτ 3 ಠཱQAνʔϜͱεΫϥϜνʔϜͷڠۀͷൿ݃͸…… ୎ӽͨ͠ςετٕज़ @mkwrd @mkwrd Essence for Successful Collaboration Is … Expert’s Test Skills Contribution to Scrum@Scale 4DSVN!4DBMF ΁ͷߩݙ 4
  31. Changing Billing System Platform ՝ۚ1'੾ସ 1 @mkwrd Data Table Renewal

    σʔλ ςʔϒϧߋվ 2 Major Update of iOS App J04ΞϓϦ େܕΞοϓ σʔτ 3 Contribution to Scrum@Scale 4DSVN!4DBMF ΁ͷߩݙ 4 ಠཱQAνʔϜͱεΫϥϜνʔϜͷڠۀͷൿ݃͸…… Essence for Successful Collaboration Is … ஸೡͳίϛϡχέʔγϣϯ Cordial Communication @mkwrd
  32. @mkwrd 2"νʔϜ͸ɺεΫϥϜνʔϜ͕ࣗ෼ͨͪͰ ੒Ռ෺ΛςετͰ͖ΔΑ͏ࢧԉ͢Δ QA Team will support Scrum Teams to

    test artifacts on their own. ඼࣭ʹର͢ΔʮνʔϜશମΞϓϩʔνʯ “The Whole Team Approach” to Quality
  33. ϞμϯςεςΟϯά @mkwrd Modern Testing Alan Page Program Director at Unity

    Brent Jensen Data Scientist at MS moderntesting.org
  34. 6. σʔλυϦϒϯ ϞμϯςεςΟϯά @mkwrd Modern Testing 7 Principles 7ݪଇ 1.

    Ϗδωεͷ੒௕ 2. ϘτϧωοΫ΁ͷରॲ 3. ܧଓతͳվળ 4. ඼࣭จԽৢ੒ 5. ސ٬ͦ͜඼࣭ͷධՁऀ 1. Business Growth 2. Dealing with Bottleneck 3. Continuous Improvement 4. Cultivating Quality Culture 5. Regarding Customer as Unique Quality Evaluator 6. Data Driven 7. ςετ͸νʔϜʹؐΔ 7. Bringing Testing Back to the Team moderntesting.org
  35. 7. ςετ͸νʔϜʹؐΔ ϞμϯςεςΟϯά 7. Bringing Testing @mkwrd Modern Testing ςετεΩϧ΍ϊ΢ϋ΢ΛνʔϜʹ޿ΊΔɿ

    ઐଐͷςετεϖγϟϦετͷधཁ͕ݮͬͨΓ ແ͘ͳͬͨΓ͢Δ͜ͱʹͳΔͱ෼͔͍ͬͯͯɺ ͦΕͰ΋ɺͩ We expand testing abilities and knowhow across the team; understanding that this may reduce (or eliminate) the need for a dedicated testing specialist. Back to the Team moderntesting.org
  36. @mkwrd agiletester.ca/ Why does start from … HERE!? In math,

    it usually starts at the top right… Lisa Crispin & Janet Gregory ”Agile Testing Quadrants”
  37. @mkwrd 2"νʔϜ͸ɺεΫϥϜνʔϜ͕ࣗ෼ͨͪͰ ੒Ռ෺ΛςετͰ͖ΔΑ͏ࢧԉ͢Δ QA Team will support Scrum Teams to

    test artifacts on their own. ඼࣭ʹର͢ΔʮνʔϜશମΞϓϩʔνʯ “The Whole Team Approach” to Quality
  38. ςελʔ QAνʔϜ QA Team @mkwrd ։ൃऀ Developers εΫϥϜϚελʔ Scrum Master

    ϓϩμΫτΦʔφʔ Product Owner εΫϥϜνʔϜ Scrum Team ςελʔ Tester ʮ2"νʔϜͷςετΛ௨͢͜ͱʯ ͳΜͯ%P%ʹॻ͖ͨ͘ͳ͍ͳ͊ʜʜ We don’t want to write on DoD that “the artifacts have to pass QA team’s testing.”
  39. ςελʔ QAνʔϜ QA Team @mkwrd ։ൃऀ Developers εΫϥϜϚελʔ Scrum Master

    ϓϩμΫτΦʔφʔ Product Owner εΫϥϜνʔϜ Scrum Team ςελʔ Tester εΫϥϜνʔϜ͞Μɺ ࣗ͝਎Ͱςετ͕Ͱ͖ΔΑ͏ʹ ͳΓͨ͘͸͋Γ·ͤΜ͔ʁ Hey, Scrum Team, why don’t you want to test on your own?
  40. ςελʔ QAνʔϜ QA Team @mkwrd ։ൃऀ Developers εΫϥϜϚελʔ Scrum Master

    ϓϩμΫτΦʔφʔ Product Owner εΫϥϜνʔϜ Scrum Team ΋ͦ͠ͷͭ΋ΓͳΒɺ 2"νʔϜ͕ςετͷ΍ΓํΛ ࣮ફͰ͓఻͑͠·͢Αʂ If so, QA team will tell you how to test in practice! ςελʔ Tester
  41. εΫϥϜνʔϜ͕ ςετΛओಋ͠ 2"νʔϜ͸ ϨϏϡʔͱ ΞυόΠεΛ͢Δ εΫϥϜνʔϜ͕ ςετΛ΄΅શ࣮ͯࢪ͠ 2"νʔϜ͸ઐ໳ੑΛ ཁ͢Δͱ͖ʹࢧԉ͢Δɻ @mkwrd

    QA team leads almost all test process and shares the way, how-to, etc. 2"νʔϜ͕ ςετϓϩηεΛ ΄΅શͯϦʔυ͠ աఔɾख๏ͳͲΛ εΫϥϜνʔϜͱ ڞ༗͢Δ 1 2 3 Scrum team holds initiative, and QA team provides review and advice. Scrum team makes progress of almost all testing process without QA team instead of some tests requiring technical specialities. The Scrum team don’t need testers’ help to test. 4 εΫϥϜνʔϜ͕2"νʔϜͷ खΛआΓͣʹςετΛߦ͏ɻ Stairway to “QA Team Free” ʮQAνʔϜཁΒͣʯ ΁ͷ֊ஈ
  42. “Should we include testers in Scrum to improve quality or

    not?” There is still no absolute answer to this question. ʮ඼࣭ΛߴΊΔͨΊʹεΫϥϜʹ
 ςελʔΛೖΕΔ͔൱͔ʁʯͱ͍͏໰୊΁ͷ
 ઈରతͳ౴͑͸·ͩଘࡏ͠ͳ͍ɻ @mkwrd
  43. @mkwrd 1 2 Testers Join Scrum Team as Developers. An

    Independent QA Team Supports Scrum. ςελʔ͕։ൃऀͱͯ͠ εΫϥϜνʔϜʹࢀՃ͢Δ ಠཱͨ͠2"νʔϜ͕ εΫϥϜνʔϜΛࢧԉ͢Δ ͋ͳͨͳΒɺͲ͏ߟ͑·͔͢ʁ What would you think?
  44. @mkwrd ͜ͷ͓࿩ΛςελʔɾεΫϥϜ࣮ફऀʹ޿Ίɺٞ࿦͍ͯͩ͘͠͞ɻ Share this session to Testers & Scrum Practitioners

    and discuss, please. ςελʔ͕ ։ൃऀͱͯ͠ εΫϥϜνʔϜʹ ࢀՃ͢Δ Testers Join Scrum as Developers. 1 ಠཱͨ͠ 2"νʔϜ͕ εΫϥϜνʔϜΛ ࢧԉ͢Δ An Independent QA Team Supports Scrum. 2
  45. Masanori Kawarada QA Brain in GLOBIS Thoughts and Experience :

    ৽͍͠ఏҊ΍࣮ݧ Online Interpretation : ೔ӳಉ࣌௨༁ 2021-01-07 14:00 - 14:45 @mkwrd ಠཱQAνʔϜ εΫϥϜͷ֎͔Β νʔϜͱ૊৫ͷ ඼࣭Λ૑Δಓ An Independent QA Team’s 1 Year’s War Way to Create Quality of the Teams and the Organization from the Outside of Scrum 1೥ઓه Design Inspired by Eesti Vabariik, the Country of Andrei Solntsev.