Share
Embed
210107_RSGT2021_独立QAチーム1年戦記/210107_RSGT2021_An_Independent_QA_Teams_1_Years_War
RSGT2021で登壇した資料です。
Scrum@Scaleの会社で独立QAチームが経験した1年間と教訓をまとめたものです。
This slide was provided on RSGT2021.
1 Year's real story of a QA team which fought in Scrum@Scale company, and some precepts.
Written in both English and Japanese
Transcript
71 slides
-
Masanori Kawarada QA Brain in GLOBIS Thoughts and Experience :
৽͍͠ఏҊ࣮ݧ Online Interpretation : ӳಉ࣌௨༁ 2021-01-07 14:00 - 14:45 @mkwrd ಠཱQAνʔϜ εΫϥϜͷ֎͔Β νʔϜͱ৫ͷ ࣭ΛΔಓ An Independent QA Team’s 1 Year’s War Way to Create Quality of the Teams and the Organization from the Outside of Scrum 1ઓه Design Inspired by Eesti Vabariik, the Country of Andrei Solntsev. -
ՏݪాయʢϚʔΫɾΥʔυʣ Masanori Kawarada (Mark Ward) 2"ܙାʢϒϨΠϯʣ QA Brain / Evangelist
ΤϯδχΞྺ 8 Years Exp. as an Engineer @mkwrd ւ֎ΧϯϑΝϨϯεϑϦʔΫ International Conf. Freak ొஃऀհ About Speaker 1 2 3 4 5 Working for גࣜձࣾάϩʔϏεʢڭҭࣄۀʣ -
@mkwrd ࢀՃΧϯϑΝϨϯε Conferences 1 2 3 4 5 6 7
8 9 2017 2018 2019 2020 1. SeleniumConf Berlin 2. Selenium Camp 2018 3. AppiumConf London 4. HeisenBug Moscow 2018 5. SeleniumConf Tokyo 6. SeleniumConf London 7. HeisenBug Moscow 2019 8. European Testing Conference 2020 9. OnlineTestConf 2020 Spring -
@mkwrd 1 2 3 4 5 6 7 8 9
2017 2018 2019 2020 JanetɾLisaͱͷࣸਅ 8. European Testing Conference 2020 Lisa Crispin Janet Gregory Me ”Agile Testing” Japanese Edition ੈքͷΤϯδχΞ Engineers in the World -
10 @mkwrd 1 2 3 4 5 6 7 8
9 2017 2018 2019 2020 Daria Ramberg Maaike & OIiver Andrei Solntsev Ingo Philipp Petra Boušková Ivan & Natali Peter Andrei Domitriev ੈքͷΤϯδχΞ Engineers in the World -
εΫϥϜ࣮ફऀ Scrum Practitioner @mkwrd ͜ͷεϥΠυ In this slide, ςελʔ Tester
ʹ͚ͯ࡞ͬͨͷͰ͢ɻ I assume that will be the audience. ͓Αͼ and ɺ -
Tester ςελʔ ʮςετɾ࣭ͷઐՈʯͯ͢ Every “Test / Quality Specialist” ʮςετ࣮ߦऀʯ͚ͩ @mkwrd
Only “Test Operator” ͜ͷεϥΠυ In this slide, ͱ means Ͱɺ -
@mkwrd γΣΠΫεϐΞ W. Shakespeare https://en.wikipedia.org/wiki/William_Shakespeare ͜ͷ··Ͱ͍͍ͷ͔ɺ͍͚ͳ͍ͷ͔ɺ ʰϋϜϨοτʱ খాౡ༤ࢤʦ༁ʧനਫࣾ “Hamlet” ͦΕ͕ͩɻ
question. or not to be, To be that is the -
https://en.wikipedia.org/wiki/William_Shakespeare @mkwrd ΅͘Β͕ߟ͑Δ͍ Issue To Be Discussed in Scrum εΫϥϜʹೖΔͷ͔ɺೖΒͳ͍ͷ͔ɺ
ςελʔ Tester ? ։ൃऀ Developers εΫϥϜϚελʔ Scrum Master ϓϩμΫτΦʔφʔ Product Owner εΫϥϜνʔϜ Scrum Team ςελʔͷ Tester’s ͦΕ͕ ͩɻ question. or not to be, To be that is the -
ཁ݅ఆٛ @mkwrd %FTJHO ઃܭ $PEJOH ςετ 3FMFBTF WATERFALL 3FRVJSFNFOU
5FTUJOH ϦϦʔε ςελʔ Tester -
։ൃऀ Developers εΫϥϜϚελʔ Scrum Master ϓϩμΫτΦʔφʔ Product Owner εΫϥϜνʔϜ Scrum
Team ςελʔ Tester ςε λ ʔ ͕ ײ ͡ ͯ ͍ Δ ͜ ͱ W hat Tester Feels @mkwrd -
։ൃऀ Developers εΫϥϜϚελʔ Scrum Master ϓϩμΫτΦʔφʔ Product Owner εΫϥϜνʔϜ Scrum
Team ςελʔ Tester εΫϥϜνʔϜͷҰମײ͕࡞Δݟ͑ͳ͍น Invisible Wall of Scrum Team Unity ෑډͷߴ͞ Feeling Hard to Work with @mkwrd ແݶʹݟ͔ͭΔ ෆ۩߹ɾҧײ Infinitive Bugs and Incongruity -
։ൃऀ Developers εΫϥϜϚελʔ Scrum Master ϓϩμΫτΦʔφʔ Product Owner εΫϥϜνʔϜ Scrum
Team ςελʔ Tester ε Ϋ ϥϜ ν ʔϜ ͕ ײ ͡ ͯ ͍ Δ ͜ ͱ W hat Scrum Team Feels @mkwrd -
։ൃऀ Developers εΫϥϜϚελʔ Scrum Master ϓϩμΫτΦʔφʔ Product Owner εΫϥϜνʔϜ Scrum
Team ςελʔ Tester ࡶͳίϛϡχέʔγϣϯ Complicated Communication ࣌ؒͷϩε Loss of Time ͯ͞͠ॏཁͳΘ͚Ͱͳ͍ෆ۩߹ใࠂͷཛྷ Massive Number of Trivial Bug Reports @mkwrd -
ςελʔ Tester @mkwrd ։ൃऀ Developers εΫϥϜϚελʔ Scrum Master ϓϩμΫτΦʔφʔ Product
Owner εΫϥϜνʔϜ Scrum Team Ͳ͏ͬͯղܾ͠·͠ΐ͏ʁ How to Solve the Problem? -
ಠཱͨ͠2"νʔϜ͕ εΫϥϜνʔϜΛࢧԉ͢Δ @mkwrd Testers Join Scrum Team as Developers. ςελʔ͕։ൃऀͱͯ͠
εΫϥϜνʔϜʹࢀՃ͢Δ An Independent QA Team Supports Scrum 1 2 -
ςελʔ QAνʔϜ QA Team @mkwrd ։ൃऀ Developers εΫϥϜϚελʔ Scrum Master
ϓϩμΫτΦʔφʔ Product Owner εΫϥϜνʔϜ Scrum Team ςελʔ Tester ಠཱͨ͠2"νʔϜ Independent QA Team -
@mkwrd Testers Join Scrum Team as Developers. ςελʔ͕։ൃऀͱͯ͠ εΫϥϜνʔϜʹࢀՃ͢Δ ϝϦοτ
Pros. σϝϦοτ Cons. ίϛϡχέʔγϣϯ ϩεΛ࠷খʹͰ͖Δ εΫϥϜͰ δΣωϥϦετͷ ಇ͖͕ٻΊΒΕΔ Minimized Communication Loss Obligation to Work as Generalist in Scrum, Not Specialist ʢҰྫͰ͢ʣ (An Example) 1 -
@mkwrd An Independent QA Team Supports Scrum. ಠཱͨ͠2"νʔϜ͕ εΫϥϜνʔϜΛࢧԉ͢Δ ϝϦοτ
Pros. σϝϦοτ Cons. தɾظʹΘͨΔ ্࣭ʹ ߩݙ͍͢͠ ίϛϡχέʔγϣϯ ϩε͕େ͖͘ͳΔ Contribution to The Quality Improvement in The Long Run Bigger Communication Loss ʢҰྫͰ͢ʣ (An Example) 2 -
@mkwrd Testers Join Scrum Team as Developers. ςελʔ͕։ൃऀͱͯ͠ εΫϥϜνʔϜʹࢀՃ͢Δ ಠཱͨ͠2"νʔϜ͕
εΫϥϜνʔϜΛࢧԉ͢Δ An Independent QA Team Supports Scrum. 1 2 -
1 ࠓճͷࣄྫͪ͜Β I’d like to talk about @mkwrd ಠཱͨ͠2"νʔϜ͕ εΫϥϜνʔϜΛࢧԉ͢Δ
An Independent QA Team Supports Scrum. 2 ⾣ ⾣ -
ࢹ ࠲ VISION SHIZA @mkwrd ͳͥεΫϥϜνʔϜʹೖΒͳ͍ಓΛબΜ͔ͩ Reason Why Not to
Join Scrum Team 2 -
@mkwrd ۀͷڭҭࣄۀձࣾ Educational Company since 1992 Developing Web/Mobile App, LMS,
etc. ʹ։ൃ෦ઃཱɺ4DSVN!4DBMF 8FCɾϞόΠϧΞϓϦ-.4ͳͲΛ։ൃ Dev. Dept. since 2016, Scrum@Scale 2"νʔϜ QA Team ݄ɺςελʔ໊ೖࣾ ݄ɺ໊ͰνʔϜཱ֬ গਫ਼ӶͷʮϏδϣφϦʔɾ2"ʯ 1st Tester Joined in Jan. 2019 Started with 4 testers in Jan. 2020 Elite Corps as “Visionary QA” -
@mkwrd Can’t assign Testers to each Scrum Team due to
shortage ͦͦਓ͕ গͳ͘ɺཧతʹ શεΫϥϜνʔϜʹ ΞαΠϯͰ͖ͳ͍ 1 -
ςελʔ @mkwrd ςελʔ Tester QAνʔϜ QA Team ։ൃऀ Developers εΫϥϜϚελʔ
Scrum Master ϓϩμΫτΦʔφʔ Product Owner εΫϥϜνʔϜ Scrum Team -
Would like to make the QA team who contributes quality
from not only testing but all aspects 2 Can’t assign Testers to each Scrum Team due to shortage @mkwrd ͦͦਓ͕ গͳ͘ɺཧతʹ શεΫϥϜνʔϜʹ ΞαΠϯͰ͖ͳ͍ ςετ͚ͩͰͳ͘ ͋ΒΏΔଆ໘͔Β ࣭ʹߩݙ͢Δ2" νʔϜʹͳΓ͍ͨ 1 -
ςετ Test ্࣭ͷ औΓΈ Efforts to Improve Quality ςετʹͱΒΘΕͣ ࣭ʹूத͠Α͏
⾣ @mkwrd https://testcon.lt/wp-content/uploads/2020/11/Joel-Montvelisky-TestCon-Europe-2020-Focus-on-Quality-Not-Testing.pdf -
@mkwrd ͦͦਓ͕ গͳ͘ɺཧతʹ શεΫϥϜνʔϜʹ ΞαΠϯͰ͖ͳ͍ 1 ςετ͚ͩͰͳ͘ ͋ΒΏΔଆ໘͔Β ࣭ʹߩݙ͢Δ2" νʔϜʹͳΓ͍ͨ
2 Would like to create “QA team free” organization, ultimately! ڀۃతʹ 2"νʔϜෆཁͷ ৫ʹ্͍͛ͨ 3 Would like to make the QA team who contributes quality from not only testing but all aspects Can’t assign Testers to each Scrum Team due to shortage -
Changing Billing System Platform ՝ۚ1'ସ 1 ՝ۚP/F [B] New Billing
System Platform ൣͳϦάϨογϣϯςετ Extensive Regression Testing ՝ۚP/F [A] Old Billing System Platform طଘސ٬ Existing Customer ৽نސ٬ New Customer @mkwrd ։ൃऀ͕࡞ͬͨςετέʔε Test Case provided by Dev. ςελʔ͕࡞ͬͨςετνϟʔλʔ Test Charter provided by Tester ܗࣜతςετ Formal Testing ୳ࡧతςετ Exploratory Testing -
Changing Billing System Platform ՝ۚ1'ସ 1 @mkwrd ։ൃऀ͕࡞ͬͨςετέʔε Test Case
provided by Dev. ςελʔ͕࡞ͬͨςετνϟʔλʔ Test Charter provided by Tester ܗࣜతςετ Formal Testing ୳ࡧతςετ Exploratory Testing LEARNING DESIGN EXECUTION ෆ۩߹ͷ Tendency of Defects Finding Many Bugs in Short Term & Reporting Selected Ones ࣌ؒͰଟ͘ͷෆ۩߹Λݕग़͠ɺݫબͯ͠ใࠂ ςελʔͷࣄΛՃ To Accelerate Tester’s Work -
@mkwrd Data Table Renewal σʔλ ςʔϒϧߋվ 2 ϦϦʔε1ϲ݄ޙ Only 1
Month until Release ൣͳϦάϨογϣϯςετ Extensive Regression Testing Dev SM PO Scrum QA Team Tester Shared Idea, “Testing Enough to Get a Peace of Mind” ʮ҆৺ײΛಘΒΕΔ·Ͱͷςετʯͷڞ௨ೝࣝ @mkwrd Close Communi- cation ີͳ ίϛϡχ έʔγϣϯ -
Major Update of iOS App J04ΞϓϦ େܕΞοϓ σʔτ 3 ৽ΞϓϦͷߋ৽
App Renewal Phase. 1 @mkwrd Apple՝ۚͷରԠ In-App Billing Purchase Phase. 2 -
Major Update of iOS App J04ΞϓϦ େܕΞοϓ σʔτ 3 ৽ΞϓϦͷߋ৽
App Renewal Phase. 1 ୳ࡧతςετ Exploratory Testing Ensuring Transparency & Building a Peace of Mind ಁ໌ੑͷ୲อͱ҆৺ײͷৢ @mkwrd -
Major Update of iOS App J04ΞϓϦ େܕΞοϓ σʔτ 3 Apple՝ۚͷରԠ
In-App Billing Purchase Phase. 2 Problems to Be Resolved vs Scrum-QA Connected Team ղܾ͖͢՝ vs εΫϥϜνʔϜ & QAνʔϜ @mkwrd Dev SM PO Scrum QA Team Tester SANDBOX ༷ॻʹແ͍ڍಈ ͔ͨ͘͠͞Μ Many Behaviors Undefined in the Specification -
Contribution to Scrum@Scale 4DSVN!4DBMF ͷߩݙ 4 @mkwrd https://scrumatscale.scruminc.com/scrum-at-scale-guide/ Defining Common
DoD Providing Quality Knowledge ڞ௨ͷDoD੍ఆΛϦʔυ ࣭ͷٕज़ใఏڙ Scrum Master’s Cycle -
Contribution to Scrum@Scale 4DSVN!4DBMF ͷߩݙ 4 @mkwrd https://scrumatscale.scruminc.com/scrum-at-scale-guide/ ϢʔβʔετʔϦʔɺಛʹ डೖ݅ͷΞϓϩʔν
Approaching to User Stories Refinement, especially Acceptance Criteria Product Owner’s Cycle Defining Common DoD Providing Quality Knowledge ڞ௨ͷDoD੍ఆΛϦʔυ ࣭ͷٕज़ใఏڙ Scrum Master’s Cycle -
Changing Billing System Platform ՝ۚ1'ସ 1 Data Table Renewal σʔλ
ςʔϒϧߋվ 2 Major Update of iOS App J04ΞϓϦ େܕΞοϓ σʔτ 3 ಠཱQAνʔϜͱεΫϥϜνʔϜͷڠۀͷൿ݃…… ӽͨ͠ςετٕज़ @mkwrd @mkwrd Essence for Successful Collaboration Is … Expert’s Test Skills Contribution to Scrum@Scale 4DSVN!4DBMF ͷߩݙ 4 -
Changing Billing System Platform ՝ۚ1'ସ 1 @mkwrd Data Table Renewal
σʔλ ςʔϒϧߋվ 2 Major Update of iOS App J04ΞϓϦ େܕΞοϓ σʔτ 3 Contribution to Scrum@Scale 4DSVN!4DBMF ͷߩݙ 4 ಠཱQAνʔϜͱεΫϥϜνʔϜͷڠۀͷൿ݃…… Essence for Successful Collaboration Is … ஸೡͳίϛϡχέʔγϣϯ Cordial Communication @mkwrd -
@mkwrd 2"νʔϜɺεΫϥϜνʔϜ͕ࣗͨͪͰ ՌΛςετͰ͖ΔΑ͏ࢧԉ͢Δ QA Team will support Scrum Teams to
test artifacts on their own. ࣭ʹର͢ΔʮνʔϜશମΞϓϩʔνʯ “The Whole Team Approach” to Quality -
ϞμϯςεςΟϯά @mkwrd Modern Testing Alan Page Program Director at Unity
Brent Jensen Data Scientist at MS moderntesting.org -
ϞμϯςεςΟϯά @mkwrd Modern Testing Mission ϛογϣϯ ग़ՙͰ͖Δ࣭ͷ౸ୡΛ Ճͤ͞Δ͜ͱ Accelerate the
Achievement of Shippable Quality moderntesting.org -
6. σʔλυϦϒϯ ϞμϯςεςΟϯά @mkwrd Modern Testing 7 Principles 7ݪଇ 1.
Ϗδωεͷ 2. ϘτϧωοΫͷରॲ 3. ܧଓతͳվળ 4. ࣭จԽৢ 5. ސ٬࣭ͦ͜ͷධՁऀ 1. Business Growth 2. Dealing with Bottleneck 3. Continuous Improvement 4. Cultivating Quality Culture 5. Regarding Customer as Unique Quality Evaluator 6. Data Driven 7. ςετνʔϜʹؐΔ 7. Bringing Testing Back to the Team moderntesting.org -
7. ςετνʔϜʹؐΔ ϞμϯςεςΟϯά 7. Bringing Testing @mkwrd Modern Testing ςετεΩϧϊϋΛνʔϜʹΊΔɿ
ઐଐͷςετεϖγϟϦετͷधཁ͕ݮͬͨΓ ແ͘ͳͬͨΓ͢Δ͜ͱʹͳΔͱ͔͍ͬͯͯɺ ͦΕͰɺͩ We expand testing abilities and knowhow across the team; understanding that this may reduce (or eliminate) the need for a dedicated testing specialist. Back to the Team moderntesting.org -
Lisa Crispin & @mkwrd Janet Gregory agiletester.ca/ ϦαɾΫϦεϐϯ δϟωοτɾάϨΰϦʔ ະ༁
Not Translated into Japanese -
@mkwrd agiletester.ca/ Why does start from … HERE!? In math,
it usually starts at the top right… Lisa Crispin & Janet Gregory ”Agile Testing Quadrants” -
@mkwrd 2"νʔϜɺεΫϥϜνʔϜ͕ࣗͨͪͰ ՌΛςετͰ͖ΔΑ͏ࢧԉ͢Δ QA Team will support Scrum Teams to
test artifacts on their own. ࣭ʹର͢ΔʮνʔϜશମΞϓϩʔνʯ “The Whole Team Approach” to Quality -
ςελʔ QAνʔϜ QA Team @mkwrd ։ൃऀ Developers εΫϥϜϚελʔ Scrum Master
ϓϩμΫτΦʔφʔ Product Owner εΫϥϜνʔϜ Scrum Team ςελʔ Tester ʮ2"νʔϜͷςετΛ௨͢͜ͱʯ ͳΜͯ%P%ʹॻ͖ͨ͘ͳ͍ͳ͊ʜʜ We don’t want to write on DoD that “the artifacts have to pass QA team’s testing.” -
ςελʔ QAνʔϜ QA Team @mkwrd ։ൃऀ Developers εΫϥϜϚελʔ Scrum Master
ϓϩμΫτΦʔφʔ Product Owner εΫϥϜνʔϜ Scrum Team ςελʔ Tester εΫϥϜνʔϜ͞Μɺ ࣗ͝Ͱςετ͕Ͱ͖ΔΑ͏ʹ ͳΓͨ͋͘Γ·ͤΜ͔ʁ Hey, Scrum Team, why don’t you want to test on your own? -
ςελʔ QAνʔϜ QA Team @mkwrd ։ൃऀ Developers εΫϥϜϚελʔ Scrum Master
ϓϩμΫτΦʔφʔ Product Owner εΫϥϜνʔϜ Scrum Team ͦ͠ͷͭΓͳΒɺ 2"νʔϜ͕ςετͷΓํΛ ࣮ફͰ͓͑͠·͢Αʂ If so, QA team will tell you how to test in practice! ςελʔ Tester -
εΫϥϜνʔϜ͕ ςετΛओಋ͠ 2"νʔϜ ϨϏϡʔͱ ΞυόΠεΛ͢Δ εΫϥϜνʔϜ͕ ςετΛ΄΅શ࣮ͯࢪ͠ 2"νʔϜઐੑΛ ཁ͢Δͱ͖ʹࢧԉ͢Δɻ @mkwrd
QA team leads almost all test process and shares the way, how-to, etc. 2"νʔϜ͕ ςετϓϩηεΛ ΄΅શͯϦʔυ͠ աఔɾख๏ͳͲΛ εΫϥϜνʔϜͱ ڞ༗͢Δ 1 2 3 Scrum team holds initiative, and QA team provides review and advice. Scrum team makes progress of almost all testing process without QA team instead of some tests requiring technical specialities. The Scrum team don’t need testers’ help to test. 4 εΫϥϜνʔϜ͕2"νʔϜͷ खΛआΓͣʹςετΛߦ͏ɻ Stairway to “QA Team Free” ʮQAνʔϜཁΒͣʯ ͷ֊ஈ -
“Should we include testers in Scrum to improve quality or
not?” There is still no absolute answer to this question. ʮ࣭ΛߴΊΔͨΊʹεΫϥϜʹ ςελʔΛೖΕΔ͔൱͔ʁʯͱ͍͏ͷ ઈରతͳ͑·ͩଘࡏ͠ͳ͍ɻ @mkwrd -
ಠཱQAνʔϜ͕εΫϥϜΛࢧԉ͢ΔͨΊͷ 伴ʮӽͨ͠ςετٕ๏ɾٕज़ʯͰͳ͘ ʮஸೡͳίϛϡχέʔγϣϯʯͰ͋Δɻ The Key for an Independent QA Team
to Support Scrum Team is not “Distinguishing Testing Skills” but “Cordial Communication”. @mkwrd -
ϓϩμΫτ࣭ͷ୲อεΫϥϜͷɻ ಠཱQAνʔϜ͕͍ͳͯ͘ɺ ࣗͨͪͰςετͰ͖ΔΑ͏ʹͳΖ͏ɻ Scrum Should Ensure Product Quality. Without an
Independent QA Team, Scrum Has to Be Able to Test Enough. @mkwrd -
@mkwrd ࠓͦͯ͜͢ͷςελʔɾεΫϥϜ࣮ફऀʹ͍·͢ Now is the Time to Ask All Testers
& Scrum Practitioners. -
@mkwrd 1 2 Testers Join Scrum Team as Developers. An
Independent QA Team Supports Scrum. ςελʔ͕։ൃऀͱͯ͠ εΫϥϜνʔϜʹࢀՃ͢Δ ಠཱͨ͠2"νʔϜ͕ εΫϥϜνʔϜΛࢧԉ͢Δ ͋ͳͨͳΒɺͲ͏ߟ͑·͔͢ʁ What would you think? -
@mkwrd ͜ͷ͓ΛςελʔɾεΫϥϜ࣮ફऀʹΊɺ͍ٞͯͩ͘͠͞ɻ Share this session to Testers & Scrum Practitioners
and discuss, please. ςελʔ͕ ։ൃऀͱͯ͠ εΫϥϜνʔϜʹ ࢀՃ͢Δ Testers Join Scrum as Developers. 1 ಠཱͨ͠ 2"νʔϜ͕ εΫϥϜνʔϜΛ ࢧԉ͢Δ An Independent QA Team Supports Scrum. 2 -
Masanori Kawarada QA Brain in GLOBIS Thoughts and Experience :
৽͍͠ఏҊ࣮ݧ Online Interpretation : ӳಉ࣌௨༁ 2021-01-07 14:00 - 14:45 @mkwrd ಠཱQAνʔϜ εΫϥϜͷ֎͔Β νʔϜͱ৫ͷ ࣭ΛΔಓ An Independent QA Team’s 1 Year’s War Way to Create Quality of the Teams and the Organization from the Outside of Scrum 1ઓه Design Inspired by Eesti Vabariik, the Country of Andrei Solntsev.