定量評価疲弊しませんか？～Well-beingと生産性指標を組み合わせた エンジニアリングメトリクスプログラムについて～

Developers Summit 2023 登壇資料
https://event.shoeisha.jp/devsumi/20230209/session/4171/

overflowは、副業・転職サービス「Offers(オファーズ)」の開発、運用を行っています。
サービスの提供を開始してから3年。サービスの拡大に合わせ、組織も比例して成長してきました。

その中で、組織の成長に伴い、どのように生産性指標を開発に取り入れていったか。
取り入れていった結果、状態把握から逸脱し何が起きたか。そして、その後どのようにして改善していっているかご紹介します。

私達が行ってきたことを例に(反省として)、数値に踊らされずに正しく運用する方法を考えるきっかけになれば幸いです。

▼関連リンク
Offers：https://offers.jp/
Offers MGR（オファーズマネージャー）：https://offers-mgr.com/lp
Offers Tech Blog: https://zenn.dev/offers
Offersデジタル人材総研：https://hr-lab.offers.jp/
Offers事例集：https://offers.jp/cases
Offersお役立ち資料：https://offers.jp/whitepaper
OffersMagazine：https://offers.jp/media
OffersJobs：https://offers.jp/jobs
Podcast：https://anchor.fm/overflowinc/

Transcript

1. Well-being 2023.2.9 Developers Summit 2023
2. 2 overflow CTO 2010 Ameba 2013 A 2015 2017 6 CTO overflow Tabito Ohtani
4. 4 Introduction = (Developer Productivity) Source lines of code (SLOC) PR d/d/d (deploys/ a day / a developer) FourKeys
5. 5 Introduction 02 ( ) 03 = 01
6. Corporate overflow
7. Corporate 7 overflow 105-0001 1-1-21 5F 2 880 4440 2017 6 9 Our vision
8. Mission 8
9. overflow 9 IT / Corporate
10. 10 Corporate
11. 11 Corporate
12. Development Organization
13. 13 Development Organization Offers toC Offers toB Offers MGR Enabling/Core Design PO/PdM Dev/Tech Lead Data Analysts Engineers Designers 兼務 兼務 兼務 =Flexible = Full
14. 14 Development Organization what/why - how
15. Our history & issues
16. Our history & issues 16
17. PR PR PR PR Github Insight PR Our history & issues 17
18. PR Our history & issues 18 pros cons PR , PR
19. cons PR , PR pros PR Our history & issues 19
20. d/d/d (deploys/ a day / a developer) Our history & issues 20 頻 0.1 (0.5 ~ 1.0 ) = = or = 頻 https://itrevolution.com/product/accelerate/
21. d/d/d (deploys/ a day / a developer) Our history & issues 21 pros cons e.g. or
22. d/d/d (deploys/ a day / a developer) Our history & issues 22 pros cons e.g. or 頻
23. DORA 6 https://cloud.google.com/blog/ja/products/gcp/using-the-four-keys-to-measure- your-devops-performance FourKeys Our history & issues 23 4
24. FourKeys Our history & issues 24 pros cons ⾒ Agile etc.. DevOps
25. FourKeys Our history & issues 25 pros cons ⾒ Agile etc.. DevOps (DevOps, Note ( )
26. https://www.atlassian.com/ja/incident-management/kpis/sla-vs-slo-vs-sli FourKeys + SLO/SLI Our history & issues 26 頻 API 99.95% 90% n SLO Sprint FourKeys SLO/SLI
27. FourKeys + SLO/SLI Our history & issues 27 pros cons &
28. FourKeys + SLO/SLI Our history & issues 28 pros cons & OKR ( )
29. Our history & issues 29
30. Our history & issues 30 (OKR)
31. Our history & issues 31 Donald T. Campbell
32. Our history & issues 32 どのような定量的な社会指標も、 社会的意思決定に用いられると、 その分だけ劣化圧力を受けやすくなり、 追跡対象としていた社会的プロセスがゆがめられ 劣化する傾向が強まる Donald T. Campbell
33. Our history & issues 33 QA
34. Current solution
35. Current solution 35 ( ) 01 = 02 ⾒ 03 04
36. Current solution 36
37. Current solution 37 MTG
38. Current solution 38 MTG ⾒
39. https://queue.acm.org/detail.cfm?id=3454124 SPACE Current solution 39 Copilot SRE Github Copilot Report 2022.09
40. SPACE Current solution 40 1 5 Satisfaction and well being Performance Activity Communication and collaboration Efficiency and flow
41. SPACE Current solution 41 (Well-being (FourKeys, Github, etc..
42. SPACE Current solution 42
43. Communication and collaboration Efficiency and flow SPACE - Current solution 43 SPACE / 3 ⾒
44. SPACE - Satisfaction and well being Current solution 44 Satisfaction and well being Satisfaction How fulfilled developers feel with their work, team, tools, or culture Well-being How healthy and happy they are, and how their work impacts it e.g.) e.g.) CI/CD pipeline
45. SPACE - Performance Current solution 45 Performance Performance the outcome of a system or process
46. Activity a count of actions or outputs completed in the course of performing work SPACE - Activity Current solution 46 Activity PR FourKeys (FourKeys
47. Communication and collaboration how people and teams communicate and work together SPACE - Communication and collaboration Current solution 47 Communication and collaboration
48. Efficiency and flow capture the ability to complete work or make progress on it with minimal interruptions or delays, whether individually or through a system SPACE - Efficiency and flow Current solution 48 Efficiency and flow e.g.) MTG MTG Velocity CI/CD
49. SPACE Current solution 49
50. Satisfaction and well being SPACE - - Current solution 50 Communication and collaboration Activity FourKeys/SLO PR ⾒
51. SPACE - Satisfaction and well being Current solution 51 !! !!
52. SPACE - Satisfaction and well being Current solution 52 / Developer Survey SRE
53. SPACE - Communication & Collaboration Current solution 53 Slack
54. SPACE - Activity Current solution 54 !! !! FourKeys FourKeys & Github Github PR Issue
55. Current solution 55 FourKeys 1on1 etc
56. for the next
57. for the next 57 Review to Merge Time (RTMT) PR PR 01 Time before delivery production 02 Time in progress open release ⾒ 03 Time in phase QA 04 Flow control 05
58. for the next 58 https://scrumorg-website-prod.s3.amazonaws.com/drupal/2021-02/2020- EBM-Guide-Japanese.pdf Scrum.org (KVA) (FourKeys)
59. for the next 59 https://scrumorg-website-prod.s3.amazonaws.com/drupal/2021-02/2020- EBM-Guide-Japanese.pdf (KVM) KVM = 頻 ⾒
60. for the next 60 01 Well-being 02 SPACE 03
61. ( SaaS) +
62. 2023 1 26 β URL : http://bit.ly/3XgKBg7
64. Offers MGR CTO
65. 65 105-0001 1-1-21 5F web: https://overflow.co.jp/ pr@overflow.co.jp