定量評価疲弊しませんか？～Well-beingと生産性指標を組み合わせた エンジニアリングメトリクスプログラムについて～

Developers Summit 2023 登壇資料
https://event.shoeisha.jp/devsumi/20230209/session/4171/

overflowは、副業・転職サービス「Offers(オファーズ)」の開発、運用を行っています。
サービスの提供を開始してから3年。サービスの拡大に合わせ、組織も比例して成長してきました。

その中で、組織の成長に伴い、どのように生産性指標を開発に取り入れていったか。
取り入れていった結果、状態把握から逸脱し何が起きたか。そして、その後どのようにして改善していっているかご紹介します。

私達が行ってきたことを例に(反省として)、数値に踊らされずに正しく運用する方法を考えるきっかけになれば幸いです。

▼関連リンク
Offers：https://offers.jp/
Offers MGR（オファーズマネージャー）：https://offers-mgr.com/lp
Offers Tech Blog: https://zenn.dev/offers
Offersデジタル人材総研：https://hr-lab.offers.jp/
Offers事例集：https://offers.jp/cases
Offersお役立ち資料：https://offers.jp/whitepaper
OffersMagazine：https://offers.jp/media
OffersJobs：https://offers.jp/jobs
Podcast：https://anchor.fm/overflowinc/

Transcript

1. Well-being
   2023.2.9 Developers Summit 2023
   

   View Slide

2. 2
   overflow CTO
   2010
   Ameba
   2013 A
   2015
   2017 6 CTO overflow
   Tabito Ohtani
   

   View Slide

3. View Slide

4. 4
   Introduction
   = (Developer Productivity)
   Source lines of code (SLOC)
   PR
   d/d/d (deploys/ a day / a developer)
   FourKeys
   

   View Slide

5. 5
   Introduction
   02
   ( )
   03
   =
   01
   

   View Slide

6. Corporate
   overflow
   

   View Slide

7. Corporate
   7
   overflow
   105-0001
   1-1-21 5F
   2 880 4440
   2017 6 9
   Our vision
   

   View Slide

8. Mission
   8
   

   View Slide

9. overflow
   9
   IT /
   Corporate
   

   View Slide

10. 10
    Corporate
    

    View Slide

11. 11
    Corporate
    

    View Slide

12. Development Organization
    

    View Slide

13. 13
    Development Organization
    Offers toC Offers toB Offers MGR Enabling/Core Design
    PO/PdM
    Dev/Tech
    Lead
    Data Analysts
    Engineers
    Designers
    兼務 兼務
    兼務
    =Flexible
    = Full
    

    View Slide

14. 14
    Development Organization
    what/why - how
    

    View Slide

15. Our history & issues
    

    View Slide

16. Our history & issues
    16
    

    View Slide

17. PR
    PR PR
    PR
    Github Insight
    PR
    Our history & issues
    17
    

    View Slide

18. PR
    Our history & issues
    18
    pros cons
    PR ,
    PR
    

    View Slide

19. cons
    PR ,
    PR
    pros
    PR
    Our history & issues
    19
    

    View Slide

20. d/d/d (deploys/ a day / a developer)
    Our history & issues
    20
    頻
    0.1
    (0.5 ~ 1.0 )
    =
    = or
    = 頻
    https://itrevolution.com/product/accelerate/
    

    View Slide

21. d/d/d (deploys/ a day / a developer)
    Our history & issues
    21
    pros cons
    e.g. or
    

    View Slide

22. d/d/d (deploys/ a day / a developer)
    Our history & issues
    22
    pros cons
    e.g. or
    頻
    

    View Slide

23. DORA
    6
    https://cloud.google.com/blog/ja/products/gcp/using-the-four-keys-to-measure-
    your-devops-performance
    FourKeys
    Our history & issues
    23
    4
    

    View Slide

24. FourKeys
    Our history & issues
    24
    pros cons
    ⾒
    Agile
    etc.. DevOps
    

    View Slide

25. FourKeys
    Our history & issues
    25
    pros cons
    ⾒
    Agile
    etc.. DevOps
    (DevOps,
    Note
    ( )
    

    View Slide

26. https://www.atlassian.com/ja/incident-management/kpis/sla-vs-slo-vs-sli
    FourKeys + SLO/SLI
    Our history & issues
    26
    頻
    API 99.95%
    90% n
    SLO
    Sprint
    FourKeys
    SLO/SLI
    

    View Slide

27. FourKeys + SLO/SLI
    Our history & issues
    27
    pros cons
    &
    

    View Slide

28. FourKeys + SLO/SLI
    Our history & issues
    28
    pros cons
    &
    OKR
    (
    )
    

    View Slide

29. Our history & issues
    29
    

    View Slide

30. Our history & issues
    30
    (OKR)
    

    View Slide

31. Our history & issues
    31
    Donald T. Campbell
    

    View Slide

32. Our history & issues
    32
    どのような定量的な社会指標も、
    社会的意思決定に用いられると、
    その分だけ劣化圧力を受けやすくなり、
    追跡対象としていた社会的プロセスがゆがめられ
    劣化する傾向が強まる
    Donald T. Campbell
    

    View Slide

33. Our history & issues
    33
    QA
    

    View Slide

34. Current solution
    

    View Slide

35. Current solution
    35
    ( )
    01
    =
    02
    ⾒
    03
    04
    

    View Slide

36. Current solution
    36
    

    View Slide

37. Current solution
    37
    MTG
    

    View Slide

38. Current solution
    38
    MTG
    ⾒
    

    View Slide

39. https://queue.acm.org/detail.cfm?id=3454124
    SPACE
    Current solution
    39
    Copilot
    SRE
    Github Copilot Report 2022.09
    

    View Slide

40. SPACE
    Current solution
    40
    1
    5
    Satisfaction
    and well being
    Performance Activity
    Communication
    and collaboration
    Efficiency
    and flow
    

    View Slide

41. SPACE
    Current solution
    41
    (Well-being
    (FourKeys, Github, etc..
    

    View Slide

42. SPACE
    Current solution
    42
    

    View Slide

43. Communication and collaboration
    Efficiency and flow
    SPACE -
    Current solution
    43
    SPACE
    /
    3
    ⾒
    

    View Slide

44. SPACE - Satisfaction and well being
    Current solution
    44
    Satisfaction
    and well being
    Satisfaction
    How fulfilled developers feel with their work, team, tools, or
    culture
    Well-being
    How healthy and happy they are, and how their work impacts it
    e.g.)
    e.g.) CI/CD pipeline
    

    View Slide

45. SPACE - Performance
    Current solution
    45
    Performance
    Performance
    the outcome of a system or process
    

    View Slide

46. Activity
    a count of actions or outputs completed in the course of
    performing work
    SPACE - Activity
    Current solution
    46
    Activity
    PR
    FourKeys
    (FourKeys
    

    View Slide

47. Communication and collaboration
    how people and teams communicate and work together
    SPACE - Communication and collaboration
    Current solution
    47
    Communication
    and collaboration
    

    View Slide

48. Efficiency and flow
    capture the ability to complete work or make progress on it with
    minimal interruptions or delays, whether individually or
    through a system
    SPACE - Efficiency and flow
    Current solution
    48
    Efficiency and
    flow
    e.g.)
    MTG
    MTG
    Velocity
    CI/CD
    

    View Slide

49. SPACE
    Current solution
    49
    

    View Slide

50. Satisfaction and well being
    SPACE - -
    Current solution
    50
    Communication and collaboration
    Activity
    FourKeys/SLO PR
    ⾒
    

    View Slide

51. SPACE - Satisfaction and well being
    Current solution
    51
    !! !!
    

    View Slide

52. SPACE - Satisfaction and well being
    Current solution
    52
    /
    Developer Survey
    SRE
    

    View Slide

53. SPACE - Communication & Collaboration
    Current solution
    53
    Slack
    

    View Slide

54. SPACE - Activity
    Current solution
    54
    !! !!
    FourKeys
    FourKeys & Github
    Github
    PR Issue
    

    View Slide

55. Current solution
    55
    FourKeys
    1on1
    etc
    

    View Slide

56. for the next
    

    View Slide

57. for the next
    57
    Review to Merge Time (RTMT)
    PR PR
    01
    Time before delivery
    production
    02
    Time in progress
    open release ⾒
    03
    Time in phase
    QA
    04
    Flow control
    05
    

    View Slide

58. for the next
    58
    https://scrumorg-website-prod.s3.amazonaws.com/drupal/2021-02/2020-
    EBM-Guide-Japanese.pdf
    Scrum.org
    (KVA)
    (FourKeys)
    

    View Slide

59. for the next
    59
    https://scrumorg-website-prod.s3.amazonaws.com/drupal/2021-02/2020-
    EBM-Guide-Japanese.pdf
    (KVM)
    KVM
    =
    頻
    ⾒
    

    View Slide

60. for the next
    60
    01
    Well-being
    02
    SPACE
    03
    

    View Slide

61. ( SaaS) +
    

    View Slide

62. 2023 1 26
    β
    URL : http://bit.ly/3XgKBg7
    

    View Slide

63. View Slide

64. Offers MGR
    CTO
    

    View Slide

65. 65
    105-0001 1-1-21 5F
    web: https://overflow.co.jp/
    pr@overflow.co.jp
    

    View Slide