$30 off During Our Annual Pro Sale. View Details »

定量評価疲弊しませんか?~Well-beingと生産性指標を組み合わせた エンジニアリングメトリクスプログラムについて~

定量評価疲弊しませんか?~Well-beingと生産性指標を組み合わせた エンジニアリングメトリクスプログラムについて~

Developers Summit 2023 登壇資料
https://event.shoeisha.jp/devsumi/20230209/session/4171/

overflowは、副業・転職サービス「Offers(オファーズ)」の開発、運用を行っています。
サービスの提供を開始してから3年。サービスの拡大に合わせ、組織も比例して成長してきました。

その中で、組織の成長に伴い、どのように生産性指標を開発に取り入れていったか。
取り入れていった結果、状態把握から逸脱し何が起きたか。そして、その後どのようにして改善していっているかご紹介します。

私達が行ってきたことを例に(反省として)、数値に踊らされずに正しく運用する方法を考えるきっかけになれば幸いです。

▼関連リンク
Offers:https://offers.jp/
Offers MGR(オファーズマネージャー):https://offers-mgr.com/lp
Offers Tech Blog: https://zenn.dev/offers
Offersデジタル人材総研:https://hr-lab.offers.jp/
Offers事例集:https://offers.jp/cases
Offersお役立ち資料:https://offers.jp/whitepaper
OffersMagazine:https://offers.jp/media
OffersJobs:https://offers.jp/jobs
Podcast:https://anchor.fm/overflowinc/

overflow ,Inc

February 09, 2023
Tweet

More Decks by overflow ,Inc

Other Decks in Technology

Transcript

  1. Well-being
    2023.2.9 Developers Summit 2023

    View Slide

  2. 2
    overflow CTO
    2010
    Ameba
    2013 A
    2015
    2017 6 CTO overflow
    Tabito Ohtani

    View Slide

  3. 3

    View Slide

  4. 4
    Introduction
    = (Developer Productivity)
    Source lines of code (SLOC)
    PR
    d/d/d (deploys/ a day / a developer)
    FourKeys

    View Slide

  5. 5
    Introduction
    02
    ( )
    03
    =
    01

    View Slide

  6. Corporate
    overflow

    View Slide

  7. Corporate
    7
    overflow
    105-0001
    1-1-21 5F
    2 880 4440
    2017 6 9
    Our vision

    View Slide

  8. Mission
    8

    View Slide

  9. overflow
    9
    IT /
    Corporate

    View Slide

  10. 10
    Corporate

    View Slide

  11. 11
    Corporate

    View Slide

  12. Development Organization

    View Slide

  13. 13
    Development Organization
    Offers toC Offers toB Offers MGR Enabling/Core Design
    PO/PdM
    Dev/Tech
    Lead
    Data Analysts
    Engineers
    Designers
    兼務 兼務
    兼務
    =Flexible
    = Full

    View Slide

  14. 14
    Development Organization
    what/why - how

    View Slide

  15. Our history & issues

    View Slide

  16. Our history & issues
    16

    View Slide

  17. PR
    PR PR
    PR
    Github Insight
    PR
    Our history & issues
    17

    View Slide

  18. PR
    Our history & issues
    18
    pros cons
    PR ,
    PR

    View Slide

  19. cons
    PR ,
    PR
    pros
    PR
    Our history & issues
    19

    View Slide

  20. d/d/d (deploys/ a day / a developer)
    Our history & issues
    20

    0.1
    (0.5 ~ 1.0 )
    =
    = or
    = 頻
    https://itrevolution.com/product/accelerate/

    View Slide

  21. d/d/d (deploys/ a day / a developer)
    Our history & issues
    21
    pros cons
    e.g. or

    View Slide

  22. d/d/d (deploys/ a day / a developer)
    Our history & issues
    22
    pros cons
    e.g. or

    View Slide

  23. DORA
    6
    https://cloud.google.com/blog/ja/products/gcp/using-the-four-keys-to-measure-
    your-devops-performance
    FourKeys
    Our history & issues
    23
    4

    View Slide

  24. FourKeys
    Our history & issues
    24
    pros cons

    Agile
    etc.. DevOps

    View Slide

  25. FourKeys
    Our history & issues
    25
    pros cons

    Agile
    etc.. DevOps
    (DevOps,
    Note
    ( )

    View Slide

  26. https://www.atlassian.com/ja/incident-management/kpis/sla-vs-slo-vs-sli
    FourKeys + SLO/SLI
    Our history & issues
    26

    API 99.95%
    90% n
    SLO
    Sprint
    FourKeys
    SLO/SLI

    View Slide

  27. FourKeys + SLO/SLI
    Our history & issues
    27
    pros cons
    &

    View Slide

  28. FourKeys + SLO/SLI
    Our history & issues
    28
    pros cons
    &
    OKR
    (
    )

    View Slide

  29. Our history & issues
    29

    View Slide

  30. Our history & issues
    30
    (OKR)

    View Slide

  31. Our history & issues
    31
    Donald T. Campbell

    View Slide

  32. Our history & issues
    32
    どのような定量的な社会指標も、
    社会的意思決定に用いられると、
    その分だけ劣化圧力を受けやすくなり、
    追跡対象としていた社会的プロセスがゆがめられ
    劣化する傾向が強まる
    Donald T. Campbell

    View Slide

  33. Our history & issues
    33
    QA

    View Slide

  34. Current solution

    View Slide

  35. Current solution
    35
    ( )
    01
    =
    02

    03
    04

    View Slide

  36. Current solution
    36

    View Slide

  37. Current solution
    37
    MTG

    View Slide

  38. Current solution
    38
    MTG

    View Slide

  39. https://queue.acm.org/detail.cfm?id=3454124
    SPACE
    Current solution
    39
    Copilot
    SRE
    Github Copilot Report 2022.09

    View Slide

  40. SPACE
    Current solution
    40
    1
    5
    Satisfaction
    and well being
    Performance Activity
    Communication
    and collaboration
    Efficiency
    and flow

    View Slide

  41. SPACE
    Current solution
    41
    (Well-being
    (FourKeys, Github, etc..

    View Slide

  42. SPACE
    Current solution
    42

    View Slide

  43. Communication and collaboration
    Efficiency and flow
    SPACE -
    Current solution
    43
    SPACE
    /
    3

    View Slide

  44. SPACE - Satisfaction and well being
    Current solution
    44
    Satisfaction
    and well being
    Satisfaction
    How fulfilled developers feel with their work, team, tools, or
    culture
    Well-being
    How healthy and happy they are, and how their work impacts it
    e.g.)
    e.g.) CI/CD pipeline

    View Slide

  45. SPACE - Performance
    Current solution
    45
    Performance
    Performance
    the outcome of a system or process

    View Slide

  46. Activity
    a count of actions or outputs completed in the course of
    performing work
    SPACE - Activity
    Current solution
    46
    Activity
    PR
    FourKeys
    (FourKeys

    View Slide

  47. Communication and collaboration
    how people and teams communicate and work together
    SPACE - Communication and collaboration
    Current solution
    47
    Communication
    and collaboration

    View Slide

  48. Efficiency and flow
    capture the ability to complete work or make progress on it with
    minimal interruptions or delays, whether individually or
    through a system
    SPACE - Efficiency and flow
    Current solution
    48
    Efficiency and
    flow
    e.g.)
    MTG
    MTG
    Velocity
    CI/CD

    View Slide

  49. SPACE
    Current solution
    49

    View Slide

  50. Satisfaction and well being
    SPACE - -
    Current solution
    50
    Communication and collaboration
    Activity
    FourKeys/SLO PR

    View Slide

  51. SPACE - Satisfaction and well being
    Current solution
    51
    !! !!

    View Slide

  52. SPACE - Satisfaction and well being
    Current solution
    52
    /
    Developer Survey
    SRE

    View Slide

  53. SPACE - Communication & Collaboration
    Current solution
    53
    Slack

    View Slide

  54. SPACE - Activity
    Current solution
    54
    !! !!
    FourKeys
    FourKeys & Github
    Github
    PR Issue

    View Slide

  55. Current solution
    55
    FourKeys
    1on1
    etc

    View Slide

  56. for the next

    View Slide

  57. for the next
    57
    Review to Merge Time (RTMT)
    PR PR
    01
    Time before delivery
    production
    02
    Time in progress
    open release ⾒
    03
    Time in phase
    QA
    04
    Flow control
    05

    View Slide

  58. for the next
    58
    https://scrumorg-website-prod.s3.amazonaws.com/drupal/2021-02/2020-
    EBM-Guide-Japanese.pdf
    Scrum.org
    (KVA)
    (FourKeys)

    View Slide

  59. for the next
    59
    https://scrumorg-website-prod.s3.amazonaws.com/drupal/2021-02/2020-
    EBM-Guide-Japanese.pdf
    (KVM)
    KVM
    =


    View Slide

  60. for the next
    60
    01
    Well-being
    02
    SPACE
    03

    View Slide

  61. ( SaaS) +

    View Slide

  62. 2023 1 26
    β
    URL : http://bit.ly/3XgKBg7

    View Slide

  63. View Slide

  64. Offers MGR
    CTO

    View Slide

  65. 65
    105-0001 1-1-21 5F
    web: https://overflow.co.jp/
    [email protected]

    View Slide