Slide 1

Slide 1 text

© Microsoft Corporation Ramp-up Journey of New Hires: Tug of War of Aids and Impediments Ayushi Rastogi, Suresh Thummalapenta, Thomas Zimmermann, Nachiappan Nagappan, Jacek Czerwonka

Slide 2

Slide 2 text

© Microsoft Corporation Hiring Top Talent

Slide 3

Slide 3 text

© Microsoft Corporation New Hires often spend weeks or months before • Making major contribution • Reaching the productivity level of existing employees

Slide 4

Slide 4 text

© Microsoft Corporation Percentage of New Hires 14-49% of all software developers in Microsoft product teams are New Hires

Slide 5

Slide 5 text

© Microsoft Corporation Goal of this Study 1. Identify factors that influence the ramp-up journey of new hires. 2. Measure the amount of time it takes for new hires to become productive.

Slide 6

Slide 6 text

© Microsoft Corporation Application of the Results Industry – Reduce bottlenecks in existing processes – Spread best practices Academia – Understand skills needed in industry and challenges that new hires face

Slide 7

Slide 7 text

© Microsoft Corporation Mixed Methods Approach MINING INTERVIEWS SURVEY

Slide 8

Slide 8 text

© Microsoft Corporation New Hires • University recruit or first company • Joined as an intern or vendor and converted to a full time position • Left the company and joined again after at least a year • Worked for other companies in the past

Slide 9

Slide 9 text

© Microsoft Corporation Data Analysis • CodeMine • Data from Version Control System • Data from HR database

Slide 10

Slide 10 text

© Microsoft Corporation Time to First Check-In First check-in that makes the release branch Intuition: • Basic understanding of the engineering system • Basic knowledge of the project

Slide 11

Slide 11 text

© Microsoft Corporation Time to Ramp-up Employee reaches the productivity level of existing employees Three flavors of ramp-up • Familiarity… frequency of Check-ins • Effort… lines changed • Knowledge… files changed

Slide 12

Slide 12 text

© Microsoft Corporation Interviews • 30 minutes interviews with 4 developers – What factors supported or undermined attempts to early first check-in and the time to ramp-up? – What could have been done to reduce it?

Slide 13

Slide 13 text

© Microsoft Corporation Survey Questions • Influence of factors on time to first check-in and time to ramp-up • Other activities that take time • Suggestions for improvement of the ramp up process

Slide 14

Slide 14 text

© Microsoft Corporation Survey Participants • Selection of population – Have started recently (fresh memory) and spent a minimum time at Microsoft – Anticipated response rate ~ 20% • Randomly selected 1189 developers with 6-13 months experience at Microsoft • 411 complete response (34.57%)

Slide 15

Slide 15 text

© Microsoft Corporation RESULTS

Slide 16

Slide 16 text

© Microsoft Corporation Time to first check-in

Slide 17

Slide 17 text

© Microsoft Corporation Does the product group of new hires influence the time to first check-in? Median population of new hires across all product divisions take 4-10% of the maximum time to first check-in. Working with some specific product group has no significant impact on the time to check-in.

Slide 18

Slide 18 text

© Microsoft Corporation Does prior job experience influence the time to first check-in? Inexperienced new hires make early first check- ins (~20%) compared to experienced new hires. Senior developers perform consistently and make early first check- ins compared to middle level SDE.

Slide 19

Slide 19 text

© Microsoft Corporation Influence of factors

Slide 20

Slide 20 text

© Microsoft Corporation SI: Strong Increase; MI: Moderate Increase; NE: No Effect; MD: Moderate Decrease; SD: Strong Decrease; DK: Don’t Know

Slide 21

Slide 21 text

© Microsoft Corporation Other factors • Mentorship • Documentation – Product and Process – Different Formats • Standardize Process • Access and Permissions with team • System set-up

Slide 22

Slide 22 text

© Microsoft Corporation Time to ramp-up

Slide 23

Slide 23 text

© Microsoft Corporation Does early check-in correlated with early ramp-up? Early ramp-up not related to early first check-in

Slide 24

Slide 24 text

© Microsoft Corporation Is ramp-up journey a function of product? New hires ramp-up step-wise Ramp-up journey similar on check-in counts (~32-45%); different on lines changed (~45-81%) and files changed (~68-100%).

Slide 25

Slide 25 text

© Microsoft Corporation Is ramp-up journey a function of experience? Experience has no impact on ramp-up time on check-in counts Middle and senior developers take longer (~13% and 6%) to ramp-up on lines changed and files changed (~22%).

Slide 26

Slide 26 text

© Microsoft Corporation Influence of factors

Slide 27

Slide 27 text

© Microsoft Corporation SI: Strong Increase; MI: Moderate Increase; NE: No Effect; MD: Moderate Decrease; SD: Strong Decrease; DK: Don’t Know

Slide 28

Slide 28 text

© Microsoft Corporation Other factors • Team Interaction – Verbal communication/Pair programming – Recently ramped-up mentors • Training programs • Overview of the system – Well chosen starting tasks • Proximity to release

Slide 29

Slide 29 text

© Microsoft Corporation Other New Hire Activities • Time to relocate • Set-up the system • Understand the existing system and their role • Acquire technical and functional knowledge • Miscellaneous: writing proposals, participate in events like Hackathons, etc.

Slide 30

Slide 30 text

© Microsoft Corporation Suggestions • Apply companywide coding standards • Improved code base and documentation • Easy tools One Engineering System Initiative • Training tools • Guided work • Centralized information • Clearly communicated expectation

Slide 31

Slide 31 text

© Microsoft Corporation Threats to Validity • Internal Validity – Data Accuracy • Construct Validity – Activities in other product groups – Activities other than code check-in • External Validity – Generalizability – Geographic differences

Slide 32

Slide 32 text

© Microsoft Corporation Summary • Factors that influence the ramp-up journey of new hires. • Amount of time it takes for new hires to become productive.

Slide 33

Slide 33 text

© Microsoft Corporation Thank you!