Elastic{ON} 2018 - Lessons Learned from Workday's Search Application Journey from POC to Production

Dd9d954997353b37b4c2684f478192d3?s=47 Elastic Co
March 01, 2018

Elastic{ON} 2018 - Lessons Learned from Workday's Search Application Journey from POC to Production

Dd9d954997353b37b4c2684f478192d3?s=128

Elastic Co

March 01, 2018
Tweet

Transcript

  1. Workday February 28, 2018 https://github.com/Workday Lessons Learned from A Search

    Application POC to Production Journey Angela Juang, Tech Lead Search Madhura Dudhgaonkar, Head of Search/ML
  2. This presentation may contain forward-looking statements for which there are

    risks, uncertainties, and assumptions. If the risks materialize or assumptions prove incorrect, Workday’s business results and directions could differ materially from results implied by the forward-looking statements. Forward-looking statements include any statements regarding strategies or plans for future operations; any statements concerning new features, enhancements or upgrades to our existing applications or plans for future applications; and any statements of belief. Further information on risks that could affect Workday’s results is included in our filings with the Securities and Exchange Commission which are available on the Workday investor relations webpage: www.workday.com/company/investor_relations.php Workday assumes no obligation for and does not intend to update any forward-looking statements. Any unreleased services, features, functionality or enhancements referenced in any Workday document, roadmap, blog, our website, press release or public statement that are not currently available are subject to change at Workday’s discretion and may not be delivered as planned or at all. Customers who purchase Workday, Inc. services should make their purchase decisions upon services, features, and functions that are currently available. Safe Harbor Statement
  3. Introductions Workday Confidential Angela Juang Tech Lead Search, Workday

  4. Workday Confidential Elasticon 2017!

  5. Creating things that delight people Workday Confidential

  6. Creating things that delight people Workday Confidential

  7. Creating things that delight people Workday Confidential

  8. Workday Search Creating things that delight people Workday Confidential

  9. Introductions Workday Confidential Madhura Dudhgaonkar Head of Search/ML, Workday

  10. Mar 2009 - March 2006

  11. Mar 2009 - March 2009 Mt. Denali | 20,320 ft

    | 6,194 m
  12. Mar 2009 - March 2009 The Crazy Ones!

  13. March 2009 - June 2010

  14. July 2010

  15. Mar 2009 - Audacious Goals Accelerated Learning and Mastery!

  16. Workday Confidential Happy Madhura!

  17. The Enterprise Cloud for Finance and HR Workday Confidential

  18. Search and Machine Learning Teams San Francisco Dublin, Ireland Pleasanton

    Workday Confidential
  19. Search @ Workday Recruiting Recruiting Search Relevance Workday Confidential 2007-2011

    2012-2014 2015-2018
  20. Mar 2009 - 2014 - Recruiting search needs upgrade Workday

    Confidential
  21. Workday Confidential Options..Options..

  22. Choice Workday Confidential

  23. Search Relevance Search Scale

  24. Search Relevance

  25. scala & search & senior developer & (San Francisco or

    San Mateo or Dublin, Ireland) & enterprise software & file systems & distributed systems & query latency tuning Workday Confidential What Customers Told
  26. Workday Confidential User Research

  27. Angela Juang java Madhura Dudhgaonkar senior developer & scala Megan

    Gates Workday Confidential
  28. Name Job Title Skill Workday Confidential They Cared About

  29. Workday Confidential More User Research

  30. Angela Gates 10 of 10000 Angela Juang Srini Nithyanandan Angela

    Gates . . Workday Confidential
  31. Angela Gates & scala 10 of 5000 Angela Juang Jas

    Singh Angela Gates . . Workday Confidential
  32. Angela Gates & scala & senior developer 10 of 2000

    Angela Juang Jas Singh John Washington Angela Gates . Workday Confidential
  33. Workday Confidential Eureka!

  34. Workday Confidential Deep Search Find oysters (no rocks/fish) - Precision

  35. Workday Confidential Shallow Search Find a pearl oyster in top

    3-5 - Ranking
  36. Solve the Right Search Problem

  37. Workday Confidential Tune Precision and Victory

  38. Workday Confidential

  39. Angela Gates & scala & senior developer 10 of 500

    Angela Juang Jas Singh John Washington Angela Gates . Workday Confidential
  40. Workday Confidential What Is Going On?

  41. Workday Confidential Spelunking Began

  42. Job Application Form: Name * Skills Title Attachments * Workday

    Confidential
  43. Cover Letters Resumes Portfolio docs Workday Confidential Nothing in Structured

    Fields!
  44. John Washington 10 of 2000 John Singh (Ref: John Washington)

    John Washington Angela Gates (John Hopkins University) . . Workday Confidential
  45. Workday Confidential Doc Parsing to Rescue

  46. Angela Gates & scala & senior developer 10 of 20

    Angela Gates Angela Juang Jas Singh John Washington . Workday Confidential
  47. Check Data Quality Early! Garbage in, Garbage out. Workday Confidential

  48. Total Results Workday Confidential Total Results

  49. Precision @50 Workday Confidential Precision @50

  50. Ndcg for Ranking Workday Confidential Ndcg for Ranking

  51. Search Scale

  52. Tenant Index Workday Confidential

  53. Workday Confidential

  54. Workday Confidential Unmanageable Indices

  55. Workday Confidential

  56. Workday Confidential

  57. Understand your data and growth patterns! Workday Confidential

  58. Cluster State Size: Before & After Workday Confidential Cluster State

    Size: Before & After
  59. Workday Confidential Security

  60. 22 TB JVM heap <= 30GB per data node 734

    data nodes (minimum!) Workday Confidential
  61. Workday Confidential Outage Scenario

  62. Workday Confidential

  63. https://github.com/Workday/elasticrypt Workday Confidential

  64. Plan for the unknown! Workday Confidential

  65. But don’t reinvent the wheel. Workday Confidential

  66. If you do invent, share it! :) Workday Confidential

  67. Workday Confidential

  68. Workday Confidential

  69. • Solve the right search problem • Check data quality

    early • Understand the characteristics of your data and growth patterns • Plan for the unknown Workday Confidential In Summary
  70. We Are Hiring! Distributed systems engineer Elasticsearch engineer Search engineer

    Data scientist Machine Learning engineer Deep learning engineer Workday Confidential
  71. TM Thank You