Slide 1

Slide 1 text

No content

Slide 2

Slide 2 text

Ben Sheldon Engineering Manager @bensheldon

Slide 3

Slide 3 text

We are making government work, starting with people who need it most.

Slide 4

Slide 4 text

We believe Services can be simple, accessible, and easy to use. Outcomes can be measurably better. Better can cost less. We can serve everyone with respect and dignity.

Slide 5

Slide 5 text

Principles and practices that make change real A learning community that makes change stick Show what’s possible Help others do it themselves Build a movement Government services so good they inspire change What we do and how we do it

Slide 6

Slide 6 text

$42B To have impact at scale, government programs must work better than they do today. Charitable contributions towards safety net Making government programs just 10% more effective would be bigger than all charitable spending. $470B Spent on government safety net programs

Slide 7

Slide 7 text

GetCalFresh Closing the SNAP participation gap in California

Slide 8

Slide 8 text

45-55 minutes to use $800M to build $80M/year to maintain Applying for SNAP in California

Slide 9

Slide 9 text

● 8 minutes to complete ● Works on any device, no download (50%+ of clients use mobile) ● Considerate of limited data plans ● Written in plain English & Spanish ● Live chat for questions ● Customized user flows for specific populations / exemptions Making sure applicants have what they need

Slide 10

Slide 10 text

GetCalFresh reach CA Counties 34 Applications in August 17,700 People helped in August 35,000+ ...and growing People helped all-time 400,000+

Slide 11

Slide 11 text

The past 18 months

Slide 12

Slide 12 text

The GetCalFresh Team Product Manager Program Director Program & Partnerships Research & Design Client Success Engineering

Slide 13

Slide 13 text

Version 0

Slide 14

Slide 14 text

No content

Slide 15

Slide 15 text

Version 1 → →

Slide 16

Slide 16 text

Version 1.1 → →

Slide 17

Slide 17 text

No content

Slide 18

Slide 18 text

→ → → →

Slide 19

Slide 19 text

No content

Slide 20

Slide 20 text

No content

Slide 21

Slide 21 text

No content

Slide 22

Slide 22 text

How we did it... ➔ Staging environments for every remote system ➔ Strict validations for every form input that maps to the corresponding county system inputs. ➔ Bulletproof parsers for names, addresses, etc. ➔ A comprehensive test library of every possible image, document, and file format in the world today ➔ ML-powered circuit breakers and job schedulers

Slide 23

Slide 23 text

How we did it... ➔ Staging environments for every remote system ➔ Strict validations for every form input that maps to the corresponding county system inputs. ➔ Bulletproof parsers for names, addresses, etc. ➔ A comprehensive test library of every possible image, document, and file format in the world today ➔ ML-powered circuit breakers and job schedulers ➔ Test in production ➔ Embrace manual workflows ➔ Leave automation till the end

Slide 24

Slide 24 text

“ [The] paradox of increased overall control through letting go a bit seems paradoxical only because our normal way of thinking about control is mistakenly static: it is not development or process-oriented because it leaves out the dimension of time. — Peter Elbow, Writing Without Teachers

Slide 25

Slide 25 text

Example: Document Processing ➔ Convert PNGs and JPGs to PDF ➔ Convert TIFFs to PDF ➔ Reduce large file size PDFs ➔ Convert DOCX to PDF ➔ Validate password protected PDFs ➔ Validate broken PDFs with missing EOF marker ➔ Validate massive housing documents (e.g. leases) ➔ Normalize mixed-orientation PDFs ➔ Convert interlaced PNGs to PDF ➔ Convert BMPs to PDF ➔ Convert Multipage TIFFs to PDF

Slide 26

Slide 26 text

Example: Document Processing ➔ Convert PNGs and JPGs to PDF June 6, 2016 ➔ Convert TIFFs to PDF April 19, 2017 ➔ Reduce large file size PDFs September 15, 2017 ➔ Convert DOCX to PDF September 19, 2017 ➔ Validate password protected PDFs January 18, 2018 ➔ Validate broken PDFs with missing EOF marker June 29, 2018 ➔ Validate massive housing documents (e.g. leases) July 2, 2018 ➔ Normalize mixed-orientation PDFs August 17, 2018 ➔ Convert interlaced PNGs to PDF September 24, 2018 ➔ Convert BMPs to PDF September 26, 2018 ➔ Convert Multipage TIFFs to PDF TODO

Slide 27

Slide 27 text

The past 18 months

Slide 28

Slide 28 text

XKCD at Scale

Slide 29

Slide 29 text

No content

Slide 30

Slide 30 text

No content

Slide 31

Slide 31 text

The “Wobbly Stool” model Improve client experience & outcomes Improve automation Manually submit client applications

Slide 32

Slide 32 text

How we did it... ➔ Staging environments for every remote system ➔ Strict validations for every form input that maps to the corresponding county system inputs. ➔ Bulletproof parsers for names, addresses, etc. ➔ A comprehensive test library of every possible image, document, and file format in the world today ➔ ML-powered circuit breakers and job schedulers ➔ Test in production ➔ Embrace manual workflows ➔ Leave automation till the end

Slide 33

Slide 33 text

A week in the life...

Slide 34

Slide 34 text

A week in the life... Drive Time

Slide 35

Slide 35 text

A week in the life... Drive Time

Slide 36

Slide 36 text

March 6, 2017 June 1, 2018 April 17, 2017

Slide 37

Slide 37 text

No content

Slide 38

Slide 38 text

No content

Slide 39

Slide 39 text

No content

Slide 40

Slide 40 text

Our support system ➔ Recognize that safety and reliability is human work ➔ Talk through our natural tendencies towards catastrophizing and perfectionism ➔ Maintain a dependable backlog ➔ Have a consistent prioritization process ➔ Trust (and coach) team members to balance their time ➔ Constantly reinforce why we’re building this system...

Slide 41

Slide 41 text

No content

Slide 42

Slide 42 text

We can’t make government work without YOU. (Literally.)

Slide 43

Slide 43 text

No content