Open Data & Application Development INSIDE Government

Data is Food Supply to Smart Cities. Open Data matters even when government is required by law to create the application. As Chief Data Officer at the U.S. FCC, we used Open Data Principles to developer higher quality, less-costly Application Development by government in support of Public Administration.

Transcript

1. 2006 - Created Sunlight Labs at Sunlight Foundation 2010 - Chief Data Officer, US Federal Communications Commission 2013 - Knight Foundation News Challenge Winner - GovReady.org ! 1st Open Government Forum, Emirates Identity Authority & UNDESA April 28, 29, 2014 Greg Elin @GregElin gregelin@gitmachines.com Open Data & Application Development
2. How relevant is Open Data when law requires government to develop software?
4. D A T A https://www.flickr.com/photos/brainware3000/14625517/
5. We are what we eat. https://www.flickr.com/photos/koadla/5768446499
6. Sharing is community.
7. Guests eat what we eat. https://www.flickr.com/photos/basykes/23701665
8. Sharing is reciprocated. https://www.flickr.com/photos/kevinkrejci/3899031368
9. D A T A https://www.flickr.com/photos/forever5yearsold/2808759067
10. D A T A https://www.flickr.com/photos/koadla/5768446499
11. D A T A https://www.flickr.com/photos/travelourplanet/7997446704
12. D A T A https://www.flickr.com/photos/andrewmalone/3146866639
13. D A T A https://www.flickr.com/photos/nsalt/3276560707 Food supply for smart cities.
14. D A T A
15. slide credit: Ben Balter, GitHub
16. (2007)
17. 1 2 3
18. Na#onal'Broadband'Map' •  The'Na#onal'Broadband'Map'is'the'statutory' responsibility'of'the'' – Na#onal'Telecommunica#ons'Informa#on' Administra#on'(NTIA)' – Under'the'Broadband'Data'Improvement'Act,' congress'directed'NTIA'to'build'and'maintain'a' database'of'broadband'availability'that'is' ‘searchable'and'interac#ve’' – NBM'was'funded'under'ARRA' slide credit: Mike Byrne, FCC
19. Project(Focus(–(Collabora1on( •  Federal(to(Federal;(Federal(to(State;(State(to( private(sector;(Private(sector(to(Federal( •  See(h:p://www.fgdc.gov/library/whitepapersBreports/annual%20reports/2011( •  NTIA(–(FCC( – NTIA(distribu1ng(ARRA(funds(for(broadband( infrastructure(investment( – FCC(making(regulatory(decisions(on(the( distribu1on(of(Universal(Service(money( slide credit: Mike Byrne, FCC
20. Multi-million dollar budget ! 6 week prototype to define requirements ! Prototype highest risks! ! - What did "map" really mean? ! - Can we build on open APIs?
21. http://www.broadbandmap.gov/ internet-service-providers/south- bend,-in/lat=41.6763545/ long=-86.25198979999999/
22. http://www.broadbandmap.gov/about- provider/bright-house-networks-llc/ nationwide Answer a question with a URL!
25. http://www.broadbandmap.gov/ broadbandmap/analyze/jun2011/summary/ population/county/ids/06041?format=xml slide credit: Mike Byrne, FCC
26. Guests eat what we eat.
27. Agile&–&start&small,&success,&repeat& •  The&site&www.broadbandmap.gov&consumes& 100%&of&our&data&via&APIs&we&also&publish&for& public&availability&(dogfooding)& •  Value& – We&demonstrate&how&sure&we&are&in&our&process& for&developers& – It’s&the&definiGon&of&transparency& – Small&digesGble&bites&are&more&robust& – Get&more&people&to&our&data& slide credit: Mike Byrne, FCC
28. Sharing is reciprocated.
29. JSON data output of an API
30. Low$barrier$to$consume$ •  API$and$Map$services$present$a$low$barrier$for$ others$to$consume$ •  Department$of$Educa<on$Example$ Guests eat what we eat. slide credit: Mike Byrne, FCC
31. Accessibility  Clearinghouse -­‐ Mandated  by  statute  in  21st  Century   Communica9ons  and  Video  Accessibility  Act   -­‐ Requires  FCC  to  track  and  display  on  web   site  clearinghouse  of  accessible   communica9on  devices   -­‐ Statute  discourages  new  burdens  on   industry   !
32. Very little budget ! 10 day prototype to define requirements ! Prototype highest risks! ! - How to organize site and navigation? ! - How will we update data?
34. Guests eat what we eat.
36. Online  Database  of  TV  Sta9on     Public  File  Documents -­‐ Voted  rule  by  Commission.   -­‐ Poli9cally  charged.  Public  advocates  wanted,   Broadcasters  did  not.   -­‐ First  ever  filings  required  on  a  real-­‐9me   (daily)  basis.   -­‐ Some  documents  already  filed  with  FCC,   some  only  at  sta9ons  and  must  be  uploaded.  
37. Budget sensitivity ($650K) ! 4 week prototype to define requirements ! Prototype highest risks! ! - How to make filing easy for stations? ! - How to organize data without requiring a form? ! - How to present information usefully? ! - 20 categories of content with dozens of docs each
38. Essen9al,  BeOer,  Best Essen%al  -­‐  absolute  must  haves  to  avoid  failure   Be)er  -­‐  improvements,  "it  would  be  good  if..."   Best  -­‐  oh  wow,  that's  amazing!   Answer a question with a URL! APIs - Guests eat what we eat.
41. Bureau API freebase (public) Bureau database #1 Bureau database #2 Recent uploads uploaded by stations OpenStreetMap
42. Guests eat what we eat.
43. (via  API) Guests eat what we eat.
44. A  Few  Last  Tips
46. Sharing is reciprocated.
47. ! 24 hours to create something ! Government staff and contractors ! Discovery & Community - cooking together "FedEx Days" internal hackathons
48. Roadmap  to  Data  Dining 1.  Show  examples  you  like  and  discuss   2.  Iden9fy  just  6  to  12  ques9ons  to  start   3.  Gather  the  SQL  statements  into  a  doc   4.  Pick  friendly  URL  to  display  answers   5.  Generate  JSON  and  XML  output  from  SQL   6.  Create  presenta9on  on  top  of  API   7.  Repeat  and  improve
49. Data Supply Demand / Use Open Data Impact Value Measure Kansas Business App Future: design apps to measure demand Startup sensors Thank you.