A Farmers Market of Open Data

My talk on Open Data for QueensJS

Transcript

1. https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche Megan Taylor, UI Developer at Spies/Assassins, volunteer teacher at ScriptEd, news & data junkie, bibliophile, Flyers fan, scifi geek, kitteh servant • https://github.com/megantaylor/ NYCFarmersMarketLocator • http://megantaylor.github.io/ NYCFarmersMarketLocator/index.html • mtaylor@megantaylor.org • @selfmadepsyche
2. https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche A FARMERS MARKET OF OPEN DATA • What is Open Data? • Why Open Data? • What Can Open Data Do? • What’s Out There? • Farmers Market App • Open Data Challenges • Solutions?
3. https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche A FARMERS MARKET OF OPEN DATA • What is Open Data? • Why Open Data? • What Can Open Data Do? • What’s Out There? • Farmers Market App • Open Data Challenges • Solutions?
4. https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche WHAT IS OPEN DATA? According to the Open Knowledge Foundation… Open data is data that can be freely used, reused and redistributed by anyone - subject only, at most, to the requirement to attribute and share.
5. https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche WHAT IS OPEN DATA? AVAILABILITY AND ACCESS + REUSE AND REDISTRIBUTION + ! UNIVERSAL PARTICIPATION = ! INTEROPERABILITY
6. https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche A FARMERS MARKET OF OPEN DATA • What is Open Data? • Why Open Data? • What Can Open Data Do? • What’s Out There? • Farmers Market App • Open Data Challenges • Solutions?
7. https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche WHY OPEN DATA? Numerous scientists have pointed out the irony that right at the historical moment when we have the technologies to permit worldwide availability and distributed process of scientific data, broadening collaboration and accelerating the pace and depth of discovery…..we are busy locking up that data and preventing the use of correspondingly advanced technologies on knowledge. John Wilbanks, VP Science, Creative Commons
8. https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche WHY OPEN DATA? My Administration is committed to creating an unprecedented level of openness in Government. We will work together to ensure the public trust and establish a system of transparency, public participation, and collaboration. Openness will strengthen our democracy and promote efficiency and effectiveness in Government. President Obama, 2009
9. https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche WHY OPEN DATA? AVAILABILITY AND ACCESS + REUSE AND REDISTRIBUTION + ! UNIVERSAL PARTICIPATION = ! INTEROPERABILITY
10. https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche WHY OPEN DATA? This untapped potential can be unleashed if we turn public government data into open data. This will only happen, however, if it is really open, i.e. if there are no restrictions (legal, financial or technological) to its re-use by others. Every restriction will exclude people from re- using the public data, and make it harder to find valuable ways of doing that. For the potential to be realized, public data needs to be open data. http://opendatahandbook.org/en/why-open-data/index.html
11. https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche A FARMERS MARKET OF OPEN DATA • What is Open Data? • Why Open Data? • What Can Open Data Do? • What’s Out There? • Farmers Market App • Open Data Challenges • Solutions?
12. https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche WHAT CAN OPEN DATA DO? http://www.nytimes.com/2013/03/24/nyregion/mayor-bloombergs-geek- squad.html?pagewanted=all&_r=0
13. https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche WHAT CAN OPEN DATA DO? http://wheredoesmymoneygo.org
14. https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche WHAT CAN OPEN DATA DO? ! BigApps NYC isn't just a competition – it’s three months of community building. Participants have access to hundreds of data resources, mentors, and partners. The event culminates in a grand showcase in the largest-ever public demo of civic tech. http://www.nycbigapps.com
15. https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche WHAT CAN OPEN DATA DO? • GPS data alone benefits US economy to the tune of ~ $90 billion • Open weather data supports an estimated $1.5 billion in applications in the secondary insurance market – but much greater value comes from accurate weather predictions, which save the U.S. more than $30 billion annually. Sources: GPS Innovation Alliance, The Governance Lab @ NYU
16. https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche A FARMERS MARKET OF OPEN DATA • What is Open Data? • Why Open Data? • What Can Open Data Do? • What’s Out There? • Farmers Market App • Open Data Challenges • Solutions?
17. https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche WHATS OUT THERE? ! OPEN DATA AROUND THE WORLD • 260+ open data portals • 110+ open data events
18. https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche WHAT’S OUT THERE? • data.gov • Socrata • Infochimps • Google Public data explorer • W(eather)underground • The New York Times • The Guardian Data Blog
19. https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche
20. https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche A FARMERS MARKET OF OPEN DATA • What is Open Data? • Why Open Data? • What Can Open Data Do? • What’s Out There? • Farmers Market App • Open Data Challenges • Solutions?
21. https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche
22. https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche FARMERS MARKET APP
23. https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche
24. https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche FARMERS MARKET APP DATA NEEDED • location • open hours • special closed days? • special events? • products? • misc
25. https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche FARMERS MARKET APP EFF SCRAPING • Farmers Market data from the State of New York
 https://data.ny.gov/ • More Farmers Market data from the USDA
 http://search.ams.usda.gov/farmersmarkets/v1/ svcdesc.html
26. https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche
27. https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche USDA FARMERS MARKET DATA {"results"[
 {"id":"1000087","marketname":"0.2 Sunnyside Greenmarket"}, {"id":"1009304","marketname":"0.7 Orchard Farmers Market"},
 ]}
28. https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche USDA FARMERS MARKET DATA {"marketdetails":{
 "Address":"Skillman - 42 & 43 Sts, Queens, New York, 11104",
 "GoogleLink":"http:\/\/maps.google.com\/? q=40.746899%2C%20-73.921230%20(%22Sunnyside +Greenmarket%22)",
 "Products":"Baked goods; Cheese and\/or dairy products; Eggs; Fish and\/or seafood; Fresh fruit and vegetables; Honey; Canned or preserved fruits, vegetables, jams, jellies, preserves, salsas, pickles, dried fruit, etc.; Meat; Poultry; Wine, beer, hard cider",
 "Schedule":"06\/01\/2013 to 12\/21\/2013 Sat: 8:00 AM-3:00 PM;<br> <br> <br> "
 }}
29. https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche DATA.NY.GOV
30. https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche
31. https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche DATA.NY.GOV { "market_name" : "Sunnyside Greenmarket",
 "zip" : "11104",
 "phone" : "2127887476",
 "operation_hours" : "Saturday 8am-3pm",
 "location" : "Skillman Ave., btwn 42nd & 43rd Sts.",
 "location_points" : {
 "needs_recoding" : false,
 "longitude" :
 "-73.92173",
 "latitude" : "40.74699"
 },
 "state" : "NY",
 "market_link" : {
 "url" : "http:// www.grownyc.org"
 },
 "contact" : "Chelsea Whittaker",
 "city" : "Sunnyside",
 "address_line_1" : "Skillman Ave and 42nd St",
 "county" : "Queens",
 "fmnp" : "Y",
 "operation_season" : "May 10 - December 20",
 "longitude" : "-73.92173",
 "latitude" : "40.74699"
 }
32. https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche
33. https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche FARMERS MARKET APP
34. https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche FARMERS MARKET APP • Messy USDA data, how to clean it up? • Multiple data sources, how to merge?
35. https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche GROW NYC
36. https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche A FARMERS MARKET OF OPEN DATA • What is Open Data? • Why Open Data? • What Can Open Data Do? • What’s Out There? • Farmers Market App • Open Data Challenges • Solutions?
37. https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche OPEN DATA CHALLENGES For developers • Formats • Definitions • Standards • Guidelines • Quality
38. https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche OPEN DATA CHALLENGES For non-technical users • Technical • Economic • Socio-cultural For activists • Low civil engagement
39. https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche Findability precedes usability. In the alphabet and on the Web. You can’t use what you can’t find. Peter Morville, President of Semantic Studios, an information architecture and findability consulting firm OPEN DATA CHALLENGES
40. https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche OPEN DATA CHALLENGES • data.gov • Socrata • Infochimps • Google Public data explorer • W(eather)underground • The New York Times • The Guardian Data Blog
41. https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche OPEN DATA CHALLENGES For providers • Audience • Definitions • Intermediaries • Funding and sustainability • Quality
42. https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche AVAILABILITY AND ACCESS + REUSE AND REDISTRIBUTION + ! UNIVERSAL PARTICIPATION = ! INTEROPERABILITY
43. https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche A FARMERS MARKET OF OPEN DATA • What is Open Data? • Why Open Data? • What Can Open Data Do? • What’s Out There? • Farmers Market App • Open Data Challenges • Solutions?
44. https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche SOLUTIONS? 2013 OPEN DATA POLICY
 MANAGING INFORMATION AS AN ASSET The White House developed Project Open Data – this collection of code, tools, and case studies – to help agencies adopt the Open Data Policy and unlock the potential of government data. http://project-open-data.github.io/
45. https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche SOLUTIONS? • Time • Data journalism in 2006 vs today • Research • Education / Awareness • http://sunlightfoundation.com/opendataguidelines/ • http://schoolofdata.org/courses/ • What else?
46. https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche
47. https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche HALP • https://github.com/megantaylor/ NYCFarmersMarketLocator • http://megantaylor.github.io/ NYCFarmersMarketLocator/index.html • mtaylor@megantaylor.org • @selfmadepsyche