A Cook’s Tour of Open Data from a User’s Perspective (Queen's Printers)

Presentation to 
The Queen’s Printers Association of Canada
 at its annual conference in Charlottetown, Prince Edward Island, on June 22, 2015, looking at open data not from a policy or regulatory perspective, but through the eyes of someone who has been consuming open data, and pointing to general principles that have been learned along the way.

Transcript

1. A Cook’s Tour of Open Data
   from a User’s Perspective
   Presentation to 

   The Queen’s Printers Association of Canada

   Peter Rukavina, Hacker in Residence, Robertson Library, University of PEI
   June 22, 2015
   

   View Slide

2. View Slide

3. View Slide

4. View Slide

5. 64th Conference of the
   Queen’s Printer Association of Canada
   Charlottetown, Prince Edward Island
   2015 Conference Agenda - Draft
   Open Government - Open Information
   Sunday, June 21
   7 p.m. Welcome reception at The Great George Hotel
   Monday, June 22
   8 a.m. – 8:30 a.m. Continental breakfast
   8:30 a.m. – 9 a.m. Opening of conference with Word of Welcome
   from Krista Grant, Assistant Deputy Minister,
   Communications PEI
   9 a.m. – 10 a.m. A Cook’s Tour of Open Data from a User’s Perspective
   Peter Rukavina, Visiting Scholar, Hacker in Residence,
   University of Prince Edward Island
   11 a.m. – 12 noon Federal/Provincial/Territorial presentations
   12 noon Lunch
   1:30 p.m. – 4 p.m. Federal/Provincial/Territorial presentations
   6 p.m. Lobster Dinner ~ Claddagh Oyster House
   Tuesday, June 23
   8 a.m. – 9 a.m. Continental breakfast
   9 a.m. – 10:30 a.m. Federal/Provincial/Territorial presentations
   10:30 a.m. – 11:30 noon Copyright Board of Canada Decision
   Ivan MacArthur, Senior Policy Analyst, Communications PEI
   12 noon Lunch
   1:30 p.m. – 2:30 p.m. Tour of the University of Prince Edward Island
   Robertson Library Digitization Lab
   3 p.m. – 5 p.m. Federal/Provincial/Territorial presentations
   6 p.m. Official photograph of the Queen’s Printers
   6:30 p.m. Official Dinner ~ Sims Corner Steakhouse & Oyster Bar
   Wednesday, June 24
   8:30 a.m. – 9:30 a.m. Breakfast buffet
   9:30 a.m. – 11 a.m. QPAC Annual General Meeting
   11 a.m. – 11:15 a.m. QPAC 2016 presentation
   11:15 a.m. – 12 noon Roundtable discussion, unfinished business
   

   View Slide

6. View Slide

7. View Slide

8. BEGIN:VEVENT
   CREATED:20150621T132252Z
   UID:63FFC87E-61CD-4BA2-A4FB-87C30272A480
   DTEND;TZID=America/Halifax:20150621T210000
   TRANSP:OPAQUE
   SUMMARY:Welcome Reception
   DTSTART;TZID=America/Halifax:20150621T190000
   DTSTAMP:20150621T132252Z
   LOCATION:The Great George\n58 Great George St\nCharlottetown PE C1A 4K3
   X-APPLE-STRUCTURED-LOCATION;VALUE=URI;X-ADDRESS=58 Great George St\\n

   Charlottetown PE C1A 4K3;X-APPLE-RADIUS=49.91305570459815;X-TITLE=

   The GreatGeorge:geo:46.234112,-63.124349
   SEQUENCE:0
   END:VEVENT
   

   View Slide

9. View Slide

10. View Slide

11. Open Data Principles
    

    View Slide

12. Windmill by Stephen Downes is licensed under CC BY-NC 2.0
    

    View Slide

13. Photo of Richard Brown from Liberal Party of Prince Edward Island
    

    View Slide

14. Photo of Ron Estabrooks taken at the open house to officially launch the Hermanville/Clearspring wind development from www.gov.pe.ca.
    

    View Slide

15. View Slide

16. View Slide

17. Clip of audio from CBC Spark interview with Peter Rukavina by Nora Young, recorded June 19, 2011.
    

    View Slide

18. View Slide

19. [
    {
    "data1": 210.15,
    "data2": 139.22,
    "data3": 7.98,
    "data4": 82.02,
    "data5": 57.2,
    "updateDate": 1424875441,
    "error": 0
    }
    ]
    

    View Slide

20. {
    "on-island-load": 210.15,
    "on-island-wind": 139.22,
    "on-island-fossil": 7.98,
    "wind-local": 82.02,
    "wind-export": 57.2,
    "percentage-wind": "66.25"
    }
    

    View Slide

21. View Slide

22. View Slide

23. View Slide

24. View Slide

25. http://innovis.cpsc.ucalgary.ca/
    

    View Slide

26. “I have become slightly obsessed by
    your energy graph and am very
    grateful that you have found a way to
    record the load and wind power
    generated in PEI. Do you by any
    chance have a spread sheet of these
    values? I am looking at using storage to
    balance wind fluctuations and was
    hoping to try and using the real load
    and wind data to accomplish that.”
    

    View Slide

27. Open Data Principle № 1
    You have no idea (at all)
    what open data might be
    used for.
    

    View Slide

28. View Slide

29. Town of Stratford Building Permit Summary 7/1/2013 to 7/31/2013
    Applicant Estimated Development
    Date PermitID Applicant Name Phone # PID Lot# Address Permit Type Project Value Permit Fee
    JUL-15-2013 DP078-13 Robert Gaudet 902-367-6129 932111 171 6 Carrington Road Accessory Building - New $1,200.00 $30.00
    JUL-25-2013 DP056-13 Stratford Quickstop 1044494 1 Jubilee Drive Accessory Building - New $11,000.00 $100.00
    Sub Totals: $12,200.00 $130.00
    JUL-05-2013 DP072-13 Rosemary Scott 902-569-3021 728188 135 33 Celtic Lane Accessory Structure (Pool, Deck, etc) - $800.00 $30.00
    Addition
    JUL-16-2013 DP077-13 Kent Building Supply - 329375 154 Spinnaker Drive Accessory Structure (Pool, Deck, etc) - $5,000.00 $30.00
    Andrew Sanderson Addition
    Sub Totals: $5,800.00 $60.00
    JUL-26-2013 DP085-13 Richard E. Woodfield 902-367-3637 1010693 7 Picton Beete Cr Accessory Structure (Pool, Deck, etc) - $3,000.00 $30.00
    New
    JUL-12-2013 DP076-13 Jamie Doiron 902-629-0224 486118 14 Towerwood Drive Accessory Structure (Pool, Deck, etc) - $3,000.00 $30.00
    New
    JUL-03-2013 DP039-13 Chris and Jennifer 902-569-2114 471508 10 Aintree Drive Accessory Structure (Pool, Deck, etc) - $6,000.00 $30.00
    Whitlock New
    JUL-30-2013 DP016-13 Craig and Jennifer 902-566-1801 1014638 93 Bonavista Avenue Accessory Structure (Pool, Deck, etc) - $25,000.00 $30.00
    Lawlor New
    JUL-15-2013 DP062-13 Drew and Karen 902-894-3959 1029180 22 Saints Crescent Accessory Structure (Pool, Deck, etc) - $50,000.00 $30.00
    MacIntyre New
    Sub Totals: $87,000.00 $150.00
    JUL-31-2013 DP059-13 Craftsman 940650 11 Galway Court Single Family Dwelling - Addition $18,000.00 $56.80
    Construction
    JUL-05-2013 DP071-13 Roger Johnson 902-569-4882 709154 73 Rankin Drive Single Family Dwelling - Addition $40,000.00 $114.40
    JUL-10-2013 DP070-13 Greenleaf Construction 902-566-3358 603613 1 2 Battery Point Drive Single Family Dwelling - Addition $150,000.00 $43.68
    Sub Totals: $208,000.00 $214.88
    JUL-25-2013 DP081-13 D.C. McCardle 902-367-9200 398586 70 77 Southampton Drive Single Family Dwelling - New $180,000.00 $458.20
    JUL-18-2013 DP079-13 D.C. McCardle Ltd 902-367-9200 398586 72 85 Southampton Dr Single Family Dwelling - New $200,000.00 $469.40
    JUL-30-2013 DP084-13 Barry MacDonald 1045749 13 11 Donegal Lane Single Family Dwelling - New $300,000.00 $1,187.60
    Thursday, August 01, 2013 Town of Stratford Building Permit Summary 7/1/2013 to 7/31/2013 Page 1 of 2
    

    View Slide

30. View Slide

31. View Slide

32. pdftotext -raw

    Weekly_approvals_webpage_21_Oct_2011.pdf \
    Weekly_approvals_webpage_21_Oct_2011.txt
    

    View Slide

33. 10-533 335067 402-bld-10 20-Oct-10 3-Oct-11 18-22 Water Street...
    10-569 363556 439-BLD-10 17-Nov-10 3-Oct-11 20 Lapthorne Avenue...
    11-002 1018274 001-bld-11 4-Jan-11 6-Oct-11 375 Mount Edward Road...
    11-136 342436 326-bld-11 26-Aug-11 3-Oct-11 134 Kent Street...
    

    View Slide

34. -63.12688,46.23066,22 WATER ST,"10-533 335067 402-bld-10…
    -63.12606,46.24454,20 LAPTHORN AV,"10-569 363556 439-BLD-10..
    -63.14558,46.27834,375 MOUNT EDWARD RD,"11-002 1018274 001-bod-11…
    -63.12808,46.23572,134 KENT ST,"11-136 342436 326-bld-11…
    

    View Slide

35. View Slide

36. View Slide

37. View Slide

38. Open Data Principle № 2
    PDFs are where 

    data goes to die.
    

    View Slide

39. I walked thru some testing with the
    admin assistant in planning.
    She had some concerns with data
    entry -- she found it cumbersome and
    also identified a couple of scenarios
    that were not possible to enter
    properly, or were not represented
    clearly in the result.
    

    View Slide

40. Open Data Principle № 2B
    Bureaucrats really like
    File > Save as PDF…
    

    View Slide

41. View Slide

42. scale drawings drawn to Parking Design Standards and certified
    (stamped) by a qualified engineer, architect, or public land surveyor Shall
    be submitted where there are ten (10) or more Parking Spaces or for less
    than ten (10) spaces as required by the Development Officer with the
    application for the Building permit showing entrances and exits to such
    Parking facilities, all proposed and Existing Parking Spaces, aisles,
    lighting, and drainage of the Lot;
    

    View Slide

43. scale drawings drawn to Parking Design Standards and certified
    (stamped) by a qualified engineer, architect, or public land surveyor Shall
    be submitted where there are ten (10) or more Parking Spaces or for less
    than ten (10) spaces as required by the Development Officer with the
    application for the Building permit showing entrances and exits to such
    Parking facilities, all proposed and Existing Parking Spaces, aisles,
    lighting, and drainage of the Lot;
    scale drawings drawn to Parking Design Standards and certified
    (stamped) by a qualified engineer, architect, or public land surveyor Shall
    be submitted where there are ten (10) or more Parking Spaces or for less
    than ten (10) spaces as required by the Development Officer with the
    application for the Building permit showing entrances and exits to such
    Parking facilities, all proposed and Existing Parking Spaces, aisles,
    lighting, and drainage of the Lot;
    

    View Slide

44. GENERAL PROVISIONS FOR BUILDINGS AND STRUCTURES ................................................ 26
    4.1 ACCESSORY BUILDINGS
    4.2 BUILDING HEIGHT
    4.3 DECKS, AND OTHER PROJECTIONS INTO YARDS
    4.4 EXISTING BUILDINGS OR STRUCTURES
    4.5 FENCES
    4.6 GROUPED DWELLINGS
    4.7 ONE MAIN BUILDING ON A LOT
    4.8 RESTORATION TO A SAFE CONDITION
    4.9 SATELLITE DISHES AND COMMUNICATION TOWERS
    4.10 WINDMILL TOWERS
    4.11 SUBDIVIDING OF ATTACHED DWELLINGS
    4.12 SWIMMING POOLS
    4.13 VEHICLE BODIES
    

    View Slide

45. GENERAL PROVISIONS FOR BUILDINGS AND STRUCTURES ................................................ 26
    4.1 ACCESSORY BUILDINGS
    4.2 BUILDING HEIGHT
    4.3 DECKS, AND OTHER PROJECTIONS INTO YARDS
    4.4 EXISTING BUILDINGS OR STRUCTURES
    4.5 FENCES
    4.6 GROUPED DWELLINGS
    4.7 ONE MAIN BUILDING ON A LOT
    4.8 RESTORATION TO A SAFE CONDITION
    4.9 SATELLITE DISHES AND COMMUNICATION TOWERS
    4.10 WINDMILL TOWERS
    4.11 SUBDIVIDING OF ATTACHED DWELLINGS
    4.12 SWIMMING POOLS
    4.13 VEHICLE BODIES
    General Provision for Buildings and Structures ................................................................................. 26
    4.1 Accessory Buildings
    4.2 Building Height
    4.3 Decks, and Other Projections into Yards
    4.4 Existing Buildings or Structures
    4.5 Fences
    4.6 Groups Dwellings
    4.7 One Main Building on a Lot
    4.8 Restoration to a Safe Condition
    4.9 Satellite Dishes and Communication Towers
    4.10 Windmill Towers
    4.11 Subdividing of Attached Dwellings
    4.12 Swimming Pools
    4.13 Vehicle Bodies
    

    View Slide

46. View Slide

47. Open Data Principle № 3
    Sometimes “open” can simply
    mean following 

    basic rules of design.
    

    View Slide

48. View Slide

49. View Slide

50. View Slide

51. View Slide

52. Metadata Issues
    • Lot 50 was mislabelled as Lot 66.
    • Lot 66 was unlabelled.
    • Georgetown Royalty was mislabelled as Lot 73
    • Princetown Royalty was missing.
    

    View Slide

53. View Slide

54. View Slide

55. View Slide

56. View Slide

57. View Slide

58. View Slide

59. View Slide

60. The Confederation Trail passes 

    through 47 lots and 2 royalties.
    

    View Slide

61. Open Data Principle № 4
    Open data is a
    conversation.
    

    View Slide

62. View Slide

63. View Slide

64. View Slide

65. View Slide

66. (902) 367-3694
    

    View Slide

67. View Slide

68. Open Data Principle № 5
    Sometimes your users will
    create open data for you. 

    Follow their lead.
    

    View Slide

69. View Slide

70. Please note that with respect to some cases, only
    the name of the case and a short headnote is
    available. These are: (1) cases in which as
    publication ban has been imposed under the
    Criminal Code or other legislation; (2) cases
    involving actions, applications or petitions under
    the Family and Child Services Act, The Family
    Law Act and The Divorce Act.
    

    View Slide

71. Open Data Principle № 6
    “Opening” changes 

    the audience.
    

    View Slide

72. View Slide

73. View Slide

74. View Slide

75. View Slide

76. View Slide

77. Open Data Principle № 7
    “Opening” allows for 

    new connections.
    

    View Slide

78. Open Data Principles
    1. You have no idea (at all) what open data might be used for.
    2. PDFs are where data goes to die.
    3. Sometimes “open” can simply mean following rules of design.
    4. Open data is a conversation.
    5. Sometimes your users will create open data for you.
    6. “Opening” changes the audience.
    7. “Opening” allows for new connections.
    

    View Slide

79. Open Data Principles
    1. You have no idea (at all) what open data might be used for.
    2. PDFs are where data goes to die.
    3. Sometimes “open” can simply mean following rules of design.
    4. Open data is a conversation.
    5. Sometimes your users will create open data for you.
    6. “Opening” changes the audience.
    7. “Opening” allows for new connections.
    Don’t try to anticipate this: be as open as possible.
    Use PDF as a format-of-last-resort.
    Design continues to be important.
    Participate in it.
    Watch for it. Use it as a guide.
    Be mindful of the changed audience.
    Think about the new connections: threats and opportunities.
    

    View Slide

80. Colophon
    • Headline text is Futura Demibold.
    • Body text is Futura Medium.
    • Presentation created with Apple Keynote v6.5.3.
    • It took me about 7 hours to assemble the slides.
    • I was fuelled by coffee from Receiver Coffee.
    • I had a smoked salmon bagel for lunch.
    

    View Slide

81. Slides are online at
    http://l.ruk.ca/queensprinter
    These slides are released under a Creative Commons license.
    You are encouraged to distribute them as far and as 

    wide as possible under the terms of the license.
    

    View Slide