$30 off During Our Annual Pro Sale. View Details »

A Cook’s Tour of Open Data from a User’s Perspective (Queen's Printers)

A Cook’s Tour of Open Data from a User’s Perspective (Queen's Printers)

Presentation to 
The Queen’s Printers Association of Canada
 at its annual conference in Charlottetown, Prince Edward Island, on June 22, 2015, looking at open data not from a policy or regulatory perspective, but through the eyes of someone who has been consuming open data, and pointing to general principles that have been learned along the way.

Peter Rukavina

June 21, 2015
Tweet

More Decks by Peter Rukavina

Other Decks in Education

Transcript

  1. A Cook’s Tour of Open Data
    from a User’s Perspective
    Presentation to 

    The Queen’s Printers Association of Canada

    Peter Rukavina, Hacker in Residence, Robertson Library, University of PEI
    June 22, 2015

    View Slide

  2. View Slide

  3. View Slide

  4. View Slide

  5. 64th Conference of the
    Queen’s Printer Association of Canada
    Charlottetown, Prince Edward Island
    2015 Conference Agenda - Draft
    Open Government - Open Information
    Sunday, June 21
    7 p.m. Welcome reception at The Great George Hotel
    Monday, June 22
    8 a.m. – 8:30 a.m. Continental breakfast
    8:30 a.m. – 9 a.m. Opening of conference with Word of Welcome
    from Krista Grant, Assistant Deputy Minister,
    Communications PEI
    9 a.m. – 10 a.m. A Cook’s Tour of Open Data from a User’s Perspective
    Peter Rukavina, Visiting Scholar, Hacker in Residence,
    University of Prince Edward Island
    11 a.m. – 12 noon Federal/Provincial/Territorial presentations
    12 noon Lunch
    1:30 p.m. – 4 p.m. Federal/Provincial/Territorial presentations
    6 p.m. Lobster Dinner ~ Claddagh Oyster House
    Tuesday, June 23
    8 a.m. – 9 a.m. Continental breakfast
    9 a.m. – 10:30 a.m. Federal/Provincial/Territorial presentations
    10:30 a.m. – 11:30 noon Copyright Board of Canada Decision
    Ivan MacArthur, Senior Policy Analyst, Communications PEI
    12 noon Lunch
    1:30 p.m. – 2:30 p.m. Tour of the University of Prince Edward Island
    Robertson Library Digitization Lab
    3 p.m. – 5 p.m. Federal/Provincial/Territorial presentations
    6 p.m. Official photograph of the Queen’s Printers
    6:30 p.m. Official Dinner ~ Sims Corner Steakhouse & Oyster Bar
    Wednesday, June 24
    8:30 a.m. – 9:30 a.m. Breakfast buffet
    9:30 a.m. – 11 a.m. QPAC Annual General Meeting
    11 a.m. – 11:15 a.m. QPAC 2016 presentation
    11:15 a.m. – 12 noon Roundtable discussion, unfinished business

    View Slide

  6. View Slide

  7. View Slide

  8. BEGIN:VEVENT
    CREATED:20150621T132252Z
    UID:63FFC87E-61CD-4BA2-A4FB-87C30272A480
    DTEND;TZID=America/Halifax:20150621T210000
    TRANSP:OPAQUE
    SUMMARY:Welcome Reception
    DTSTART;TZID=America/Halifax:20150621T190000
    DTSTAMP:20150621T132252Z
    LOCATION:The Great George\n58 Great George St\nCharlottetown PE C1A 4K3
    X-APPLE-STRUCTURED-LOCATION;VALUE=URI;X-ADDRESS=58 Great George St\\n

    Charlottetown PE C1A 4K3;X-APPLE-RADIUS=49.91305570459815;X-TITLE=

    The GreatGeorge:geo:46.234112,-63.124349
    SEQUENCE:0
    END:VEVENT

    View Slide

  9. View Slide

  10. View Slide

  11. Open Data Principles

    View Slide

  12. Windmill by Stephen Downes is licensed under CC BY-NC 2.0

    View Slide

  13. Photo of Richard Brown from Liberal Party of Prince Edward Island

    View Slide

  14. Photo of Ron Estabrooks taken at the open house to officially launch the Hermanville/Clearspring wind development from www.gov.pe.ca.

    View Slide

  15. View Slide

  16. View Slide

  17. Clip of audio from CBC Spark interview with Peter Rukavina by Nora Young, recorded June 19, 2011.

    View Slide

  18. View Slide

  19. [
    {
    "data1": 210.15,
    "data2": 139.22,
    "data3": 7.98,
    "data4": 82.02,
    "data5": 57.2,
    "updateDate": 1424875441,
    "error": 0
    }
    ]

    View Slide

  20. {
    "on-island-load": 210.15,
    "on-island-wind": 139.22,
    "on-island-fossil": 7.98,
    "wind-local": 82.02,
    "wind-export": 57.2,
    "percentage-wind": "66.25"
    }

    View Slide

  21. View Slide

  22. View Slide

  23. View Slide

  24. View Slide

  25. http://innovis.cpsc.ucalgary.ca/

    View Slide

  26. “I have become slightly obsessed by
    your energy graph and am very
    grateful that you have found a way to
    record the load and wind power
    generated in PEI. Do you by any
    chance have a spread sheet of these
    values? I am looking at using storage to
    balance wind fluctuations and was
    hoping to try and using the real load
    and wind data to accomplish that.”

    View Slide

  27. Open Data Principle № 1
    You have no idea (at all)
    what open data might be
    used for.

    View Slide

  28. View Slide

  29. Town of Stratford Building Permit Summary 7/1/2013 to 7/31/2013
    Applicant Estimated Development
    Date PermitID Applicant Name Phone # PID Lot# Address Permit Type Project Value Permit Fee
    JUL-15-2013 DP078-13 Robert Gaudet 902-367-6129 932111 171 6 Carrington Road Accessory Building - New $1,200.00 $30.00
    JUL-25-2013 DP056-13 Stratford Quickstop 1044494 1 Jubilee Drive Accessory Building - New $11,000.00 $100.00
    Sub Totals: $12,200.00 $130.00
    JUL-05-2013 DP072-13 Rosemary Scott 902-569-3021 728188 135 33 Celtic Lane Accessory Structure (Pool, Deck, etc) - $800.00 $30.00
    Addition
    JUL-16-2013 DP077-13 Kent Building Supply - 329375 154 Spinnaker Drive Accessory Structure (Pool, Deck, etc) - $5,000.00 $30.00
    Andrew Sanderson Addition
    Sub Totals: $5,800.00 $60.00
    JUL-26-2013 DP085-13 Richard E. Woodfield 902-367-3637 1010693 7 Picton Beete Cr Accessory Structure (Pool, Deck, etc) - $3,000.00 $30.00
    New
    JUL-12-2013 DP076-13 Jamie Doiron 902-629-0224 486118 14 Towerwood Drive Accessory Structure (Pool, Deck, etc) - $3,000.00 $30.00
    New
    JUL-03-2013 DP039-13 Chris and Jennifer 902-569-2114 471508 10 Aintree Drive Accessory Structure (Pool, Deck, etc) - $6,000.00 $30.00
    Whitlock New
    JUL-30-2013 DP016-13 Craig and Jennifer 902-566-1801 1014638 93 Bonavista Avenue Accessory Structure (Pool, Deck, etc) - $25,000.00 $30.00
    Lawlor New
    JUL-15-2013 DP062-13 Drew and Karen 902-894-3959 1029180 22 Saints Crescent Accessory Structure (Pool, Deck, etc) - $50,000.00 $30.00
    MacIntyre New
    Sub Totals: $87,000.00 $150.00
    JUL-31-2013 DP059-13 Craftsman 940650 11 Galway Court Single Family Dwelling - Addition $18,000.00 $56.80
    Construction
    JUL-05-2013 DP071-13 Roger Johnson 902-569-4882 709154 73 Rankin Drive Single Family Dwelling - Addition $40,000.00 $114.40
    JUL-10-2013 DP070-13 Greenleaf Construction 902-566-3358 603613 1 2 Battery Point Drive Single Family Dwelling - Addition $150,000.00 $43.68
    Sub Totals: $208,000.00 $214.88
    JUL-25-2013 DP081-13 D.C. McCardle 902-367-9200 398586 70 77 Southampton Drive Single Family Dwelling - New $180,000.00 $458.20
    JUL-18-2013 DP079-13 D.C. McCardle Ltd 902-367-9200 398586 72 85 Southampton Dr Single Family Dwelling - New $200,000.00 $469.40
    JUL-30-2013 DP084-13 Barry MacDonald 1045749 13 11 Donegal Lane Single Family Dwelling - New $300,000.00 $1,187.60
    Thursday, August 01, 2013 Town of Stratford Building Permit Summary 7/1/2013 to 7/31/2013 Page 1 of 2

    View Slide

  30. View Slide

  31. View Slide

  32. pdftotext -raw

    Weekly_approvals_webpage_21_Oct_2011.pdf \
    Weekly_approvals_webpage_21_Oct_2011.txt

    View Slide

  33. 10-533 335067 402-bld-10 20-Oct-10 3-Oct-11 18-22 Water Street...
    10-569 363556 439-BLD-10 17-Nov-10 3-Oct-11 20 Lapthorne Avenue...
    11-002 1018274 001-bld-11 4-Jan-11 6-Oct-11 375 Mount Edward Road...
    11-136 342436 326-bld-11 26-Aug-11 3-Oct-11 134 Kent Street...

    View Slide

  34. -63.12688,46.23066,22 WATER ST,"10-533 335067 402-bld-10…
    -63.12606,46.24454,20 LAPTHORN AV,"10-569 363556 439-BLD-10..
    -63.14558,46.27834,375 MOUNT EDWARD RD,"11-002 1018274 001-bod-11…
    -63.12808,46.23572,134 KENT ST,"11-136 342436 326-bld-11…

    View Slide

  35. View Slide

  36. View Slide

  37. View Slide

  38. Open Data Principle № 2
    PDFs are where 

    data goes to die.

    View Slide

  39. I walked thru some testing with the
    admin assistant in planning.
    She had some concerns with data
    entry -- she found it cumbersome and
    also identified a couple of scenarios
    that were not possible to enter
    properly, or were not represented
    clearly in the result.

    View Slide

  40. Open Data Principle № 2B
    Bureaucrats really like
    File > Save as PDF…

    View Slide

  41. View Slide

  42. scale drawings drawn to Parking Design Standards and certified
    (stamped) by a qualified engineer, architect, or public land surveyor Shall
    be submitted where there are ten (10) or more Parking Spaces or for less
    than ten (10) spaces as required by the Development Officer with the
    application for the Building permit showing entrances and exits to such
    Parking facilities, all proposed and Existing Parking Spaces, aisles,
    lighting, and drainage of the Lot;

    View Slide

  43. scale drawings drawn to Parking Design Standards and certified
    (stamped) by a qualified engineer, architect, or public land surveyor Shall
    be submitted where there are ten (10) or more Parking Spaces or for less
    than ten (10) spaces as required by the Development Officer with the
    application for the Building permit showing entrances and exits to such
    Parking facilities, all proposed and Existing Parking Spaces, aisles,
    lighting, and drainage of the Lot;
    scale drawings drawn to Parking Design Standards and certified
    (stamped) by a qualified engineer, architect, or public land surveyor Shall
    be submitted where there are ten (10) or more Parking Spaces or for less
    than ten (10) spaces as required by the Development Officer with the
    application for the Building permit showing entrances and exits to such
    Parking facilities, all proposed and Existing Parking Spaces, aisles,
    lighting, and drainage of the Lot;

    View Slide

  44. GENERAL PROVISIONS FOR BUILDINGS AND STRUCTURES ................................................ 26
    4.1 ACCESSORY BUILDINGS
    4.2 BUILDING HEIGHT
    4.3 DECKS, AND OTHER PROJECTIONS INTO YARDS
    4.4 EXISTING BUILDINGS OR STRUCTURES
    4.5 FENCES
    4.6 GROUPED DWELLINGS
    4.7 ONE MAIN BUILDING ON A LOT
    4.8 RESTORATION TO A SAFE CONDITION
    4.9 SATELLITE DISHES AND COMMUNICATION TOWERS
    4.10 WINDMILL TOWERS
    4.11 SUBDIVIDING OF ATTACHED DWELLINGS
    4.12 SWIMMING POOLS
    4.13 VEHICLE BODIES

    View Slide

  45. GENERAL PROVISIONS FOR BUILDINGS AND STRUCTURES ................................................ 26
    4.1 ACCESSORY BUILDINGS
    4.2 BUILDING HEIGHT
    4.3 DECKS, AND OTHER PROJECTIONS INTO YARDS
    4.4 EXISTING BUILDINGS OR STRUCTURES
    4.5 FENCES
    4.6 GROUPED DWELLINGS
    4.7 ONE MAIN BUILDING ON A LOT
    4.8 RESTORATION TO A SAFE CONDITION
    4.9 SATELLITE DISHES AND COMMUNICATION TOWERS
    4.10 WINDMILL TOWERS
    4.11 SUBDIVIDING OF ATTACHED DWELLINGS
    4.12 SWIMMING POOLS
    4.13 VEHICLE BODIES
    General Provision for Buildings and Structures ................................................................................. 26
    4.1 Accessory Buildings
    4.2 Building Height
    4.3 Decks, and Other Projections into Yards
    4.4 Existing Buildings or Structures
    4.5 Fences
    4.6 Groups Dwellings
    4.7 One Main Building on a Lot
    4.8 Restoration to a Safe Condition
    4.9 Satellite Dishes and Communication Towers
    4.10 Windmill Towers
    4.11 Subdividing of Attached Dwellings
    4.12 Swimming Pools
    4.13 Vehicle Bodies

    View Slide

  46. View Slide

  47. Open Data Principle № 3
    Sometimes “open” can simply
    mean following 

    basic rules of design.

    View Slide

  48. View Slide

  49. View Slide

  50. View Slide

  51. View Slide

  52. Metadata Issues
    • Lot 50 was mislabelled as Lot 66.
    • Lot 66 was unlabelled.
    • Georgetown Royalty was mislabelled as Lot 73
    • Princetown Royalty was missing.

    View Slide

  53. View Slide

  54. View Slide

  55. View Slide

  56. View Slide

  57. View Slide

  58. View Slide

  59. View Slide

  60. The Confederation Trail passes 

    through 47 lots and 2 royalties.

    View Slide

  61. Open Data Principle № 4
    Open data is a
    conversation.

    View Slide

  62. View Slide

  63. View Slide

  64. View Slide

  65. View Slide

  66. (902) 367-3694

    View Slide

  67. View Slide

  68. Open Data Principle № 5
    Sometimes your users will
    create open data for you. 

    Follow their lead.

    View Slide

  69. View Slide

  70. Please note that with respect to some cases, only
    the name of the case and a short headnote is
    available. These are: (1) cases in which as
    publication ban has been imposed under the
    Criminal Code or other legislation; (2) cases
    involving actions, applications or petitions under
    the Family and Child Services Act, The Family
    Law Act and The Divorce Act.

    View Slide

  71. Open Data Principle № 6
    “Opening” changes 

    the audience.

    View Slide

  72. View Slide

  73. View Slide

  74. View Slide

  75. View Slide

  76. View Slide

  77. Open Data Principle № 7
    “Opening” allows for 

    new connections.

    View Slide

  78. Open Data Principles
    1. You have no idea (at all) what open data might be used for.
    2. PDFs are where data goes to die.
    3. Sometimes “open” can simply mean following rules of design.
    4. Open data is a conversation.
    5. Sometimes your users will create open data for you.
    6. “Opening” changes the audience.
    7. “Opening” allows for new connections.

    View Slide

  79. Open Data Principles
    1. You have no idea (at all) what open data might be used for.
    2. PDFs are where data goes to die.
    3. Sometimes “open” can simply mean following rules of design.
    4. Open data is a conversation.
    5. Sometimes your users will create open data for you.
    6. “Opening” changes the audience.
    7. “Opening” allows for new connections.
    Don’t try to anticipate this: be as open as possible.
    Use PDF as a format-of-last-resort.
    Design continues to be important.
    Participate in it.
    Watch for it. Use it as a guide.
    Be mindful of the changed audience.
    Think about the new connections: threats and opportunities.

    View Slide

  80. Colophon
    • Headline text is Futura Demibold.
    • Body text is Futura Medium.
    • Presentation created with Apple Keynote v6.5.3.
    • It took me about 7 hours to assemble the slides.
    • I was fuelled by coffee from Receiver Coffee.
    • I had a smoked salmon bagel for lunch.

    View Slide

  81. Slides are online at
    http://l.ruk.ca/queensprinter
    These slides are released under a Creative Commons license.
    You are encouraged to distribute them as far and as 

    wide as possible under the terms of the license.

    View Slide