Linked Data + Drupal for Oceanographic Data Management

Presented at Drupalcon Austin 2014

Transcript

1. LINKED DATA + DRUPAL FOR OCEANOGRAPHIC DATA MANAGEMENT ADAM SHEPHERD & STÉPHANE CORLOSQUET CASE STUDIES WEDNESDAY 2:15PM JUNE 4TH
2. LINKED DATA + DRUPAL FOR OCEANOGRAPHIC DATA MANAGEMENT ADAM SHEPHERD & STÉPHANE CORLOSQUET
3. LINKED DATA + DRUPAL FOR OCEANOGRAPHIC DATA MANAGEMENT ➢ WELCOME TO THE JUNGLE (WE’VE GOT FUN N’ GAMES) ➢ HOW & WHY LINKED DATA HELPS ➢ USING LINKED DATA IN DRUPAL
4. http://4.bp.blogspot.com/-gQWSBV6EnBo/TiRcN9unwbI/AAAAAAAAPXs/tydq754TRoI/s1600/vgdvd3.jpg It’s 1984 ...
5. http://i.telegraph.co.uk/multimedia/archive/01594/corey-haim_1594267c.jpg Friday night
6. http://img2.timeinc.net/people/i/2006/celebdatabase/patrickdempsey/patrick_dempsey5_180_240.jpg http://img.timeinc.net/time/daily/2009/0901/360_elm_street_0105.jpg MISSION: PIZZA “What’s their address?” “1428 Elm St.” “Be there in 30 mins or less ...or it’s free.”
7. http://media-cache-ak0.pinimg.com/736x/07/57/b1/0757b14109002ff196eefbbe8e39bb6c.jpg
8. http://swhomevid.site40.net/vhs_anh1.jpg MISSION: MOVIE “GET THE ONE WITH…” ➢ Righteous girl + bodacious dude ➢ Light beams flying everywhere ➢ The one with the “Force”
9. The search begins... https://deadlymovies.files.wordpress.com/2012/01/photo-2.jpg
10. http://www.chud.com/wp-content/uploads/2012/07/MEGAFORCE-FRONT-copy.jpg MOVIE: FOUND! ✓ Righteous girl + bodacious dude ✓ light beams flying everywhere ✓ The one with the “Force”
11. BACK AT THE HOUSE… http://static.guim.co.uk/sys-images/Film/Pix/pictures/2010/2/24/1267010697702/Winona-Ryder-Kim-Walker-L-001.jpg
12. A Tale of Two Elm Streets Which ‘Elm St’ was that? http://i.huffpost.com/gen/1594554/thumbs/o-PIZZA-facebook.jpg http://themaindamie.files.wordpress.com/2013/10/a-nightmare-on-elm-street-2010-horror-movies-11384409-720-297.jpg http://img.timeinc.net/time/daily/2009/0901/360_elm_street_0105.jpg
13. ELM ST. near Austin, TX http://brooklynsteez.com/products/square/81690.png http://tinyurl.com/mtmlbpx #1 #2
14. http://www.chud.com/wp-content/uploads/2012/07/MEGAFORCE-FRONT-copy.jpg At least, you have MEGAFORCE ✓ Righteous girl + bodacious dude ✓ light beams flying everywhere ✓ The one with the “Force”
15. http://images.sodahead.com/slideshows/000000228/betamax-11979413784_xlarge.jpeg http://upload.wikimedia.org/wikipedia/commons/thumb/3/3c/Betavhs2.jpg/220px-Betavhs2.jpg Betamax vs. VHS
16. WHAT HAPPENED, DUDE?
17. PIZZA bad or no results = ambiguous query MEGA FORCE got results, not what was expected BETAMAX results weren’t useful WHAT HAPPENED, DUDE?
18. It’s A Hard Knock Life http://2.bp.blogspot.com/_9ROOpn4epE0/SwHye-JfXYI/AAAAAAAADQo/mjKOBuVL3EU/s1600/02.jpg
19. Livin’ on a Prayer ➢ “Grand Challenges” require data ➢ Right data has been hard to find http://4.bp.blogspot.com/-ymbRRrq5G-4/Uy99LJEuPTI/AAAAAAAAIzA/GbuMaLcLd1c/s1600/the-life-aquatic-with-steve-zissou-1024x435.png
20. Zooplankton abundance
21. http://fallmeeting.agu.org/2012/eposters/eposter/in43b-1506/
22. PEOPLE & ORGANIZATIONS http://www.thelifeaquatic.org/images/walking.jpg
23. CRUISES & LOCATIONS http://www.whoi.edu/main/ships/knorr http://www.whoi.edu/cruiseplanning/files/1355434346284_5722_Cruise_track_121312.jpg R/V KNORR
24. INSTRUMENTS & MEASUREMENTS http://globec.whoi.edu/globec-dir/reports/al9906/Image29.gif http://www.whoi.edu/cms/images/instruments/2004/8/vpr_advanced_1383.gif
25. FUNDING http://thewartburgwatch.com/wp/wp-content/uploads/2012/05/fan-of-dollars1.jpg
26. BCO-DMO on Drupal http://www.bco-dmo.org
27. AHA #1: Data needs CONTEXT http://www.oocities.org/sunsetstrip/4426/visual/faces.gif What is it: 2 faces - or - 1 candlestick
28. CONTEXT influences the understanding of a subject by adding surrounding information.
29. CONTEXT influences the understanding of a subject by adding surrounding information.
30. CONTEXT: Related Links http://www.whoi.edu/oceanus/feature/deep-western-boundary-current
31. http://www.whoi.edu/oceanus/feature/deep-western-boundary-current CONTEXT: Related Links
32. http://www.themightyginge.com/blog/wp-content/uploads/2014/04/porthole.jpg http://compartmaps.com/images/415_World_Oceanflat.jpg Geospatial CONTEXT
33. http://www.themightyginge.com/blog/wp-content/uploads/2014/04/porthole.jpg http://compartmaps.com/images/415_World_Oceanflat.jpg Geospatial CONTEXT
34. VISUALIZING the CONTENT
35. VISUALIZING the CONTENT
36. VISUALIZING the CONTENT,
37. “STILL HAVEN’T FOUND WHAT I’M LOOKING FOR…” http://4.bp.blogspot.com/-mTbIH1IeLpw/Uxvh-es_ifI/AAAAAAAAFEg/BtRDO0w9U6w/s1600/I-wonder-if-it-remembers-me.-life-aquatic-with-steve-zissou- 2004.gif
38. Addressing the “Grand Challenges” requires interoperable systems to aid in the discovery & exchange of information. AHA #2: Cooperative Data
39. Somewhere out there… where dreams come true.
40. Express Yourself What does it mean to be “friends”? What does “connected” mean? ➢ Family are “friends” ➢ Co-workers are “friends” ➢ High-school acquaintances are “friends”
41. Example: Walking on the Moon http://astrobob.areavoices.com/files/2011/08/Moon-May-3-AS-Del1-1024x776.jpg
42. Copernicus plotted http://stko.geog.ucsb.edu/location_linked_data Is that the moon?
43. “One small step for man...” in South Sudan APO LLO 11 http://dbpedia.oobian.com/#/OobianMaps/VPIN/dbp%253aCopernicus_(lunar_crater)
44. http://www.leftcoastgrassfed.com/ Example: Grass-fed beef supplier
45. SEARCH: “COASTAL BEEF” http://www.leftcoastgrassfed.com/
46. IS “COASTAL BEEF” DEADLY? http://tinyurl.com/laawqgv http://i343.photobucket.com/albums/o465/MattLeader/Biggie-ReadyToDie-CD.jpg
47. AHA #3: Reliable data exchange needs semantic interoperability
48. AHA #3: Reliable data exchange needs semantic interoperability ➢ Sender knows Ready To Die is a “MusicalWork”
49. AHA #3: Reliable data exchange needs semantic interoperability ➢ Sender knows Ready To Die is a “MusicalWork” ➢ Receiver should interpret Ready To Die as a “MusicalWork”
50. Semantic interoperability means shared UNDERSTANDING throughout content exchange.
51. If your content is worthy of a website, then it deserves to be understood. http://drupal.org/files/druplicon.small_.png http://www.mouthymag.com/wp-content/uploads/2013/11/tumblr_inline_mjwd8k0Zjs1qz4rgp.jpg http://deployment.googleapps.com/_/rsrc/1326052805286/Home/user-resources/google-icons-and-logos/google_logo_3D_online_medium.png http://www.wildsoundmovies.com/images/terminator_logo.jpg HUMANS MEDIATORS MACHINES
52. SCREENCAST LINKED DATA in ACTION https://www.youtube.com/watch?v=_bn4muKqXv0
53. MapServer OpenSearch Linked Data Drupal What’s the Stack, Yo? http://mapserver.org/ http://www.opensearch.org/ http://www.w3.org/standards/semanticweb/data https://drupal.org/
54. LINKED DATA http://www.ibiblio.org/hhalpin/homepage/presentations/tpac2008/rdf.png What’s the big deal?
55. ➢ Some facets are built from 3rd party ❏ Instruments by Type ❏ Parameters by Type Linked Data: The Deal
56. ➢ repository of oceanographic terms ➢ vetted by oceanographers (pan-European project) ➢ exposed as Linked Data by BODC SeaDataNet @ BODC http://vocab.nerc.ac.uk/ http://www.seadatanet.org/extension/seadatanet2/design/skin-seadatanet2/images/Logo_SeaDataNet_fond_transparent.png
57. One consumer was across the ‘pond’ - 3,000 miles away It was assumed that SeaDataNet terms would be useful to others
58. 1. Context through RDF vocabularies 2. Cooperation via common framework (RDF) 3. Cooperation without coordination 4. Semantic Interoperability through HTTP URIs for naming things LINKED DATA http://www.ibiblio.org/hhalpin/homepage/presentations/tpac2008/rdf.png
59. LINKED DATA + DRUPAL http://www.ibiblio.org/hhalpin/homepage/presentations/tpac2008/rdf.png http://fc03.deviantart.net/fs71/i/2011/179/c/d/vector_tree_by_axelintu-d3kedq3.png http://drupal.org/files/druplicon.small_.png
60. RDF (core) ➢ Entities have globally unique URIs ➢ Content Types = RDF Vocabulary Classes ➢ Fields = RDF Vocabulary Class Properties http://calexis.com/blog/wp-content/uploads/2010/06/My-Name-Is.jpg CONTEXT
61. RDFx (contrib) ➢ Serializes content in RDF data model (“structured data”) ◦ 1 model = many formats ▪ HTML ▪ JSON ▪ XML ▪ TEXT ◦ RestWS support http://calexis.com/blog/wp-content/uploads/2010/06/My-Name-Is.jpg http://www.contestheat.com/wp-content/uploads/2013/03/lays-flavor-walgreens-giveaway.png COOPERATION
62. RDF UI (rdfx) https://drupal.org/files/issues/835350-8-rdf-ui-form-fields.jpg
63. TimBL: Linked Data is a Bag of Chips https://www.youtube.com/watch?v=ga1aSJXCFe0
64. Vocabularies @ BCO-DMO Ocean Data Ontology cruises, ships, instrumentation, measurements, funding Dublin Core generic metadata DCAT dataset catalog FOAF people & organizations VoID linking data GeoSPARQL geospatial features PROV-O provenance (revisions & activity) For info on creating your own vocabulary, try this presentation: http://www.slideshare.net/OpenDataSupport/model-your-data-metadata
65. Enable rdf and rdfx modules for immediate semantic interoperability POWER-UP #1 http://images.clipartlogo.com/files/images/32/325521/mushroom-vector-power_f.png http://37.media.tumblr.com/08e90c026242fbee0c7704b078219359/tumblr_mu1gb4NKee1sw8d3mo6_400.png http://newsupermariobrosu.nintendo.com/_ui/img/powerups/art1b.png
66. QUERYING LINKED DATA http://www.cedar-project.nl/wp-content/uploads/alibobo_w3cSPARQL-logo.png OpenSearch Linked Data
67. rdf_indexer (contrib) ➢ Index data in triple store ➢ Uses Search API ➢ SPARQL endpoint
68. rdf_indexer (contrib) ➢ Uses Search API
69. rdf_indexer (contrib) ➢ SPARQL endpoint
70. rdf_indexer (contrib) ➢ Extensible for support of external RDF stores ◦ BCO-DMO uses Virtuoso RDF store ◦ submitted Virtuoso extension as a patch (https: //drupal.org/node/2029717) ▪ BCO-DMO SPARQL endpoint: http://lod.bco-dmo.org/sparql
71. Enable rdf_indexer to make your data queryable. POWER-UP #2 http://img2.wikia.nocookie.net/__cb20131129222600/mario/images/5/5d/Fireflower3dworld.png http://newsupermariobrosu.nintendo.com/_ui/img/powerups/art1b.png http://img3.wikia.nocookie.net/__cb20120718023604/fantendo/images/thumb/c/c7/NSMB2_Fire_Mario.png/1024px-NSMB2_Fire_Mario.png
72. LINKED DATA: External Links
73. LINKED DATA: External Links
74. LINKED DATA: External Links
75. LINKED DATA: External Links
76. Generate value by creating links from your data to others. POWER-UP #3 http://newsupermariobros2.nintendo.com/mobile/_ui/img/power-ups/carousel/super-star.png http://newsupermariobrosu.nintendo.com/_ui/img/powerups/art1b.png http://www.mariowiki.com/images/thumb/8/85/Nsmb2_starman_mario.png/220px-Nsmb2_starman_mario.png http://dbpedia.org https://www.freebase.com http://www.wikidata.org
77. DATA is out there... http://datavisualization.ch/wp-content/uploads/2011/01/lod-wikipedia.png
78. New York Times: Innovation Report “...there are substantial costs to waiting.” http://www.niemanlab.org/2014/05/the-leaked-new-york-times-innovation-report-is-one-of-the-key-documents-of-this-media-age/
79. New York Times: Innovation Report RECIPES aren’t properly tagged by ingredients and cooking time “We can do it now, but only after spending a huge sum to retroactively structure the data.” http://www.niemanlab.org/2014/05/the-leaked-new-york-times-innovation-report-is-one-of-the-key-documents-of-this-media-age/
80. New York Times: Innovation Report “The lack of structured data helps explain why we are...“ 1. unable to automate the sale of our photos 2. continually struggle to attain higher rankings on search engines. http://www.niemanlab.org/2014/05/the-leaked-new-york-times-innovation-report-is-one-of-the-key-documents-of-this-media-age/
81. New York Times: Innovation Report “We need to reclaim our industry-leading position, but right now our needs are far more basic. We must expand the structured data we create.” http://www.niemanlab.org/2014/05/the-leaked-new-york-times-innovation-report-is-one-of-the-key-documents-of-this-media-age/
82. “I like a good story, well told.” -Mark Twain
83. CONTEXT with CONTENT
84. REFERENCES Linked Data by David Wood (Manning) Learning SPARQL by Bob DuCharme (O’Reilly) Definitive Guide to Drupal 7 Chapter 28 by Stéphane Corlosquet (Apress) http://www.manning.com/dwood/ http://www.learningsparql.com/ http://definitivedrupal.org/
85. BoF: LINKED DATA & RDF IN DRUPAL Time: Thursday · 11:45-01:00 Room: 10B - Blink Reaction | 3rd floor
86. QUESTIONS? Twitter: @ashep_15 drupal.org: ashepherd Twitter: @scorlosquet drupal.org: scor
87. WHAT DID YOU THINK? EVALUATE THIS SESSION: AUSTIN2014.DRUPAL.ORG/SCHEDULE Thank you! LINKED DATA + DRUPAL FOR OCEANOGRAPHIC DATA MANAGEMENT