Share
Embed
Getting to understand Linked Open Data in 60 minutes
Guest lecture at Ghent University
Pieter Colpaert
May 08, 2017
Transcript
38 slides
-
Will engineering a better information system help us build a
type I civilization? https://en.wikipedia.org/wiki/Kardashev_scale -
Open Data in the world For example Data Portal from
Worldbank http://data.worldbank.org -
Open Data in Europe Public Sector Information INSPIRE directive PSI
directive http://europeandataportal.eu -
SNCB STIB De Lijn TEC Schedules shared shared shared open
Real-time shared shared shared planned Tickets no no yes no Historic no no no open Status of e.g., Public Transit in BE? -
Sharing data between 2 systems Your system Third party system
Agree on a protocol Will determine which questions can be answered in a timely fashion Can ask questions to your system as previously agreed -
Sharing data on the Web Your system ? ? ?
? ? ? Maximizing reuse → need to raise the interoperability -
↓ Querying syntactic semantic technical legal When I have got
2 datasets, how easy is it to use them as if they were 1? -
As a reuser, you need certainty that you won’t get
sued https://github.com/iRail/stations -
A story of raising interoperability ↓ Querying syntactic semantic technical
legal When I have 2 datasets, how easy is it to turn them into 1 dataset? → Open Definition & open licenses → The Internet: exchanging data world-wide → JSON, XML, CSV, HTML… Open Standards -
name type city population StP-Plein Parking Gent 257k { “StP-Plein”
: { “type” : “Parking”, “city” : “Gent, “population” : “257k” } } <StP-Plein> <type>Parking</type> <city>Gent</city> <population> 257k </population> </StP-Plein> Table / CSV / Spreadsheet JSON XML Serialisations ↓ Querying syntactic semantic technical legal -
{ “StP-Plein” : { “type” : “Parking”, “city” : “Gent,
“population” : “257k” } } name type city population StP-Plein Parking Gent 257k <StP-Plein> <type>Parking</type> <city>Gent</city> <population> 257k </population> </StP-Plein> <StP-Plein> <type> <Parking> . <StP-Plein> <city> <Gent> . <Gent> <population> “257k” . Table / CSV / Spreadsheet 3 time a datum Triples JSON XML -
World Wide Web St-P Plein city Gent St Pietersplein type
Parking Gent population 257k HTTP Machine 1 HTTP Machine 2 HTTP Machine 3 Thought experiment: decentralizing publishing A user agent visiting each machine knows more than any of the machines independently -
Problem Sint-Pietersplein is a Parking Site ? ↓ Querying syntactic
semantic technical legal -
Problem Sint-Pietersplein is a Parking Site ? ↓ Querying syntactic
semantic technical legal -
Solution Sint Pietersplein → https://stad.gent/id/parking/P10 is a → http://www.w3.org/1999/02/22-rdf-syntax-ns#type Parking
→ http://vocab.datex.org/terms#UrbanParkingSite Uniform Resource Identifiers (URIs) -
A story of raising interoperability ↓ Querying syntactic semantic technical
legal When I have 2 datasets, how easy is it to turn them into 1 dataset? → Open Definition & open licenses → The Internet: exchanging data world-wide → JSON, XML, CSV, HTML… Open Standards → Linked Data -
Open Data is only a legal definition… but: The 5
stars of Linked Open Data http://5stardata.info -
Sharing data between 2 systems Your system Third party system
Agree on a protocol Will determine which questions can be answered in a timely fashion Can ask questions to your system as previously agreed -
Sharing data on the Web Your system ? ? ?
? ? ? Maximizing reuse → need to raise the interoperability -
data dump Ask any question How to allow for asking
any kind of query? Your system 3d party Your system ? ? ? ? ? ? -
data dump Ask any question Asking questions Your system 3d
party Your system ? ? ? ? ? ? Data publishing: Cacheable Dataset split in fragments -
A long tail for for e.g., transport data services ...
Hard to guess which kind of queries will be needed … More specific features Size of audience Google maps Proximus CityMapper Go-OV Ally Transit App NextTrain smartwatch -
Proposal http://api.{mycompany}/?from={A}&to={B} &departuretime=2016-10-16T14:45.024Z &wheelchairaccessible=true &transit_modes=plane,railway,bus,car &algoritm_mode=shortest ... Yet this interface
will need to answer all questions for all third party apps… -
data dump Route planning algorithms as a service Asking questions
Your system 3d party Your system ? ? ? ? ? ? Does not scale: Extra users comes with extra load Does not give necessary flexibility to companies -
Discover all the necessary data on the Web Just like
websites, we want your data to be high available -
API fanboys Real data reusers Need Open Data Want services
on top of data What we ask data owners -
What we ask data owners Data dumps Smart servers Data
publishing (cheap/reliable) Data services (rather expensive/unreliable) Entire query languages over HTTP Dataset split in fragments Smart agents algorithms as a service Read more at http://linkeddatafragments.org API fanboys Open Data -
Business model? API fanboys Real data reusers Need Open Data
Need services on top of data Business opportunity? -
Servers publishing Open Data e.g., • all the planned and
actual arrivals and departures • the network of roads in a certain region worldwide web-services e.g., • a route planner: from → to • the closest station to your current location? Scalable businesses $$$ $ $ $$$ end-users -
We want a world where knowledge creates power for the
many, not the few. Looking for a student job in Open Data? Check out http://summerofcode.be