Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
CKAN
Search
Rae Knowler
February 12, 2015
Programming
690
0
Share
Embed
Copy iframe code
Copy JS code
Copy link
Start on current slide
CKAN
An introduction to the open data management system, CKAN.
Rae Knowler
February 12, 2015
More Decks by Rae Knowler
See All by Rae Knowler
How do vampires use the internet? An exploration of fandom and technology
bellisk
0
470
Liiptalk__Mental_Health_First_Aid.pdf
bellisk
0
86
Hypothesis: Property-based testing for Python
bellisk
0
100
Python, Locales and Writing Systems - PyCon US, 12th May 2018
bellisk
0
140
Unsafe at Any Speed (PyDays Vienna, 5th May 2018)
bellisk
0
110
Unsafe at Any Speed (PyCon UK, 26th October 2017)
bellisk
1
730
Python, Locales and Writing Systems (PyCon Poland, 18th August 2017)
bellisk
1
140
Python, Locales and Writing Systems (PyCon Italia, 7th April 2017)
bellisk
1
130
Python, Locales and Writing Systems (Swiss Python Summit 2017)
bellisk
0
140
Other Decks in Programming
See All in Programming
VibeCodingからAgenticWorkflowへ
starfish719
0
450
Terraform標準の組織で AWS CDKをどう使うか
mu7889yoon
1
510
【やさしく解説 設計編・中級 #4】ルールの寿命と、システムの年輪
panda728
PRO
2
180
運用ダッシュボードの設計を誰も教えてくれないのだけどみなさんどうしてるんですか? - チームに監視するという文化を根付かせるための第一歩を踏みたい -
satoshi256kbyte
1
120
AI Readyの正体はデータマネジメントだ メダリオン2.0の最前線
freee
PRO
0
230
言葉の格闘技のススメ~紙とペンと言葉から始める、キャリアの描き方~
progresscicada
2
150
Building a Meta Ray-Ban display app
akkeylab
0
140
【やさしく解説 設計編・中級 #6】良いアーキテクチャとは ~ 一本の登り道の、行き先 ~
panda728
PRO
0
210
わからない話を追いかけたら、プログラミング言語を作る側にいた
ydah
3
500
170k Jobs a Day on GKE: Scaling Mercari's CI Platform - and What's Next for AI-Native Development
junyaokabe
0
110
JAWS-UG横浜 #102 AWSサ終供養LT会 成仏できない AWS サービスたち 〜本日、三体供養します〜
maroon1st
0
360
そこに3びきプロダクトがいるじゃろう——生成AI時代における“価値が届かない理由”の構造
kosuket
0
480
Featured
See All Featured
How to build an LLM SEO readiness audit: a practical framework
nmsamuel
1
860
Into the Great Unknown - MozCon
thekraken
41
2.7k
Collaborative Software Design: How to facilitate domain modelling decisions
baasie
1
280
HU Berlin: Industrial-Strength Natural Language Processing with spaCy and Prodigy
inesmontani
PRO
0
640
The Web Performance Landscape in 2024 [PerfNow 2024]
tammyeverts
12
1.2k
The agentic SEO stack - context over prompts
schlessera
0
860
The Spectacular Lies of Maps
axbom
PRO
1
910
How To Stay Up To Date on Web Technology
chriscoyier
790
250k
Side Projects
sachag
455
43k
Impact Scores and Hybrid Strategies: The future of link building
tamaranovitovic
0
390
A brief & incomplete history of UX Design for the World Wide Web: 1989–2019
jct
2
460
Un-Boring Meetings
codingconduct
0
390
Transcript
Rae Knowler Liip Techtalk, 12th February 2015 1
What is CKAN? 2
CKAN is a powerful data management system that makes data
accessible – by providing tools to streamline publishing, sharing, finding and using data. ckan.org/ 3
OGD@Bund (http://opendata.admin.ch) 4
Python backend, JavaScript frontend - Framework: Pylons - ORM: SQLAlchemy
- Database engine: PostgreSQL - Search: Solr - Templates: Jinja2 5 Technical basis
What is Open Data? 6
Data ... 7 - any kind - from governments -
from research and science - from businesses - ...
… that's Open 8 - accessible - free - reusable
/ remixable
The Five Stars of Open Data 9 Tim Berners-Lee (image
source)
10 Andreas Amsler (image source)
Why use CKAN? 11
Well, what happens when you don't? 12 - "If only
we could get the statistics for this…" - "Not another scanned-in PDF!" - "Do you have the hard drive with our results on it? … No, the other hard drive?"
CKAN lets you ... - upload any kind of file
- from anywhere - with a sensible metadata system - track metadata history - publish data, easily - preview it - share it 13
Who uses CKAN? 14
The Natural History Museum, UK (http://www.nhm.ac.uk/research- curation/research/informatics/creating-digital-infrastructure-science/data-portal/index.html) 15
data.gov.uk 16
CKAN features 17
Open Source - No tool lock-in - No need to
rely on the core devs for features - All the other advantages of Open Source! 18
Federation of data sources - Federation of data sources -
Can store data within CKAN itself - Search all the databases! 19
Super searching - Solr for full-text search - Facetted search
- Tags and groups for datasets - Related material 20
Groups and organisations - Organise datasets by source and topic
- Privilege control for users 21
API - RESTful JSON API - Well-documented - All features
of web interface - Access dataset statistics - Get RDF version of the catalogue - CSV / JSON dump of catalogue - ... 22
Plus ... - Responsive design - Data preview - Geospatial
features - Customisable - Extensible 23
CKAN extensions 24
Add comments 25
Google Analytics 26
QA checker (including the 5 stars) 27
Harvesting https://github.com/ckan/ckanext-harvest - Harvest datasets from any CKAN instance -
Basis for further extensions to harvest data from anywhere 28
Harvesting to a local and a central CKAN instance 29
http://extensions.ckan.org/ 30
CKAN at Liip 31
OGD@Bund (http://opendata.admin.ch) 32
Open Data Zürich (https://data.integ.stadt-zuerich.ch/) 33
ORD@CH (http://openresearchdata.ch) 34
The CKAN community 35
The Open Knowledge Foundation - UK-based non-profit organisation - Manages
CKAN development - Employs full-time dev team 36
Everyone else! - Other contributors are welcome - Useful mailing
lists: - https://lists.okfn.org/mailman/listinfo/ckan-dev - https://groups.google.com/forum/#!forum/ckan- global-user-group - Good issues for contribution: - https://github.com/ckan/ckan/labels/Good%20for% 20Contribution 37
CKANCon 2014, Berlin 38
Useful links 39
- http://ckan.org - http://docs.ckan.org/en/latest/ - https://github.com/liip/ckan-vagrant - Vagrant box for
CKAN development 40 Useful Links
Thanks! 41