Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
CKAN
Search
Rae Knowler
February 12, 2015
Programming
690
0
Share
Embed
Copy iframe code
Copy JS code
Copy link
Start on current slide
CKAN
An introduction to the open data management system, CKAN.
Rae Knowler
February 12, 2015
More Decks by Rae Knowler
See All by Rae Knowler
How do vampires use the internet? An exploration of fandom and technology
bellisk
0
470
Liiptalk__Mental_Health_First_Aid.pdf
bellisk
0
86
Hypothesis: Property-based testing for Python
bellisk
0
100
Python, Locales and Writing Systems - PyCon US, 12th May 2018
bellisk
0
140
Unsafe at Any Speed (PyDays Vienna, 5th May 2018)
bellisk
0
110
Unsafe at Any Speed (PyCon UK, 26th October 2017)
bellisk
1
730
Python, Locales and Writing Systems (PyCon Poland, 18th August 2017)
bellisk
1
140
Python, Locales and Writing Systems (PyCon Italia, 7th April 2017)
bellisk
1
130
Python, Locales and Writing Systems (Swiss Python Summit 2017)
bellisk
0
140
Other Decks in Programming
See All in Programming
AI Readyの正体はデータマネジメントだ メダリオン2.0の最前線
freee
PRO
0
520
源内ハンズオン概要編
hideg
0
240
T3DD26: From RAGs to Riches
martinhelmich
0
130
PyO3 で既存 Python 評価器を Rust core 化する ー wasm-bindgen でブラウザにも配るための設計
kdash
1
110
まずはプロンプトガイドを読もう、話はそれからだ
kiakiraki
1
250
いまどきの Codex で開発する visionOS アプリの開発スタイルについて
karad
0
180
まだ間に合う!今年の夏こそSchemeのマクロ展開器を完全理解!
omasanori
0
600
数年滞っていたダークモード対応をおよそ2週間で完了させる
chigichan24
0
200
DynamoDBの基礎を振り返りながらベクトル検索機能を理解する
musan
3
260
Oxlintはいいぞ(続)
yug1224
1
510
{ Android | Kotlin } Gradle Plugin in 2026
ryunen344
1
200
Go 1.27からのGODEBUG / Go 1.27 リリースパーティ #go127party
mazrean
0
280
Featured
See All Featured
Bridging the Design Gap: How Collaborative Modelling removes blockers to flow between stakeholders and teams @FastFlow conf
baasie
0
680
Kristin Tynski - Automating Marketing Tasks With AI
techseoconnect
PRO
0
490
How People are Using Generative and Agentic AI to Supercharge Their Products, Projects, Services and Value Streams Today
helenjbeal
1
300
<Decoding/> the Language of Devs - We Love SEO 2024
nikkihalliwell
1
310
How to Build an AI Search Optimization Roadmap - Criteria and Steps to Take #SEOIRL
aleyda
1
2.2k
Accessibility Awareness
sabderemane
1
190
Getting science done with accelerated Python computing platforms
jacobtomlinson
2
460
The Mindset for Success: Future Career Progression
greggifford
PRO
0
490
How Fast Is Fast Enough? [PerfNow 2025]
tammyeverts
3
850
No one is an island. Learnings from fostering a developers community.
thoeni
21
3.8k
WCS-LA-2024
lcolladotor
0
820
Impact Scores and Hybrid Strategies: The future of link building
tamaranovitovic
0
430
Transcript
Rae Knowler Liip Techtalk, 12th February 2015 1
What is CKAN? 2
CKAN is a powerful data management system that makes data
accessible – by providing tools to streamline publishing, sharing, finding and using data. ckan.org/ 3
OGD@Bund (http://opendata.admin.ch) 4
Python backend, JavaScript frontend - Framework: Pylons - ORM: SQLAlchemy
- Database engine: PostgreSQL - Search: Solr - Templates: Jinja2 5 Technical basis
What is Open Data? 6
Data ... 7 - any kind - from governments -
from research and science - from businesses - ...
… that's Open 8 - accessible - free - reusable
/ remixable
The Five Stars of Open Data 9 Tim Berners-Lee (image
source)
10 Andreas Amsler (image source)
Why use CKAN? 11
Well, what happens when you don't? 12 - "If only
we could get the statistics for this…" - "Not another scanned-in PDF!" - "Do you have the hard drive with our results on it? … No, the other hard drive?"
CKAN lets you ... - upload any kind of file
- from anywhere - with a sensible metadata system - track metadata history - publish data, easily - preview it - share it 13
Who uses CKAN? 14
The Natural History Museum, UK (http://www.nhm.ac.uk/research- curation/research/informatics/creating-digital-infrastructure-science/data-portal/index.html) 15
data.gov.uk 16
CKAN features 17
Open Source - No tool lock-in - No need to
rely on the core devs for features - All the other advantages of Open Source! 18
Federation of data sources - Federation of data sources -
Can store data within CKAN itself - Search all the databases! 19
Super searching - Solr for full-text search - Facetted search
- Tags and groups for datasets - Related material 20
Groups and organisations - Organise datasets by source and topic
- Privilege control for users 21
API - RESTful JSON API - Well-documented - All features
of web interface - Access dataset statistics - Get RDF version of the catalogue - CSV / JSON dump of catalogue - ... 22
Plus ... - Responsive design - Data preview - Geospatial
features - Customisable - Extensible 23
CKAN extensions 24
Add comments 25
Google Analytics 26
QA checker (including the 5 stars) 27
Harvesting https://github.com/ckan/ckanext-harvest - Harvest datasets from any CKAN instance -
Basis for further extensions to harvest data from anywhere 28
Harvesting to a local and a central CKAN instance 29
http://extensions.ckan.org/ 30
CKAN at Liip 31
OGD@Bund (http://opendata.admin.ch) 32
Open Data Zürich (https://data.integ.stadt-zuerich.ch/) 33
ORD@CH (http://openresearchdata.ch) 34
The CKAN community 35
The Open Knowledge Foundation - UK-based non-profit organisation - Manages
CKAN development - Employs full-time dev team 36
Everyone else! - Other contributors are welcome - Useful mailing
lists: - https://lists.okfn.org/mailman/listinfo/ckan-dev - https://groups.google.com/forum/#!forum/ckan- global-user-group - Good issues for contribution: - https://github.com/ckan/ckan/labels/Good%20for% 20Contribution 37
CKANCon 2014, Berlin 38
Useful links 39
- http://ckan.org - http://docs.ckan.org/en/latest/ - https://github.com/liip/ckan-vagrant - Vagrant box for
CKAN development 40 Useful Links
Thanks! 41