$30 off During Our Annual Pro Sale. View Details »
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
CKAN
Search
Rae Knowler
February 12, 2015
Programming
0
670
CKAN
An introduction to the open data management system, CKAN.
Rae Knowler
February 12, 2015
Tweet
Share
More Decks by Rae Knowler
See All by Rae Knowler
How do vampires use the internet? An exploration of fandom and technology
bellisk
0
420
Liiptalk__Mental_Health_First_Aid.pdf
bellisk
0
78
Hypothesis: Property-based testing for Python
bellisk
0
80
Python, Locales and Writing Systems - PyCon US, 12th May 2018
bellisk
0
120
Unsafe at Any Speed (PyDays Vienna, 5th May 2018)
bellisk
0
96
Unsafe at Any Speed (PyCon UK, 26th October 2017)
bellisk
1
690
Python, Locales and Writing Systems (PyCon Poland, 18th August 2017)
bellisk
1
120
Python, Locales and Writing Systems (PyCon Italia, 7th April 2017)
bellisk
1
120
Python, Locales and Writing Systems (Swiss Python Summit 2017)
bellisk
0
110
Other Decks in Programming
See All in Programming
バックエンドエンジニアによる Amebaブログ K8s 基盤への CronJobの導入・運用経験
sunabig
0
170
Spinner 軸ズレ現象を調べたらレンダリング深淵に飲まれた #レバテックMeetup
bengo4com
0
170
Claude Codeの「Compacting Conversation」を体感50%減! CLAUDE.md + 8 Skills で挑むコンテキスト管理術
kmurahama
1
630
実は歴史的なアップデートだと思う AWS Interconnect - multicloud
maroon1st
0
260
組み合わせ爆発にのまれない - 責務分割 x テスト
halhorn
1
160
The Past, Present, and Future of Enterprise Java
ivargrimstad
0
330
tsgolintはいかにしてtypescript-goの非公開APIを呼び出しているのか
syumai
7
2.3k
Cap'n Webについて
yusukebe
0
150
著者と進める!『AIと個人開発したくなったらまずCursorで要件定義だ!』
yasunacoffee
0
160
実はマルチモーダルだった。ブラウザの組み込みAI🧠でWebの未来を感じてみよう #jsfes #gemini
n0bisuke2
3
1.3k
AIコーディングエージェント(Gemini)
kondai24
0
270
脳の「省エネモード」をデバッグする ~System 1(直感)と System 2(論理)の切り替え~
panda728
PRO
0
120
Featured
See All Featured
How to make the Groovebox
asonas
2
1.8k
Reality Check: Gamification 10 Years Later
codingconduct
0
1.9k
The Psychology of Web Performance [Beyond Tellerrand 2023]
tammyeverts
49
3.2k
Lightning talk: Run Django tests with GitHub Actions
sabderemane
0
92
Discover your Explorer Soul
emna__ayadi
2
1k
Helping Users Find Their Own Way: Creating Modern Search Experiences
danielanewman
31
3k
Gemini Prompt Engineering: Practical Techniques for Tangible AI Outcomes
mfonobong
2
230
Prompt Engineering for Job Search
mfonobong
0
130
How to train your dragon (web standard)
notwaldorf
97
6.4k
AI: The stuff that nobody shows you
jnunemaker
PRO
1
19
Max Prin - Stacking Signals: How International SEO Comes Together (And Falls Apart)
techseoconnect
PRO
0
49
How to Build an AI Search Optimization Roadmap - Criteria and Steps to Take #SEOIRL
aleyda
1
1.8k
Transcript
Rae Knowler Liip Techtalk, 12th February 2015 1
What is CKAN? 2
CKAN is a powerful data management system that makes data
accessible – by providing tools to streamline publishing, sharing, finding and using data. ckan.org/ 3
OGD@Bund (http://opendata.admin.ch) 4
Python backend, JavaScript frontend - Framework: Pylons - ORM: SQLAlchemy
- Database engine: PostgreSQL - Search: Solr - Templates: Jinja2 5 Technical basis
What is Open Data? 6
Data ... 7 - any kind - from governments -
from research and science - from businesses - ...
… that's Open 8 - accessible - free - reusable
/ remixable
The Five Stars of Open Data 9 Tim Berners-Lee (image
source)
10 Andreas Amsler (image source)
Why use CKAN? 11
Well, what happens when you don't? 12 - "If only
we could get the statistics for this…" - "Not another scanned-in PDF!" - "Do you have the hard drive with our results on it? … No, the other hard drive?"
CKAN lets you ... - upload any kind of file
- from anywhere - with a sensible metadata system - track metadata history - publish data, easily - preview it - share it 13
Who uses CKAN? 14
The Natural History Museum, UK (http://www.nhm.ac.uk/research- curation/research/informatics/creating-digital-infrastructure-science/data-portal/index.html) 15
data.gov.uk 16
CKAN features 17
Open Source - No tool lock-in - No need to
rely on the core devs for features - All the other advantages of Open Source! 18
Federation of data sources - Federation of data sources -
Can store data within CKAN itself - Search all the databases! 19
Super searching - Solr for full-text search - Facetted search
- Tags and groups for datasets - Related material 20
Groups and organisations - Organise datasets by source and topic
- Privilege control for users 21
API - RESTful JSON API - Well-documented - All features
of web interface - Access dataset statistics - Get RDF version of the catalogue - CSV / JSON dump of catalogue - ... 22
Plus ... - Responsive design - Data preview - Geospatial
features - Customisable - Extensible 23
CKAN extensions 24
Add comments 25
Google Analytics 26
QA checker (including the 5 stars) 27
Harvesting https://github.com/ckan/ckanext-harvest - Harvest datasets from any CKAN instance -
Basis for further extensions to harvest data from anywhere 28
Harvesting to a local and a central CKAN instance 29
http://extensions.ckan.org/ 30
CKAN at Liip 31
OGD@Bund (http://opendata.admin.ch) 32
Open Data Zürich (https://data.integ.stadt-zuerich.ch/) 33
ORD@CH (http://openresearchdata.ch) 34
The CKAN community 35
The Open Knowledge Foundation - UK-based non-profit organisation - Manages
CKAN development - Employs full-time dev team 36
Everyone else! - Other contributors are welcome - Useful mailing
lists: - https://lists.okfn.org/mailman/listinfo/ckan-dev - https://groups.google.com/forum/#!forum/ckan- global-user-group - Good issues for contribution: - https://github.com/ckan/ckan/labels/Good%20for% 20Contribution 37
CKANCon 2014, Berlin 38
Useful links 39
- http://ckan.org - http://docs.ckan.org/en/latest/ - https://github.com/liip/ckan-vagrant - Vagrant box for
CKAN development 40 Useful Links
Thanks! 41