Slide 1

Slide 1 text

Open Data And CKAN Joro Penchev, Dimitar Dimitrov
 Foundation Obshtestvo.bg
 www.obshtestvo.bg [email protected]

Slide 2

Slide 2 text

Agenda

Slide 3

Slide 3 text

Agenda 1. Abstract

Slide 4

Slide 4 text

Agenda 1. Abstract 1. About us

Slide 5

Slide 5 text

Agenda 1. Abstract 1. About us 2. How we understand the problem

Slide 6

Slide 6 text

Agenda 1. Abstract 1. About us 2. How we understand the problem 3. The idea about an open data demo project

Slide 7

Slide 7 text

Agenda 1. Abstract 1. About us 2. How we understand the problem 3. The idea about an open data demo project 2. The CKAN platform

Slide 8

Slide 8 text

Agenda 1. Abstract 1. About us 2. How we understand the problem 3. The idea about an open data demo project 2. The CKAN platform 1. How we chose CKAN

Slide 9

Slide 9 text

Agenda 1. Abstract 1. About us 2. How we understand the problem 3. The idea about an open data demo project 2. The CKAN platform 1. How we chose CKAN 2. Why open source and open technologies?

Slide 10

Slide 10 text

Agenda 1. Abstract 1. About us 2. How we understand the problem 3. The idea about an open data demo project 2. The CKAN platform 1. How we chose CKAN 2. Why open source and open technologies? 3. About CKAN

Slide 11

Slide 11 text

Agenda 1. Abstract 1. About us 2. How we understand the problem 3. The idea about an open data demo project 2. The CKAN platform 1. How we chose CKAN 2. Why open source and open technologies? 3. About CKAN 4. Our experience with the platform

Slide 12

Slide 12 text

Agenda 1. Abstract 1. About us 2. How we understand the problem 3. The idea about an open data demo project 2. The CKAN platform 1. How we chose CKAN 2. Why open source and open technologies? 3. About CKAN 4. Our experience with the platform 3. Current status of the project

Slide 13

Slide 13 text

Agenda 1. Abstract 1. About us 2. How we understand the problem 3. The idea about an open data demo project 2. The CKAN platform 1. How we chose CKAN 2. Why open source and open technologies? 3. About CKAN 4. Our experience with the platform 3. Current status of the project 4. Future work

Slide 14

Slide 14 text

Agenda 1. Abstract 1. About us 2. How we understand the problem 3. The idea about an open data demo project 2. The CKAN platform 1. How we chose CKAN 2. Why open source and open technologies? 3. About CKAN 4. Our experience with the platform 3. Current status of the project 4. Future work 5. Questions and discussion

Slide 15

Slide 15 text

1. Abstract

Slide 16

Slide 16 text

1.1. About Us

Slide 17

Slide 17 text

1.1. About Us • Joro and Dimitar, part of Obshtestvo.bg (translates as “community”)

Slide 18

Slide 18 text

1.1. About Us • Joro and Dimitar, part of Obshtestvo.bg (translates as “community”) • A young (~1 year old) non-government, non-profit organization

Slide 19

Slide 19 text

1.1. About Us • Joro and Dimitar, part of Obshtestvo.bg (translates as “community”) • A young (~1 year old) non-government, non-profit organization • Software developers, designers, journalists, marketing specialists, lawyers and many others

Slide 20

Slide 20 text

1.1. About Us • Joro and Dimitar, part of Obshtestvo.bg (translates as “community”) • A young (~1 year old) non-government, non-profit organization • Software developers, designers, journalists, marketing specialists, lawyers and many others • Currently about 10 active projects and campaigns aimed at improving the interaction between citizens and the government

Slide 21

Slide 21 text

1.1. About Us • Joro and Dimitar, part of Obshtestvo.bg (translates as “community”) • A young (~1 year old) non-government, non-profit organization • Software developers, designers, journalists, marketing specialists, lawyers and many others • Currently about 10 active projects and campaigns aimed at improving the interaction between citizens and the government • We strongly believe in open data, open source, agile, transparency and collaboration with the government

Slide 22

Slide 22 text

1.2. The Problem

Slide 23

Slide 23 text

1.2. The Problem • This is our very rough understanding of the overall picture in Bulgaria in relation to public and open data

Slide 24

Slide 24 text

1.2. The Problem • This is our very rough understanding of the overall picture in Bulgaria in relation to public and open data • A significant amount of data is public, but not in a machine readable format and it’s not updated regularly

Slide 25

Slide 25 text

1.2. The Problem • This is our very rough understanding of the overall picture in Bulgaria in relation to public and open data • A significant amount of data is public, but not in a machine readable format and it’s not updated regularly • No central hub to concentrate and categorize all available public data

Slide 26

Slide 26 text

1.2. The Problem • This is our very rough understanding of the overall picture in Bulgaria in relation to public and open data • A significant amount of data is public, but not in a machine readable format and it’s not updated regularly • No central hub to concentrate and categorize all available public data • Lots of misconceptions and fear about open data

Slide 27

Slide 27 text

1.2. The Problem • This is our very rough understanding of the overall picture in Bulgaria in relation to public and open data • A significant amount of data is public, but not in a machine readable format and it’s not updated regularly • No central hub to concentrate and categorize all available public data • Lots of misconceptions and fear about open data • Poor back-end software systems additionally complicate data management

Slide 28

Slide 28 text

1.2. Short-term Goals

Slide 29

Slide 29 text

1.2. Short-term Goals • Show the public that open data can easily aid in creating value-added products

Slide 30

Slide 30 text

1.2. Short-term Goals • Show the public that open data can easily aid in creating value-added products • Give citizens the incentive to demand open data more rigorously from the government

Slide 31

Slide 31 text

1.2. Short-term Goals • Show the public that open data can easily aid in creating value-added products • Give citizens the incentive to demand open data more rigorously from the government • Fight misconceptions regarding open data in the administration – given the proper infrastructure, open data becomes the easier option for data publishing

Slide 32

Slide 32 text

1.2. Short-term Goals • Show the public that open data can easily aid in creating value-added products • Give citizens the incentive to demand open data more rigorously from the government • Fight misconceptions regarding open data in the administration – given the proper infrastructure, open data becomes the easier option for data publishing • Lay the groundwork for creating a government operated central open data hub

Slide 33

Slide 33 text

1.3. Demo Project

Slide 34

Slide 34 text

1.3. Demo Project • An idea by the current deputy-minister of the Ministry of Transport, Information Technology and Communications, Kamen Spassov

Slide 35

Slide 35 text

1.3. Demo Project • An idea by the current deputy-minister of the Ministry of Transport, Information Technology and Communications, Kamen Spassov • Create an experimental central hub for open data

Slide 36

Slide 36 text

1.3. Demo Project • An idea by the current deputy-minister of the Ministry of Transport, Information Technology and Communications, Kamen Spassov • Create an experimental central hub for open data • Import existing public data sets, converting them in a machine-readable and API-accessible format

Slide 37

Slide 37 text

1.3. Demo Project • An idea by the current deputy-minister of the Ministry of Transport, Information Technology and Communications, Kamen Spassov • Create an experimental central hub for open data • Import existing public data sets, converting them in a machine-readable and API-accessible format • Create simple applications on top of the APIs

Slide 38

Slide 38 text

1.3. Demo Project • An idea by the current deputy-minister of the Ministry of Transport, Information Technology and Communications, Kamen Spassov • Create an experimental central hub for open data • Import existing public data sets, converting them in a machine-readable and API-accessible format • Create simple applications on top of the APIs • Demo the results and use the public interest to educate about the benefits of open data

Slide 39

Slide 39 text

2. The CKAN Platform

Slide 40

Slide 40 text

2.1. Choosing a Platform

Slide 41

Slide 41 text

2.1. Choosing a Platform • Existing solution or build our own?

Slide 42

Slide 42 text

2.1. Choosing a Platform • Existing solution or build our own? • Evaluated Socrata, CKAN, DKAN, Junar and others

Slide 43

Slide 43 text

2.1. Choosing a Platform • Existing solution or build our own? • Evaluated Socrata, CKAN, DKAN, Junar and others • CKAN seemed very stable and the most widely adopted one

Slide 44

Slide 44 text

2.1. Choosing a Platform • Existing solution or build our own? • Evaluated Socrata, CKAN, DKAN, Junar and others • CKAN seemed very stable and the most widely adopted one • Because of time and resource constraints choose an existing platform for the experiment

Slide 45

Slide 45 text

2.1. Why CKAN

Slide 46

Slide 46 text

2.1. Why CKAN • Stable

Slide 47

Slide 47 text

2.1. Why CKAN • Stable • Popular

Slide 48

Slide 48 text

2.1. Why CKAN • Stable • Popular • Modular and extensible

Slide 49

Slide 49 text

2.1. Why CKAN • Stable • Popular • Modular and extensible • Built on open technologies

Slide 50

Slide 50 text

2.1. Why CKAN • Stable • Popular • Modular and extensible • Built on open technologies • Open source with a permissive license

Slide 51

Slide 51 text

2.1. Why CKAN • Stable • Popular • Modular and extensible • Built on open technologies • Open source with a permissive license • Translated in many languages, including Bulgarian

Slide 52

Slide 52 text

2.2. Why Open

Slide 53

Slide 53 text

2.2. Why Open • The use of open technologies in the platform was a key metric

Slide 54

Slide 54 text

2.2. Why Open • The use of open technologies in the platform was a key metric • Allows us to evaluate the technical quality of the product

Slide 55

Slide 55 text

2.2. Why Open • The use of open technologies in the platform was a key metric • Allows us to evaluate the technical quality of the product • Allows us to extend and modify our installation as needed

Slide 56

Slide 56 text

2.2. Why Open • The use of open technologies in the platform was a key metric • Allows us to evaluate the technical quality of the product • Allows us to extend and modify our installation as needed • Provides some level of guarantee against vendor lock-in

Slide 57

Slide 57 text

2.2. Why Open • The use of open technologies in the platform was a key metric • Allows us to evaluate the technical quality of the product • Allows us to extend and modify our installation as needed • Provides some level of guarantee against vendor lock-in • Allows us to validate our ideas quickly and in a low-cost manner

Slide 58

Slide 58 text

2.3. The CKAN Platform

Slide 59

Slide 59 text

2.3. The CKAN Platform • Built on top of and runs on open technologies such as Linux, Python, and PostgreSQL

Slide 60

Slide 60 text

2.3. The CKAN Platform • Built on top of and runs on open technologies such as Linux, Python, and PostgreSQL • Extensible via plugins

Slide 61

Slide 61 text

2.3. The CKAN Platform • Built on top of and runs on open technologies such as Linux, Python, and PostgreSQL • Extensible via plugins • Licensed under AGPL v3

Slide 62

Slide 62 text

2.3. The CKAN Platform • Built on top of and runs on open technologies such as Linux, Python, and PostgreSQL • Extensible via plugins • Licensed under AGPL v3 • Built by Open Knowledge Foundation, Germany

Slide 63

Slide 63 text

2.3. The CKAN Platform • Built on top of and runs on open technologies such as Linux, Python, and PostgreSQL • Extensible via plugins • Licensed under AGPL v3 • Built by Open Knowledge Foundation, Germany • Used by many central and local governments, including the European Commission

Slide 64

Slide 64 text

2.3. CKAN in the EU

Slide 65

Slide 65 text

2.3. CKAN in the EU • Austria – http://data.gv.at/

Slide 66

Slide 66 text

2.3. CKAN in the EU • Austria – http://data.gv.at/ • Holland – https://data.overheid.nl/

Slide 67

Slide 67 text

2.3. CKAN in the EU • Austria – http://data.gv.at/ • Holland – https://data.overheid.nl/ • Italy – http://www.dati.gov.it/

Slide 68

Slide 68 text

2.3. CKAN in the EU • Austria – http://data.gv.at/ • Holland – https://data.overheid.nl/ • Italy – http://www.dati.gov.it/ • Romania – http://data.gov.ro/

Slide 69

Slide 69 text

2.3. CKAN in the EU • Austria – http://data.gv.at/ • Holland – https://data.overheid.nl/ • Italy – http://www.dati.gov.it/ • Romania – http://data.gov.ro/ • Slovakia – http://data.gov.sk/

Slide 70

Slide 70 text

2.3. CKAN in the EU • Austria – http://data.gv.at/ • Holland – https://data.overheid.nl/ • Italy – http://www.dati.gov.it/ • Romania – http://data.gov.ro/ • Slovakia – http://data.gov.sk/ • Sweden – http://oppnadata.se/

Slide 71

Slide 71 text

2.3. CKAN in the EU • Austria – http://data.gv.at/ • Holland – https://data.overheid.nl/ • Italy – http://www.dati.gov.it/ • Romania – http://data.gov.ro/ • Slovakia – http://data.gov.sk/ • Sweden – http://oppnadata.se/ • UK – http://data.gov.uk/

Slide 72

Slide 72 text

2.4. Our Experience

Slide 73

Slide 73 text

2.4. Our Experience • Deployment and configuration were not trivial

Slide 74

Slide 74 text

2.4. Our Experience • Deployment and configuration were not trivial • Some plugins (extensions) need to be activated for a sensible feature set, they’re not on by default

Slide 75

Slide 75 text

2.4. Our Experience • Deployment and configuration were not trivial • Some plugins (extensions) need to be activated for a sensible feature set, they’re not on by default • Bulgarian translation was only 50% complete, we fixed that

Slide 76

Slide 76 text

2.4. Our Experience • Deployment and configuration were not trivial • Some plugins (extensions) need to be activated for a sensible feature set, they’re not on by default • Bulgarian translation was only 50% complete, we fixed that • Documentation seems to be good

Slide 77

Slide 77 text

2.4. Our Experience • Deployment and configuration were not trivial • Some plugins (extensions) need to be activated for a sensible feature set, they’re not on by default • Bulgarian translation was only 50% complete, we fixed that • Documentation seems to be good • Will do the job for our purpose, but we still need time to evaluate it more in actual usage

Slide 78

Slide 78 text

3. Project Status

Slide 79

Slide 79 text

No content

Slide 80

Slide 80 text

No content

Slide 81

Slide 81 text

4. Future Work

Slide 82

Slide 82 text

Use CKAN officially

Slide 83

Slide 83 text

Use CKAN officially • CKAN only holds a copy of the data and the data is public

Slide 84

Slide 84 text

Use CKAN officially • CKAN only holds a copy of the data and the data is public • There are practically no security risks in using CKAN officially as a central open data hub

Slide 85

Slide 85 text

Use CKAN officially • CKAN only holds a copy of the data and the data is public • There are practically no security risks in using CKAN officially as a central open data hub • Migration from CKAN to other platforms is possible if needed

Slide 86

Slide 86 text

Use CKAN officially • CKAN only holds a copy of the data and the data is public • There are practically no security risks in using CKAN officially as a central open data hub • Migration from CKAN to other platforms is possible if needed • Thus, no risks to use it officially and encourage data to be published there

Slide 87

Slide 87 text

Questions? Foundation Obshtestvo.bg
 www.obshtestvo.bg [email protected]