Grano: A Python tool for investigating influence

Slide 1

Slide 1 text

PYTHON TOOLS FOR Investigating Influence

Slide 2

Slide 2 text

No content

Slide 3

Slide 3 text

BACKBONE SERVICES for JOURNALISTS and ACTIVISTS Open AFRICA SOURCE AFRICA AFRI LEAKS AFRICAN SPENDING CONNECTED AFRICA

Slide 4

Slide 4 text

INVESTIGATIVE JOURNALISTS

Slide 5

Slide 5 text

WHAT DO THEY DO? HOW DO THEY DO IT?

Slide 6

Slide 6 text

INVESTIGATIVE ACTIVITIES MINE DOCS AND DATA MAP OUT NETWORKS CONSTRAINTS LEGALLY ACTIONABLE PROTECT SOURCES

Slide 7

Slide 7 text

BIOS/FAMILY COMPANY DIRECTORS NGO DIRECTORS COURT CASES PARTY MEMBERSHIP COMMITTEES FINANCIAL INTERESTS GOV CONTRACTS STRUCTURAL TRANSACTIONAL

Slide 8

Slide 8 text

JOURNALISTIC QUERIES PERSON COMPANY PUBLIC BODY PERSON

Slide 9

Slide 9 text

INFLUENCE MAPPING

Slide 10

Slide 10 text

HTTP://GRANOPROJECT.oRG

Slide 11

Slide 11 text

Network analysis tool Integrate messy data Full provenance REQUIREMENTS

Slide 12

Slide 12 text

BACKENDS

Slide 13

Slide 13 text

DETOUR: LINKED DATA https://github.com/uf6/design/issues

Slide 14

Slide 14 text

SQL: STILL PRETTY AWESOME

Slide 15

Slide 15 text

DATA MODEL I’LL BUY A COPY OF OMNIGRAfFLE SOON. PROMISE.

Slide 16

Slide 16 text

DATA LOADING SCRAPERS CSV FILES SCRAPERS GRANO LOADER GRANO API PROFIT! GOOGLE DOCS YAML MAPPINGS ALIAS MAPPINGS REFINE SCHEMA

Slide 17

Slide 17 text

DATA LOADING SCRAPERS CSV FILES SCRAPERS GRANO LOADER GRANO API PROFIT! GOOGLE DOCS YAML MAPPINGS ALIAS MAPPINGS REFINE SCHEMA

Slide 18

Slide 18 text

DE-DUPE IS HELL

Slide 19

Slide 19 text

EXTERNAL INTERFACES (FROZEN) FLASK REST API CLIENTS

Slide 20

Slide 20 text

ANALYTICAL INTERFACES FIND STORIES MANAGE EVIDENCE

Slide 21

Slide 21 text

QUERY LANGUAGE GRANO QL = STUPID MQL MQL (FREEBASE/GOOGLE) - QUERY BY JSON EXAMPLE CYPHER (NEO4J) - SQL FOR GRAPHS SPARQL (RDF/LINKED DATA) - SQL FOR LINKED DATA

Slide 22

Slide 22 text

QUERY TOOL (WIP!) ANGULAR.JS D3 + DUCT TAPE

Slide 23

Slide 23 text

Great query tool FEDERATED Data enrichment “Soup (docs) to sense (relations)” Roll out to other countries THE FUTURE

Slide 24

Slide 24 text

THANKS friedrich@pudo.org http://granoproject.org LOOKING FOR FRONT-END JS DEVS!