Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Sign up for free
Menu
Search
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Pricing
Search
Sign in
Sign up for free
Data doesn't grow in tables
Search
Friedrich Lindenberg
July 16, 2014
Technology
310
2
Share
Embed
Copy iframe code
Copy JS code
Copy link
Start on current slide
Data doesn't grow in tables
Friedrich Lindenberg
July 16, 2014
Transcript
19 slides
Data doesn’t grow in tables Dealing with large sets of
documents
–An investigative reporter “We're working with 40 GB of XXX
and would like to search within the documents for certain keywords (like XXX) so we can identify XXX. Ideally we should be able to tag the docs..”
Some lingo • OCR (Optical Character Recognition) • NLP (Natural
Language Processing) • NER (Named Entity Recognition) • Regular Expressions
Cases
Exhibit A
Exhibit B
Exhibit C
Exhibit D
Tools
Tables in disguise http://tabula.nerdpower.org
Docs in a cloud http://documentcloud.org
Clustering, tagging, mining http://overview.ap.org
Let them eat PDF https://github.com/CrowData
All the visuals Jigsaw
Spoken word magic http://sayit.mysociety.org/
Whats missing? Easy-to-use ElasticSearch Commercial-grade OCR Configurable pipelines
Stefan Wehrmeyer, correctiv.org, @stefanwehrmeyer ! ! ! ! ! !
! Friedrich Lindenberg, codeforafrica.org, @pudo
None
None
More Decks by Friedrich Lindenberg
See All by Friedrich Lindenberg
Introducción a OCCRP Data
pudo
0
470
Getting started with OCCRP Data
pudo
0
1.8k
#nr16: Recherche-Tools
pudo
1
150
data.occrp.org
pudo
0
190
Tools for Data Journalism | MediaLab Prado DDJ Workshop
pudo
0
270
Digitial Research Tools for Investigative Reporters
pudo
0
11k
Grano: A Python tool for investigating influence
pudo
1
330
Dr. Freezefile
pudo
2
490
Intro presentation for Naivasha
pudo
1
210
Other Decks in Technology
See All in Technology
Datadog の権限統制 〜Org 統合に向けて調べた注意点 / JDDUG-Meetup_24
visional_engineering_and_design
1
110
Agent Harnessはどう作る?事例から学ぶAI Agentの設計思想
sergicalsix
0
290
自治体AIコンタクトセンター、何をどこに任せる?~Amazon Connect Customer +Amazon Bedrockの実践知~ / 20261107 Satoshi Torano
shift_evolve
PRO
1
140
BALLAS Technology Deck
ballas_inc
0
590
セキュリティ専任チームなしで攻撃を先回りするSREが実践したSIEM on Amazon OpenSearch Service
cscengineer
PRO
1
860
AIが会計業務の伴走者に。 マネーフォワード クラウド会計MCPサーバーで実現するAI前提の新しい業務プロセス
nobitabashi
0
120
AWS Emulator を評価する: 手元で動く AWS の API の仕組み、始め方、確かめ方
inariku
PRO
1
180
AI時代に求められる優秀なTechLeadの振る舞い
pospome
11
16k
大江戸Ruby会議でデータベース クライアントの話をするのは 間違っているだろうか
yahonda
1
120
Active Directory と Entra ID のむむむな関係
murachiakira
PRO
4
1.8k
Quick Automate | 目指せ Quick マスター 12
inariku
PRO
1
110
田んぼの見回りをIoTで減らしたい!水位監視から電池駆動カメラまでの試行錯誤
itosoft
1
160
Featured
See All Featured
Mobile First: as difficult as doing things right
swwweet
225
10k
Conquering PDFs: document understanding beyond plain text
inesmontani
PRO
4
3.3k
Reflections from 52 weeks, 52 projects
jeffersonlam
356
22k
The AI Search Optimization Roadmap by Aleyda Solis
aleyda
2
6.4k
Marketing Yourself as an Engineer | Alaka | Gurzu
gurzu
0
370
Product Roadmaps are Hard
iamctodd
55
13k
RailsConf 2023
tenderlove
30
1.6k
Everyday Curiosity
cassininazir
0
400
BBQ
matthewcrist
90
10k
[RailsConf 2023] Rails as a piece of cake
palkan
59
7.1k
Lightning Talk: Beautiful Slides for Beginners
inesmontani
PRO
2
790
The Cult of Friendly URLs
andyhume
79
7.1k