Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Web scraping for data scientists

Avatar for Irio Musskopf Irio Musskopf
May 24, 2016
Programming
90
0

Web scraping for data scientists

Avatar for Irio Musskopf

Irio Musskopf

May 24, 2016

More Decks by Irio Musskopf

See All by Irio Musskopf
Using Machine Learning and Open Data to Report 216 Brazilian Congresspeople for Corruption
Avatar for Irio Musskopf irio
0
390
Por que functional programming é mais rápido?
Avatar for Irio Musskopf irio
0
78
No país das maravilhas
Avatar for Irio Musskopf irio
0
60
Desenvolvendo o mínimo com Ruby on Rails
Avatar for Irio Musskopf irio
0
140
Implementando pagamentos usando Moip
Avatar for Irio Musskopf irio
0
94
vim 101
Avatar for Irio Musskopf irio
1
230

Other Decks in Programming

See All in Programming
The NotImplementedError Problem in Ruby
Avatar for Koichi ITO koic
1
760
Inside Stream API
Avatar for Yuichi.Sakuraba skrb
1
700
Spec Driven Development | AI Summit Lisbon
Avatar for Daniel Sogl danielsogl
PRO
0
190
「エンジニアインターン、どうやって取った？」準備のリアルを語るLT会 Progate BAR
Avatar for akio akiomatic
0
130
TSKaigi Night Talks 2026_TypeScriptでサプライチェーンの整合性を型に閉じ込める
Avatar for ギークプラス ソフトウェア事業部 geekplus_tech
0
340
TAKTでAI駆動開発の品質を設計する
Avatar for かとじゅん j5ik2o
6
1.2k
生成AI時代にこそ効くGo | Why Go Works in the Age of Generative AI
Avatar for mom0tomo mom0tomo
8
3.2k
Hunting Vulnerabilities in Symfony with LLMs
Avatar for Vincent Amstoutz vinceamstoutz
0
540
Mujeres en SEO Summit 2026 - Greatest Disaster Hits en Web Performance
Avatar for Estela Franco guaca
0
170
DynamoDBには集計系のクエリがないけどなんとかしたい
Avatar for 村上優稀 musan
1
140
Technical Debt: Understanding it Rightly, Engaging it Rightly #LaravelLiveJP
Avatar for shogogg shogogg
0
220
Vite+ Unified Toolchain for the Web
Avatar for Naoki Haba naokihaba
0
300

Featured

See All Featured
4 Signs Your Business is Dying
Avatar for Josh Pigford shpigford
187
22k
Are puppies a ranking factor?
Avatar for Jono Alderson jonoalderson
1
3.5k
Money Talks: Using Revenue to Get Sh*t Done
Avatar for Nikki Halliwell nikkihalliwell
0
250
From π to Pie charts
Avatar for Rasagy Sharma rasagy
0
210
エンジニアに許された特別な時間の終わり
Avatar for watany watany
107
250k
Into the Great Unknown - MozCon
Avatar for Noah Learner thekraken
41
2.6k
Designing Dashboards & Data Visualisations in Web Apps
Avatar for Des Traynor destraynor
231
55k
Technical Leadership for Architectural Decision Making
Avatar for Kenny Baas-Schwegler baasie
3
410
The browser strikes back
Avatar for Jono Alderson jonoalderson
0
1.2k
How to train your dragon (web standard)
Avatar for Monica Dinculescu notwaldorf
97
6.7k
Applied NLP in the Age of Generative AI
Avatar for Ines Montani inesmontani
PRO
4
2.3k
How Fast Is Fast Enough? [PerfNow 2025]
Avatar for Tammy Everts tammyeverts
3
610

Transcript

  1. Web scraping Irio Musskopf Data Science Retreat for data scientists

  2. Finding data Not always easy

  3. 1. Downloadable dataset

  4. 2.APIs

  5. 3. Scraping

  6. 4.Talk with other companies

  7. 4.Produce yourself

  8. Doesn’t matter how complex the system is. It is possible.

  9. Doesn’t matter how complex the system is. It is possible.

    Unless there’s a captcha.
  10. None

  11. DEMO

  12. Selectors Limitations User agents Proxies

  13. Irio Musskopf [email protected] Thanks