Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Web scraping for data scientists

Avatar for Irio Musskopf Irio Musskopf
May 24, 2016
Programming
0
71

Web scraping for data scientists

Avatar for Irio Musskopf

Irio Musskopf

May 24, 2016
Tweet

More Decks by Irio Musskopf

See All by Irio Musskopf
Using Machine Learning and Open Data to Report 216 Brazilian Congresspeople for Corruption
Avatar for Irio Musskopf irio
0
350
Por que functional programming é mais rápido?
Avatar for Irio Musskopf irio
0
66
No país das maravilhas
Avatar for Irio Musskopf irio
0
45
Desenvolvendo o mínimo com Ruby on Rails
Avatar for Irio Musskopf irio
0
130
Implementando pagamentos usando Moip
Avatar for Irio Musskopf irio
0
88
vim 101
Avatar for Irio Musskopf irio
1
220

Other Decks in Programming

See All in Programming
テーブル定義書の構造化抽出して、生成AIでDWH分析を試してみた / devio2025tokyo
Avatar for kasacchiful kasacchiful
0
330
When Dependencies Fail: Building Antifragile Applications in a Fragile World
Avatar for Selçuk Usta selcukusta
0
110
品質ワークショップをやってみた
Avatar for Nealle nealle
0
650
The Past, Present, and Future of Enterprise Java
Avatar for ivargrimstad ivargrimstad
0
590
Reactive Thinking with Signals and the Resource API
Avatar for Manfred Steyer manfredsteyer
PRO
0
120
Introducing RemoteCompose: break your UI out of the app sandbox.
Avatar for Nicolas Roard camaelon
2
120
Node-REDのノードの開発・活用事例とコミュニティとの関わり(Node-RED Con Nagoya 2025)
Avatar for 404background 404background
0
100
kiroとCodexで最高のSpec駆動開発を！！数時間で web3ネイティブなミニゲームを作ってみたよ！
Avatar for Haruki Kondo mashharuki
0
980
AIと人間の共創開発！OSSで試行錯誤した開発スタイル
Avatar for mae616 mae616
2
830
なんでRustの環境構築してないのにRust製のツールが動くの？ / Why Do Rust-Based Tools Run Without a Rust Environment?
Avatar for TOMIKAWA Sotaro ssssota
14
47k
Swift Concurrency 年表クイズ
Avatar for omochimetaru omochi
2
130
Migration to Signals, Resource API, and NgRx Signal Store
Avatar for Manfred Steyer manfredsteyer
PRO
0
130

Featured

See All Featured
The Illustrated Children's Guide to Kubernetes
Avatar for Chris Short chrisshort
51
51k
Build your cross-platform service in a week with App Engine
Avatar for Jose L jlugia
234
18k
Building a Modern Day 
E-commerce SEO Strategy
Avatar for Aleyda Solis aleyda
44
7.9k
jQuery: Nuts, Bolts and Bling
Avatar for Doug Neiner dougneiner
65
7.9k
Reflections from 52 weeks, 52 projects
Avatar for Jefferson Lam jeffersonlam
355
21k
How Fast Is Fast Enough? [PerfNow 2025]
Avatar for Tammy Everts tammyeverts
2
170
Rails Girls Zürich Keynote
Avatar for Gregor Martynus gr2m
95
14k
Templates, Plugins, & Blocks: Oh My! Creating the theme that thinks of everything
Avatar for Michelle Schulp Hunt marktimemedia
31
2.6k
Context Engineering - Making Every Token Count
Avatar for Addy Osmani addyosmani
8
320
Code Reviewing Like a Champion
Avatar for maltzj maltzj
526
40k
Six Lessons from altMBA
Avatar for Skipper Chong Warson skipperchong
29
4k
How STYLIGHT went responsive
Avatar for nonsquared nonsquared
100
5.9k

Transcript

  1. Web scraping Irio Musskopf Data Science Retreat for data scientists

  2. Finding data Not always easy

  3. 1. Downloadable dataset

  4. 2.APIs

  5. 3. Scraping

  6. 4.Talk with other companies

  7. 4.Produce yourself

  8. Doesn’t matter how complex the system is. It is possible.

  9. Doesn’t matter how complex the system is. It is possible.

    Unless there’s a captcha.
  10. None

  11. DEMO

  12. Selectors Limitations User agents Proxies

  13. Irio Musskopf [email protected] Thanks