Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Web scraping for data scientists

Avatar for Irio Musskopf Irio Musskopf
May 24, 2016
Programming
0
85

Web scraping for data scientists

Avatar for Irio Musskopf

Irio Musskopf

May 24, 2016
Tweet

More Decks by Irio Musskopf

See All by Irio Musskopf
Using Machine Learning and Open Data to Report 216 Brazilian Congresspeople for Corruption
Avatar for Irio Musskopf irio
0
360
Por que functional programming é mais rápido?
Avatar for Irio Musskopf irio
0
73
No país das maravilhas
Avatar for Irio Musskopf irio
0
54
Desenvolvendo o mínimo com Ruby on Rails
Avatar for Irio Musskopf irio
0
140
Implementando pagamentos usando Moip
Avatar for Irio Musskopf irio
0
94
vim 101
Avatar for Irio Musskopf irio
1
220

Other Decks in Programming

See All in Programming
Feature Toggle は捨てやすく使おう
Avatar for gennei gennei
0
380
おれのAgentic Coding 2026/03
Avatar for TsukasaSekiguchi tsukasagr
1
120
Java 21/25 Virtual Threads 소개
Avatar for Sunghyouk Bae (Debop) debop
0
300
20260315 AWSなんもわからん🥲
Avatar for Chiaki Okamoto chiilog
2
180
Claude Codeログ基盤の構築
Avatar for giginet giginet
PRO
7
3.7k
脱 雰囲気実装！ AgentCoreを良い感じに WEBアプリケーションに組み込むために
Avatar for Takuya Yonezawa takuyay0ne
3
410
2026-03-27 #terminalnight 変数展開とコマンド展開でターミナル作業をスマートにする方法
Avatar for SUZUKI Masashi masasuzu
0
240
L’IA au service des devs : Anatomie d'un assistant de Code Review
Avatar for Thomas Boileau toham
0
100
PHPのバージョンアップ時にも役立ったAST（2026年版）
Avatar for Atsushi Matsuo matsuo_atsushi
0
270
条件判定に名前、つけてますか？ #phperkaigi #c
Avatar for Hiromi Hishida 77web
2
860
AI時代のシステム設計：ドメインモデルで変更しやすさを守る設計戦略
Avatar for 増田 亨 masuda220
PRO
6
1.1k
実践ハーネスエンジニアリング #MOSHTech
Avatar for Takuma Kajikawa kajitack
7
4.8k

Featured

See All Featured
Imperfection Machines: The Place of Print at Facebook
Avatar for Scott Boms scottboms
269
14k
Producing Creativity
Avatar for Steve Smith orderedlist
PRO
348
40k
Testing 201, or: Great Expectations
Avatar for Joseph Mastey jmmastey
46
8.1k
Designing Dashboards & Data Visualisations in Web Apps
Avatar for Des Traynor destraynor
231
54k
Helping Users Find Their Own Way: Creating Modern Search Experiences
Avatar for Dan Newman danielanewman
31
3.1k
Building Flexible Design Systems
Avatar for Yesenia Perez-Cruz yeseniaperezcruz
330
40k
Build your cross-platform service in a week with App Engine
Avatar for Jose L jlugia
234
18k
Refactoring Trust on Your Teams (GOTO; Chicago 2020)
Avatar for Rebecca Miller-Webster rmw
35
3.4k
Color Theory Basics | Prateek | Gurzu
Avatar for Gurzu gurzu
0
270
How to Create Impact in a Changing Tech Landscape [PerfNow 2023]
Avatar for Tammy Everts tammyeverts
55
3.3k
世界の人気アプリ100個を分析して見えたペイウォール設計の心得
Avatar for Akihiro Kokubo akihiro_kokubo
PRO
68
38k
Principles of Awesome APIs and How to Build Them.
Avatar for Keavy McMinn keavy
128
17k

Transcript

  1. Web scraping Irio Musskopf Data Science Retreat for data scientists

  2. Finding data Not always easy

  3. 1. Downloadable dataset

  4. 2.APIs

  5. 3. Scraping

  6. 4.Talk with other companies

  7. 4.Produce yourself

  8. Doesn’t matter how complex the system is. It is possible.

  9. Doesn’t matter how complex the system is. It is possible.

    Unless there’s a captcha.
  10. None

  11. DEMO

  12. Selectors Limitations User agents Proxies

  13. Irio Musskopf [email protected] Thanks