Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Web scraping for data scientists

Sponsored · Your Podcast. Everywhere. Effortlessly. Share. Educate. Inspire. Entertain. You do you. We'll handle the rest. →
Avatar for Irio Musskopf Irio Musskopf
May 24, 2016
Programming
90
0

Web scraping for data scientists

Avatar for Irio Musskopf

Irio Musskopf

May 24, 2016

More Decks by Irio Musskopf

See All by Irio Musskopf
Using Machine Learning and Open Data to Report 216 Brazilian Congresspeople for Corruption
Avatar for Irio Musskopf irio
0
390
Por que functional programming é mais rápido?
Avatar for Irio Musskopf irio
0
80
No país das maravilhas
Avatar for Irio Musskopf irio
0
60
Desenvolvendo o mínimo com Ruby on Rails
Avatar for Irio Musskopf irio
0
140
Implementando pagamentos usando Moip
Avatar for Irio Musskopf irio
0
95
vim 101
Avatar for Irio Musskopf irio
1
230

Other Decks in Programming

See All in Programming
act1-costs.pdf
Avatar for Sumedh Bala sumedhbala
0
170
OSINT for SRE: 
学術論文とポストモーテムから探る
システム障害の共通パターン / SRE NEXT 2026
Avatar for Tomoyuki KOYAMA tomoyk
1
2.5k
なぜ型を書くのか？ TSKaigi2026で改めて考える #tskaigi_smarthr
Avatar for Takuma Kajikawa kajitack
0
210
Observability in Practice：Grafana 與 Edge Device SRE 的那些事
Avatar for Blueswen blueswen
0
190
コーディングルールの鮮度を保ちたい for SRE NEXT 2026 / keep-fresh-go-internal-conventions-sre-next-2026
Avatar for NAGATA Hiroaki handlename
0
120
これからAgentCoreを触る方へ トレンドはGatewayです
Avatar for Har1101 har1101
6
480
過去最大のMCPアップデート! 2026-07-28 RC版の謎に迫る
Avatar for matsukada licux
6
460
技術記事、 専門家としてのプログラマ、 言語化
Avatar for Koutarou Chikuba mizchi
14
7.3k
SREは、MCPとSRE Agentをこう使え！
Avatar for kazumax55 kazumax55
0
150
気圧・高度・GPSを記録&可視化するアプリ「Koudo」を作った話
Avatar for Hajime Kato hjmkth
1
350
ランチタイムLT会3周年！ランチタイムLT会を3年間続けられたお話
Avatar for y-ohgi y0hgi
1
130
Semantic Version 単位で戦略を柔軟に変えて、パッケージアップデートを自動化する
Avatar for daitasu daitasu
1
340

Featured

See All Featured
Everyday Curiosity
Avatar for Cassini Nazir cassininazir
0
250
技術選定の審美眼（2025年版） / Understanding the Spiral of Technologies 2025 edition
Avatar for Takuto Wada twada
PRO
118
120k
Color Theory Basics | Prateek | Gurzu
Avatar for Gurzu gurzu
0
380
Max Prin - Stacking Signals: How International SEO Comes Together (And Falls Apart)
Avatar for Tech SEO Connect techseoconnect
PRO
0
200
Leveraging Curiosity to Care for An Aging Population
Avatar for Cassini Nazir cassininazir
1
310
What Being in a Rock Band Can Teach Us About Real World SEO
Avatar for Ade Holder 427marketing
0
1k
Intergalactic Javascript Robots from Outer Space
Avatar for Vicent Martí tanoku
273
27k
Digital Projects Gone Horribly Wrong (And the UX Pros Who Still Save the Day) - Dean Schuster
Avatar for UX Y'all uxyall
1
1.9k
Gemini Prompt Engineering: Practical Techniques for Tangible AI Outcomes
Avatar for Mfonobong Umondia mfonobong
2
460
The Spectacular Lies of Maps
Avatar for Per Axbom axbom
PRO
1
850
Paper Plane
Avatar for Katie Cordina Lindsey katiecoart
PRO
1
52k
Responsive Adventures: Dirty Tricks From The Dark Corners of Front-End
Avatar for Vitaly Friedman smashingmag
254
22k

Transcript

  1. Web scraping Irio Musskopf Data Science Retreat for data scientists

  2. Finding data Not always easy

  3. 1. Downloadable dataset

  4. 2.APIs

  5. 3. Scraping

  6. 4.Talk with other companies

  7. 4.Produce yourself

  8. Doesn’t matter how complex the system is. It is possible.

  9. Doesn’t matter how complex the system is. It is possible.

    Unless there’s a captcha.
  10. None

  11. DEMO

  12. Selectors Limitations User agents Proxies

  13. Irio Musskopf [email protected] Thanks