Upgrade to Pro — share decks privately, control downloads, hide ads and more …

ruby conf tw 2012 build your own web scrapper

Dale Ma
December 08, 2012

ruby conf tw 2012 build your own web scrapper

build your own web scrapper

Dale Ma

December 08, 2012
Tweet

Other Decks in Programming

Transcript

  1. @eguitarz Since making a robot is too difficult, so I

    choose to make a web bot. 12年12月8日星期六
  2. @eguitarz Today I’m talking about how do I build my

    own web scraper in ruby. 12年12月8日星期六
  3. @eguitarz Web scrappers should be able to `grab page` and

    `parse html tags`. 12年12月8日星期六
  4. @eguitarz There’s a problem, links stored in hash by threads.

    But hash in ruby is not thread-safe... 12年12月8日星期六
  5. @eguitarz There’s a easy way... use browser to render the

    html with javascript. 12年12月8日星期六