try to scraping with linebot

D0d4d4296722d99a43dfdc1f9438d7a2?s=47 Gin
February 13, 2020

try to scraping with linebot

D0d4d4296722d99a43dfdc1f9438d7a2?s=128

Gin

February 13, 2020
Tweet

Transcript

  1. LINEBOT With Scraping twitter : @gin2_5 Created at 2020/02

  2. ࣗݾ঺հ ֶੜʢ̎̍ࡀʣ LINE FUKUOKAʹ ɹɹɹɹɹ௕ظΠϯλʔϯ AI, IoT(ϥζύΠ) ,Java ɹɹɹɹɹɹͲΕ΋಴࠳தɻ ࢿ֨ɿԠ༻৘ใٕज़ऀ

  3. ࠷ۙɺ ػցֶशͷֶश ΛαϘͬͯ·͢ɻ ਺ࣜʹർΕ·ͨ͠ɻ ॏճؼͰଉ੾ΕͰ͢ɻ

  4. Կ͔ɺଉൈ͖Ͱ ؔ࿈͋Δ͜ͱ͍ͨ͠ͳɻ

  5. εΫϨΠϐϯάͬͯ ໘നͦ͏ɻ

  6. ҰԠɺεΫϨΠϐϯάʹ͍ͭͯ “ WebεΫϨΠϐϯάͱ͸ɺWebαΠτ͔Β WebϖʔδͷHTMLσʔλΛऩूͯ͠ɺಛ ఆͷσʔλΛநग़ɺ੔ܗ͠௚͢͜ͱͰ͋Δ ” (weblio ༷ΑΓҾ༻)

  7. HTML File Python Something (DB,File, and more) Scrape Output About

    scraping
  8. Α͘ɺ͜Μͳ͜ͱ͋Γ·ͤΜ͔ʁ ໘നͦ͏ͳITܥͷΠϕϯτΛݟಀͪ͠Όͬͨɻ ؾ෇͍ͨΒɺఆһ͍ͬͺ͍ɻ ʢओʹ๻Ͱ͢ʣ

  9. ࡞Γ·ͨ͠ LINEͰΠϕϯτΛ ௨஌ɾݕࡧͯ͘͠ΕΔౕ

  10. heroku ߏ੒ DB LINE API Flask python cron (ఆظతʹಈ͘) python

    Connpassͷ ެࣜαΠτ (HTMLϑΝΠϧ)
  11. ݁ߏ؆୯ʹεΫϨΠϐϯάग़དྷͪΌ͍·ͨ͠ $ pip install beautifulsoup4 from bs4 import BeautifulSoup import

    requests bash scrape.py Install Import
  12. url = ’https:!//something.com' r = requests.get(url) soup = BeautifulSoup(r.content, "html.parser")

    events_name = soup.select('a.url.summary') events_date = soup.select('p.date') events_year = soup.select('p.year') events_img = soup.select('p.event_thumbnail img') scrape.py
  13. ͨͩɺਅ໘໨ͳ࿩ɻ Web APIΛ࢖͍ͬͯΔΘ͚Ͱ͸ͳ͍ͷͰɺ ϖʔδͷߏ੒Λม͑ΒΕͨΒɺऴΘΓ·͢ɻ ࣗવݴޠॲཧͱ͔΋བྷΊͯ΍ͬͯΈ͍ͨͳ

  14. ͓͠·͍ɻ ͋Γ͕ͱ͏͍͟͝·ͨ͠ɻ

  15. None
  16. !<- ͜Εɺ શ֯ʮzʴhʯ Ͱೖྗग़དྷ·͢ ͓·͚