try to scraping with linebot

Transcript

1. LINEBOT With Scraping twitter : @gin2_5 Created at 2020/02

2. ࣗݾ঺հ ֶੜʢ̎̍ࡀʣ LINE FUKUOKAʹ ɹɹɹɹɹ௕ظΠϯλʔϯ AI, IoT(ϥζύΠ) ,Java ɹɹɹɹɹɹͲΕ΋಴࠳தɻ ࢿ֨ɿԠ༻৘ใٕज़ऀ

3. ࠷ۙɺ ػցֶशͷֶश ΛαϘͬͯ·͢ɻ ਺ࣜʹർΕ·ͨ͠ɻ ॏճؼͰଉ੾ΕͰ͢ɻ

4. Կ͔ɺଉൈ͖Ͱ ؔ࿈͋Δ͜ͱ͍ͨ͠ͳɻ

5. εΫϨΠϐϯάͬͯ ໘നͦ͏ɻ

6. ҰԠɺεΫϨΠϐϯάʹ͍ͭͯ “ WebεΫϨΠϐϯάͱ͸ɺWebαΠτ͔Β WebϖʔδͷHTMLσʔλΛऩूͯ͠ɺಛ ఆͷσʔλΛநग़ɺ੔ܗ͠௚͢͜ͱͰ͋Δ ” (weblio ༷ΑΓҾ༻)

7. HTML File Python Something (DB,File, and more) Scrape Output About

   scraping

8. Α͘ɺ͜Μͳ͜ͱ͋Γ·ͤΜ͔ʁ ໘നͦ͏ͳITܥͷΠϕϯτΛݟಀͪ͠Όͬͨɻ ؾ෇͍ͨΒɺఆһ͍ͬͺ͍ɻ ʢओʹ๻Ͱ͢ʣ

9. ࡞Γ·ͨ͠ LINEͰΠϕϯτΛ ௨஌ɾݕࡧͯ͘͠ΕΔౕ

10. heroku ߏ੒ DB LINE API Flask python cron (ఆظతʹಈ͘) python

    Connpassͷ ެࣜαΠτ (HTMLϑΝΠϧ)

11. ݁ߏ؆୯ʹεΫϨΠϐϯάग़དྷͪΌ͍·ͨ͠ $ pip install beautifulsoup4 from bs4 import BeautifulSoup import

    requests bash scrape.py Install Import

12. url = ’https:!//something.com' r = requests.get(url) soup = BeautifulSoup(r.content, "html.parser")

    events_name = soup.select('a.url.summary') events_date = soup.select('p.date') events_year = soup.select('p.year') events_img = soup.select('p.event_thumbnail img') scrape.py

13. ͨͩɺਅ໘໨ͳ࿩ɻ Web APIΛ࢖͍ͬͯΔΘ͚Ͱ͸ͳ͍ͷͰɺ ϖʔδͷߏ੒Λม͑ΒΕͨΒɺऴΘΓ·͢ɻ ࣗવݴޠॲཧͱ͔΋བྷΊͯ΍ͬͯΈ͍ͨͳ

14. ͓͠·͍ɻ ͋Γ͕ͱ͏͍͟͝·ͨ͠ɻ

15. None

16. !<- ͜Εɺ શ֯ʮzʴhʯ Ͱೖྗग़དྷ·͢ ͓·͚