try to scraping with linebot

Transcript

1. LINEBOT With Scraping twitter : @gin2_5 Created at 2020/02
2. ࣗݾ঺հ ֶੜʢ̎̍ࡀʣ LINE FUKUOKAʹ ɹɹɹɹɹ௕ظΠϯλʔϯ AI, IoT(ϥζύΠ) ,Java ɹɹɹɹɹɹͲΕ΋಴࠳தɻ ࢿ֨ɿԠ༻৘ใٕज़ऀ
3. ࠷ۙɺ ػցֶशͷֶश ΛαϘͬͯ·͢ɻ ਺ࣜʹർΕ·ͨ͠ɻ ॏճؼͰଉ੾ΕͰ͢ɻ
4. Կ͔ɺଉൈ͖Ͱ ؔ࿈͋Δ͜ͱ͍ͨ͠ͳɻ
5. εΫϨΠϐϯάͬͯ ໘നͦ͏ɻ
6. ҰԠɺεΫϨΠϐϯάʹ͍ͭͯ “ WebεΫϨΠϐϯάͱ͸ɺWebαΠτ͔Β WebϖʔδͷHTMLσʔλΛऩूͯ͠ɺಛ ఆͷσʔλΛநग़ɺ੔ܗ͠௚͢͜ͱͰ͋Δ ” (weblio ༷ΑΓҾ༻)
7. HTML File Python Something (DB,File, and more) Scrape Output About scraping
8. Α͘ɺ͜Μͳ͜ͱ͋Γ·ͤΜ͔ʁ ໘നͦ͏ͳITܥͷΠϕϯτΛݟಀͪ͠Όͬͨɻ ؾ෇͍ͨΒɺఆһ͍ͬͺ͍ɻ ʢओʹ๻Ͱ͢ʣ
9. ࡞Γ·ͨ͠ LINEͰΠϕϯτΛ ௨஌ɾݕࡧͯ͘͠ΕΔౕ
10. heroku ߏ੒ DB LINE API Flask python cron (ఆظతʹಈ͘) python Connpassͷ ެࣜαΠτ (HTMLϑΝΠϧ)
11. ݁ߏ؆୯ʹεΫϨΠϐϯάग़དྷͪΌ͍·ͨ͠ $ pip install beautifulsoup4 from bs4 import BeautifulSoup import requests bash scrape.py Install Import
12. url = ’https:!//something.com' r = requests.get(url) soup = BeautifulSoup(r.content, "html.parser") events_name = soup.select('a.url.summary') events_date = soup.select('p.date') events_year = soup.select('p.year') events_img = soup.select('p.event_thumbnail img') scrape.py
13. ͨͩɺਅ໘໨ͳ࿩ɻ Web APIΛ࢖͍ͬͯΔΘ͚Ͱ͸ͳ͍ͷͰɺ ϖʔδͷߏ੒Λม͑ΒΕͨΒɺऴΘΓ·͢ɻ ࣗવݴޠॲཧͱ͔΋བྷΊͯ΍ͬͯΈ͍ͨͳ
14. ͓͠·͍ɻ ͋Γ͕ͱ͏͍͟͝·ͨ͠ɻ
16. !<- ͜Εɺ શ֯ʮzʴhʯ Ͱೖྗग़དྷ·͢ ͓·͚