Slide 1

Slide 1 text

With Twitter API & Tidytext Matt Dancho & David Curry Business Science Learning Lab Text Mining Tweets

Slide 2

Slide 2 text

Learning Lab Structure ● Presentation (20 min) ● Demo’s (30 min) ● Pro-Tips (15 mins)

Slide 3

Slide 3 text

Shiny API Series ● Lab 28 - Shiny Real Estate App ○ Zillow API ● Lab 29 - Shiny Oil & Gas App ○ Quandl API ● Lab 30 - Shiny Finance App ○ Tidyquant API ● Lab 31 - Shiny Marketing App ○ Google Analytics API ● Lab 32 - Shiny Twitter App ○ Twitter API

Slide 4

Slide 4 text

Learning Labs PRO Every 2-Weeks 1-Hour Course Recordings + Code + Slack $19/month university.business-science.io Lab 32 - Shiny API Series, Pt 5 Shiny + Twitter + Tidytext Lab 31 - Shiny API Series, Pt 4 Shiny + Google Analytics + Prophet Lab 30 - Shiny API Series, Pt 3 Shiny + Finance + Excel + R + Tidyquant Lab 29 - Shiny API Series, Pt 2 Shiny + Quandl + ARIMA for Energy Forecasting Lab 28 - Shiny API Series, Pt 1 Shiny + Zillow for Real Estate Lab 27 - Marketing Series, Pt 4 Google Trends Automation with Shiny Lab 26 - Marketing Series, Pt 3 Customer Journey with Machine Learning Lab 25 - Marketing Series, Pt 2 Attribution with ChannelAttribution Continuous Learning Advanced Topics

Slide 5

Slide 5 text

Agenda ● Demo ○ Twitter Hashtag Sentiment Analyzer ● Business Case ○ Uses of Sentiment Analysis ● Twitter API ○ What’s Available? (80/20) ● Text Mining & Sentiment ○ What is it? ○ How do we do it? ● 30-Min Demo ○ Twitter API ○ Sentiment Analysis ○ Shiny Hashtag Analyzer [LL PRO] ● Career Acceleration ○ Shiny capabilities ○ Build your career

Slide 6

Slide 6 text

Bonuses for LL PRO Members Today Bonus #1 - Shiny Hashtag App Bonus #2 - Geocoding for FREE Script $19

Slide 7

Slide 7 text

Business Case Study Brand Intelligence

Slide 8

Slide 8 text

Brand Assessment Ideas spread. What are your customers saying?

Slide 9

Slide 9 text

Positive Sentiment Positive Sentiment Can highlight where people are positively viewing your brand. Keep this up! “Community” “Sustainability ”

Slide 10

Slide 10 text

Negative Sentiment Negative Sentiment Can highlight key issues your customers care about. “Recycling”

Slide 11

Slide 11 text

Twitter Hashtag Tracker Ideas spread. What are your customers saying?

Slide 12

Slide 12 text

Demo

Slide 13

Slide 13 text

Twitter API in R

Slide 14

Slide 14 text

Twitter In 2019, Twitter had 145 Million Daily Active Users Twitter has an open developer API ● Tweet-Level Data ● Screen name ● Tweet Text

Slide 15

Slide 15 text

Twitter Developer API: https://developer.twitter.com/en

Slide 16

Slide 16 text

rtweet: https://rtweet.info/

Slide 17

Slide 17 text

Obtaining Access: https://rtweet.info/articles/auth.html

Slide 18

Slide 18 text

Twitter Data https://rtweet.info/articles/intro.html

Slide 19

Slide 19 text

Text Analysis With Tidytext

Slide 20

Slide 20 text

Tidytext https://www.tidytextmining.com/ Key Points ● 1M downloads (super popular) ● Easy to use ● Integrates tools for tokenizing & sentiment analysis ● Works in tidyverse My experience I’m not an expert in text. But I feel like one now. Key Point: Simple & Good.

Slide 21

Slide 21 text

How Tidytext Works Tokenizing Tweet Data

Slide 22

Slide 22 text

Sentiment Analysis Bing Dictionary Afinn Dictionary Assign words values (sentiment or polarity)

Slide 23

Slide 23 text

Sentiment Analysis

Slide 24

Slide 24 text

Workflow From zero to Twitter Sentiment Automation

Slide 25

Slide 25 text

Workflow Step-By-Step Start Finish 1 2 3 Twitter API Connect to Twitter Preprocess & Visualize Data Tidytext Tokenize data Apply Sentiment Analysis Shiny App that automates the Brand Sentiment Analysis

Slide 26

Slide 26 text

Shiny is Critical to Production! Leaflet Map to show search radius Plotly Polarity Viz for isolating tweets Word Cloud to Summarize Polarity

Slide 27

Slide 27 text

30-Min Demo Tidy Text + Twitter + Shiny

Slide 28

Slide 28 text

No content

Slide 29

Slide 29 text

Career Acceleration And how Shiny Apps help

Slide 30

Slide 30 text

Shiny is Critical to Production! Leaflet Map to show search radius Plotly Polarity Viz for isolating tweets Word Cloud to Summarize Data

Slide 31

Slide 31 text

Career Tip #1: Give Businesses Apps Apps are what businesses need Businesses can’t scale reports Businesses have cloud & servers (AWS / Azure) Businesses need your analysis in the right form You can solve these problems with shiny apps Apps solve these challenges

Slide 32

Slide 32 text

Career Tip #2: Say no to reports No

Slide 33

Slide 33 text

Career Tip #3: Say YES to apps. Yes apps.business-science.io

Slide 34

Slide 34 text

Advanced Visualization Advanced Data Wrangling Advanced Functional Programming & Modeling Advanced Machine Learning Visualization Data Cleaning & Manipulation Data Science Algorithms & Iteration Business Reporting Business Analysis with R (DS4B 101-R) Data Science For Business with R (DS4B 201-R) Web Apps & Shiny Developer (DS4B 102-R + DS4B 202A-R) Web Apps Data Science Foundations 7 Weeks Machine Learning & Business Consulting 10 Weeks Web Application Development 12 Weeks -TRACK Project-Based Courses with Business Application Business Science University R-Track 4-Course R-Track System

Slide 35

Slide 35 text

Key Benefits - Fundamentals - Weeks 1-5 (25 hours of Video Lessons) - Data Manipulation (dplyr) - Time series (lubridate) - Text (stringr) - Categorical (forcats) - Visualization (ggplot2) - Programming & Iteration (purrr) - 3 Challenges - Machine Learning - Week 6 (8 hours of Video Lessons) - Clustering (3 hours) - Regression (5 hours) - 2 Challenges - Learn Business Reporting - Week 7 - RMarkdown & plotly - 2 Project Reports: 1. Product Pricing Algo 2. Customer Segmentation Visualization Data Cleaning & Manipulation Business Reporting Business Analysis with R (DS4B 101-R) Data Science Foundations 7 Weeks Data Science Algorithms & Iteration

Slide 36

Slide 36 text

Key Benefits Understanding the Problem & Preparing Data - Weeks 1-4 - Project Setup & Framework - Business Understanding / Sizing Problem - Tidy Evaluation - rlang - EDA - Exploring Data -GGally, skimr - Data Preparation - recipes - Correlation Analysis - 3 Challenges Machine Learning - Weeks 5, 6, 7 - H2O AutoML - Modeling Churn - ML Performance - LIME Feature Explanation Return-On-Investment - Weeks 7, 8, 9 - Expected Value Framework - Threshold Optimization - Sensitivity Analysis - Recommendation Algorithm Data Science For Business (DS4B 201-R) Machine Learning & Business Consulting 10 Weeks Advanced Visualization Advanced Data Wrangling Advanced Functional Programming & Modeling Advanced Data Science End-to-End Churn Project

Slide 37

Slide 37 text

Key Benefits Learn Shiny & Flexdashboard - Build Applications - Learn Reactive Programming - Integrate Machine Learning App #1: Predictive Pricing App - Model Product Portfolio - XGBoost Pricing Prediction - Generate new products instantly App #2: Sales Dashboard with Demand Forecasting - Model Demand History - Segment Forecasts by Product & Customer - XGBoost Time Series Forecast - Generate new forecasts instantly Shiny Apps for Business (DS4B 102-R) Web Application Development 4 Weeks Web Apps Machine Learning

Slide 38

Slide 38 text

Key Benefits Frontend + Backend + Production Deployment Frontend for Shiny - Bootstrap Backend for Shiny - MongoDB Atlas Cloud - Dynamic UI - User Authentication & Security Production Deployment - AWS - EC2 Server - SSL & HTTPS Encryption Shiny Apps for Business (DS4B 202A-R) Web Application Development 6 Weeks

Slide 39

Slide 39 text

-TRACK BUNDLE 15% OFF PROMO Code: learninglabs $127/mo Limited Time

Slide 40

Slide 40 text

Career acceleration awaits university.business-science.io