Sentiment Analysis

Talk given in Portland October 21, 2013

Transcript

1. Sentiment Analysis Matthew Kirk - Modulus 7 Monday, October 21, 13
2. The Challenge Monday, October 21, 13
3. Big Data Languages Java Python R Julia Clojure Monday, October 21, 13
4. Ruby has tools too Monday, October 21, 13
5. Monday, October 21, 13
6. Ruby is not Complex Math Monday, October 21, 13
7. A Solution • Listen To Speeches • Watch Others • Read Books and Materials Monday, October 21, 13
8. Sentiment Monday, October 21, 13
9. The Goal is to Classify Data Monday, October 21, 13
10. Monday, October 21, 13
11. Machine Learning Monday, October 21, 13
12. Step 1: Collect Data • https://github.com/jperla/sentiment-data • Finance • Harvard Negative Words • Hu Liu Words (Positive / Negative) • Pang Lee Movie Reviews Monday, October 21, 13
13. Now What? Monday, October 21, 13
14. Chess Monday, October 21, 13
15. The Features of a Chess Piece • Color • Location on Board • Type (Rook, Queen, Pawn...) • Material • Length • Width • Temperature Monday, October 21, 13
16. Linear Regression Monday, October 21, 13
17. Support Vector Machines Monday, October 21, 13
18. That’s It! Monday, October 21, 13
19. Oh right Sentiment Analysis Monday, October 21, 13
20. Features of Text Monday, October 21, 13
21. We will use words only Monday, October 21, 13
22. Monday, October 21, 13
23. Linear Regression has a Curse Monday, October 21, 13
24. Support Vector Machines • Using the example of linear support vector machines (our chess example) we’d end up with a similar response to the clustering Monday, October 21, 13
25. But there’s a trick (The Kernel Trick) Monday, October 21, 13
26. Parameter C • Find through Cross Validation • Try all C’s from 2^-15 to 2^15 accepting the lowest error. Monday, October 21, 13
27. Demonstration Play with the tool at sentiment-analyzer.heroku.com Monday, October 21, 13
28. Testing Monday, October 21, 13
29. Conclusion This is just the beginning Go learn more become more adept at data analysis Monday, October 21, 13
30. QR CODE! Monday, October 21, 13
31. modulus7.com/svm-talk @mjkirk Monday, October 21, 13
32. http://en.wikipedia.org/wiki/File:Kernel_Machine.png http://rickmanelius.com/article/do-you-dread-emails Comedy Central http://en.wikipedia.org/wiki/File:Chess_board_opening_staunton.jpg Star Trek Photo Credits Monday, October 21, 13