People who like cheese also like crackers: a learning hour on recommender systems

A systems-level introduction to recommender systems, put together for a Future Learn internal Learning Hour.

Transcript

1. People who like cheese also like crackers: a learning hour on recommender systems BEN FIELDS | 2 DECEMBER 2016 | !ALSOTHINGS
2. Intro Framework Innards Accuracy Workshopping
3. SECTION 1: Intro
4. imon Nelson INTRO what is a recommender system? What should I listen to next?
5. http://www.flickr.com/photos/bookgrl/423259086/
8. imon Nelson INTRO what is a recommender system? What to drink next?
9. http://www.flickr.com/photos/avcellshots/4381124026/
10. imon Nelson INTRO what is a recommender system? So, what is a recommender system?
14. imon Nelson INTRO what is a recommender system? prediction of opinions about things
15. imon Nelson INTRO what is a recommender system? rating item
16. imon Nelson INTRO what is a recommender system? rating movie
18. imon Nelson INTRO what is a recommender system? prediction of opinions about things
19. imon Nelson INTRO what is a recommender system? prediction of actions on things
20. imon Nelson INTRO what is a recommender system? rating movie
21. imon Nelson INTRO what is a recommender system? listen song
24. imon Nelson INTRO what is a recommender system? So, what is a recommender system?
25. imon Nelson INTRO what is a recommender system? recommender system (NP): a methodology of predicting the preferences users will have for items, across a corpus of items and a collection of users
26. SECTION 2: Framework
27. imon Nelson FRAMEWORK system considerations relevance novelty/serendipity transparency/trust reach context
28. imon Nelson FRAMEWORK relevance
29. imon Nelson FRAMEWORK novelty/serendipity
30. imon Nelson FRAMEWORK novelty/serendipity Popularity Bias - The Harry Potter Effect recsys 2011 | music recommendation and discovery tutorial | paul lamere & oscar celma Popularity Bias - The Harry Potter Effect recsys 2011 | music recommendation and discovery tutorial | paul lamere & oscar celma
31. imon Nelson FRAMEWORK novelty/serendipity T he E n em y
32. imon Nelson FRAMEWORK transparency/trust - explanation If you like Norah Jones you might like Ravi Shankar
33. imon Nelson FRAMEWORK transparency/trust - explanation If you like Norah Jones you might like her father, Ravi Shankar
34. imon Nelson FRAMEWORK transparency/trust - reliability+consistency Quiz!
35. imon Nelson FRAMEWORK reach The limited reach of music recommendation Help! I’m stuck in the head Popularity 83 Artists 6,659 Artists 239,798 Artists 0% of recommendations 48% of recommendations 52% of recommendations recsys 2011 | music recommendation and discovery tutorial | paul lamere & oscar celma
36. imon Nelson FRAMEWORK context
37. imon Nelson FRAMEWORK context
38. SECTION 3: Innards
39. imon Nelson INNARDS collaborative filtering, mostly rating /user 1 2 3 4 … N 1 4 5 1 … 2 4 1 3 … … 3 … N 2 2 … items users
40. imon Nelson INNARDS content-based : tf/idf term frequency inverse document frequency
41. imon Nelson INNARDS content-based : tf/idf The Beatles were an English rock band formed in Liverpool in 1960, and one of the most commercially successful and critically acclaimed acts in the history of popular music.[1] The group's best-known lineup consisted of John Lennon (rhythm guitar, vocals), Paul McCartney (bass guitar, vocals), George Harrison(lead guitar, vocals) and Ringo Starr (drums, vocals). Rooted in skiffle and 1950s rock and roll, the group later worked in many genres ranging from pop ballads to psychedelic rock, often incorporating classicaland other elements in innovative ways. Their enormous popularity first emerged as "Beatlemania"; as their songwriting grew in sophistication by the late 1960s, they came to be perceived by many fans and cultural observers as an embodiment of the ideals shared by the era's sociocultural revolutions. Oasis were an English rock band formed in Manchester in 1991. Originally known as The Rain, the group was formed by Liam Gallagher (vocals and tambourine), Paul "Bonehead" Arthurs (guitar), Paul "Guigsy" McGuigan (bass guitar) and Tony McCarroll (drums, percussion), who were soon joined by Liam's older brother Noel Gallagher (lead guitar and vocals). They have had eight UK number-one singles and eight UK number-one albums, and won fifteen NME Awards, nine Q Awards, four MTV Europe Music Awards and six Brit Awards, including one in 2007 for outstanding contribution to music and one for the best album of the last 30 years as voted by the BBC Radio 2 listeners; they have been nominated for three Grammy Awards. As of 2009, the band have sold an estimated 70 million records worldwide.[1] Also the band was listed in the Guinness Book of World Records in 2010 for …
42. imon Nelson INNARDS content-based : tf/idf 60s 70s acoustic alternative alternative rock awesome beat beatles best band ever blues britishbritish invasion british psychedelia british rock britpop classic classic pop classic rockclassics england english experimental favorite favorite artists favorites favourites folk funk funky genius groovyhard rock indie indie rock jazz legend legends liverpool love male vocalists merseybeat metal oldies overrated pop pop rock pop-rock progressive rock psychedelic psychedelic pop psychedelic rock rock rock and roll rock n roll rock'n'roll singer-songwriter soul the beatles the best uk The Beatles Oasis 00s 80s 90s acoustic alt rock alternative alternative rock awesome brit brit pop brit rockbrit-pop british british rock britpop britrock chillout classic rock easy listeningelectronic emo england english favorites favourites funk funky groovy grunge guitar hard rock indieindie pop indie rock japanese jazz jecks liam gallagher love madchester male vocalists manchester mellowmetal nice noel gallagher oasis pop pop rock progressive rock punk punk rock rock rock and roll rock n roll singer-songwriter soft rock soul uk wonderwall
43. SECTION 5: Workshopping
44. imon Nelson WORKSHOPPING Make Friends! Influence People! 1. Form groups of 3-4 2. Find a website or app with a recommender 3. Consider the recommender on the 5 facets 4. Note some good or bad recommendations. Why do they work? 5. Repeat 2-4 as time allows and compare 6. Report your findings back to the group!
45. imon Nelson WORKSHOPPING Make Friends! Influence People! 1. Form groups of 3-4 2. Find a website or app with a recommender 3. Consider the recommender on the 5 facets 4. Note some good or bad recommendations. Why do they work? 5. Repeat 2-4 as time allows and compare 6. Report your findings back to the group! relevance novelty/serendipity transparency/trust reach context
46. imon Nelson RESOURCES Further reading • The Recommender Systems Book http://www.recommenderbook.net/ • Paul Lamere & Oscar Celma on music recs: http:// www.slideshare.net/plamere/music-recommendation-and-discovery • Me, talking - https://vimeo.com/50305526 • ACM RecSys https://recsys.acm.org/ http://www.recsyswiki.com/