Upgrade to Pro — share decks privately, control downloads, hide ads and more …

People who like cheese also like crackers: a learning hour on recommender systems

Ben Fields
December 02, 2016

People who like cheese also like crackers: a learning hour on recommender systems

A systems-level introduction to recommender systems, put together for a Future Learn internal Learning Hour.

Ben Fields

December 02, 2016
Tweet

More Decks by Ben Fields

Other Decks in Technology

Transcript

  1. People who like cheese also like crackers:
    a learning hour on recommender systems
    BEN FIELDS | 2 DECEMBER 2016 | !ALSOTHINGS

    View Slide

  2. Intro
    Framework
    Innards
    Accuracy
    Workshopping

    View Slide

  3. SECTION 1:
    Intro

    View Slide

  4. imon Nelson
    INTRO
    what is a recommender system?
    What should I listen to next?

    View Slide

  5. http://www.flickr.com/photos/bookgrl/423259086/

    View Slide

  6. View Slide

  7. View Slide

  8. imon Nelson
    INTRO
    what is a recommender system?
    What to drink next?

    View Slide

  9. http://www.flickr.com/photos/avcellshots/4381124026/

    View Slide

  10. imon Nelson
    INTRO
    what is a recommender system?
    So, what is a recommender system?

    View Slide

  11. View Slide

  12. View Slide

  13. View Slide

  14. imon Nelson
    INTRO
    what is a recommender system?
    prediction of opinions about things

    View Slide

  15. imon Nelson
    INTRO
    what is a recommender system?
    rating item

    View Slide

  16. imon Nelson
    INTRO
    what is a recommender system?
    rating movie

    View Slide

  17. View Slide

  18. imon Nelson
    INTRO
    what is a recommender system?
    prediction of opinions about things

    View Slide

  19. imon Nelson
    INTRO
    what is a recommender system?
    prediction of actions on things

    View Slide

  20. imon Nelson
    INTRO
    what is a recommender system?
    rating movie

    View Slide

  21. imon Nelson
    INTRO
    what is a recommender system?
    listen song

    View Slide

  22. View Slide

  23. View Slide

  24. imon Nelson
    INTRO
    what is a recommender system?
    So, what is a recommender system?

    View Slide

  25. imon Nelson
    INTRO
    what is a recommender system?
    recommender system (NP): a methodology
    of predicting the preferences users will have
    for items, across a corpus of items and a
    collection of users

    View Slide

  26. SECTION 2:
    Framework

    View Slide

  27. imon Nelson
    FRAMEWORK
    system considerations
    relevance
    novelty/serendipity
    transparency/trust
    reach
    context

    View Slide

  28. imon Nelson
    FRAMEWORK
    relevance

    View Slide

  29. imon Nelson
    FRAMEWORK
    novelty/serendipity

    View Slide

  30. imon Nelson
    FRAMEWORK
    novelty/serendipity
    Popularity Bias - The Harry Potter Effect
    recsys 2011 | music recommendation and discovery tutorial | paul lamere & oscar celma
    Popularity Bias - The Harry Potter Effect
    recsys 2011 | music recommendation and discovery tutorial | paul lamere & oscar celma

    View Slide

  31. imon Nelson
    FRAMEWORK
    novelty/serendipity
    T
    he
    E
    n
    em
    y

    View Slide

  32. imon Nelson
    FRAMEWORK
    transparency/trust - explanation
    If you like Norah Jones
    you might like Ravi Shankar

    View Slide

  33. imon Nelson
    FRAMEWORK
    transparency/trust - explanation
    If you like Norah Jones
    you might like her father, Ravi Shankar

    View Slide

  34. imon Nelson
    FRAMEWORK
    transparency/trust - reliability+consistency
    Quiz!

    View Slide

  35. imon Nelson
    FRAMEWORK
    reach
    The limited reach of music recommendation
    Help! I’m stuck in the head
    Popularity
    83 Artists 6,659 Artists 239,798 Artists
    0% of
    recommendations
    48% of recommendations
    52% of recommendations
    recsys 2011 | music recommendation and discovery tutorial | paul lamere & oscar celma

    View Slide

  36. imon Nelson
    FRAMEWORK
    context

    View Slide

  37. imon Nelson
    FRAMEWORK
    context

    View Slide

  38. SECTION 3:
    Innards

    View Slide

  39. imon Nelson
    INNARDS
    collaborative filtering, mostly
    rating
    /user
    1 2 3 4 … N
    1 4 5 1 …
    2 4 1 3
    … … 3 …
    N 2 2 …
    items
    users

    View Slide

  40. imon Nelson
    INNARDS
    content-based : tf/idf
    term frequency
    inverse document
    frequency

    View Slide

  41. imon Nelson
    INNARDS
    content-based : tf/idf
    The Beatles were an English rock band formed in
    Liverpool in 1960, and one of the most
    commercially successful and critically acclaimed
    acts in the history of popular music.[1] The group's
    best-known lineup consisted of John Lennon
    (rhythm guitar, vocals), Paul McCartney (bass
    guitar, vocals), George Harrison(lead guitar,
    vocals) and Ringo Starr (drums, vocals). Rooted in
    skiffle and 1950s rock and roll, the group later
    worked in many genres ranging from pop ballads
    to psychedelic rock, often incorporating
    classicaland other elements in innovative ways.
    Their enormous popularity first emerged as
    "Beatlemania"; as their songwriting grew in
    sophistication by the late 1960s, they came to be
    perceived by many fans and cultural observers as
    an embodiment of the ideals shared by the era's
    sociocultural revolutions.
    Oasis were an English rock band formed in
    Manchester in 1991. Originally known as The Rain,
    the group was formed by Liam Gallagher (vocals
    and tambourine), Paul "Bonehead" Arthurs
    (guitar), Paul "Guigsy" McGuigan (bass guitar) and
    Tony McCarroll (drums, percussion), who were
    soon joined by Liam's older brother Noel
    Gallagher (lead guitar and vocals). They have had
    eight UK number-one singles and eight UK
    number-one albums, and won fifteen NME
    Awards, nine Q Awards, four MTV Europe Music
    Awards and six Brit Awards, including one in 2007
    for outstanding contribution to music and one for
    the best album of the last 30 years as voted by
    the BBC Radio 2 listeners; they have been
    nominated for three Grammy Awards. As of 2009,
    the band have sold an estimated 70 million
    records worldwide.[1] Also the band was listed in
    the Guinness Book of World Records in 2010 for

    View Slide

  42. imon Nelson
    INNARDS
    content-based : tf/idf
    60s 70s acoustic alternative alternative rock awesome beat beatles best band ever blues
    britishbritish invasion british psychedelia
    british rock britpop classic classic pop
    classic rockclassics england english experimental favorite favorite artists favorites
    favourites folk funk funky genius groovyhard rock indie indie rock jazz legend legends liverpool love male vocalists merseybeat metal oldies
    overrated
    pop pop rock pop-rock progressive rock psychedelic psychedelic pop psychedelic rock
    rock rock and roll rock n roll rock'n'roll
    singer-songwriter soul the beatles the best uk
    The Beatles
    Oasis
    00s 80s 90s acoustic alt rock
    alternative alternative rock awesome brit brit pop brit rockbrit-pop
    british
    british rock
    britpop britrock chillout classic rock easy listeningelectronic emo england english favorites favourites funk
    funky groovy grunge guitar hard rock
    indieindie pop indie rock japanese jazz jecks liam gallagher love madchester male vocalists
    manchester mellowmetal nice noel gallagher oasis pop pop rock progressive rock punk punk rock
    rock rock and roll rock n roll
    singer-songwriter soft rock soul uk wonderwall

    View Slide

  43. SECTION 5:
    Workshopping

    View Slide

  44. imon Nelson
    WORKSHOPPING
    Make Friends! Influence People!
    1. Form groups of 3-4
    2. Find a website or app with a recommender
    3. Consider the recommender on the 5 facets
    4. Note some good or bad recommendations.
    Why do they work?
    5. Repeat 2-4 as time allows and compare
    6. Report your findings back to the group!

    View Slide

  45. imon Nelson
    WORKSHOPPING
    Make Friends! Influence People!
    1. Form groups of 3-4
    2. Find a website or app with a
    recommender
    3. Consider the recommender on the 5
    facets
    4. Note some good or bad
    recommendations. Why do they work?
    5. Repeat 2-4 as time allows and
    compare
    6. Report your findings back to the
    group!
    relevance
    novelty/serendipity
    transparency/trust
    reach
    context

    View Slide

  46. imon Nelson
    RESOURCES
    Further reading
    • The Recommender Systems Book http://www.recommenderbook.net/
    • Paul Lamere & Oscar Celma on music recs: http://
    www.slideshare.net/plamere/music-recommendation-and-discovery
    • Me, talking - https://vimeo.com/50305526
    • ACM RecSys https://recsys.acm.org/ http://www.recsyswiki.com/

    View Slide