pop-your-filter-bubble.pdf

C789ab052f13ddd37af520c4dc1dc375?s=47 Xyggy
February 21, 2019

 pop-your-filter-bubble.pdf

Take control of your AI with Thingy, a dynamic recommendation engine.

C789ab052f13ddd37af520c4dc1dc375?s=128

Xyggy

February 21, 2019
Tweet

Transcript

  1. 1 Pop Your Filter Bubble

  2. 2 ML and Me Dinesh Vadhia Systems background ML 10+

    years Python, Numpy and Scipy since 2007 Collaboration with Professor Zoubin Ghahramani at Cambridge University www.xyggy.com © 2019
  3. 3 1. Bubble 2. Your filter 3. Pop www.xyggy.com ©

    2019
  4. 4 Bubble 2016 Brexit referendum and US election a turning

    point Bad stuff happened and continues to happen Social media and recommendation engines implicated www.xyggy.com © 2019
  5. 5 The worm has turned Up Next: A Better Recommendation

    System, Renne Diresta, Wired, April ‘18 We are all trapped in the “Feed”, Om Malik, May ’18 The Expensive Education of Mark Zuckerberg and Silicon Valley, Kara Swisher, New York Times, Aug ‘18 www.xyggy.com © 2019
  6. 6 Francois Chollet asks … Is “super intelligence” the real

    danger or … … the scalable manipulation of human behavior AI enables, … and its malicious use by corporations and governments? What worries me about AI Francois Chollet, creator of Keras, neural networks library Medium, Mar ‘18 www.xyggy.com © 2019
  7. 7 www.xyggy.com © 2019 Villain is the ScreenSlayer It takes

    over people’s mind and agency
  8. 8 1. Bubble 2. Your filter 3. Pop www.xyggy.com ©

    2019
  9. 9 AI has all the control Recommendation engines have spread

    like a virus because open source makes it easy … All behave the same, with each consumer … … in a single lane without control … not an open road with control www.xyggy.com © 2019
  10. 10 Static AI in the enterprise Built over decades, integrated

    enterprise workflows are dynamic AI is static Caveat emptor www.xyggy.com © 2019
  11. 11 Learning algorithms Invented by academics for experimental research (50’s

    to 90’s). Not designed for: i. Real-world use (not dynamic) ii. Interactivity (no control) iii. Scalability (in production) www.xyggy.com © 2019
  12. 12 Machine learning pipeline machine learning model data feature engineering

    unseen data train test deploy production offline www.xyggy.com © 2019 manual or deep learning predictions
  13. 13 Static machine leaning machine learning static model new data

    feature engineering unseen data retrain retest redeploy www.xyggy.com © 2019 production offline predictions
  14. 14 Dynamic machine learning www.xyggy.com © 2019 predictions production data

    feature engineering dynamic machine learning unseen data
  15. 15 1. Bubble 2. Your filter 3. Pop www.xyggy.com ©

    2019
  16. 16 data: add update delete read query: standard more like

    this/these more or less anomaly detection dynamic automatic generalization interactive Thingy A P I A P I Thingy is a dynamic recommendation engine www.xyggy.com © 2019
  17. 17 www.xyggy.com © 2019 Thingy query of things things results

    ranked by how well each thing “fits into” universe of things including the query
  18. 18 query www.xyggy.com © 2019

  19. 19 Query images Result images Query Dataset: wikiart images -

    https://www.wikiart.org/. No image pre-processing performed. No textual data used. Feature vectors generated automatically with deep learning. www.xyggy.com © 2019
  20. 20 Add 2nd image to query www.xyggy.com © 2019 Query

    images Result images
  21. 21 www.xyggy.com © 2019 Add 3rd image to query Query

    images Result images
  22. 22 Add 4th image to query www.xyggy.com © 2019 Query

    images Result images
  23. 23 query: add & remove www.xyggy.com © 2019

  24. 24 Add and remove images Query images Result images Dataset:

    wikiart images - https://www.wikiart.org/. No image pre-processing performed. No textual data used. Feature vectors generated automatically with deep learning. www.xyggy.com © 2019
  25. 25 Add 2nd image to query www.xyggy.com © 2019 Query

    images Result images
  26. 26 Add two more images to query www.xyggy.com © 2019

    Query images Result images
  27. 27 Remove two images from query www.xyggy.com © 2019 Query

    images Result images
  28. 28 API www.xyggy.com © 2019

  29. 29 API v0.3: Request / Response www.xyggy.com © 2019 import

    json, requests url = ‘http://127.0.0.1:8181’ + ‘/thingy/api/v0.3’ headers = {‘content-type’:’application/json’} data = json.dumps(payload) response = requests.post(url, headers, data) results = response.json()
  30. 30 API: query www.xyggy.com © 2019 # query request_type =

    query|query_more|query_pos|query_neg # detect query request_type = detect # crud request_type = crud_add|crud_read|crud_update|crud_delete request_type = “query” number_of_results = 10 include_scores = True payload = { 'meta': {'request_type':request_type, 'number_of_results':number_of_results, 'include_scores': include_scores}, 'unknown_items': unknown_items, 'known_items': known_items}
  31. 31 query: more like this/these www.xyggy.com © 2019

  32. 32 More like this Query images Result images Dataset: 110K

    Visual Genome images - http://visualgenome.org/ No image pre-processing performed. No textual data used. Feature vectors generated automatically with deep learning. www.xyggy.com © 2019
  33. 33 More like this www.xyggy.com © 2019 Query images Result

    images
  34. 34 More like these Query images Result images www.xyggy.com ©

    2019
  35. 35 More like these www.xyggy.com © 2019 Query images Result

    images
  36. 36 query: more like these, less like others www.xyggy.com ©

    2019
  37. 37 More like these, less like others Query images Result

    images Dataset: wikiart images - https://www.wikiart.org/. No image pre-processing performed. No textual data used. Feature vectors generated automatically with deep learning. www.xyggy.com © 2019
  38. 38 More like +’s, less like –’s www.xyggy.com © 2019

    Query images Query images
  39. 39 More like +’s, less like –’s www.xyggy.com © 2019

    Result images
  40. 40 More like –’s, less like +’s www.xyggy.com © 2019

    Query images Query images
  41. 41 More like –’s, less like +’s www.xyggy.com © 2019

    Result images
  42. 42 Yin and Yang www.xyggy.com © 2019

  43. 43 crud: add data www.xyggy.com © 2019

  44. 44 Litmus test to add unknown image 1. Query with

    an unknown image. If image is known to Thingy, duplicate will show as the first result. It doesn’t (next slide). 2. Add a copy of the unknown image to Thingy. 3. Query with the unknown image again. If image is known to Thingy, duplicate will show as the first result. www.xyggy.com © 2019
  45. 45 1. Query with unknown image Dataset: wikiart images -

    https://www.wikiart.org/. No image pre-processing performed. No textual data used. Feature vectors generated automatically from deep learning model. Unknown image U U not in Thingy www.xyggy.com © 2019
  46. 46 2. Add image Add a copy of unknown image

    U to Thingy in realtime www.xyggy.com © 2019
  47. 47 3. Query with unknown image again Unknown image U

    Copy of U is first result www.xyggy.com © 2019
  48. 48 Test to add 3 unknown images 1. Query with

    3 unknown images. If images are known, duplicates will show in results. They don’t (see next slide). 2. Add copies of 3 unknown images to Thingy. 3. Query with 3 unknown images again. If images are known, duplicates will show in results. www.xyggy.com © 2019
  49. 49 1. Query with 3 unknown images Unknown images U1,

    U2, U3 U1, U2, U3 not in Thingy www.xyggy.com © 2019
  50. 50 2. Add 3 images Add copies of 3 unknown

    images U1, U2, U3 to Thingy in realtime www.xyggy.com © 2019
  51. 51 3. Query with 3 unknown images again Unknown images

    U1, U2, U3 Copies of U1, U2, U3 appear in results www.xyggy.com © 2019
  52. 52 www.xyggy.com © 2019 Control with UIX less … and

    many other UIX functions built with API
  53. 53 Roadmap www.xyggy.com © 2019 recommendation engine for all kinds

    of things
  54. 54 We want to: Give people control of their AI

    Enable a new generation of dynamic recommendation services for consumers and enterprises Make dynamic AI a focus of ML research www.xyggy.com © 2019
  55. 55 www.xyggy.com © 2019 “If you use an old tool

    to tackle a problem you’ve got to be really smarter than the rest of the folks because everybody has this tool. If you are the first to look with something new it’s like starting a new world. You just look around and everything you see is going to be new.” Steven Chu, Nobel Laureate, Physics
  56. 56 Dinesh Vadhia dinesh@xyggy.com www.xyggy.com @DineshVadhia www.xyggy.com © 2019