Upgrade to Pro — share decks privately, control downloads, hide ads and more …

pop-your-filter-bubble.pdf

Xyggy
February 21, 2019

 pop-your-filter-bubble.pdf

Take control of your AI with Thingy, a dynamic recommendation engine.

Xyggy

February 21, 2019
Tweet

More Decks by Xyggy

Other Decks in Technology

Transcript

  1. 2 ML and Me Dinesh Vadhia Systems background ML 10+

    years Python, Numpy and Scipy since 2007 Collaboration with Professor Zoubin Ghahramani at Cambridge University www.xyggy.com © 2019
  2. 4 Bubble 2016 Brexit referendum and US election a turning

    point Bad stuff happened and continues to happen Social media and recommendation engines implicated www.xyggy.com © 2019
  3. 5 The worm has turned Up Next: A Better Recommendation

    System, Renne Diresta, Wired, April ‘18 We are all trapped in the “Feed”, Om Malik, May ’18 The Expensive Education of Mark Zuckerberg and Silicon Valley, Kara Swisher, New York Times, Aug ‘18 www.xyggy.com © 2019
  4. 6 Francois Chollet asks … Is “super intelligence” the real

    danger or … … the scalable manipulation of human behavior AI enables, … and its malicious use by corporations and governments? What worries me about AI Francois Chollet, creator of Keras, neural networks library Medium, Mar ‘18 www.xyggy.com © 2019
  5. 9 AI has all the control Recommendation engines have spread

    like a virus because open source makes it easy … All behave the same, with each consumer … … in a single lane without control … not an open road with control www.xyggy.com © 2019
  6. 10 Static AI in the enterprise Built over decades, integrated

    enterprise workflows are dynamic AI is static Caveat emptor www.xyggy.com © 2019
  7. 11 Learning algorithms Invented by academics for experimental research (50’s

    to 90’s). Not designed for: i. Real-world use (not dynamic) ii. Interactivity (no control) iii. Scalability (in production) www.xyggy.com © 2019
  8. 12 Machine learning pipeline machine learning model data feature engineering

    unseen data train test deploy production offline www.xyggy.com © 2019 manual or deep learning predictions
  9. 13 Static machine leaning machine learning static model new data

    feature engineering unseen data retrain retest redeploy www.xyggy.com © 2019 production offline predictions
  10. 14 Dynamic machine learning www.xyggy.com © 2019 predictions production data

    feature engineering dynamic machine learning unseen data
  11. 16 data: add update delete read query: standard more like

    this/these more or less anomaly detection dynamic automatic generalization interactive Thingy A P I A P I Thingy is a dynamic recommendation engine www.xyggy.com © 2019
  12. 17 www.xyggy.com © 2019 Thingy query of things things results

    ranked by how well each thing “fits into” universe of things including the query
  13. 19 Query images Result images Query Dataset: wikiart images -

    https://www.wikiart.org/. No image pre-processing performed. No textual data used. Feature vectors generated automatically with deep learning. www.xyggy.com © 2019
  14. 24 Add and remove images Query images Result images Dataset:

    wikiart images - https://www.wikiart.org/. No image pre-processing performed. No textual data used. Feature vectors generated automatically with deep learning. www.xyggy.com © 2019
  15. 29 API v0.3: Request / Response www.xyggy.com © 2019 import

    json, requests url = ‘http://127.0.0.1:8181’ + ‘/thingy/api/v0.3’ headers = {‘content-type’:’application/json’} data = json.dumps(payload) response = requests.post(url, headers, data) results = response.json()
  16. 30 API: query www.xyggy.com © 2019 # query request_type =

    query|query_more|query_pos|query_neg # detect query request_type = detect # crud request_type = crud_add|crud_read|crud_update|crud_delete request_type = “query” number_of_results = 10 include_scores = True payload = { 'meta': {'request_type':request_type, 'number_of_results':number_of_results, 'include_scores': include_scores}, 'unknown_items': unknown_items, 'known_items': known_items}
  17. 32 More like this Query images Result images Dataset: 110K

    Visual Genome images - http://visualgenome.org/ No image pre-processing performed. No textual data used. Feature vectors generated automatically with deep learning. www.xyggy.com © 2019
  18. 37 More like these, less like others Query images Result

    images Dataset: wikiart images - https://www.wikiart.org/. No image pre-processing performed. No textual data used. Feature vectors generated automatically with deep learning. www.xyggy.com © 2019
  19. 44 Litmus test to add unknown image 1. Query with

    an unknown image. If image is known to Thingy, duplicate will show as the first result. It doesn’t (next slide). 2. Add a copy of the unknown image to Thingy. 3. Query with the unknown image again. If image is known to Thingy, duplicate will show as the first result. www.xyggy.com © 2019
  20. 45 1. Query with unknown image Dataset: wikiart images -

    https://www.wikiart.org/. No image pre-processing performed. No textual data used. Feature vectors generated automatically from deep learning model. Unknown image U U not in Thingy www.xyggy.com © 2019
  21. 46 2. Add image Add a copy of unknown image

    U to Thingy in realtime www.xyggy.com © 2019
  22. 47 3. Query with unknown image again Unknown image U

    Copy of U is first result www.xyggy.com © 2019
  23. 48 Test to add 3 unknown images 1. Query with

    3 unknown images. If images are known, duplicates will show in results. They don’t (see next slide). 2. Add copies of 3 unknown images to Thingy. 3. Query with 3 unknown images again. If images are known, duplicates will show in results. www.xyggy.com © 2019
  24. 49 1. Query with 3 unknown images Unknown images U1,

    U2, U3 U1, U2, U3 not in Thingy www.xyggy.com © 2019
  25. 50 2. Add 3 images Add copies of 3 unknown

    images U1, U2, U3 to Thingy in realtime www.xyggy.com © 2019
  26. 51 3. Query with 3 unknown images again Unknown images

    U1, U2, U3 Copies of U1, U2, U3 appear in results www.xyggy.com © 2019
  27. 52 www.xyggy.com © 2019 Control with UIX less … and

    many other UIX functions built with API
  28. 54 We want to: Give people control of their AI

    Enable a new generation of dynamic recommendation services for consumers and enterprises Make dynamic AI a focus of ML research www.xyggy.com © 2019
  29. 55 www.xyggy.com © 2019 “If you use an old tool

    to tackle a problem you’ve got to be really smarter than the rest of the folks because everybody has this tool. If you are the first to look with something new it’s like starting a new world. You just look around and everything you see is going to be new.” Steven Chu, Nobel Laureate, Physics