Upgrade to Pro — share decks privately, control downloads, hide ads and more …

OK Computer: WXG [and notes]

9d9f17e37b751b9f83081ba3dd44bab4?s=47 Peter Gasston
September 25, 2015

OK Computer: WXG [and notes]

New talk on AI & machine learning services.


Peter Gasston

September 25, 2015

More Decks by Peter Gasston

Other Decks in Technology


  1. OK Computer WXG, 25/09/15

  2. Peter Gasston C.T. at +rehabstudio @stopsatgreen broken-links.com

  3. @stopsatgreen ASCI Red. Intel’s last supercomputer. £43 million (today). Could

    process 1.8 teraflops. 1,800,000,000,000. Retired in 2000.
  4. @stopsatgreen PS3. Launched in 2005. 1.8 teraflops. £425.

  5. @stopsatgreen In 2012, Google used 16,000 connected processors to teach

    a computer how to detect a cat in a photo. >> Jim Wilson, NYT.
  6. @stopsatgreen In 2015, it recognises this as “man using his

    laptop while his cat looks at the screen”. 5% error rate. https://twitter.com/timClicks/status/619734363362557953
  7. @stopsatgreen IBM Watson. Beat human contestant at Jeopardy. 10 years

    of development. Hard to get costs, but at least £12 million.
  8. @stopsatgreen Cognitoys Dino. £80. Powered by Watson.

  9. @stopsatgreen Artificial Intelligence is becoming very good, very quickly. Lots

    of different strands to AI, but the revolution has been in deep learning.
  10. How deep learning works Artificial neural network. Data is passed

    through layers; each layer does a job, then passes the result up to the next layer. Layers can perform pattern analysis or classification. Can give quick rough answer, slower perfect answer.
  11. @stopsatgreen Computer scientists in Germany have used this to understand

    the content of an image and the painting styles of old masters.
 >> http://arxiv.org/abs/1508.06576 https://github.com/jcjohnson/neural-style
  12. @stopsatgreen B. Turner, C. Van Gogh, D. Munch Not just

    adding a filter; it understands the areas of differentiation (sky, buildings, water).
  13. @stopsatgreen Now the AIs are coming for your job.

  14. Is your job at risk? Abstractions People Pictures Words Numbers

    Routine Variety You’re alright Get nervous Bye Bye >> http://blogs.gartner.com/martin-kihn/how-to-know-if-a-robot-will-take-your-marketing-job/
  15. @stopsatgreen A shallow magnitude 4.7 earthquake was reported Monday morning

    five miles from Westwood, California, according to the U.S. Geological Survey. The temblor occurred at 6:25 a.m. Pacific time at a depth of 5.0 miles. Copywriters are at risk. This is text generated by Quakebot.
  16. @stopsatgreen Kitty couldn’t fall asleep for a long time. Her

    nerves were strained as two tight strings, and even a glass of hot wine, that Vronsky made her drink, did not help her. Lying in bed she kept going over and over that monstrous scene at the meadow. Russian novel, ‘True Love’, written by computer. The NYT did a quiz asking you to recognise paras written by robots or humans. I got 2/8 right. >> http://www.nytimes.com/interactive/2015/03/08/opinion/sunday/algorithm-human-quiz.html?_r=0
  17. @stopsatgreen >> http://www.bbc.co.uk/news/technology-34066941

  18. @stopsatgreen One in five of us could be out of

    work. That’s one in five.
  19. @stopsatgreen https://dwnld.me

  20. @stopsatgreen http://www.appmachine.com/instant/

  21. @stopsatgreen https://thegrid.io

  22. @stopsatgreen ‘That will just make identikit websites’. Well, people made

    these. Looks like it could be easily automated.
  23. @stopsatgreen –Travis Gertz “The work we produce is repeatable and

    predictable. It panders to a common denominator. We build buckets and templates to hold every kind of content, then move on to the next component of the system. Digital design is a human assembly line.” Travis Gertz, ‘Design Machines’ https://louderthanten.com/articles/story/design-machines
  24. Is your job at risk? Abstractions People Pictures Words Numbers

    Routine Variety You’re alright Get nervous Bye Bye A human assembly line…
  25. @stopsatgreen Developers might be feeling a bit smug, but they

    really shouldn’t be. Hone lets designers change apps without writing code. https://hone.tools
  26. @stopsatgreen – Wired “[muScalpel] successfully transplanted a video coding format

    from one media player to another. It took the automated system 26 hours to complete the transplant, while VLC's manual addition of the code happened over a period of 20 days.” Automated system to take code from one base and move it to another. Currently C only, but could work in any language. http://www.wired.co.uk/news/archive/2015-07/30/code-organ-transplant-software-myscalpel
  27. @stopsatgreen – MIT news “Helium is a system that revamps

    and fine- tunes code without ever needing the original source, in a matter of hours or even minutes.” Performance increases between 75% and 500% in tests. http://news.mit.edu/2015/computer-program-fixes-old-code-faster-than-expert-engineers-0609 The developers are probably feeling less smug now.
  28. @stopsatgreen AI can’t do our job, but it can do

    bits of our job. We become more efficient, can do more, fewer staff needed. 20% of jobs lost, probably starting with the junior ones.
  29. @stopsatgreen – Travis Gertz “While we’ve been streamlining our processes

    and perfecting our machine-like assembly techniques, others have been watching closely and assembling their own machines. We’ve designed ourselves right into an environment ripe for automation.” All of the workflow tools we’ve built make our jobs automatable. These quotes are from a fairly mandatory article, ‘Design Machines’ by Travis Gertz. But the best thing about the article is that he also suggests a solution to the problem:
  30. @stopsatgreen

  31. @stopsatgreen – Travis Gertz “We need to be better than

    the machines. It’s time to step up and design with heart.” This is the last quote from that article.
  32. @stopsatgreen Deepdream is Google’s tool for visualising neural networks. https://twitter.com/brendandawes/status/617969546079678464

  33. @stopsatgreen – Cameron Moll “Mastery of creation and composition is

    much more important than mastery of tools.” http://aneventapart.com/news/post/mastery-of-creation-is-more-important-than-mastery-of-tools
  34. @stopsatgreen – Andrew Ng “We need to enable a lot

    of people to do non- routine, non-repetitive tasks. Teaching innovation and creativity could be one way to get there.” Andrew Ng is a major player in Google and Baidu’s AI. He has major concerns about the effects of automation and AI on employment. http://www.huffingtonpost.com/2015/05/13/andrew-ng_n_7267682.html
  35. @stopsatgreen We should welcome the benefits of AI into our

  36. @stopsatgreen – Cennydd Bowles “AI is becoming a cornerstone of

    user experience. This is going to be interesting (read: difficult) for designers.” http://www.cennydd.com/blog/ai-and-future-user-experience
  37. @stopsatgreen visual motion interaction experience service emotion design intelligence

  38. @stopsatgreen – Cennydd Bowles “We’ll have to create frameworks /

    scaffolds / templates for AIs to deliver output through. These scaffolds may be sonic, tactile, and linguistic as well as visual.”
  39. @stopsatgreen Much of The Grid’s featureset is repackaged existing tech.

    A lot of what the Grid does is easy (confirm this).
  40. @stopsatgreen Smart Image Cropping.

  41. @stopsatgreen http://thumbor.org

  42. @stopsatgreen Color Thief is good for intelligent colour palettes. http://lokeshdhakar.com/projects/color-thief/

  43. @stopsatgreen Packery or Susy for intelligent layouts. http://susy.oddbird.net http://packery.metafizzy.co

  44. @stopsatgreen We can use AI to provide better services to

    our users.
  45. @stopsatgreen Artificial Intelligence is becoming very good, very quickly. Previously

    the domain of a few internet giants, now many products and services.
  46. @stopsatgreen Artificial Intelligence is becoming very good, very quickly. Artificial

    Intelligence is becoming very available, very quickly. Previously the domain of a few internet giants, now many products and services.
  47. @stopsatgreen Remember Watson?

  48. @stopsatgreen IBM Developer Cloud gives you access to all of

    Watson’s capabilities, using Node/Java and a range of RESTFUL APIs. They just brought a whole range into general availability. They want to be the ubiquitous platform of AI, as Windows was to the home PC and Android to mobile. http://www.ibm.com/smarterplanet/us/en/ibmwatson/watson-cloud.html
  49. @stopsatgreen Visual Recognition goes beyond simple face detection, to understand

    the content of an image. It’s like the Google tool I showed at the start.
  50. @stopsatgreen Has a bizarre fixation on wrestling.

  51. @stopsatgreen El luchador.

  52. @stopsatgreen The more you train deep learning systems, the better

    they get.
  53. @stopsatgreen Google Photos, Flickr, EyeEm all do this.

  54. @stopsatgreen

  55. @stopsatgreen At a certain point your users’ expectations will be

    raised. Your dumb photo system will seem outdated.
  56. @stopsatgreen New tool released yesterday: visual insights. Give it a

    batch of images, it will find common themes.
  57. @stopsatgreen Personality Insights find persona characteristics from the content provided

    by users. Better targeted promotions. This is the type of information that other sites gather on you. Now you can gather it on your users!
  58. @stopsatgreen Tradeoff Analytics are used to make comparisons, helping users

    make better choices between products or objectives.
  59. @stopsatgreen Watson not the only game in town. MS have

    Project Oxford, the power behind Cortana. Although you have to know .Net or Android for now. https://www.projectoxford.ai
  60. @stopsatgreen Has visual recognition. This seems to not be quite

    as evolved as Watson’s, but also adds ‘racy’ content detection, clever colour extraction, character recognition and intelligent cropping.
  61. @stopsatgreen Project Oxford also has very good Face APIs, able

    to detect, recognise, verify, deduce age, find similar faces, and so on. I like it because it guessed my age as a few years younger than I really am.
  62. @stopsatgreen MetaMind is a new startup with image and text

    tools. https://www.metamind.io/ Also http://www.skymind.io/
  63. @stopsatgreen Image recognition seems to get very good results.

  64. @stopsatgreen Natural language processing is the ‘killer app’ of deep

  65. @stopsatgreen Natural language understanding to get answers from the content

    of your site. Understand what a question is about. Temperature or weather. Conversations which continue asking until all details are gathered.
  66. @stopsatgreen Alchemy API, an IBM acquisition, analyses text for sentiment,

    relations, entities… it learns and recommends based on that learning.
  67. @stopsatgreen Pocket and Shutterstock recommendations. Amazon, Netflix, Google News, etc,

    all use these types of service. 2/3 of Netflix views are from recommendations.
  68. @stopsatgreen Natural language coming to Spotlight in El Capitan.

  69. @stopsatgreen The real advantage of AI is in conversation.

  70. @stopsatgreen Machine: hi, this is <name> from helpdesk connect, what

    can i help you with today? Human: hi, i forgot my password. can you tell me how i can recover it? Machine: i’ll need to verify who it is at that machine. can we do a hangout? Human: yes Machine: <a hangout ensues> Human: cool, i am good now Google trained the system using old support calls. http://www.wired.com/2015/06/google-made-chatbot-debates-meaning-life/
  71. @stopsatgreen This is about more than chatbots. Chatbots are boring.

    IKEA have had Anna since at least 2008.
  72. @stopsatgreen –Kyle Dent “A conversation is a sequence of turns

    where each utterance follows from what’s already been said and is relevant to the overall interaction. Dialog systems must maintain a context over several turns.” http://radar.oreilly.com/2015/09/talking-to-the-iot.html
  73. @stopsatgreen Virtual assistants are everybody’s new jam.

  74. @stopsatgreen Amazon Echo is the first home manifestation of the

    virtual assistant. Siri in Apple TV, Apple Car, Apple Watch etc. Google Voice Search, also in Android, Chrome, Wear, Auto, TV, etc. … in your Windows 10 laptop.
  75. @stopsatgreen https://www.jibo.com/ https://www.kickstarter.com/projects/aiforeveryone/mycroft-an-open-source-artificial-intelligence-for

  76. @stopsatgreen

  77. @stopsatgreen

  78. @stopsatgreen

  79. @stopsatgreen Conversation doesn’t need to be vocal, but it helps.

  80. @stopsatgreen Making computers talk is easy. Bell labs, 1961

  81. @stopsatgreen In browsers using the Web Speech API, supported in

    Chrome, Opera, Safari, Firefox (behind flag) http://www.broken-links.com/2013/09/20/web-speech-api-part-one-speech-synthesis/
  82. @stopsatgreen Just one of many artificial voice services available. AT&T,

    Neospeech. https://www.ivona.com http://developer.att.com/apis/speech http://www.neospeech.com/
  83. @stopsatgreen Making computers listen is easy… now. Bell Labs, 1952.

    Could recognise numbers spoken by one person. 1980s Hidden Markov method. Recently deep learning.
  84. @stopsatgreen Since 2012 Google’s voice recognition error rate has dropped

    from 26% to 8%. That’s from one word in 4 to one word in 12. This was a few months ago - a recent update is even better. Baidu, ‘China’s Google’, says theirs is 6% - one word in 17.
  85. @stopsatgreen 10% of Baidu search queries are by voice. That’s

    approx. 500m per day.
  86. @stopsatgreen Web Speech API. Chrome & Firefox OS (soon). https://developers.google.com/web/updates/2013/01/Voice-Driven-Web-Apps-Introduction-to-the-Web-Speech-API?hl=en

  87. @stopsatgreen Project Oxford native only. Useful in limited cases.

  88. @stopsatgreen ! All need WebRTC or Flash fallback, so forget

  89. @stopsatgreen Making computers understand is hard. But possible. Only recognises

    words (string matching), don’t understand intent.
  90. @stopsatgreen https://www.luis.ai

  91. @stopsatgreen https://api.ai

  92. @stopsatgreen https://wit.ai

  93. @stopsatgreen

  94. @stopsatgreen Why natural language is good: train machines, multiple steps,

    takes minutes for what can be a quite simple query.
  95. @stopsatgreen Even on the web that’s about 10 clicks, some

    typing - nationalrail.co.uk
  96. @stopsatgreen Note that I don’t have to enter dates manually.

    Not all options are available, but I can train it to use them. I used Chicago because an unfortunate drawback is that they don’t always recognise British English.
  97. @stopsatgreen This is what powers M. AI & HI. This

    is the wave of the future. https://www.facebook.com/Davemarcus/posts/10156070660595195
  98. @stopsatgreen From GUI to CUI. >> http://www.wired.com/2013/03/conversational-user-interface/

  99. @stopsatgreen http://x.ai Also https://claralabs.com/

  100. @stopsatgreen There’s a reason that WhatsApp is valued at $19billion.

    Shutterstock via http://www.wired.co.uk/news/archive/2014-02/19/whatsapp-exclusive
  101. @stopsatgreen https://www.chatshopper.com

  102. @stopsatgreen http://www.ericsson.com/res/docs/2015/consumerlab/ericsson-consumerlab-communication-in-the-world-of-apps.pdf

  103. @stopsatgreen http://a16z.com/2015/08/06/wechat-china-mobile-first/

  104. @stopsatgreen Conversational UI is an idea whose time has come.

    Natural language understanding is now at the point where this is possible.
  105. @stopsatgreen intelligence visual motion interaction experience service emotion design conversation

  106. @stopsatgreen Old problems still apply to
 new interaction models.

  107. @stopsatgreen Security is hard. Privacy even harder. Deep learning is

    impossible without some kind of human training. Samsung TV. http://www.theguardian.com/technology/2015/feb/27/samsung-voice-recording-smart-tv-breach-privacy-law-campaigners-claim
  108. @stopsatgreen Be transparent. https://history.google.com/history/audio

  109. @stopsatgreen Bollocks. http://www.huffingtonpost.com/2015/02/09/my-friend-cayla-hacked_n_6647046.html

  110. @stopsatgreen The ready availability of deep learning happened so quickly

    that we barely realised. This is an opportunity.
  111. @stopsatgreen AI is improving rapidly. AI will take some jobs.

    AI can’t create like people. AI can make your work better.
  112. @stopsatgreen @stopsatgreen