Upgrade to Pro — share decks privately, control downloads, hide ads and more …

OK Computer [FOWA, with notes]

OK Computer [FOWA, with notes]


Peter Gasston

October 07, 2015

More Decks by Peter Gasston

Other Decks in Technology


  1. OK Computer FOWA, 07/10/15

  2. Peter Gasston C.T. at +rehabstudio @stopsatgreen broken-links.com

  3. @stopsatgreen ASCI Red. Intel’s last supercomputer. £43 million (today). Could

    process 1.8 teraflops. 1,800,000,000,000. Retired in 2000.
  4. @stopsatgreen PS3. Launched in 2005. 1.8 teraflops. £425.

  5. @stopsatgreen In 2012, Google used 16,000 connected processors to teach

    a computer how to detect a cat in a photo. >> Jim Wilson, NYT.
  6. @stopsatgreen In 2015, it recognises this as “man using his

    laptop while his cat looks at the screen”. 5% error rate. https://twitter.com/timClicks/status/619734363362557953
  7. @stopsatgreen IBM Watson. Built to beat human contestant at Jeopardy.

    10 years of development. Hard to get costs, but at least £12 million.
  8. @stopsatgreen In 2011, beat human contestant at Jeopardy. By 3x.

  9. @stopsatgreen Cognitoys Dino. £80. Powered by Watson. https://cognitoys.com/

  10. @stopsatgreen Artificial Intelligence is becoming very good, very quickly. Lots

    of different strands to AI, but the revolution has been in deep learning.
  11. How deep learning works Input Input Output Classification Artificial neural

    network. Data is passed through layers; each layer does a job, then passes the result up to the next layer.
  12. How deep learning works Layers can perform pattern analysis or

    classification. Can give quick rough answer, slower perfect answer. Even this is simplified; can pass 25 layers in smartest systems.
  13. @stopsatgreen Computer scientists in Germany have used this to understand

    the content of an image and the painting styles of old masters.
 >> http://arxiv.org/abs/1508.06576 https://github.com/jcjohnson/neural-style
  14. @stopsatgreen B. Turner, C. Van Gogh, D. Munch Not just

    adding a filter; it understands the areas of differentiation (sky, buildings, water).
  15. @stopsatgreen Now A.I. is coming for your job.

  16. Is your job at risk? Abstractions People Pictures Words Numbers

    Routine Variety You’re alright Get nervous Bye Bye >> http://blogs.gartner.com/martin-kihn/how-to-know-if-a-robot-will-take-your-marketing-job/
  17. @stopsatgreen “web design & dev pro” >> http://www.bbc.co.uk/news/technology-34066941

  18. @stopsatgreen One in five of us
 could be out of

    work. Not saying we’ll all be laid off, but increased efficiency will shrink the job pool.
  19. @stopsatgreen https://dwnld.me/

  20. @stopsatgreen http://www.appmachine.com/instant/

  21. @stopsatgreen https://thegrid.io/

  22. @stopsatgreen ‘That will just make identikit websites’. Well, people made

    these. Looks like it could be easily automated.
  23. @stopsatgreen –Travis Gertz “The work we produce is repeatable and

    predictable. It panders to a common denominator. We build buckets and templates to hold every kind of content, then move on to the next component of the system. Digital design is a human assembly line.” Travis Gertz, ‘Design Machines’ >> https://louderthanten.com/articles/story/design-machines
  24. Is your job at risk? Abstractions People Pictures Words Numbers

    Routine Variety You’re alright Get nervous Bye Bye A human assembly line…
  25. @stopsatgreen Developers might be feeling a bit smug, but they

    really shouldn’t be. Hone lets designers change apps without writing code. https://hone.tools/
  26. @stopsatgreen – Wired “[muScalpel] successfully transplanted a video coding format

    from one media player to another. It took the automated system 26 hours to complete the transplant, while VLC's manual addition of the code happened over a period of 20 days.” Automated system to take code from one base and move it to another. Currently C only, but could work in any language. http://www.wired.co.uk/news/archive/2015-07/30/code-organ-transplant-software-myscalpel
  27. @stopsatgreen – MIT news “Helium is a system that revamps

    and fine- tunes code without ever needing the original source, in a matter of hours or even minutes.” Performance increases between 75% and 500% in tests. http://news.mit.edu/2015/computer-program-fixes-old-code-faster-than-expert-engineers-0609 The developers are probably feeling less smug now.
  28. @stopsatgreen AI can’t do our jobs, but it can do

    bits of our jobs. We become more efficient, can do more, fewer staff needed. 20% of jobs lost, probably starting with the junior ones.
  29. @stopsatgreen The future of web apps
 is partly automated.

  30. @stopsatgreen – Travis Gertz “While we’ve been streamlining our processes

    and perfecting our machine-like assembly techniques, others have been watching closely and assembling their own machines. We’ve designed ourselves right into an environment ripe for automation.” All of the workflow tools we’ve built make our jobs automatable. These quotes are from a fairly mandatory article, ‘Design Machines’ by Travis Gertz. But the best thing about the article is that he also suggests a solution to the problem:
  31. @stopsatgreen

  32. @stopsatgreen Deepdream is Google’s tool for visualising neural networks. >>

  33. @stopsatgreen Turing vs Lovelace. Creativity should be the benchmark of

    humanlike intelligence. Lovelace Test: artificial agent must produce an original program (music, poem, etc) that it was not engineered to produce. Must be reproducible, and unexplainable. http://www.slate.com/articles/health_and_science/new_scientist/2014/12/lovelace_test_of_artificial_intelligence_creativity_better_than_the_turing.html
  34. @stopsatgreen – Cameron Moll “Mastery of creation and composition is

    much more important than mastery of tools.” http://aneventapart.com/news/post/mastery-of-creation-is-more-important-than-mastery-of-tools
  35. @stopsatgreen – Andrew Ng “We need to enable a lot

    of people to do non- routine, non-repetitive tasks.
 Teaching innovation and creativity could be one way to get there.” Andrew Ng is a major player in Google and Baidu’s AI. He has major concerns about the effects of automation and AI on employment. http://www.huffingtonpost.com/2015/05/13/andrew-ng_n_7267682.html
  36. @stopsatgreen We should use A.I. to our own benefit.

  37. @stopsatgreen You can do what The Grid does. It’s all

    existing tech. Smart, rather than intelligent.
  38. @stopsatgreen Smart Image Cropping. http://thumbor.org

  39. @stopsatgreen Color Thief is good for intelligent colour palettes. http://lokeshdhakar.com/projects/color-thief/

  40. @stopsatgreen http://gridstylesheets.org/

  41. @stopsatgreen We can use A.I. to provide better services to

    our users.
  42. @stopsatgreen – Cennydd Bowles “AI is becoming a cornerstone of

    user experience. This is going to be interesting (read: difficult) for designers.” http://www.cennydd.com/blog/ai-and-future-user-experience
  43. @stopsatgreen visual motion interaction experience service emotion design intelligence

  44. @stopsatgreen – Cennydd Bowles “We’ll have to create frameworks /

    scaffolds / templates for AIs to deliver output through. These scaffolds may be sonic, tactile, and linguistic as well as visual.”
  45. @stopsatgreen Artificial Intelligence is becoming very good, very quickly. Artificial

    Intelligence is becoming very available, very quickly. Previously the domain of a few internet giants, now many products and services.
  46. @stopsatgreen Remember Watson?

  47. @stopsatgreen IBM Developer Cloud gives you access to all of

    Watson’s capabilities, using Node/Java and a range of RESTFUL APIs. They just brought a whole range into general availability. They want to be the ubiquitous platform of AI, as Windows was to the home PC and Android to mobile. http://www.ibm.com/smarterplanet/us/en/ibmwatson/developercloud/
  48. Watson tech stack BLUEMIX WATSON NODE.JS WWW Bluemix is a

    cloud platform like Amazon Web Services, Google Cloud Platform, or Microsoft Azure.
  49. @stopsatgreen Visual Recognition goes beyond simple face detection, to understand

    the content of an image. It’s like the Google tool I showed at the start.
  50. @stopsatgreen Has a bizarre fixation on wrestling.

  51. @stopsatgreen … unless it’s seen this picture. But I don’t

    show this picture to anyone.
  52. @stopsatgreen The more you train deep learning systems, the better

    they get.
  53. @stopsatgreen Google Photos, Flickr, EyeEm all do this.

  54. @stopsatgreen

  55. @stopsatgreen At a certain point your users’ expectations will be

    raised. Your dumb photo system will seem outdated.
  56. @stopsatgreen Visual insights. Give it a batch of images, it

    will find common themes.
  57. @stopsatgreen Personality Insights find persona characteristics from the content provided

    by users. Better targeted promotions. This is the type of information that other sites gather on you. Now you can gather it on your users!
  58. @stopsatgreen Tradeoff Analytics are used to make comparisons, helping users

    make better choices between products or objectives.
  59. @stopsatgreen Watson not the only game in town. MS have

    Project Oxford, the power behind Cortana. Although you have to know .Net or Android for now. https://www.projectoxford.ai/
  60. @stopsatgreen Has visual recognition. This seems to not be quite

    as evolved as Watson’s, but also adds ‘racy’ content detection, clever colour extraction, character recognition and intelligent cropping.
  61. @stopsatgreen Project Oxford also has very good Face APIs, able

    to detect, recognise, verify, deduce age, find similar faces, and so on. I like it because it guessed my age as a few years younger than I really am.
  62. @stopsatgreen https://www.metamind.io/ is a new startup with image and text

    tools. Also http://www.skymind.io/ for Enterprise.
  63. @stopsatgreen MetaMind image recognition seems to get very good results.

  64. @stopsatgreen The ‘killer app’ of A.I. is natural language understanding.

  65. @stopsatgreen

  66. @stopsatgreen

  67. @stopsatgreen Natural language understanding to get answers from the content

    of your site. Understand what a question is about. Temperature or weather.
  68. @stopsatgreen Pocket and Shutterstock recommendations. Amazon, Netflix, Google News, etc,

    all use these types of service. 2/3 of Netflix views are from recommendations.
  69. @stopsatgreen Alchemy API, an IBM acquisition, analyses text for sentiment,

    relations, entities… it learns and recommends based on that learning. http://www.alchemyapi.com/
  70. @stopsatgreen A.I. excels at conversation.

  71. @stopsatgreen This is about more than chatbots. Chatbots are boring.

    IKEA have had Anna since at least 2008.
  72. @stopsatgreen Machine: hi, this is <name> from helpdesk connect, what

    can i help you with today? Human: hi, i forgot my password. can you tell me how i can recover it? Machine: i’ll need to verify who it is at that machine. can we do a hangout? Human: yes Machine: <a hangout ensues> Human: cool, i am good now Google trained the system using old support calls. http://www.wired.com/2015/06/google-made-chatbot-debates-meaning-life/
  73. @stopsatgreen –Kyle Dent “A conversation is a sequence of turns

    where each utterance follows from what’s already been said and is relevant to the overall interaction. Dialog systems must maintain a context over several turns.” http://radar.oreilly.com/2015/09/talking-to-the-iot.html
  74. @stopsatgreen Virtual assistants are everybody’s new jam.

  75. @stopsatgreen Amazon Echo is the first home manifestation of the

    virtual assistant. Siri in Apple TV, Apple Car, Apple Watch etc. Google Voice Search, also in Android, Chrome, Wear, Auto, TV, etc. … in your Windows 10 laptop.
  76. @stopsatgreen https://www.jibo.com/ https://mycroft.ai/

  77. @stopsatgreen

  78. @stopsatgreen

  79. @stopsatgreen

  80. @stopsatgreen Conversation doesn’t need to be vocal, but it helps.

  81. @stopsatgreen Making computers talk is easy. Bell labs, 1961

  82. @stopsatgreen In browsers using the Web Speech API, supported in

    Chrome, Opera, Safari, Firefox (behind flag)
  83. @stopsatgreen https://www.ivona.com/ just one of many artificial voice services available.

    Also http://developer.att.com/apis/speech and http://neospeech.com/
  84. @stopsatgreen Making computers listen is easy… now. Bell Labs, 1952.

    Could recognise numbers spoken by one person. 1980s Hidden Markov method. Recently deep learning.
  85. @stopsatgreen Since 2012 Google’s voice recognition error rate has dropped

    from 26% to 8%. That’s from one word in 4 to one word in 12. This was a few months ago - a recent update is even better. Baidu, ‘China’s Google’, says theirs is 6% - one word in 17.
  86. @stopsatgreen 10% of Baidu search queries are by voice. That’s

    approx. 500m per day.
  87. @stopsatgreen Web Speech API. Chrome & Firefox OS (soon).

  88. @stopsatgreen Project Oxford native only. Useful in limited cases.

  89. @stopsatgreen ! All need WebRTC or Flash fallback, so forget

  90. @stopsatgreen Making computers understand is hard. But possible. Only recognises

    words (string matching), don’t understand intent.
  91. @stopsatgreen https://www.luis.ai/

  92. @stopsatgreen https://www.houndify.com/

  93. @stopsatgreen https://api.ai/

  94. @stopsatgreen https://wit.ai/

  95. @stopsatgreen

  96. @stopsatgreen Why natural language is good. Train machines, multiple steps,

    takes minutes for what can be a quite simple query.
  97. @stopsatgreen Even on the web that’s about 10 clicks, some

    typing - nationalrail.co.uk
  98. @stopsatgreen Note that I don’t have to enter dates manually.

    Not all options are available, but I can train it to use them. I used Chicago because an unfortunate drawback is that they don’t always recognise British English.
  99. @stopsatgreen This is what powers M. AI & HI. This

    is the wave of the future. https://www.facebook.com/Davemarcus/posts/10156070660595195
  100. @stopsatgreen (A) Future of Web Apps:
 From GUI to CUI.

    >> http://www.wired.com/2013/03/conversational-user-interface/
  101. @stopsatgreen https://x.ai/ Also https://claralabs.com/

  102. @stopsatgreen There’s a reason that WhatsApp is valued at $19billion.

    Image: Shutterstock via http://www.wired.co.uk/news/archive/2014-02/19/whatsapp-exclusive
  103. @stopsatgreen http://www.ericsson.com/res/docs/2015/consumerlab/ericsson-consumerlab-communication-in-the-world-of-apps.pdf

  104. @stopsatgreen http://techcrunch.com/2015/09/29/forget-apps-now-the-bots-take-over/

  105. @stopsatgreen https://www.chatshopper.com https://digit.co/

  106. @stopsatgreen http://a16z.com/2015/08/06/wechat-china-mobile-first/

  107. @stopsatgreen Conversational UI is an idea whose time has come.

    Natural language understanding is now at the point where this is possible.
  108. @stopsatgreen https://reinfer.io/

  109. @stopsatgreen Conversations which continue asking until all details are gathered.

  110. @stopsatgreen intelligence visual motion interaction experience service emotion design conversation

  111. @stopsatgreen Old problems still apply to
 new interaction models. Re:

    Jenn Riggins’ talk, The Good, The Bad & The Ugly.
  112. @stopsatgreen Security is hard. Privacy even harder. Deep learning is

    impossible without some kind of human training. Samsung TV.
  113. @stopsatgreen Hello Barbie. http://www.nytimes.com/2015/09/20/magazine/barbie-wants-to-get-to-know-your-child.html

  114. @stopsatgreen Be transparent. Especially because this stuff’s going to go

    in front of new markets.
  115. @stopsatgreen Bollocks. http://www.huffingtonpost.com/2015/02/09/my-friend-cayla-hacked_n_6647046.html

  116. @stopsatgreen The ready availability of deep learning happened so quickly

    that we barely realised. This is an opportunity.
  117. @stopsatgreen A.I. is improving rapidly. A.I. will take some jobs.

    A.I. can’t create like people. A.I. can improve your work.
  118. @stopsatgreen @stopsatgreen