Peter Gasston
C.T. at +rehabstudio
@stopsatgreen
broken-links.com
Slide 3
Slide 3 text
@stopsatgreen
ASCI Red. Intel’s last supercomputer. £43 million (today). Could process 1.8 teraflops. 1,800,000,000,000. Retired in 2000.
Slide 4
Slide 4 text
@stopsatgreen
PS3. Launched in 2005. 1.8 teraflops. £425.
Slide 5
Slide 5 text
@stopsatgreen
In 2012, Google used 16,000 connected processors to teach a computer how to detect a cat in a photo.
>> Jim Wilson, NYT.
Slide 6
Slide 6 text
@stopsatgreen
In 2015, it recognises this as “man using his laptop while his cat looks at the screen”. 5% error rate.
https://twitter.com/timClicks/status/619734363362557953
Slide 7
Slide 7 text
@stopsatgreen
IBM Watson. Built to beat human contestant at Jeopardy.
10 years of development. Hard to get costs, but at least £12 million.
Slide 8
Slide 8 text
@stopsatgreen
In 2011, beat human contestant at Jeopardy. By 3x.
Slide 9
Slide 9 text
@stopsatgreen
Cognitoys Dino. £80. Powered by Watson.
https://cognitoys.com/
Slide 10
Slide 10 text
@stopsatgreen
Artificial Intelligence is
becoming very good,
very quickly.
Lots of different strands to AI, but the revolution has been in deep learning.
Slide 11
Slide 11 text
How deep learning works
Input
Input
Output
Classification
Artificial neural network.
Data is passed through layers; each layer does a job, then passes the result up to the next layer.
Slide 12
Slide 12 text
How deep learning works
Layers can perform pattern analysis or classification.
Can give quick rough answer, slower perfect answer.
Even this is simplified; can pass 25 layers in smartest systems.
Slide 13
Slide 13 text
@stopsatgreen
Computer scientists in Germany have used this to understand the content of an image and the painting styles of old masters.
>> http://arxiv.org/abs/1508.06576
https://github.com/jcjohnson/neural-style
Slide 14
Slide 14 text
@stopsatgreen
B. Turner, C. Van Gogh, D. Munch
Not just adding a filter; it understands the areas of differentiation (sky, buildings, water).
Slide 15
Slide 15 text
@stopsatgreen
Now A.I. is coming for your job.
Slide 16
Slide 16 text
Is your job at risk?
Abstractions
People
Pictures
Words
Numbers
Routine Variety
You’re alright
Get nervous
Bye Bye
>> http://blogs.gartner.com/martin-kihn/how-to-know-if-a-robot-will-take-your-marketing-job/
Slide 17
Slide 17 text
@stopsatgreen
“web design & dev pro”
>> http://www.bbc.co.uk/news/technology-34066941
Slide 18
Slide 18 text
@stopsatgreen
One in five of us
could be out of work.
Not saying we’ll all be laid off, but increased efficiency will shrink the job pool.
Slide 19
Slide 19 text
@stopsatgreen
https://dwnld.me/
Slide 20
Slide 20 text
@stopsatgreen
http://www.appmachine.com/instant/
Slide 21
Slide 21 text
@stopsatgreen
https://thegrid.io/
Slide 22
Slide 22 text
@stopsatgreen
‘That will just make identikit websites’. Well, people made these. Looks like it could be easily automated.
Slide 23
Slide 23 text
@stopsatgreen
–Travis Gertz
“The work we produce is repeatable and
predictable. It panders to a common
denominator.
We build buckets and templates to hold every
kind of content, then move on to the next
component of the system.
Digital design is a human assembly line.”
Travis Gertz, ‘Design Machines’
>> https://louderthanten.com/articles/story/design-machines
Slide 24
Slide 24 text
Is your job at risk?
Abstractions
People
Pictures
Words
Numbers
Routine Variety
You’re alright
Get nervous
Bye Bye
A human assembly line…
Slide 25
Slide 25 text
@stopsatgreen
Developers might be feeling a bit smug, but they really shouldn’t be.
Hone lets designers change apps without writing code.
https://hone.tools/
Slide 26
Slide 26 text
@stopsatgreen
– Wired
“[muScalpel] successfully transplanted a video
coding format from one media player to
another. It took the automated system 26 hours
to complete the transplant, while VLC's manual
addition of the code happened over a period of
20 days.”
Automated system to take code from one base and move it to another. Currently C only, but could work in any language.
http://www.wired.co.uk/news/archive/2015-07/30/code-organ-transplant-software-myscalpel
Slide 27
Slide 27 text
@stopsatgreen
– MIT news
“Helium is a system that revamps and fine-
tunes code without ever needing the original
source, in a matter of hours or even minutes.”
Performance increases between 75% and 500% in tests.
http://news.mit.edu/2015/computer-program-fixes-old-code-faster-than-expert-engineers-0609
The developers are probably feeling less smug now.
Slide 28
Slide 28 text
@stopsatgreen
AI can’t do our jobs, but it
can do bits of our jobs.
We become more efficient, can do more, fewer staff needed. 20% of jobs lost, probably starting with the junior ones.
Slide 29
Slide 29 text
@stopsatgreen
The future of web apps
is partly automated.
Slide 30
Slide 30 text
@stopsatgreen
– Travis Gertz
“While we’ve been streamlining our processes
and perfecting our machine-like assembly
techniques, others have been watching closely
and assembling their own machines.
We’ve designed ourselves right into an
environment ripe for automation.”
All of the workflow tools we’ve built make our jobs automatable.
These quotes are from a fairly mandatory article, ‘Design Machines’ by Travis Gertz. But the best thing about the article is that he also suggests a solution to the problem:
Slide 31
Slide 31 text
@stopsatgreen
Slide 32
Slide 32 text
@stopsatgreen
Deepdream is Google’s tool for visualising neural networks.
>> https://twitter.com/brendandawes/status/617969546079678464
Slide 33
Slide 33 text
@stopsatgreen
Turing vs Lovelace. Creativity should be the benchmark of humanlike intelligence.
Lovelace Test: artificial agent must produce an original program (music, poem, etc) that it was not engineered to produce. Must be reproducible, and unexplainable.
http://www.slate.com/articles/health_and_science/new_scientist/2014/12/lovelace_test_of_artificial_intelligence_creativity_better_than_the_turing.html
Slide 34
Slide 34 text
@stopsatgreen
– Cameron Moll
“Mastery of creation and composition is much
more important than mastery of tools.”
http://aneventapart.com/news/post/mastery-of-creation-is-more-important-than-mastery-of-tools
Slide 35
Slide 35 text
@stopsatgreen
– Andrew Ng
“We need to enable a lot of people to do non-
routine, non-repetitive tasks.
Teaching innovation and creativity could be one
way to get there.”
Andrew Ng is a major player in Google and Baidu’s AI. He has major concerns about the effects of automation and AI on employment.
http://www.huffingtonpost.com/2015/05/13/andrew-ng_n_7267682.html
Slide 36
Slide 36 text
@stopsatgreen
We should use A.I.
to our own benefit.
Slide 37
Slide 37 text
@stopsatgreen
You can do what The Grid does. It’s all existing tech.
Smart, rather than intelligent.
@stopsatgreen
Color Thief is good for intelligent colour palettes.
http://lokeshdhakar.com/projects/color-thief/
Slide 40
Slide 40 text
@stopsatgreen
http://gridstylesheets.org/
Slide 41
Slide 41 text
@stopsatgreen
We can use A.I. to provide
better services to our users.
Slide 42
Slide 42 text
@stopsatgreen
– Cennydd Bowles
“AI is becoming a cornerstone of user
experience. This is going to be interesting (read:
difficult) for designers.”
http://www.cennydd.com/blog/ai-and-future-user-experience
Slide 43
Slide 43 text
@stopsatgreen
visual
motion
interaction
experience
service
emotion
design
intelligence
Slide 44
Slide 44 text
@stopsatgreen
– Cennydd Bowles
“We’ll have to create frameworks / scaffolds /
templates for AIs to deliver output through.
These scaffolds may be sonic, tactile, and
linguistic as well as visual.”
Slide 45
Slide 45 text
@stopsatgreen
Artificial Intelligence is
becoming very good,
very quickly.
Artificial Intelligence is
becoming very available,
very quickly.
Previously the domain of a few internet giants, now many products and services.
Slide 46
Slide 46 text
@stopsatgreen
Remember Watson?
Slide 47
Slide 47 text
@stopsatgreen
IBM Developer Cloud gives you access to all of Watson’s capabilities, using Node/Java and a range of RESTFUL APIs.
They just brought a whole range into general availability.
They want to be the ubiquitous platform of AI, as Windows was to the home PC and Android to mobile.
http://www.ibm.com/smarterplanet/us/en/ibmwatson/developercloud/
Slide 48
Slide 48 text
Watson tech stack
BLUEMIX
WATSON
NODE.JS
WWW
Bluemix is a cloud platform like Amazon Web Services, Google Cloud Platform, or Microsoft Azure.
Slide 49
Slide 49 text
@stopsatgreen
Visual Recognition goes beyond simple face detection, to understand the content of an image. It’s like the Google tool I showed at the start.
Slide 50
Slide 50 text
@stopsatgreen
Has a bizarre fixation on wrestling.
Slide 51
Slide 51 text
@stopsatgreen
… unless it’s seen this picture. But I don’t show this picture to anyone.
Slide 52
Slide 52 text
@stopsatgreen
The more you train
deep learning systems,
the better they get.
Slide 53
Slide 53 text
@stopsatgreen
Google Photos, Flickr, EyeEm all do this.
Slide 54
Slide 54 text
@stopsatgreen
Slide 55
Slide 55 text
@stopsatgreen
At a certain point your users’
expectations will be raised.
Your dumb photo system will seem outdated.
Slide 56
Slide 56 text
@stopsatgreen
Visual insights. Give it a batch of images, it will find common themes.
Slide 57
Slide 57 text
@stopsatgreen
Personality Insights find persona characteristics from the content provided by users.
Better targeted promotions.
This is the type of information that other sites gather on you. Now you can gather it on your users!
Slide 58
Slide 58 text
@stopsatgreen
Tradeoff Analytics are used to make comparisons, helping users make better choices between products or objectives.
Slide 59
Slide 59 text
@stopsatgreen
Watson not the only game in town. MS have Project Oxford, the power behind Cortana.
Although you have to know .Net or Android for now.
https://www.projectoxford.ai/
Slide 60
Slide 60 text
@stopsatgreen
Has visual recognition. This seems to not be quite as evolved as Watson’s, but also adds ‘racy’ content detection, clever colour extraction, character recognition and
intelligent cropping.
Slide 61
Slide 61 text
@stopsatgreen
Project Oxford also has very good Face APIs, able to detect, recognise, verify, deduce age, find similar faces, and so on.
I like it because it guessed my age as a few years younger than I really am.
Slide 62
Slide 62 text
@stopsatgreen
https://www.metamind.io/ is a new startup with image and text tools.
Also http://www.skymind.io/ for Enterprise.
Slide 63
Slide 63 text
@stopsatgreen
MetaMind image recognition seems to get very good results.
Slide 64
Slide 64 text
@stopsatgreen
The ‘killer app’ of A.I. is natural
language understanding.
Slide 65
Slide 65 text
@stopsatgreen
Slide 66
Slide 66 text
@stopsatgreen
Slide 67
Slide 67 text
@stopsatgreen
Natural language understanding to get answers from the content of your site.
Understand what a question is about. Temperature or weather.
Slide 68
Slide 68 text
@stopsatgreen
Pocket and Shutterstock recommendations.
Amazon, Netflix, Google News, etc, all use these types of service.
2/3 of Netflix views are from recommendations.
Slide 69
Slide 69 text
@stopsatgreen
Alchemy API, an IBM acquisition, analyses text for sentiment, relations, entities… it learns and recommends based on that learning.
http://www.alchemyapi.com/
Slide 70
Slide 70 text
@stopsatgreen
A.I. excels at conversation.
Slide 71
Slide 71 text
@stopsatgreen
This is about more than chatbots.
Chatbots are boring. IKEA have had Anna since at least 2008.
@stopsatgreen
–Kyle Dent
“A conversation is a sequence of turns where
each utterance follows from what’s already
been said and is relevant to the overall
interaction.
Dialog systems must maintain a context over
several turns.”
http://radar.oreilly.com/2015/09/talking-to-the-iot.html
Slide 74
Slide 74 text
@stopsatgreen
Virtual assistants are
everybody’s new jam.
Slide 75
Slide 75 text
@stopsatgreen
Amazon Echo is the first home manifestation of the virtual assistant.
Siri in Apple TV, Apple Car, Apple Watch etc.
Google Voice Search, also in Android, Chrome, Wear, Auto, TV, etc.
… in your Windows 10 laptop.
@stopsatgreen
Conversation doesn’t need to
be vocal, but it helps.
Slide 81
Slide 81 text
@stopsatgreen
Making computers talk is easy.
Bell labs, 1961
Slide 82
Slide 82 text
@stopsatgreen
In browsers using the Web Speech API, supported in Chrome, Opera, Safari, Firefox (behind flag)
Slide 83
Slide 83 text
@stopsatgreen
https://www.ivona.com/ just one of many artificial voice services available.
Also http://developer.att.com/apis/speech and http://neospeech.com/
Slide 84
Slide 84 text
@stopsatgreen
Making computers listen is
easy… now.
Bell Labs, 1952. Could recognise numbers spoken by one person.
1980s Hidden Markov method.
Recently deep learning.
Slide 85
Slide 85 text
@stopsatgreen
Since 2012 Google’s voice
recognition error rate has
dropped from 26% to 8%.
That’s from one word in 4 to one word in 12. This was a few months ago - a recent update is even better.
Baidu, ‘China’s Google’, says theirs is 6% - one word in 17.
Slide 86
Slide 86 text
@stopsatgreen
10% of Baidu search queries
are by voice.
That’s approx. 500m per day.
Slide 87
Slide 87 text
@stopsatgreen
Web Speech API. Chrome & Firefox OS (soon).
Slide 88
Slide 88 text
@stopsatgreen
Project Oxford native only.
Useful in limited cases.
Slide 89
Slide 89 text
@stopsatgreen
!
All need WebRTC or Flash fallback, so forget Safari/iOS.
Slide 90
Slide 90 text
@stopsatgreen
Making computers understand
is hard. But possible.
Only recognises words (string matching), don’t understand intent.
Slide 91
Slide 91 text
@stopsatgreen
https://www.luis.ai/
Slide 92
Slide 92 text
@stopsatgreen
https://www.houndify.com/
Slide 93
Slide 93 text
@stopsatgreen
https://api.ai/
Slide 94
Slide 94 text
@stopsatgreen
https://wit.ai/
Slide 95
Slide 95 text
@stopsatgreen
Slide 96
Slide 96 text
@stopsatgreen
Why natural language is good.
Train machines, multiple steps, takes minutes for what can be a quite simple query.
Slide 97
Slide 97 text
@stopsatgreen
Even on the web that’s about 10 clicks, some typing - nationalrail.co.uk
Slide 98
Slide 98 text
@stopsatgreen
Note that I don’t have to enter dates manually.
Not all options are available, but I can train it to use them.
I used Chicago because an unfortunate drawback is that they don’t always recognise British English.
Slide 99
Slide 99 text
@stopsatgreen
This is what powers M. AI & HI.
This is the wave of the future.
https://www.facebook.com/Davemarcus/posts/10156070660595195
Slide 100
Slide 100 text
@stopsatgreen
(A) Future of Web Apps:
From GUI to CUI.
>> http://www.wired.com/2013/03/conversational-user-interface/
Slide 101
Slide 101 text
@stopsatgreen
https://x.ai/
Also https://claralabs.com/
Slide 102
Slide 102 text
@stopsatgreen
There’s a reason that WhatsApp is valued at $19billion.
Image: Shutterstock via http://www.wired.co.uk/news/archive/2014-02/19/whatsapp-exclusive