$30 off During Our Annual Pro Sale. View Details »

A Journey into Applied AI Cloud Services

A Journey into Applied AI Cloud Services

Are the claims on the marketing pages of Google and Amazon's AI Services really true? Is it really "easy for developers", can you really have "no machine learning experience"?
Join me on a journey of learning what is really needed to use Cloud AI Services.

Gillian Armstrong

October 02, 2019
Tweet

More Decks by Gillian Armstrong

Other Decks in Technology

Transcript

  1. Liberty IT
    A Journey into Applied AI Cloud Services
    “No Machine Learning Experience Required…?”
    Gillian Armstrong
    @virtualgill

    View Slide

  2. Liberty IT

    View Slide

  3. Liberty IT

    View Slide

  4. Gillian Armstrong
    @virtualgill
    Solutions Architect
    Liberty IT
    aka: regular software engineer type person

    View Slide

  5. Cardiff
    Hamburg
    Gillian Armstrong // @virtualgill

    View Slide

  6. Gillian Armstrong // @virtualgill

    View Slide

  7. Uh-oh
    Gillian Armstrong // @virtualgill

    View Slide

  8. Gillian Armstrong // @virtualgill

    View Slide

  9. Gillian Armstrong // @virtualgill

    View Slide

  10. THE
    MONOLITH
    “Why does this method
    have 60,000 lines”
    Gillian Armstrong // @virtualgill

    View Slide

  11. Monolith
    SERVICE-
    ORIENTATED
    ARCHITECTURE
    “How deep does this go”
    Gillian Armstrong // @virtualgill

    View Slide

  12. Monolith SOA
    MICROSERVICES
    “Where did that event go?”
    Gillian Armstrong // @virtualgill

    View Slide

  13. Monolith SOA Microservices
    CLOUD
    “Where are my servers running?”
    Gillian Armstrong // @virtualgill

    View Slide

  14. SERVERLESS
    Monolith SOA Microservices Cloud
    “Servers? What Servers?”
    Gillian Armstrong // @virtualgill

    View Slide

  15. Monolith SOA Microservices Cloud Serverless
    Gillian Armstrong // @virtualgill

    View Slide

  16. Gillian Armstrong // @virtualgill
    We decided to build
    Serverless-first so
    we could…
    • Move Fast
    • Learn Fast
    • Change Fast
    …at very little upfront cost

    View Slide

  17. Focusing on
    Functionality
    Offloading
    everything else
    Gillian Armstrong // @virtualgill
    Serverless is…

    View Slide

  18. Gillian Armstrong // @virtualgill
    An application
    that costs you
    nothing to run
    when no-one is
    using it.
    Serverless is…

    View Slide

  19. Gillian Armstrong // @virtualgill
    Functions
    Databases
    Queues
    Logging
    Storage
    API Proxy
    Assembling
    your application
    using pay per
    use managed
    services
    Serverless is…

    View Slide

  20. Gillian Armstrong // @virtualgill
    Artificial
    Intelligence
    Services
    Functions
    Databases
    Queues
    Logging
    Storage
    API Proxy

    View Slide

  21. “easy for developers”
    Gillian Armstrong // @virtualgill

    View Slide

  22. “no machine
    learning experience
    required”
    Gillian Armstrong // @virtualgill

    View Slide

  23. Shiny POC
    Gillian Armstrong // @virtualgill

    View Slide

  24. I am AI-ing
    so good
    Gillian Armstrong // @virtualgill

    View Slide

  25. Effort /
    Expertise
    POC
    Production
    Gillian Armstrong // @virtualgill

    View Slide

  26. POC
    Production
    Effort /
    Expertise
    Gillian Armstrong // @virtualgill

    View Slide

  27. “no machine
    learning experience
    required”
    “easy for
    developers”
    Gillian Armstrong // @virtualgill

    View Slide

  28. Gillian Armstrong // @virtualgill

    View Slide

  29. Gillian Armstrong // @virtualgill

    View Slide

  30. Gillian Armstrong // @virtualgill

    View Slide

  31. Oops, your
    monolith is
    showing…
    Gillian Armstrong // @virtualgill

    View Slide

  32. Gillian Armstrong // @virtualgill

    View Slide

  33. REQUIREMENTS
    Gillian Armstrong // @virtualgill
    Does your business
    understand how to
    write requirements for a
    ML system?
    Do you?

    View Slide

  34. DATA
    • Quantity
    • Quality
    • Language / Linguistics
    • Feature Engineering
    Gillian Armstrong // @virtualgill

    View Slide

  35. I am definitely
    going to have to
    know something
    about machine
    learning
    Gillian Armstrong // @virtualgill

    View Slide

  36. LEGAL
    • Privacy
    • Security
    • Compliance
    Gillian Armstrong // @virtualgill

    View Slide

  37. AI SERVICES
    Gillian Armstrong // @virtualgill
    • Coding
    • Governance / Source
    Control
    • Deployment, CI/CD
    • Testing
    • Monitor

    View Slide

  38. ENGINEERING
    Gillian Armstrong // @virtualgill
    AI
    Everything else
    Not everyone is a
    Cloud Developer
    (yet)

    View Slide

  39. Gillian Armstrong // @virtualgill
    Assembling
    your application
    using pay per
    use managed
    services
    Serverless is…

    View Slide

  40. ENGINEERING
    Gillian Armstrong // @virtualgill
    AI
    Everything else
    • Infrastructure as Code
    • Deployment, CI/CD
    • Testing
    • Security
    • Observability
    • Cost

    View Slide

  41. Gillian Armstrong // @virtualgill
    Assembling
    your application
    using pay per
    use managed
    services
    Serverless is…

    View Slide

  42. Gillian Armstrong // @virtualgill
    Serverless is…
    Actually pretty hard

    View Slide

  43. They said easy!
    This isn’t easy!
    Gillian Armstrong // @virtualgill

    View Slide

  44. USER EXPERIENCE
    Gillian Armstrong // @virtualgill
    • Hey, there are still
    humans to think
    about too

    View Slide

  45. Definitely not
    easy
    Gillian Armstrong // @virtualgill

    View Slide

  46. Gillian Armstrong // @virtualgill
    https://pair.withgoogle.com/

    View Slide

  47. USER EXPERIENCE
    Gillian Armstrong // @virtualgill
    • Mental Models
    • Explainability and
    Trust
    • Feedback and
    Control

    View Slide

  48. USER EXPERIENCE
    Gillian Armstrong // @virtualgill
    • Mental Models

    View Slide

  49. Model your design on a
    human, not a website
    People are the original
    conversational interface

    View Slide

  50. The Web is about Telling
    the user what to do
    Conversational UI is
    about Listening to what
    the user wants to do

    View Slide

  51. USER EXPERIENCE
    Gillian Armstrong // @virtualgill
    • Mental Models
    • Explainability and
    Trust

    View Slide

  52. Is the user clear
    they are talking
    to a bot?
    Can we explain
    why the bot
    gave a particular
    answer?

    View Slide

  53. USER EXPERIENCE
    Gillian Armstrong // @virtualgill
    • Mental Models
    • Explainability and
    Trust
    • Feedback and
    Control

    View Slide

  54. Gillian Armstrong // @virtualgill
    Can I choose
    not to talk to the
    bot?
    Can your user give
    you feedback?

    View Slide

  55. USER EXPERIENCE
    Gillian Armstrong // @virtualgill
    • Mental Models
    • Explainability and
    Trust
    • Feedback and
    Control

    View Slide

  56. ETHICS
    Gillian Armstrong // @virtualgill
    • Humanizing Technology
    changes how we relate to it
    • Automation of Jobs
    • Privacy Concerns
    • Human Rights Concerns
    • Environmental Concerns

    View Slide

  57. ETHICS
    Gillian Armstrong // @virtualgill
    Always pair
    “What can we do”,
    with the question
    “What shouldn’t we do”

    View Slide

  58. Gillian Armstrong // @virtualgill

    View Slide

  59. Gillian Armstrong // @virtualgill
    Cloud Development
    isn’t simple
    Even just using
    AI isn’t simple

    View Slide

  60. POC
    Production
    Effort /
    Expertise
    Gillian Armstrong // @virtualgill

    View Slide

  61. Gillian Armstrong // @virtualgill
    Cloud Development
    isn’t simple
    Even just using
    AI isn’t simple

    View Slide

  62. Gillian Armstrong // @virtualgill
    Not easy, but
    worth it

    View Slide

  63. Never before has one developer had
    so much power in their hands…
    Gillian Armstrong // @virtualgill

    View Slide

  64. Never before has one developer had
    so much power in their hands…
    What are you going to do with it?
    Gillian Armstrong // @virtualgill

    View Slide

  65. Thank you!
    Gillian Armstrong
    @virtualgill
    http://virtualgill.io

    View Slide

  66. @Liberty Information Technology
    @Liberty IT
    @Liberty_IT

    View Slide