Upgrade to Pro — share decks privately, control downloads, hide ads and more …

AIY Voicekit workshop

AIY Voicekit workshop

Lee Boonstra

April 05, 2018
Tweet

More Decks by Lee Boonstra

Other Decks in Technology

Transcript

  1. 1
    Google Cloud Cardboard
    Challenge
    Setup your AIY Device

    View full-size slide

  2. Confidential & Proprietary
    of web browsing
    sessions will be
    done without a
    screen.
    of all searches
    will be voice.
    of customer
    interactions will
    be managed
    without a human.
    Gartner
    ComScore
    Gartner
    30% 50% >85%
    By 2020...

    View full-size slide

  3. Confidential & Proprietary
    This is possible through webservices
    and APIs...
    {
    “id”: “4f932d9-5678902”,
    “timestamp”: “2017-05-26”,
    “lang”: “en”,
    “result”: {
    “source”: “agent”,
    “action: “flight.book”, “parameters”: {“geo-city”: “Los Angeles”,
    “geo-state-us”: “Hawaii”, “price”: { “amount”: 300, “currency”: “USD” }
    }

    View full-size slide

  4. Confidential & Proprietary
    How do you go from code to
    conversation?

    View full-size slide

  5. Confidential & Proprietary
    Google Home

    View full-size slide

  6. Confidential & Proprietary
    Google Home — Voice-activated
    speaker powered
    Google Assistant — A conversation
    between you and Google that helps you
    get more done in your world

    View full-size slide

  7. Confidential & Proprietary
    A conversation between you and Google
    that helps you get more done in your world

    View full-size slide

  8. Confidential & Proprietary
    Google Home

    View full-size slide

  9. Confidential & Proprietary
    Get help, anytime, anywhere
    ● Manage tasks
    ● Plan the day
    ● Get answers
    ● Make memories
    ● Control your home
    ● Enjoy Entertainment

    View full-size slide

  10. Confidential + Proprietary
    Confidential + Proprietary
    Demo

    View full-size slide

  11. 11
    You could for example build your
    own Mr. Meeseeks box!

    View full-size slide

  12. 12
    ● Learn about the Google Assistant
    ● Setting up the Assistant
    ● Labs 4 (5 & 6)
    What we will do today?
    ● Let’s make groups of 2.
    ● In case you didn’t install the software on the
    micro-sd card, let me know, so I can install.

    View full-size slide

  13. 13
    ● Enable Internet
    ● Verify if audio and mic works
    ● Setting up device
    ● Use Scripts
    ● Use Google Cloud
    Software

    View full-size slide

  14. 14
    ● Raspbian
    ● With Google Assistant Libraries:
    ○ https://github.com/google/aiyprojects-raspbian.git
    ● and Voicehat, Audio drivers
    AIY Voicekit SD image

    View full-size slide

  15. 15
    Dialogflow
    Enterprise

    View full-size slide

  16. 16
    ● End-to-end development suite for building
    conversational UI.
    ● Previously known as API.AI
    ● Sept 2016, acquired by Google
    ● Powered by Machine Learning
    Dialogflow

    View full-size slide

  17. 17
    Why Dialogflow
    ● Powered by Machine Learning (NLP)
    ● Scalable: separate your conversation text from
    code
    ● Build faster with the Web UI
    ● Advanced fulfillment options and multi channel
    integrations
    ● Analytics
    ● Speech / Voice Integration
    ● Multi-lingual bot support (20+ languages)
    ● Part of Google Cloud (60+ cloud services)
    Intent
    Recognition
    (NLP)
    ...
    Web Console
    Powerful
    SDK
    Supervised
    Training
    Cross-platfor
    m

    View full-size slide

  18. Confidential + Proprietary
    Confidential + Proprietary
    Labs

    View full-size slide

  19. 19
    https://aiyprojects.withgoogle.com/voice#assembly-guide-5-connect-and-boot-the-devic
    e
    ● Chapter 4 from the booklet.
    ● Chapter 5 from the booklet
    ○ Step 13: src/examples/voice/assistant_library_demo.py
    ○ src/examples/voice/assistant_library_with_button_demo.py
    Optional
    ● Use this script to make it headless / work after reboot:
    ○ https://goo.gl/KbaFHo
    Try out Dialogflow, and build your own custom action:
    http://console.dialogflow.com
    How to setup the software?
    WIFI CODE:
    TODO
    Note: when using phone
    tethering. Use a 2.4Ghz
    network.

    View full-size slide

  20. 20
    Note: the steps provided by the website and booklet are out of date. (Due to new type of
    Raspberry, and release of Google Vision Kit.) You can use the following steps, to get your kit
    up and running:
    1. Download Raspbian with desktop - 2018-03-13 from:
    https://www.raspberrypi.org/downloads/raspbian/
    2. Use a tool like Etcher.io to flash the micro SD card.
    3. Boot your RaspberryPi with the micro SD card inserted, and choose a Wifi network.
    4. Open a terminal window with CTRL + ALT + T
    5. Execute:
    git clone https://github.com/google/aiyprojects-raspbian.git AIY-projects-python
    Raspberry Pi 3B+

    View full-size slide

  21. 21
    You will need a Python3 virtual environment. Download the following libraries and
    dependencies by executing the following commands:
    sudo apt-get install python-virtualenv
    virtualenv -p python3 env
    source env/bin/activate
    cd AIY-projects-python/
    scripts/install-deps.sh
    sudo scripts/install-services.sh
    pip install -e src/
    pip install RPi.GPIO
    sudo scripts/install-alsa-config.sh
    reboot
    Raspberry Pi 3B+

    View full-size slide

  22. 22
    Now, you will need to configure drivers. You can use the following commands:
    source env/bin/activate
    cd AIY-projects-python/
    python3 checkpoints/check_wifi.py
    sudo scripts/configure-driver.sh
    reboot
    source env/bin/activate
    cd AIY-projects-python/
    python3 checkpoints/check_audio.py
    Raspberry Pi 3B+

    View full-size slide

  23. 23
    Now you can continue with setting up the Google Assistant:
    ● Chapter 5 from the booklet
    ○ Step 13: src/examples/voice/assistant_library_with_button_demo.py
    Optional
    ● Use this script to make it headless / work after reboot:
    ○ https://goo.gl/KbaFHo
    Raspberry Pi 3B+

    View full-size slide