AIY Voicekit workshop

Transcript

1. 1
   Google Cloud Cardboard
   Challenge
   Setup your AIY Device
   

   View Slide

2. Confidential & Proprietary
   of web browsing
   sessions will be
   done without a
   screen.
   of all searches
   will be voice.
   of customer
   interactions will
   be managed
   without a human.
   Gartner
   ComScore
   Gartner
   30% 50% >85%
   By 2020...
   

   View Slide

3. Confidential & Proprietary
   This is possible through webservices
   and APIs...
   {
   “id”: “4f932d9-5678902”,
   “timestamp”: “2017-05-26”,
   “lang”: “en”,
   “result”: {
   “source”: “agent”,
   “action: “flight.book”, “parameters”: {“geo-city”: “Los Angeles”,
   “geo-state-us”: “Hawaii”, “price”: { “amount”: 300, “currency”: “USD” }
   }
   

   View Slide

4. Confidential & Proprietary
   How do you go from code to
   conversation?
   

   View Slide

5. Confidential & Proprietary
   Google Home
   

   View Slide

6. Confidential & Proprietary
   Google Home — Voice-activated
   speaker powered
   Google Assistant — A conversation
   between you and Google that helps you
   get more done in your world
   

   View Slide

7. Confidential & Proprietary
   A conversation between you and Google
   that helps you get more done in your world
   

   View Slide

8. Confidential & Proprietary
   Google Home
   

   View Slide

9. Confidential & Proprietary
   Get help, anytime, anywhere
   ● Manage tasks
   ● Plan the day
   ● Get answers
   ● Make memories
   ● Control your home
   ● Enjoy Entertainment
   

   View Slide

10. Confidential + Proprietary
    Confidential + Proprietary
    Demo
    

    View Slide

11. 11
    You could for example build your
    own Mr. Meeseeks box!
    

    View Slide

12. 12
    ● Learn about the Google Assistant
    ● Setting up the Assistant
    ● Labs 4 (5 & 6)
    What we will do today?
    ● Let’s make groups of 2.
    ● In case you didn’t install the software on the
    micro-sd card, let me know, so I can install.
    

    View Slide

13. 13
    ● Enable Internet
    ● Verify if audio and mic works
    ● Setting up device
    ● Use Scripts
    ● Use Google Cloud
    Software
    

    View Slide

14. 14
    ● Raspbian
    ● With Google Assistant Libraries:
    ○ https://github.com/google/aiyprojects-raspbian.git
    ● and Voicehat, Audio drivers
    AIY Voicekit SD image
    

    View Slide

15. 15
    Dialogflow
    Enterprise
    

    View Slide

16. 16
    ● End-to-end development suite for building
    conversational UI.
    ● Previously known as API.AI
    ● Sept 2016, acquired by Google
    ● Powered by Machine Learning
    Dialogflow
    

    View Slide

17. 17
    Why Dialogflow
    ● Powered by Machine Learning (NLP)
    ● Scalable: separate your conversation text from
    code
    ● Build faster with the Web UI
    ● Advanced fulfillment options and multi channel
    integrations
    ● Analytics
    ● Speech / Voice Integration
    ● Multi-lingual bot support (20+ languages)
    ● Part of Google Cloud (60+ cloud services)
    Intent
    Recognition
    (NLP)
    ...
    Web Console
    Powerful
    SDK
    Supervised
    Training
    Cross-platfor
    m
    

    View Slide

18. Confidential + Proprietary
    Confidential + Proprietary
    Labs
    

    View Slide

19. 19
    https://aiyprojects.withgoogle.com/voice#assembly-guide-5-connect-and-boot-the-devic
    e
    ● Chapter 4 from the booklet.
    ● Chapter 5 from the booklet
    ○ Step 13: src/examples/voice/assistant_library_demo.py
    ○ src/examples/voice/assistant_library_with_button_demo.py
    Optional
    ● Use this script to make it headless / work after reboot:
    ○ https://goo.gl/KbaFHo
    Try out Dialogflow, and build your own custom action:
    http://console.dialogflow.com
    How to setup the software?
    WIFI CODE:
    TODO
    Note: when using phone
    tethering. Use a 2.4Ghz
    network.
    

    View Slide

20. 20
    Note: the steps provided by the website and booklet are out of date. (Due to new type of
    Raspberry, and release of Google Vision Kit.) You can use the following steps, to get your kit
    up and running:
    1. Download Raspbian with desktop - 2018-03-13 from:
    https://www.raspberrypi.org/downloads/raspbian/
    2. Use a tool like Etcher.io to flash the micro SD card.
    3. Boot your RaspberryPi with the micro SD card inserted, and choose a Wifi network.
    4. Open a terminal window with CTRL + ALT + T
    5. Execute:
    git clone https://github.com/google/aiyprojects-raspbian.git AIY-projects-python
    Raspberry Pi 3B+
    

    View Slide

21. 21
    You will need a Python3 virtual environment. Download the following libraries and
    dependencies by executing the following commands:
    sudo apt-get install python-virtualenv
    virtualenv -p python3 env
    source env/bin/activate
    cd AIY-projects-python/
    scripts/install-deps.sh
    sudo scripts/install-services.sh
    pip install -e src/
    pip install RPi.GPIO
    sudo scripts/install-alsa-config.sh
    reboot
    Raspberry Pi 3B+
    

    View Slide

22. 22
    Now, you will need to configure drivers. You can use the following commands:
    source env/bin/activate
    cd AIY-projects-python/
    python3 checkpoints/check_wifi.py
    sudo scripts/configure-driver.sh
    reboot
    source env/bin/activate
    cd AIY-projects-python/
    python3 checkpoints/check_audio.py
    Raspberry Pi 3B+
    

    View Slide

23. 23
    Now you can continue with setting up the Google Assistant:
    ● Chapter 5 from the booklet
    ○ Step 13: src/examples/voice/assistant_library_with_button_demo.py
    Optional
    ● Use this script to make it headless / work after reboot:
    ○ https://goo.gl/KbaFHo
    Raspberry Pi 3B+
    

    View Slide