Upgrade to Pro — share decks privately, control downloads, hide ads and more …

AIY Voicekit workshop

AIY Voicekit workshop

8a235da15adae86851fa3216834198ed?s=128

Lee Boonstra

April 05, 2018
Tweet

Transcript

  1. 1 Google Cloud Cardboard Challenge Setup your AIY Device

  2. Confidential & Proprietary of web browsing sessions will be done

    without a screen. of all searches will be voice. of customer interactions will be managed without a human. Gartner ComScore Gartner 30% 50% >85% By 2020...
  3. Confidential & Proprietary This is possible through webservices and APIs...

    { “id”: “4f932d9-5678902”, “timestamp”: “2017-05-26”, “lang”: “en”, “result”: { “source”: “agent”, “action: “flight.book”, “parameters”: {“geo-city”: “Los Angeles”, “geo-state-us”: “Hawaii”, “price”: { “amount”: 300, “currency”: “USD” } }
  4. Confidential & Proprietary How do you go from code to

    conversation?
  5. Confidential & Proprietary Google Home

  6. Confidential & Proprietary Google Home — Voice-activated speaker powered Google

    Assistant — A conversation between you and Google that helps you get more done in your world
  7. Confidential & Proprietary A conversation between you and Google that

    helps you get more done in your world
  8. Confidential & Proprietary Google Home

  9. Confidential & Proprietary Get help, anytime, anywhere • Manage tasks

    • Plan the day • Get answers • Make memories • Control your home • Enjoy Entertainment
  10. Confidential + Proprietary Confidential + Proprietary Demo

  11. 11 You could for example build your own Mr. Meeseeks

    box!
  12. 12 • Learn about the Google Assistant • Setting up

    the Assistant • Labs 4 (5 & 6) What we will do today? • Let’s make groups of 2. • In case you didn’t install the software on the micro-sd card, let me know, so I can install.
  13. 13 • Enable Internet • Verify if audio and mic

    works • Setting up device • Use Scripts • Use Google Cloud Software
  14. 14 • Raspbian • With Google Assistant Libraries: ◦ https://github.com/google/aiyprojects-raspbian.git

    • and Voicehat, Audio drivers AIY Voicekit SD image
  15. 15 Dialogflow Enterprise

  16. 16 • End-to-end development suite for building conversational UI. •

    Previously known as API.AI • Sept 2016, acquired by Google • Powered by Machine Learning Dialogflow
  17. 17 Why Dialogflow • Powered by Machine Learning (NLP) •

    Scalable: separate your conversation text from code • Build faster with the Web UI • Advanced fulfillment options and multi channel integrations • Analytics • Speech / Voice Integration • Multi-lingual bot support (20+ languages) • Part of Google Cloud (60+ cloud services) Intent Recognition (NLP) ... Web Console Powerful SDK Supervised Training Cross-platfor m
  18. Confidential + Proprietary Confidential + Proprietary Labs

  19. 19 https://aiyprojects.withgoogle.com/voice#assembly-guide-5-connect-and-boot-the-devic e • Chapter 4 from the booklet. •

    Chapter 5 from the booklet ◦ Step 13: src/examples/voice/assistant_library_demo.py ◦ src/examples/voice/assistant_library_with_button_demo.py Optional • Use this script to make it headless / work after reboot: ◦ https://goo.gl/KbaFHo Try out Dialogflow, and build your own custom action: http://console.dialogflow.com How to setup the software? WIFI CODE: TODO Note: when using phone tethering. Use a 2.4Ghz network.
  20. 20 Note: the steps provided by the website and booklet

    are out of date. (Due to new type of Raspberry, and release of Google Vision Kit.) You can use the following steps, to get your kit up and running: 1. Download Raspbian with desktop - 2018-03-13 from: https://www.raspberrypi.org/downloads/raspbian/ 2. Use a tool like Etcher.io to flash the micro SD card. 3. Boot your RaspberryPi with the micro SD card inserted, and choose a Wifi network. 4. Open a terminal window with CTRL + ALT + T 5. Execute: git clone https://github.com/google/aiyprojects-raspbian.git AIY-projects-python Raspberry Pi 3B+
  21. 21 You will need a Python3 virtual environment. Download the

    following libraries and dependencies by executing the following commands: sudo apt-get install python-virtualenv virtualenv -p python3 env source env/bin/activate cd AIY-projects-python/ scripts/install-deps.sh sudo scripts/install-services.sh pip install -e src/ pip install RPi.GPIO sudo scripts/install-alsa-config.sh reboot Raspberry Pi 3B+
  22. 22 Now, you will need to configure drivers. You can

    use the following commands: source env/bin/activate cd AIY-projects-python/ python3 checkpoints/check_wifi.py sudo scripts/configure-driver.sh reboot source env/bin/activate cd AIY-projects-python/ python3 checkpoints/check_audio.py Raspberry Pi 3B+
  23. 23 Now you can continue with setting up the Google

    Assistant: • Chapter 5 from the booklet ◦ Step 13: src/examples/voice/assistant_library_with_button_demo.py Optional • Use this script to make it headless / work after reboot: ◦ https://goo.gl/KbaFHo Raspberry Pi 3B+