AIY Voicekit workshop

Transcript

1. 1 Google Cloud Cardboard Challenge Setup your AIY Device
2. Confidential & Proprietary of web browsing sessions will be done without a screen. of all searches will be voice. of customer interactions will be managed without a human. Gartner ComScore Gartner 30% 50% >85% By 2020...
3. Confidential & Proprietary This is possible through webservices and APIs... { “id”: “4f932d9-5678902”, “timestamp”: “2017-05-26”, “lang”: “en”, “result”: { “source”: “agent”, “action: “flight.book”, “parameters”: {“geo-city”: “Los Angeles”, “geo-state-us”: “Hawaii”, “price”: { “amount”: 300, “currency”: “USD” } }
4. Confidential & Proprietary How do you go from code to conversation?
5. Confidential & Proprietary Google Home
6. Confidential & Proprietary Google Home — Voice-activated speaker powered Google Assistant — A conversation between you and Google that helps you get more done in your world
7. Confidential & Proprietary A conversation between you and Google that helps you get more done in your world
8. Confidential & Proprietary Google Home
9. Confidential & Proprietary Get help, anytime, anywhere • Manage tasks • Plan the day • Get answers • Make memories • Control your home • Enjoy Entertainment
10. Confidential + Proprietary Confidential + Proprietary Demo
11. 11 You could for example build your own Mr. Meeseeks box!
12. 12 • Learn about the Google Assistant • Setting up the Assistant • Labs 4 (5 & 6) What we will do today? • Let’s make groups of 2. • In case you didn’t install the software on the micro-sd card, let me know, so I can install.
13. 13 • Enable Internet • Verify if audio and mic works • Setting up device • Use Scripts • Use Google Cloud Software
14. 14 • Raspbian • With Google Assistant Libraries: ◦ https://github.com/google/aiyprojects-raspbian.git • and Voicehat, Audio drivers AIY Voicekit SD image
15. 15 Dialogflow Enterprise
16. 16 • End-to-end development suite for building conversational UI. • Previously known as API.AI • Sept 2016, acquired by Google • Powered by Machine Learning Dialogflow
17. 17 Why Dialogflow • Powered by Machine Learning (NLP) • Scalable: separate your conversation text from code • Build faster with the Web UI • Advanced fulfillment options and multi channel integrations • Analytics • Speech / Voice Integration • Multi-lingual bot support (20+ languages) • Part of Google Cloud (60+ cloud services) Intent Recognition (NLP) ... Web Console Powerful SDK Supervised Training Cross-platfor m
18. Confidential + Proprietary Confidential + Proprietary Labs
19. 19 https://aiyprojects.withgoogle.com/voice#assembly-guide-5-connect-and-boot-the-devic e • Chapter 4 from the booklet. • Chapter 5 from the booklet ◦ Step 13: src/examples/voice/assistant_library_demo.py ◦ src/examples/voice/assistant_library_with_button_demo.py Optional • Use this script to make it headless / work after reboot: ◦ https://goo.gl/KbaFHo Try out Dialogflow, and build your own custom action: http://console.dialogflow.com How to setup the software? WIFI CODE: TODO Note: when using phone tethering. Use a 2.4Ghz network.
20. 20 Note: the steps provided by the website and booklet are out of date. (Due to new type of Raspberry, and release of Google Vision Kit.) You can use the following steps, to get your kit up and running: 1. Download Raspbian with desktop - 2018-03-13 from: https://www.raspberrypi.org/downloads/raspbian/ 2. Use a tool like Etcher.io to flash the micro SD card. 3. Boot your RaspberryPi with the micro SD card inserted, and choose a Wifi network. 4. Open a terminal window with CTRL + ALT + T 5. Execute: git clone https://github.com/google/aiyprojects-raspbian.git AIY-projects-python Raspberry Pi 3B+
21. 21 You will need a Python3 virtual environment. Download the following libraries and dependencies by executing the following commands: sudo apt-get install python-virtualenv virtualenv -p python3 env source env/bin/activate cd AIY-projects-python/ scripts/install-deps.sh sudo scripts/install-services.sh pip install -e src/ pip install RPi.GPIO sudo scripts/install-alsa-config.sh reboot Raspberry Pi 3B+
22. 22 Now, you will need to configure drivers. You can use the following commands: source env/bin/activate cd AIY-projects-python/ python3 checkpoints/check_wifi.py sudo scripts/configure-driver.sh reboot source env/bin/activate cd AIY-projects-python/ python3 checkpoints/check_audio.py Raspberry Pi 3B+
23. 23 Now you can continue with setting up the Google Assistant: • Chapter 5 from the booklet ◦ Step 13: src/examples/voice/assistant_library_with_button_demo.py Optional • Use this script to make it headless / work after reboot: ◦ https://goo.gl/KbaFHo Raspberry Pi 3B+