Google Assistant with Raspberry Pi

by Yuki Anzai

Slide 1

Slide 1 text

Raspberry Pi Ͱ Google Assistant Λମݧ͠Α͏ ͋Μ͍͟Ώ͖ʢ@yanzmʣ GTUG Girls Meet Up #33

Slide 2

Slide 2 text

ࢿྉ goo.gl/CDHpi4

Slide 3

Slide 3 text

Google Assistant • https://assistant.google.com/ • SDK • https://developers.google.com/assistant/sdk/ prototype/getting-started-pi-python/

Slide 4

Slide 4 text

ඞཁͳ΋ͷ • Raspberry Pi 3ʢRaspberry Pi 2 + WiFiυϯάϧͰ΋ Մʣ • Raspbian JessieͷΠϯετʔϧ͞ΕͨmicroSD • ిݯΞμϓλ ΋͘͠͸ microUSBέʔϒϧ • USB ϚΠΫ ΋͘͠͸ϚΠΫ಺ଂܕͷUSBΧϝϥ • εϐʔΧʔʢUSB or 3.5mmδϟοΫʣ

Slide 5

Slide 5 text

४උ • Raspberry Pi Λ WiFi ʹ઀ଓ͢Δ

Slide 6

Slide 6 text

४උ • Raspberry Pi ͰίϯιʔϧΛ։͖ɺifconﬁg ίϚϯ υΛ࣮ߦͯ͠IPΞυϨεΛϝϞ͢Δ

Slide 7

Slide 7 text

४උ • Raspberry Pi Ͱ SSH Λ༗ޮʹ͢Δ • Preferences - Raspberry Pi Conﬁguration - Interfaces • SSH Λ Enabled ʹͯ͠ OK ΛΫϦοΫ

Slide 8

Slide 8 text

४උ2 • ࣌ࠁઃఆΛ֬ೝ͢Δʢ͕࣌ؒਖ਼͚͠Ε͹OKʣ • JST ʹ͍ͨ͠ͳΒ • Preferences - Raspberry Pi Conﬁguration - Localisation • Set Timezone ΛΫϦοΫ • Area: Asia, Location: Tokyo • ࠶ىಈ

Slide 9

Slide 9 text

४උ3 • Raspberry Pi ʹ PC ͔Β SSH ͰϩάΠϯ͢Δ $ ssh pi@[ϝϞͨ͠IPΞυϨε] password: [σϑΥϧτ͸raspberry] • ࣌ࠁઃఆΛ֬ೝ͢Δʢ͕࣌ؒਖ਼͚͠Ε͹OKʣ $ date

Slide 10

Slide 10 text

։ൃϓϩδΣΫτͱ ΞΧ΢ϯτͷઃఆ • https://developers.google.com/assistant/sdk/ prototype/getting-started-pi-python/conﬁg-dev- project-and-account Λ։͘ • goo.gl/GxLUSW • Ҏ߱ɺ͜ͷϖʔδΛʮઃఆखॱυΩϡϝϯτʯͱݺ ͼ·͢ɻ

Slide 11

Slide 11 text

৽͍͠ϓϩδΣΫτΛ࡞Δ - 1 • ʮઃఆखॱυΩϡϝϯτʯʹ͋Δ GO TO THE PROJECT PAGE ϘλϯΛΫϦοΫ͢Δ

Slide 12

Slide 12 text

৽͍͠ϓϩδΣΫτΛ࡞Δ - 2 • ্ͷํʹ͋ΔϓϩδΣΫτΛ࡞੒ΛΫϦοΫ • ϓϩδΣΫτ໊Λೖྗͯ͠࡞੒ΛΫϦοΫ • ͳΜͰ΋Α͍Ͱ͢ɻAssistant with Raspberry Pi ͱ͔

Slide 13

Slide 13 text

Google Assistant API ༗ޮԽ • ʮઃఆखॱυΩϡϝϯτʯʹ͋Δ ENABLE THE API ϘλϯΛΫϦοΫ͢Δ

Slide 14

Slide 14 text

OAuth Client ID ͷઃఆ - 1 • OAuth ಉҙը໘Λઃఆ͢Δ

Slide 15

Slide 15 text

OAuth Client ID ͷઃఆ - 2 • OAuth ΫϥΠΞϯτ ID Λ࡞੒͢Δ

Slide 16

Slide 16 text

OAuth Client ID ͷઃఆ - 3 • OAuth ΫϥΠΞϯτ ID Λ࡞੒͢Δ • μΠΞϩά͕දࣔ͞ΕͨΒ OK ΛΫϦοΫ

Slide 17

Slide 17 text

OAuth Client ID ͷઃఆ - 4 • ΫϥΠΞϯτ ID secret JSON ϑΝΠϧΛμ΢ϯ ϩʔυ

Slide 18

Slide 18 text

OAuth Client ID ͷઃఆ - 5 • μ΢ϯϩʔυͨ͠ΫϥΠΞϯτ ID secret JSON ϑΝΠϧΛ Raspberry Pi ʹసૹ $ scp [μ΢ϯϩʔυͨ͠JSONϑΝΠϧ] pi@[ϝϞ ͨ͠IPΞυϨε]:/home/pi/ password: [σϑΥϧτ͸raspberry]

Slide 19

Slide 19 text

ΞΫςΟϏςΟίϯτϩʔϧͷ ઃఆ - 1 • ʮઃఆखॱυΩϡϝϯτʯͷԼͷํʹ͋Δ Activity Controls page ͷϦϯΫΛ։͘

Slide 20

Slide 20 text

ΞΫςΟϏςΟίϯτϩʔϧͷ ઃఆ - 2 • ҎԼͷ߲໨Λ༗ޮʹ͢Δ • ΢ΣϒͱΞϓϦͷΞΫςΟϏςΟ • ϩέʔγϣϯཤྺ • ୺຤৘ใ • Ի੠ΞΫςΟϏςΟ

Slide 21

Slide 21 text

Ի੠ͷઃఆͱ֬ೝ - 0 • RaspberryPi ʹ SSH ͰϩάΠϯ͢Δ

Slide 22

Slide 22 text

Ի੠ͷઃఆͱ֬ೝ - 1 • εϐʔΧʔͷςετ • Front, Left ͕܁Γฦ͠ฉ͑͜Ε͹OK • Ի͕໐Βͳ͍ਓ͸࣍ͷεϥΠυ΁ $ speaker-test -t wav

Slide 23

Slide 23 text

εϐʔΧʔ͔ΒԻ͕໐Βͳ͍ ਓ͸͜ΕΛ΍Δ $ sudo raspi-config • ʲAdvanced OptionsʳΛબ୒ • ʲAudioʳΛબ୒ • ʲForce 3.5mmʢ'headphone'ʣjackʳΛબ୒

Slide 24

Slide 24 text

Ի੠ͷઃఆͱ֬ೝ - 2 • ϚΠΫͷςετʢ5ඵؒ࿥Իʣ • Τϥʔ͕ग़ͳ͔ͬͨΒద౰ʹ͠Ό΂ͬͯ 7 ΁ • Τϥʔ͕ग़ͨΒ 3ʢ࣍ʣ΁ $ arecord --format=S16_LE --duration=5 -- rate=16k --file-type=raw out.raw

Slide 25

Slide 25 text

Ի੠ͷઃఆͱ֬ೝ - 3 • ϚΠΫͷΧʔυ൪߸ͱσόΠε൪߸Λௐ΂Δ • ͜ΕͳΒΧʔυ൪߸͸ 1, σόΠε൪߸͸ 0 $ arecord -l **** List of CAPTURE Hardware Devices **** card 1: Device [USB PnP Sound Device], device 0: USB Audio [USB Audio]

Slide 26

Slide 26 text

Ի੠ͷઃఆͱ֬ೝ - 4 • εϐʔΧʔͷΧʔυ൪߸ͱσόΠε൪߸Λௐ΂Δ • ͜ΕͳΒΧʔυ൪߸͸ 0, σόΠε൪߸͸ 0 $ aplay -l **** List of PLAYBACK Hardware Devices **** card 0: ALSA [bcm2835 ALSA], device 0: bcm2835 ALSA [bcm2835 ALSA]

Slide 27

Slide 27 text

Ի੠ͷઃఆͱ֬ೝ - 5 • SSH ͷ઀ଓΛ੾Δ • ઃఆϑΝΠϧΛ࡞Δ • ϑΝΠϧ໊ : .asoundrc • ಺༰: ࣍ͷεϥΠυ

Slide 28

Slide 28 text

pcm.!default { type asym capture.pcm "mic" playback.pcm "speaker" } pcm.mic { type plug slave { pcm "hw:[ϚΠΫͷΧʔυ൪߸],[ϚΠΫͷσόΠε൪߸]" } } pcm.speaker { type plug slave { pcm "hw:[εϐʔΧʔͷΧʔυ൪߸],[εϐʔΧʔͷσόΠε൪߸]" } }

Slide 29

Slide 29 text

pcm.!default { type asym capture.pcm "mic" playback.pcm "speaker" } pcm.mic { type plug slave { pcm "hw:1,0" } } pcm.speaker { type plug slave { pcm "hw:1,1" } } ྫʣ

Slide 30

Slide 30 text

Ի੠ͷઃఆͱ֬ೝ - 6 • Raspberry Pi ͷ /home/pi/ ʹஔ͘ • 2 ʹ໭Δ $ scp .asoundrc pi@[ϝϞͨ͠IPΞυϨε]:/ home/pi/ password: [σϑΥϧτ͸raspberry]

Slide 31

Slide 31 text

Ի੠ͷઃఆͱ֬ೝ - 7 • 2Ͱ࿥Իͨ͠Ի੠Λ࠶ੜ • ໰୊ͳ͘࿥Ի͞Ε͍ͯΕ͹ OK • Իྔͷௐઅ͸ $ aplay --format=S16_LE --rate=16k out.raw $ alsamixer

Slide 32

Slide 32 text

Python ͷઃఆ • Python virtual environment Λ࢖ͬͯγεςϜͷ Python ύοέʔδ͔Β SDK ͱґଘ͢Δ΋Ζ΋ΖΛ ִ཭ • ݱঢ় Google Assistant ͷϥΠϒϥϦ͸ Python 3.x ͰͷΈಈ͘ • Πϯετʔϧͷ్தͰฉ͔ΕͨΒ y ͰਐΜͰͩ͘͞ ͍

Slide 33

Slide 33 text

Python ͷઃఆ $ sudo apt-get update $ sudo apt-get install python3-dev python3-venv $ python3 -m venv env $ env/bin/python -m pip install --upgrade pip setuptools $ source env/bin/activate

Slide 34

Slide 34 text

ϥΠϒϥϦͱαϯϓϧίʔυ Λऔͬͯ͘Δ (env) $ python -m pip install --upgrade google-assistant-library

Slide 35

Slide 35 text

αϯϓϧίʔυͷೝূ - 1 • ϒϥ΢βΛ։͍ͯ Google ΞΧ΢ϯτʹϩάΠϯ͢ Δ • ΞΫςΟϏςΟίϯτϩʔϧͷઃఆΛͨ͠΍ͭ • ೝূπʔϧΛΠϯετʔϧ͢Δ (env) $ python -m pip install --upgrade google-auth-oauthlib[tool]

Slide 36

Slide 36 text

αϯϓϧίʔυͷೝূ - 2 • ೝূπʔϧΛ࣮ߦ͢Δ • จࣈίʔυͷΤϥʔ͕ग़ͨΒ (env) $ google-oauthlib-tool --client- secrets /home/pi/[લʹసૹ͓͍ͯͨ͠JSON] -- scope https://www.googleapis.com/auth/ assistant-sdk-prototype --save --headless (env) $ export LC_ALL=C.UTF-8 (env) $ export LANG=C.UTF-8

Slide 37

Slide 37 text

• ͱදࣔ͞ΕΔͷͰ … ෦෼ͷ URL Λίϐʔͯ͠ϒϥ ΢βʹషΓ෇͚ͯදࣔ • ΞΧ΢ϯτΛબ୒ʢඞཁͳ৔߹ʣ͠ɺALLOW ʢڐ ՄʣΛΫϦοΫ • දࣔ͞ΕΔίʔυΛίϐʔ͠ Please visit this URL to authorize this application: … Enter the authorization code: • ʹೖྗ

Slide 38

Slide 38 text

αϯϓϧίʔυͷ࣮ߦ • OK, google. What’s the weather in Tokyo • ͱݴͬͯΈΑ͏ (env) $ google-assistant-demo