Speech Frameworkを使った音声認識の基本

Mobile勉強会 ウォンテッドリー × チームラボ × Sansan #18 〜新技術の導入〜
https://sansan.connpass.com/event/338706/

Transcript

1. Speech FrameworkΛ࢖ͬͨ Ի੠ೝࣝͷجຊ
2. Տล խ࢙ɹMasashi Kawabe NOT A HOTEL גࣜձࣾ Smart Home νʔϜ ιϑτ΢ΣΞΤϯδχΞ
3. ࣨ಺ʹεΠον΍ϦϞίϯ͸ͳ͘ɺ͢΂ͯ͸ Home Controller͔Βૢ࡞ɻ
 ੈքதɺͲ͜ͷNOT A HOTELʹߦͬͯ΋ɺ ·ΔͰࣗ୐ͷΑ͏ʹ໎͏͜ͱͳ͘͢΂ͯͷػ ثͷૢ࡞͕Ͱ͖·͢ɻ Home Controller
4. Speech Framework • iOS ඪ४ͷԻ੠ೝࣝ Framework • ࿥ԻࡁΈͷԻ੠ϑΝΠϧͷೝࣝ, ϚΠΫೖྗΛར༻ͨ͠ϦΞϧλΠϜͳ Ի੠ͷೝ͕ࣝՄೳ • ೔ຊޠ΋αϙʔτ • iOS 10.0 Ҏ߱Ͱར༻Մೳ
5. Speech Framework Λ࢖ͬͨԻ੠ೝࣝͷ࠷খ࣮૷
6. Ի੠ೝࣝͷதؒ݁Ռͷऔಘ • SFSpeechRecognitionRequest ͷ shouldReportPartialResults ϓϩύςΟͰɺԻ੠ೝࣝͷதؒ݁ՌΛऔಘ͢Δɾऔಘ͠ͳ͍ͷ ੍ޚ͕Մೳ • σϑΥϧτ஋͸ true ( தؒ݁ՌΛऔಘ͢Δ ) • a • Ի੠ೝࣝͷ࠷ऴతͳ݁Ռ͚͕ͩඞཁͳ৔߹͸ɺ shouldReportPartialResults Λfalse ʹઃఆ͢Δ
7. Ի੠ೝࣝͷதؒ݁Ռऔಘͷ༗ແʹΑΔڍಈͷҧ͍
8. ΦϯσόΠεͰͷԻ੠ೝࣝ • ϓϥΠόγʔΛߟྀͯ͠ɺΦϯσόΠεͰԻ੠ೝࣝΛͤ͞Δ͜ͱ͕Ͱ͖Δ • ωοτϫʔΫʹܨ͕ͣͱ΋Ի੠ೝ͕ࣝՄೳ • ͨͩ͠ɺServer ϕʔεͷԻ੠ೝࣝͱൺֱͯ͠ਫ਼౓͕ߴ͘ͳ͍ • Server ϕʔεͷԻ੠ೝࣝ΋ɺԻ੠ೝࣝͷ࠷େ࣌ؒͷ੍ݶ, Ұ೔͋ͨΓͷճ਺੍ݶ͕͋Δͱ͍͏σϝϦοτ͕͋Δ • SFSpeechRecognitionRequest ͷ requiresOnDeviceRecognition ϓϩύςΟͰɺ༗ޮԽͰ͖Δ • a
9. ݴޠϞσϧͷΧελϚΠζ • Ի੠ೝࣝͷݴޠϞσϧΛΧελϚΠζ͢Δ͜ͱͰɺಛఆͷϢʔεέʔε ޲͚ʹೝࣝਫ਼౓Λ্͛Δ͜ͱ͕Ͱ͖Δ • iOS 17.0 Ҏ߱Ͱར༻Մೳ • ΧελϚΠζͨ͠ݴޠϞσϧΛར༻͢Δʹ͸ɺΦϯσόΠεͰԻ੠ೝࣝ ͤ͞Δඞཁ͕͋Δ • a
10. ΧελϚΠζͨ͠ݴޠϞσϧͷ࡞੒
11. ΧελϚΠζͨ͠ݴޠϞσϧͷ࡞੒ • PhraseCount ΦϒδΣΫτΛར༻͢Δ͜ͱͰɺਖ਼֬ͳϑϨʔζΛ ΧελϜϞσϧʹొ࿥͢Δ͜ͱ͕Ͱ͖Δ • ಛఆͷϑϨʔζΛೝࣝͤ͞΍͘͢͢Δ •
12. ΧελϚΠζͨ͠ݴޠϞσϧͷ࡞੒ • ΞϓϦͰઐ໳༻ޠͳͲҰൠతͰ͸ͳ͍୯ޠΛ࢖༻͢Δ৔߹ɺ༻ޠͷεϖϧ ͱൃԻͷϖΞΛఆٛ͠ɺΧελϜϞσϧʹొ࿥͢Δ͜ͱ͕Ͱ͖Δ • ൃԻ͸ X-SAMPA ܗࣜ •
13. ΧελϚΠζͨ͠ݴޠϞσϧͷར༻ • ࡞੒ͨ͠ΧελϜݴޠϞσϧ SFSpeechRecognitionRequest ͷ customizedLanguageModel ϓϩύςΟʹઃఆ͢Δ͜ͱͰར༻Մೳ •
14. ࢀߟ • Advances in Speech Recognition • https://developer.apple.com/videos/play/wwdc2019/256 • Customize on-device speech recognition • https://developer.apple.com/videos/play/ wwdc2023/10101 • Recognizing speech in live audio • https://developer.apple.com/documentation/speech/ recognizing-speech-in-live-audio