GDG DevFest 2015 Poland - How to grow your own Babel fish

Video of the demo is available at https://youtu.be/Tv8ilBOKS2o

Transcript

3. WEBRTC
4. demo
8. WORKS IN A BROWSER
9. USES OPEN STANDARDS
10. TOOK ONE DAY TO WRITE
12. HOW DOES IT WORK?
13. 1. SENDS AUDIO AND VIDEO USING WEBRTC
14. webrtc = new SimpleWebRTC({ localVideoEl: 'localVideo', remoteVideosEl: 'remoteVideos', autoRequestMedia: true }) webrtc.on('readyToCall', () => { webrtc.joinRoom('your awesome room name') })
15. webrtc = new SimpleWebRTC({ localVideoEl: 'localVideo', remoteVideosEl: 'remoteVideos', autoRequestMedia: true }) webrtc.on('readyToCall', () => { webrtc.joinRoom('your awesome room name') })
16. webrtc = new SimpleWebRTC({ localVideoEl: 'localVideo', remoteVideosEl: 'remoteVideos', autoRequestMedia: true }) webrtc.on('readyToCall', () => { webrtc.joinRoom('your awesome room name') })
17. webrtc = new SimpleWebRTC({ localVideoEl: 'localVideo', remoteVideosEl: 'remoteVideos', autoRequestMedia: true }) webrtc.on('readyToCall', () => { webrtc.joinRoom('your awesome room name') })
18. webrtc = new SimpleWebRTC({ localVideoEl: 'localVideo', remoteVideosEl: 'remoteVideos', autoRequestMedia: true }) webrtc.on('readyToCall', () => { webrtc.joinRoom('your awesome room name') })
19. 2. RECOGNIZES WHAT YOU SAY USING WEB SPEECH
20. recognition = new SpeechRecognition() recognition.on('result', (result) => { // do something with the result }) recognition.start()
21. recognition = new SpeechRecognition() recognition.on('result', (result) => { // do something with the result }) recognition.start()
22. recognition = new SpeechRecognition() recognition.on('result', (result) => { // do something with the result }) recognition.start()
23. 3. SENDS TRANSCRIPT TO GOOGLE TRANSLATE
24. 4. SENDS TRANSLATION TO THE OTHER PERSON USING WEBRTC
25. webrtc.sendDirectlyToAll( 'channel label', 'payload label', payload )
26. 5. READS IT OUT LOUD USING WEB SPEECH
27. msg = new SpeechSynthesisUtterance() msg.lang = 'en-GB' msg.text = 'German jokes are the wurst!' speechSynthesis.speak(msg)
28. msg = new SpeechSynthesisUtterance() msg.lang = 'en-GB' msg.text = 'German jokes are the wurst!' speechSynthesis.speak(msg)
30. WEB SPEECH API INTRO
31. ONE-SHOT CONTINUOUS
32. SERVER CLIENT
34. WEB SPEECH API RANT
35. 1. STOPS IF YOU TALK FOR TOO LONG
36. 2. STOPS IF YOU DON’T TALK FOR TOO LONG
37. 3. DOESN’T WORK WITH WEBRTC MEDIA STREAMS
38. recognition = new SpeechRecognition()
39. recognition = new SpeechRecognition(audioStream)
40. 4. WORKS ONLY IN CHROME* * DESKTOP CHROME (crbug.com/427567)
42. GOOGLE NOW BY GOOGLE
43. CORTANA BY MICROSOFT
44. SIRI BY APPLE
45. FIREFOX POWERED BY POCKET SPHINX
47. WE DON’T NEED TO WAIT FOR BROWSER VENDORS
48. recognition = new window.SpeechRecognition(audioStream)
49. recognition = new window.SpeechRecognition(audioStream)
50. recognition = new acme.SpeechRecognition(audioStream)
51. FACEBOOK M BY FACEBOOK
52. HOUND BY SOUNDHOUND
53. DUER BY BAIDU
54. DRAGON BY NUANCE
55. IBM WATSON BY IBM
56. POCKETSPHINX.JS BY SYLVAIN CHEVALIER
58. WEBRTC-TRANSLATE.HEROKUAPP.COM GITHUB.COM/SZIMEK/WEBRTC-TRANSLATE DEMO: CODE:
59. SZYMON NOWAK @SZIMEK COWBELL LABS FREELETICS we’re hiring!
60. THANK YOU