JSConf EU 2015 - How to grow your own Babel fish

Transcript

3. WEBRTC
4. demo
8. WORKS IN A BROWSER
9. USES OPEN STANDARDS
10. TOOK ONE DAY TO WRITE
12. HOW DOES IT WORK?
13. 1. SENDS AUDIO AND VIDEO USING WEBRTC
14. webrtc = new SimpleWebRTC({ localVideoEl: 'localVideo', remoteVideosEl: 'remoteVideos', autoRequestMedia: true }) webrtc.on('readyToCall', () => { webrtc.joinRoom('your awesome room name') })
15. webrtc = new SimpleWebRTC({ localVideoEl: 'localVideo', remoteVideosEl: 'remoteVideos', autoRequestMedia: true }) webrtc.on('readyToCall', () => { webrtc.joinRoom('your awesome room name') })
16. webrtc = new SimpleWebRTC({ localVideoEl: 'localVideo', remoteVideosEl: 'remoteVideos', autoRequestMedia: true }) webrtc.on('readyToCall', () => { webrtc.joinRoom('your awesome room name') })
17. webrtc = new SimpleWebRTC({ localVideoEl: 'localVideo', remoteVideosEl: 'remoteVideos', autoRequestMedia: true }) webrtc.on('readyToCall', () => { webrtc.joinRoom('your awesome room name') })
18. webrtc = new SimpleWebRTC({ localVideoEl: 'localVideo', remoteVideosEl: 'remoteVideos', autoRequestMedia: true }) webrtc.on('readyToCall', () => { webrtc.joinRoom('your awesome room name') })
19. 2. RECOGNIZES WHAT YOU SAY USING WEB SPEECH
20. recognition = new SpeechRecognition() recognition.on('result', (result) => { // do something with the result }) recognition.start()
21. recognition = new SpeechRecognition() recognition.on('result', (result) => { // do something with the result }) recognition.start()
22. recognition = new SpeechRecognition() recognition.on('result', (result) => { // do something with the result }) recognition.start()
23. 3. SENDS TRANSCRIPT TO GOOGLE TRANSLATE
24. 4. SENDS TRANSLATION TO THE OTHER PERSON USING WEBRTC
25. webrtc.sendDirectlyToAll( 'channel label', 'payload label', payload )
26. 5. READS IT OUT LOUD USING WEB SPEECH
27. msg = new SpeechSynthesisUtterance() msg.lang = 'en-GB' msg.text = 'German jokes are the wurst!' speechSynthesis.speak(msg)
28. msg = new SpeechSynthesisUtterance() msg.lang = 'en-GB' msg.text = 'German jokes are the wurst!' speechSynthesis.speak(msg)
29. WEB SPEECH API INTRO
30. ONE-SHOT CONTINUOUS
31. SERVER CLIENT
33. WEB SPEECH API RANT
34. 1. STOPS IF YOU TALK FOR TOO LONG
35. 2. STOPS IF YOU DON’T TALK FOR TOO LONG
36. 3. DOESN’T WORK WITH WEBRTC MEDIA STREAMS
37. recognition = new SpeechRecognition()
38. recognition = new SpeechRecognition(audioStream)
39. 4. WORKS ONLY IN CHROME* * DESKTOP CHROME (crbug.com/427567)
41. GOOGLE NOW BY GOOGLE
42. CORTANA BY MICROSOFT
43. SIRI BY APPLE
44. FIREFOX POWERED BY POCKET SPHINX
46. WE DON’T NEED TO WAIT FOR BROWSER VENDORS
47. recognition = new window.SpeechRecognition(audioStream)
48. recognition = new window.SpeechRecognition(audioStream)
49. recognition = new acme.SpeechRecognition(audioStream)
50. FACEBOOK M BY FACEBOOK
51. HOUND BY SOUNDHOUND
52. DUER BY BAIDU
53. DRAGON BY NUANCE
54. IBM WATSON BY IBM
55. POCKETSPHINX.JS BY SYLVAIN CHEVALIER
56. WEBRTC-TRANSLATE.HEROKUAPP.COM GITHUB.COM/SZIMEK/WEBRTC-TRANSLATE DEMO: CODE:
57. SZYMON NOWAK @SZIMEK COWBELL LABS FREELETICS we’re hiring!
58. THANK YOU