Serverless and AI Fun with Azure

Transcript

2. ME !! ME !! MEEEEE !!! Gurucharan Subramani Software Engineer EV Chargers, ABB. www.gurucharan.in
3. BACKSTORY @gurucharan94 Once upon a time…. at The Redmond Reality Distortion Centre BUILD 2019
4. BACKSTORY @gurucharan94 CONVERSATION TRANSCRIPTION The APIwe deserve but not the one we need right now.
5. BACKSTORY @gurucharan94 TRANSCRIPTION The APIwe have and the one we need now.. BATCH
6. @gurucharan94
7. AZURE SPEECH SERVICES @gurucharan94 Azure Speech Services SPEECH-TO-TEXT TEXT-TO-SPEECH SPEECH-TRANSLATION
8. AZURE SPEECH SERVICES @gurucharan94 Real-Time Audio Transcription Conversation Transcription BATCH TRANSCRIPTION SPEECH-TO-TEXT WAV / MP3 / OGG
9. AZURE SPEECH SERVICES @gurucharan94 SPEECH-TO-TEXT Getting Startedwith Azure Portal New Speech S0 TIER Region SUBSCRIPTION KEY CRIS ENDPOINT Batch Transcription
10. BATCH TRANSCRIPTION @gurucharan94 JSON ! JSON !! JSON !!!
11. BATCH TRANSCRIPTION @gurucharan94 JSON ! JSON !! JSON !!!
12. AZURE BLOB STORAGE @gurucharan94 Azure BLOB Storage Storage Solution for unsTruCtuRED DATA
14. @gurucharan94 • CREATING STORAGE ACCOUNT • STORAGE EXPLORER • UPLOAD FILE & GET SAS URI • CREATE SPEECH SERVICE • HTTP POST to CRIS ENDPOINT • SEE TRANSCRIPT
15. C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E CODE !! CODE !! CODE !! @gurucharan94 - Download Audio File - Upload to Storage & Get SAS URI - POST to CRIS TRANSCRIPTION ENDPOINT - GET Transcript from CRIS TRANSCRIPTION ENDPOINT DO THIS PROGRAMATICALLY PLEASE ???
16. CODE !! CODE !! CODE !! @gurucharan94 - Download Audio File - Upload to Storage & Get SAS URI - POST to CRIS TRANSCRIPTION ENDPOINT - GET Transcript from CRIS TRANSCRIPTION ENDPOINT C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E
17. CODE !! CODE !! CODE !! @gurucharan94 - Download Audio File - Upload to Storage & Get SAS URI - POST to CRIS TRANSCRIPTION ENDPOINT - GET Transcript from CRIS TRANSCRIPTION ENDPOINT C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E
18. CODE !! CODE !! CODE !! @gurucharan94 - Download Audio File - Upload to Storage & Get SAS URI - POST to CRIS TRANSCRIPTION ENDPOINT - GET Transcript from CRIS TRANSCRIPTION ENDPOINT C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E
19. CODE !! CODE !! CODE !! @gurucharan94 - Download Audio File - Upload to Storage & Get SAS URI - POST to CRIS TRANSCRIPTION ENDPOINT - GET Transcript from CRIS TRANSCRIPTION ENDPOINT C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E C O D E
20. CODE !! CODE !! CODE !! @gurucharan94 In HOW many ways can I run this on Azure ???
21. @gurucharan94
22. @gurucharan94 Azure Functions $ERVERLE$$COMPUTE Runs code-on-demand on magical severs when events AZURE FUNCTIONS
23. @gurucharan94 AZURE FUNCTIONS My function INPUT BINDINGS TRIGGER OUTPUT BINDINGS
24. @gurucharan94 AZURE FUNCTIONS My function INPUT BINDINGS TRIGGER OUTPUT BINDINGS
25. @gurucharan94 AZURE FUNCTIONS My function INPUT BINDINGS TRIGGER OUTPUT BINDINGS
26. @gurucharan94 AZURE FUNCTIONS My function INPUT BINDINGS TRIGGER OUTPUT BINDINGS
27. @gurucharan94 AZURE FUNCTIONS - Download Audio File - Upload to Storage & Get SAS URI - POST to CRIS TRANSCRIPTION ENDPOINT - GET Transcript from CRIS TRANSCRIPTION ENDPOINT My function INPUT BINDINGS TRIGGER OUTPUT BINDINGS
30. THE BIG DIAGRAM SLIDE Save Audio File In Blob Storage Submit for Transcription Audio file link Audio Files??
31. Q: What is a good source of high quality conversational audio that we can use to test our system ?? A: Podcasts
32. Q: Which is your favourite podcast ??? A: Hanselminutes
33. Q: What is the best way to get all the links to the audio files on a podcast ?? A: RSS Feed
34. @gurucharan94
35. @gurucharan94 Azure Logic Apps SERVERLESS DESIGNER-FIRST Business workflow Integration service AZURE LOGIC APPS
36. THE BIG DIAGRAM SLIDE Save Audio File In Blob Storage Submit for Transcription Check RSS Feed for updates New Feed Item ???
37. @gurucharan94 Azure Cosmos DB Globally Distributed Multi-Model, Scalable NO - SQL Database AZURE COSMOS DB
38. THE BIG DIAGRAM SLIDE . . . . . . Check RSS Feed for updates New Feed Item Transcription Completed Store Results Save Audio File In Blob Storage Submit for Transcription
40. . . . . . . Check RSS Feed for updates New Feed Item Transcription Completed Store Results Save Audio File In Blob Storage Submit for Transcription HOW MUCH DOES THIS COST ??
41. . . . . . . Check RSS Feed for updates New Feed Item Transcription Completed Store Results Save Audio File In Blob Storage Submit for Transcription HOW MUCH DOES THIS COST ??
42. . . . . . . Check RSS Feed for updates New Feed Item Transcription Completed Store Results Save Audio File In Blob Storage Submit for Transcription HOW MUCH DOES THIS COST ??
43. HOW TO DO THE GITHUB THING?? . . . . . . Check RSS Feed for updates New Feed Item Transcription Completed Store Results Save Audio File In Blob Storage Submit for Transcription
46. HOW WELL DOES THIS SCALE ?? . . . . . . Check RSS Feed for updates New Feed Item Transcription Completed Store Results Save Audio File In Blob Storage Submit for Transcription
47. SHOULD I QUIT MY JOB ??? . . . . . . Check RSS Feed for updates New Feed Item Transcription Completed Store Results Save Audio File In Blob Storage Submit for Transcription
48. TAKE IT FORWARD . . . Check RSS Feed for updates Save Audio File In Blob Storage Submit for Transcription Transcription Completed Store Results Save Audio File In Blob Storage Transcribe Past Episodes Speaker Segmentation
49. HOME WORK LINKS @gurucharan94 https://nerdstagram.com/GuruCharan94/az-podcast-transcriber Send Pull Requests at 01 03 https://www.gurucharan.in/hanselminutes-plus-plus/ Read Blog Post at https://hanselminutesplusplus.azurewebsites.net See Live Demo at 02
50. CREDITS @gurucharan94 01 https://github.com/ashleymcnamara/Developer-Advocate-Bit Ashley McNamara https://speaking.io Zach Holman 02
51. @gurucharan94