Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Why so serious? Using GCP for realtime video co...

Avatar for Johann du Toit Johann du Toit
March 06, 2019
Programming
89
0

Why so serious? Using GCP for realtime video context analyzation

Look into real-time video processing and how you might do this on Google Cloud

Avatar for Johann du Toit

Johann du Toit

March 06, 2019

More Decks by Johann du Toit

See All by Johann du Toit
​Natural Language, Unnatural Access: The Emerging LLM Attack Pattern
Avatar for Johann du Toit johanndutoit
0
34
RESPECTING THE MICROSERVICE.
Avatar for Johann du Toit johanndutoit
1
90
Attacking a K8s cluster and how defending it
Avatar for Johann du Toit johanndutoit
0
78
Progressive Web Apps in 15 Minutes
Avatar for Johann du Toit johanndutoit
0
58
The Machine Learning Intervention
Avatar for Johann du Toit johanndutoit
0
79
Progressive Web Apps
Avatar for Johann du Toit johanndutoit
0
110
Progressive Web Apps
Avatar for Johann du Toit johanndutoit
0
110
Launchpad Start Day 2 - Google Design Sprints
Avatar for Johann du Toit johanndutoit
2
140
Google Design Sprints
Avatar for Johann du Toit johanndutoit
0
99

Other Decks in Programming

See All in Programming
5分で問診！Composer セキュリティ健康診断
Avatar for コドモン開発チーム codmoninc
0
580
AI駆動開発を妨げる技術的負債の解消アプローチ / ai-refactoring-approach
Avatar for MinoDriven minodriven
17
9.3k
【やさしく解説 設計編・中級 #1】一つの車に、運転手は一人　～ある倉庫システムの事例から～
Avatar for HideyukiKitao panda728
PRO
0
190
Embedded SREと共に達成した会員管理システムのAWS移行 - SRE NEXT 2026 ランチスポンサーセッション
Avatar for ニフティ株式会社 niftycorp
PRO
1
2.9k
鹿野さんに聞く！『TypeScriptコードレシピ集』で磨く実践力
Avatar for tonkotsuboy_com tonkotsuboy_com
4
1.2k
PHP初心者セッション2026　〜生成AIでは見えない裏側を知る：今だからLAMPを通して仕組みを学ぶ〜
Avatar for Hideo Kashioka kashioka
0
650
ビデオ通話が繋がる0.2秒で何が起きているのか
Avatar for Miyamoto Naoyuki supurazako
2
150
なぜ関数型プログラミングで「型」と「証明」が語られるのか #fp_matsuri
Avatar for Takuma Kajikawa kajitack
3
1k
Prismを使った型安全な暗号化_関数型まつり2026
Avatar for _fhhmm _fhhmm
0
150
Generative UI & AI-Assistants for Your Angular Solutions
Avatar for Manfred Steyer manfredsteyer
PRO
0
120
「正の参照」と 「負の導出」で組む ハーネスエンジニアリング
Avatar for Masahiro Watanabe cottpan
1
150
継続モナドとリアクティブプログラミング
Avatar for ゆきくらげ yukikurage
3
630

Featured

See All Featured
Agile Leadership in an Agile Organization
Avatar for Dr. Kim W Petersen kimpetersen
PRO
0
190
What’s in a name? Adding method to the madness
Avatar for The Alliance productmarketing
PRO
24
4.1k
Dominate Local Search Results - an insider guide to GBP, reviews, and Local SEO
Avatar for Greg Gifford greggifford
PRO
0
210
Distributed Sagas: A Protocol for Coordinating Microservices
Avatar for Caitie McCaffrey caitiem20
333
23k
Exploring the Power of Turbo Streams & Action Cable | RailsConf2023
Avatar for Kevin Liebholz kevinliebholz
37
6.5k
Responsive Adventures: Dirty Tricks From The Dark Corners of Front-End
Avatar for Vitaly Friedman smashingmag
254
22k
B2B Lead Gen: Tactics, Traps & Triumph
Avatar for Sophie Logan marketingsoph
0
180
My Coaching Mixtape
Avatar for mlcsv mlcsv
0
170
The Hidden Cost of Media on the Web [PixelPalooza 2025]
Avatar for Tammy Everts tammyeverts
2
380
Code Reviewing Like a Champion
Avatar for maltzj maltzj
528
40k
Why Your Marketing Sucks and What You Can Do About It - Sophie Logan
Avatar for Sophie Logan marketingsoph
0
310
Let's Do A Bunch of Simple Stuff to Make Websites Faster
Avatar for Chris Coyier chriscoyier
508
140k

Transcript

  1. None

  2. [email protected] email website @signedness

  3. Technical Lead for Cloud

  4. Developer Expert (first in Africa) https://developers.google.com/experts/people/johann-du-toit

  5. Certified Architect + Data Engineer

  6. Mentor since 2016

  7. None

  8. THIS TALK Realtime processing on video Further processing using Vision

    API Training a custom model on Google Cloud

  9. THIS TALK Realtime processing on video Further processing using Vision

    API Training a custom model on Google Cloud
  10. None

  11. 14 cameras per metro station on your way out

  12. None
  13. None
  14. None
  15. None
  16. None
  17. None

  18. gocv.VideoCaptureDevice(0)

  19. gocv.VideoCaptureFile(“a.mp4”)

  20. gocv.IMRead(“test.png”)

  21. for { webcam.Read(&img) window.IMShow(img) window.WaitKey(1) }

  22. for { webcam.Read(&img) window.IMShow(img) window.WaitKey(1) }

  23. gocv.NewWindow("Raw Video Source")

  24. gocv.NewWindow("Raw Video Source") gocv.NewWindow("Raw Video Source")

  25. None

  26. for { webcam.Read(&img) // identify cars window.IMShow(img) window.WaitKey(1) }

  27. None
  28. None
  29. None

  30. 30 frames per second

  31. 1000ms

  32. 33ms

  33. None

  34. ~20ms

  35. None
  36. None
  37. None

  38. 10ms 10ms 10ms 10ms 10ms 10ms 10ms 10ms 10ms 10ms

    10ms 10ms 10ms 10ms 10ms 10ms 10ms 10ms 10ms 10m 10ms 10ms 10ms 10ms 10ms 10ms 10ms 10m 10ms 10ms 10m 10ms 10ms 10ms 10ms 10ms 10ms 10ms 10ms 10ms 10ms 10ms 10ms 10m 10m 10ms 10ms 10ms 10ms
  39. None
  40. None
  41. None
  42. None

  43. HAAR Cascades

  44. HAAR Wavelets

  45. None
  46. None
  47. None
  48. None

  49. ~20ms

  50. None

  51. frameNumber % 1 == 0

  52. frameNumber % 2 == 0

  53. frameNumber % 3 == 0

  54. None

  55. THE AGENDA Realtime processing on video Further processing using Vision

    API Training a custom model on Google Cloud
  56. None
  57. None
  58. None

  59. 2 Events

  60. None
  61. None

  62. ImageNet (14 million images)

  63. > day on

  64. < 6 minutes

  65. None
  66. None
  67. None
  68. None
  69. None
  70. None
  71. None
  72. None
  73. None
  74. None
  75. None
  76. None
  77. None
  78. None
  79. None
  80. None

  81. THE AGENDA Realtime processing on video Vision API Training a

    custom model on Google Cloud
  82. None
  83. None
  84. None
  85. None
  86. None
  87. None
  88. None
  89. None
  90. None
  91. None
  92. None
  93. None
  94. None
  95. None
  96. None
  97. None

  98. FIN

  99. FINN