Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Why so serious? Using GCP for realtime video co...

Avatar for Johann du Toit Johann du Toit
March 06, 2019
Programming
90
0

Why so serious? Using GCP for realtime video context analyzation

Look into real-time video processing and how you might do this on Google Cloud

Avatar for Johann du Toit

Johann du Toit

March 06, 2019

More Decks by Johann du Toit

See All by Johann du Toit
​Natural Language, Unnatural Access: The Emerging LLM Attack Pattern
Avatar for Johann du Toit johanndutoit
0
37
RESPECTING THE MICROSERVICE.
Avatar for Johann du Toit johanndutoit
1
91
Attacking a K8s cluster and how defending it
Avatar for Johann du Toit johanndutoit
0
78
Progressive Web Apps in 15 Minutes
Avatar for Johann du Toit johanndutoit
0
65
The Machine Learning Intervention
Avatar for Johann du Toit johanndutoit
0
84
Progressive Web Apps
Avatar for Johann du Toit johanndutoit
0
110
Progressive Web Apps
Avatar for Johann du Toit johanndutoit
0
120
Launchpad Start Day 2 - Google Design Sprints
Avatar for Johann du Toit johanndutoit
2
140
Google Design Sprints
Avatar for Johann du Toit johanndutoit
0
100

Other Decks in Programming

See All in Programming
SlackアプリとLambdaの 連携を構築した話
Avatar for pawn pawn_4_s
1
120
Japan Community Day at Kubecon + CloudNativeCon Japan 2026: Learning Container Privilege Control by Building My Own Low-Level Container Runtime
Avatar for ternbusty ternbusty
1
160
ソフトウェア設計に溶けるインフラ ― AWS CDK のインフラ認識論
Avatar for Kenji Kono konokenj
3
800
Laravelで学ぶ Webアプリケーションチューニング入門/web_application_tuning_101
Avatar for Ryo Tomidokoro hanhan1978
4
1.9k
楽しそうなつよつよエンジニアと目が死んでる僕/A brilliant engineer having a blast, and dead-eyed me.
Avatar for Ryusei Ohkura 3l4l5
2
190
源内ハンズオン概要編
Avatar for Hideyuki Nagata hideg
0
190
改善しないと、タスクが回らない。 “てんこ盛りポジション” を引き継いだ情シスの、入社3ヶ月の業務改善録
Avatar for Kurumi Watabe krm963
0
270
KotlinConf Extended South Korea 2026 Keynote
Avatar for HyunWoo Lee l2hyunwoo
0
110
ソフトウェアエンジニアにとっての生成AI - 特性を知って使い倒す / generative ai for software enginner
Avatar for Naoki Kishida kishida
5
1.7k
20260722_microCMSで考える、AI時代のコンテンツ運用設計
Avatar for Yoshihisa Kaino yosh1
0
410
「人を評価する AI」の 設計と実装 
Avatar for 奈良亮耶 ryoyanara
0
210
What's New in Android 2026
Avatar for Veronikapj veronikapj
0
260

Featured

See All Featured
Designing for humans not robots
Avatar for Tammie Lister tammielis
254
26k
Future Trends and Review - Lecture 12 - Web Technologies (1019888BNR)
Avatar for Beat Signer signer
PRO
0
3.7k
Leveraging Curiosity to Care for An Aging Population
Avatar for Cassini Nazir cassininazir
1
470
Winning Ecommerce Organic Search in an AI Era - #searchnstuff2025
Avatar for Aleyda Solis aleyda
1
2.1k
A Guide to Academic Writing Using Generative AI - A Workshop
Avatar for Kenji Saito ks91
PRO
1
370
Performance Is Good for Brains [We Love Speed 2024]
Avatar for Tammy Everts tammyeverts
12
1.8k
The World Runs on Bad Software
Avatar for Brandon Keepers bkeepers
PRO
72
12k
Organizational Design Perspectives: An Ontology of Organizational Design Elements
Avatar for Dr. Kim W Petersen kimpetersen
PRO
1
790
職位にかかわらず全員がリーダーシップを発揮するチーム作り / Building a team where everyone can demonstrate leadership regardless of position
Avatar for MADOX madoxten
64
56k
Design in an AI World
Avatar for tapps tapps
1
280
HDC tutorial
Avatar for Michiel Stock michielstock
2
790
Visualizing Your Data: Incorporating Mongo into Loggly Infrastructure
Avatar for mongodb mongodb
49
10k

Transcript

  1. None

  2. [email protected] email website @signedness

  3. Technical Lead for Cloud

  4. Developer Expert (first in Africa) https://developers.google.com/experts/people/johann-du-toit

  5. Certified Architect + Data Engineer

  6. Mentor since 2016

  7. None

  8. THIS TALK Realtime processing on video Further processing using Vision

    API Training a custom model on Google Cloud

  9. THIS TALK Realtime processing on video Further processing using Vision

    API Training a custom model on Google Cloud
  10. None

  11. 14 cameras per metro station on your way out

  12. None
  13. None
  14. None
  15. None
  16. None
  17. None

  18. gocv.VideoCaptureDevice(0)

  19. gocv.VideoCaptureFile(“a.mp4”)

  20. gocv.IMRead(“test.png”)

  21. for { webcam.Read(&img) window.IMShow(img) window.WaitKey(1) }

  22. for { webcam.Read(&img) window.IMShow(img) window.WaitKey(1) }

  23. gocv.NewWindow("Raw Video Source")

  24. gocv.NewWindow("Raw Video Source") gocv.NewWindow("Raw Video Source")

  25. None

  26. for { webcam.Read(&img) // identify cars window.IMShow(img) window.WaitKey(1) }

  27. None
  28. None
  29. None

  30. 30 frames per second

  31. 1000ms

  32. 33ms

  33. None

  34. ~20ms

  35. None
  36. None
  37. None

  38. 10ms 10ms 10ms 10ms 10ms 10ms 10ms 10ms 10ms 10ms

    10ms 10ms 10ms 10ms 10ms 10ms 10ms 10ms 10ms 10m 10ms 10ms 10ms 10ms 10ms 10ms 10ms 10m 10ms 10ms 10m 10ms 10ms 10ms 10ms 10ms 10ms 10ms 10ms 10ms 10ms 10ms 10ms 10m 10m 10ms 10ms 10ms 10ms
  39. None
  40. None
  41. None
  42. None

  43. HAAR Cascades

  44. HAAR Wavelets

  45. None
  46. None
  47. None
  48. None

  49. ~20ms

  50. None

  51. frameNumber % 1 == 0

  52. frameNumber % 2 == 0

  53. frameNumber % 3 == 0

  54. None

  55. THE AGENDA Realtime processing on video Further processing using Vision

    API Training a custom model on Google Cloud
  56. None
  57. None
  58. None

  59. 2 Events

  60. None
  61. None

  62. ImageNet (14 million images)

  63. > day on

  64. < 6 minutes

  65. None
  66. None
  67. None
  68. None
  69. None
  70. None
  71. None
  72. None
  73. None
  74. None
  75. None
  76. None
  77. None
  78. None
  79. None
  80. None

  81. THE AGENDA Realtime processing on video Vision API Training a

    custom model on Google Cloud
  82. None
  83. None
  84. None
  85. None
  86. None
  87. None
  88. None
  89. None
  90. None
  91. None
  92. None
  93. None
  94. None
  95. None
  96. None
  97. None

  98. FIN

  99. FINN