Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Why so serious? Using GCP for realtime video co...

Avatar for Johann du Toit Johann du Toit
March 06, 2019
Programming
0
81

Why so serious? Using GCP for realtime video context analyzation

Look into real-time video processing and how you might do this on Google Cloud

Avatar for Johann du Toit

Johann du Toit

March 06, 2019
Tweet

More Decks by Johann du Toit

See All by Johann du Toit
RESPECTING THE MICROSERVICE.
Avatar for Johann du Toit johanndutoit
1
74
Attacking a K8s cluster and how defending it
Avatar for Johann du Toit johanndutoit
0
64
Progressive Web Apps in 15 Minutes
Avatar for Johann du Toit johanndutoit
0
44
The Machine Learning Intervention
Avatar for Johann du Toit johanndutoit
0
68
Progressive Web Apps
Avatar for Johann du Toit johanndutoit
0
96
Progressive Web Apps
Avatar for Johann du Toit johanndutoit
0
100
Launchpad Start Day 2 - Google Design Sprints
Avatar for Johann du Toit johanndutoit
2
120
Google Design Sprints
Avatar for Johann du Toit johanndutoit
0
93
Cloud Messaging
Avatar for Johann du Toit johanndutoit
0
180

Other Decks in Programming

See All in Programming
[AtCoder Conference 2025] LLMを使った業務AHCの上⼿な解き⽅
Avatar for terry-u16 terryu16
6
970
組み合わせ爆発にのまれない - 責務分割 x テスト
Avatar for HAL halhorn
1
170
AI時代を生き抜く 新卒エンジニアの生きる道
Avatar for coconala_engineer coconala_engineer
1
480
Flutter On-device AI로 완성하는 오프라인 앱, 박제창 @DevFest INCHEON 2025
Avatar for JaiChangPark itsmedreamwalker
1
170
GoLab2025 Recap
Avatar for kuro kuro_kurorrr
0
790
SwiftUIで本格音ゲー実装してみた
Avatar for 蛋白（たんぱく・TANPACT） hypebeans
0
550
AI Agent Tool のためのバックエンドアーキテクチャを考える #encraft
Avatar for izumin5210 izumin5210
5
1.5k
Findy AI+の開発、運用におけるMCP活用事例
Avatar for starfish719 starfish719
0
1.9k
リリース時」テストから「デイリー実行」へ！開発マネージャが取り組んだ、レガシー自動テストのモダン化戦略
Avatar for goataka (GOAMI Takaaki) goataka
0
150
Tinkerbellから学ぶ、Podで DHCPをリッスンする手法
Avatar for Tomofumi Kondo tomokon
0
150
Canon EOS R50 V と R5 Mark II 購入でみえてきた最近のデジイチ VR180 事情、そして VR180 静止画に活路を見出すまで
Avatar for kazuhiro hara karad
0
140
Grafana：建立系統全知視角的捷徑
Avatar for Blueswen blueswen
0
260

Featured

See All Featured
Heart Work Chapter 1 - Part 1
Avatar for Lake Fama lfama
PRO
3
35k
Writing Fast Ruby
Avatar for Erik Berlin sferik
630
62k
4 Signs Your Business is Dying
Avatar for Josh Pigford shpigford
187
22k
How to Ace a Technical Interview
Avatar for Jacob Kaplan-Moss jacobian
281
24k
Pawsitive SEO: Lessons from My Dog (and Many Mistakes) on Thriving as a Consultant in the Age of AI
Avatar for David Carrasco davidcarrasco
0
39
Collaborative Software Design: How to facilitate domain modelling decisions
Avatar for Kenny Baas-Schwegler baasie
0
110
The B2B funnel & how to create a winning content strategy
Avatar for Katarina Dahlin katarinadahlin
PRO
0
210
Side Projects
Avatar for Sacha Greif sachag
455
43k
Utilizing Notion as your number one productivity tool
Avatar for Mfonobong Umondia mfonobong
2
190
Into the Great Unknown - MozCon
Avatar for Noah Learner thekraken
40
2.2k
Stewardship and Sustainability of Urban and Community Forests
Avatar for Eric Wiseman pwiseman
0
80
Rails Girls Zürich Keynote
Avatar for Gregor Martynus gr2m
95
14k

Transcript

  1. None

  2. [email protected] email website @signedness

  3. Technical Lead for Cloud

  4. Developer Expert (first in Africa) https://developers.google.com/experts/people/johann-du-toit

  5. Certified Architect + Data Engineer

  6. Mentor since 2016

  7. None

  8. THIS TALK Realtime processing on video Further processing using Vision

    API Training a custom model on Google Cloud

  9. THIS TALK Realtime processing on video Further processing using Vision

    API Training a custom model on Google Cloud
  10. None

  11. 14 cameras per metro station on your way out

  12. None
  13. None
  14. None
  15. None
  16. None
  17. None

  18. gocv.VideoCaptureDevice(0)

  19. gocv.VideoCaptureFile(“a.mp4”)

  20. gocv.IMRead(“test.png”)

  21. for { webcam.Read(&img) window.IMShow(img) window.WaitKey(1) }

  22. for { webcam.Read(&img) window.IMShow(img) window.WaitKey(1) }

  23. gocv.NewWindow("Raw Video Source")

  24. gocv.NewWindow("Raw Video Source") gocv.NewWindow("Raw Video Source")

  25. None

  26. for { webcam.Read(&img) // identify cars window.IMShow(img) window.WaitKey(1) }

  27. None
  28. None
  29. None

  30. 30 frames per second

  31. 1000ms

  32. 33ms

  33. None

  34. ~20ms

  35. None
  36. None
  37. None

  38. 10ms 10ms 10ms 10ms 10ms 10ms 10ms 10ms 10ms 10ms

    10ms 10ms 10ms 10ms 10ms 10ms 10ms 10ms 10ms 10m 10ms 10ms 10ms 10ms 10ms 10ms 10ms 10m 10ms 10ms 10m 10ms 10ms 10ms 10ms 10ms 10ms 10ms 10ms 10ms 10ms 10ms 10ms 10m 10m 10ms 10ms 10ms 10ms
  39. None
  40. None
  41. None
  42. None

  43. HAAR Cascades

  44. HAAR Wavelets

  45. None
  46. None
  47. None
  48. None

  49. ~20ms

  50. None

  51. frameNumber % 1 == 0

  52. frameNumber % 2 == 0

  53. frameNumber % 3 == 0

  54. None

  55. THE AGENDA Realtime processing on video Further processing using Vision

    API Training a custom model on Google Cloud
  56. None
  57. None
  58. None

  59. 2 Events

  60. None
  61. None

  62. ImageNet (14 million images)

  63. > day on

  64. < 6 minutes

  65. None
  66. None
  67. None
  68. None
  69. None
  70. None
  71. None
  72. None
  73. None
  74. None
  75. None
  76. None
  77. None
  78. None
  79. None
  80. None

  81. THE AGENDA Realtime processing on video Vision API Training a

    custom model on Google Cloud
  82. None
  83. None
  84. None
  85. None
  86. None
  87. None
  88. None
  89. None
  90. None
  91. None
  92. None
  93. None
  94. None
  95. None
  96. None
  97. None

  98. FIN

  99. FINN