Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Why so serious? Using GCP for realtime video co...

Avatar for Johann du Toit Johann du Toit
March 06, 2019
Programming
0
83

Why so serious? Using GCP for realtime video context analyzation

Look into real-time video processing and how you might do this on Google Cloud

Avatar for Johann du Toit

Johann du Toit

March 06, 2019
Tweet

More Decks by Johann du Toit

See All by Johann du Toit
RESPECTING THE MICROSERVICE.
Avatar for Johann du Toit johanndutoit
1
77
Attacking a K8s cluster and how defending it
Avatar for Johann du Toit johanndutoit
0
67
Progressive Web Apps in 15 Minutes
Avatar for Johann du Toit johanndutoit
0
46
The Machine Learning Intervention
Avatar for Johann du Toit johanndutoit
0
69
Progressive Web Apps
Avatar for Johann du Toit johanndutoit
0
98
Progressive Web Apps
Avatar for Johann du Toit johanndutoit
0
100
Launchpad Start Day 2 - Google Design Sprints
Avatar for Johann du Toit johanndutoit
2
130
Google Design Sprints
Avatar for Johann du Toit johanndutoit
0
94
Cloud Messaging
Avatar for Johann du Toit johanndutoit
0
180

Other Decks in Programming

See All in Programming
ふつうのRubyist、ちいさなデバイス、大きな一年 / Ordinary Rubyists, Tiny Devices, Big Year
Avatar for chobishiba chobishiba
1
500
GoのDB アクセスにおける 「型安全」と「柔軟性」の両立 - Bob という選択肢
Avatar for tak tak848
0
270
ネイティブアプリとWebフロントエンドのAPI通信ラッパーにおける共通化の勘所
Avatar for Suguru Ohki suguruooki
0
180
20260315 AWSなんもわからん🥲
Avatar for Chiaki Okamoto chiilog
2
170
S3ストレージクラスの「見える」「ある」「使える」は全部違う ─ 体験から見た、仕様の深淵を覗く
Avatar for ya_ma23 ya_ma23
0
1.1k
RailsのValidatesをSwift Macrosで再現してみた
Avatar for Takuma Shimizu hokuron
0
130
[SF Ruby Feb'26] The Silicon Heel
Avatar for Vladimir Dementyev palkan
0
130
Angular-Apps smarter machen mit Gen AI: Lokal und offlinefähig - Hands-on Workshop!
Avatar for Christian Liebel christianliebel
PRO
0
140
Rで始めるML・LLM活用入門
Avatar for wakama1994 wakamatsu_takumu
0
200
OTP を自動で入力する裏技
Avatar for Megabits_mzq megabitsenmzq
0
130
Cyrius ーLinux非依存にコンテナをネイティブ実行する専用OSー
Avatar for n4mlz n4mlz
0
250
20260313 - Grafana & Friends Taipei #1 - Kubernetes v1.36 的開發雜記：那些困在 Alpha 加護病房太久的 Metrics
Avatar for ChengHao Yang tico88612
0
230

Featured

See All Featured
Balancing Empowerment & Direction
Avatar for Lara Hogan lara
5
980
Conquering PDFs: document understanding beyond plain text
Avatar for Ines Montani inesmontani
PRO
4
2.5k
Building Flexible Design Systems
Avatar for Yesenia Perez-Cruz yeseniaperezcruz
330
40k
CSS Pre-Processors: Stylus, Less & Sass
Avatar for Bermon Painter bermonpainter
360
30k
Why Your Marketing Sucks and What You Can Do About It - Sophie Logan
Avatar for Sophie Logan marketingsoph
0
120
Build your cross-platform service in a week with App Engine
Avatar for Jose L jlugia
234
18k
Ruling the World: When Life Gets Gamed
Avatar for Sebastian Deterding codingconduct
0
180
Agile Actions for Facilitating Distributed Teams - ADO2019
Avatar for Mark Kilby mkilby
0
160
Groundhog Day: Seeking Process in Gaming for Health
Avatar for Sebastian Deterding codingconduct
0
130
CoffeeScript is Beautiful & I Never Want to Write Plain JavaScript Again
Avatar for Sam Stephenson sstephenson
162
16k
ReactJS: Keep Simple. Everything can be a component!
Avatar for Pedro Nauck pedronauck
666
130k
Impact Scores and Hybrid Strategies: The future of link building
Avatar for Tamara Novitovic tamaranovitovic
0
240

Transcript

  1. None

  2. [email protected] email website @signedness

  3. Technical Lead for Cloud

  4. Developer Expert (first in Africa) https://developers.google.com/experts/people/johann-du-toit

  5. Certified Architect + Data Engineer

  6. Mentor since 2016

  7. None

  8. THIS TALK Realtime processing on video Further processing using Vision

    API Training a custom model on Google Cloud

  9. THIS TALK Realtime processing on video Further processing using Vision

    API Training a custom model on Google Cloud
  10. None

  11. 14 cameras per metro station on your way out

  12. None
  13. None
  14. None
  15. None
  16. None
  17. None

  18. gocv.VideoCaptureDevice(0)

  19. gocv.VideoCaptureFile(“a.mp4”)

  20. gocv.IMRead(“test.png”)

  21. for { webcam.Read(&img) window.IMShow(img) window.WaitKey(1) }

  22. for { webcam.Read(&img) window.IMShow(img) window.WaitKey(1) }

  23. gocv.NewWindow("Raw Video Source")

  24. gocv.NewWindow("Raw Video Source") gocv.NewWindow("Raw Video Source")

  25. None

  26. for { webcam.Read(&img) // identify cars window.IMShow(img) window.WaitKey(1) }

  27. None
  28. None
  29. None

  30. 30 frames per second

  31. 1000ms

  32. 33ms

  33. None

  34. ~20ms

  35. None
  36. None
  37. None

  38. 10ms 10ms 10ms 10ms 10ms 10ms 10ms 10ms 10ms 10ms

    10ms 10ms 10ms 10ms 10ms 10ms 10ms 10ms 10ms 10m 10ms 10ms 10ms 10ms 10ms 10ms 10ms 10m 10ms 10ms 10m 10ms 10ms 10ms 10ms 10ms 10ms 10ms 10ms 10ms 10ms 10ms 10ms 10m 10m 10ms 10ms 10ms 10ms
  39. None
  40. None
  41. None
  42. None

  43. HAAR Cascades

  44. HAAR Wavelets

  45. None
  46. None
  47. None
  48. None

  49. ~20ms

  50. None

  51. frameNumber % 1 == 0

  52. frameNumber % 2 == 0

  53. frameNumber % 3 == 0

  54. None

  55. THE AGENDA Realtime processing on video Further processing using Vision

    API Training a custom model on Google Cloud
  56. None
  57. None
  58. None

  59. 2 Events

  60. None
  61. None

  62. ImageNet (14 million images)

  63. > day on

  64. < 6 minutes

  65. None
  66. None
  67. None
  68. None
  69. None
  70. None
  71. None
  72. None
  73. None
  74. None
  75. None
  76. None
  77. None
  78. None
  79. None
  80. None

  81. THE AGENDA Realtime processing on video Vision API Training a

    custom model on Google Cloud
  82. None
  83. None
  84. None
  85. None
  86. None
  87. None
  88. None
  89. None
  90. None
  91. None
  92. None
  93. None
  94. None
  95. None
  96. None
  97. None

  98. FIN

  99. FINN