Upgrade to Pro — share decks privately, control downloads, hide ads and more …
Sign up for free

Why so serious? Using GCP for realtime video co...

Avatar for Johann du Toit Johann du Toit
March 06, 2019
Programming
93
0

Why so serious? Using GCP for realtime video context analyzation

Look into real-time video processing and how you might do this on Google Cloud

Avatar for Johann du Toit

Johann du Toit

March 06, 2019

More Decks by Johann du Toit

See All by Johann du Toit
​Natural Language, Unnatural Access: The Emerging LLM Attack Pattern
Avatar for Johann du Toit johanndutoit
0
45
RESPECTING THE MICROSERVICE.
Avatar for Johann du Toit johanndutoit
1
96
Attacking a K8s cluster and how defending it
Avatar for Johann du Toit johanndutoit
0
84
Progressive Web Apps in 15 Minutes
Avatar for Johann du Toit johanndutoit
0
67
The Machine Learning Intervention
Avatar for Johann du Toit johanndutoit
0
87
Progressive Web Apps
Avatar for Johann du Toit johanndutoit
0
110
Progressive Web Apps
Avatar for Johann du Toit johanndutoit
0
120
Launchpad Start Day 2 - Google Design Sprints
Avatar for Johann du Toit johanndutoit
2
150
Google Design Sprints
Avatar for Johann du Toit johanndutoit
0
100

Other Decks in Programming

See All in Programming
JPUG勉強会 OSSデータベースの内部構造を理解しよう(第２回)
Avatar for Atsushi Ogawa oga5
0
290
設計次第でAIコードの読む量は減らせる / designing-for-code-reading
Avatar for MinoDriven minodriven
31
14k
UnityでSystem.Net.WebSocketsなWebSocketサーバが動かないのでUnity Monoのコードを覗いてみた / about implementing websocket server with unity mono
Avatar for にー兄さん drumath2237
1
520
AI時代のコードレビューは人に向けるな、仕組みに向けろ
Avatar for meijin texmeijin
5
3.2k
GitHubハンズオン講座 — 実務レベルのチーム開発のフローを身につけよう
Avatar for junhat6 junhat6
0
110
IBM Bob Dojo #1 仕様駆動開発入門
Avatar for Akira Onishi (IBM) oniak3ibm
PRO
0
320
SREの越境 / SRE Collaboration
Avatar for y-ohgi y0hgi
2
290
半永久的に提供し続けられるプライベートクラウドを目指して ― 利用者の認知負荷を抑えるAPI抽象化とハードウェア世代交代の基盤設計
Avatar for Tomofumi Kondo tomokon
0
380
JRuby: Past, Present, and Future
Avatar for headius headius
0
220
[2026-09-26]空論ジェネリックプロセス～テスト資産とAIで紡ぐ、再現可能なパフォーマンスチューニングの話～
Avatar for tosite tosite
0
250
海上で動くGoサーバー: goroutineとchannelでさばく航行データストリーム
Avatar for Atsuki Seo atsuki_seo
0
1k
速く作れる。その次は、速く確かめられる開発へ 〜AIネイティブ開発を支える、Shift Down〜 / Can build fast. Next, moving to development where we can verify fast.
Avatar for r-kagaya rkaga
8
5.3k

Featured

See All Featured
4 Signs Your Business is Dying
Avatar for Josh Pigford shpigford
187
23k
Building Better People: How to give real-time feedback that sticks.
Avatar for Will Jessup wjessup
370
20k
What’s in a name? Adding method to the madness
Avatar for The Alliance productmarketing
PRO
24
4.2k
Bootstrapping a Software Product
Avatar for Garrett Dimon garrettdimon
PRO
306
120k
Building a Modern Day 
E-commerce SEO Strategy
Avatar for Aleyda Solis aleyda
45
9.2k
The #1 spot is gone: here's how to win anyway
Avatar for Tamara Novitovic tamaranovitovic
4
1.2k
How to Ace a Technical Interview
Avatar for Jacob Kaplan-Moss jacobian
280
24k
Evolution of real-time – Irina Nazarova, EuRuKo, 2024
Avatar for Irina Nazarova irinanazarova
9
1.6k
Code Review Best Practice
Avatar for Trisha Gee trishagee
74
20k
Building Flexible Design Systems
Avatar for Yesenia Perez-Cruz yeseniaperezcruz
330
41k
[RailsConf 2023 Opening Keynote] The Magic of Rails
Avatar for Eileen M. Uchitelle eileencodes
31
10k
Agile Actions for Facilitating Distributed Teams - ADO2019
Avatar for Mark Kilby mkilby
0
290

Transcript

  1. None

  2. [email protected] email website @signedness

  3. Technical Lead for Cloud

  4. Developer Expert (first in Africa) https://developers.google.com/experts/people/johann-du-toit

  5. Certified Architect + Data Engineer

  6. Mentor since 2016

  7. None

  8. THIS TALK Realtime processing on video Further processing using Vision

    API Training a custom model on Google Cloud

  9. THIS TALK Realtime processing on video Further processing using Vision

    API Training a custom model on Google Cloud
  10. None

  11. 14 cameras per metro station on your way out

  12. None
  13. None
  14. None
  15. None
  16. None
  17. None

  18. gocv.VideoCaptureDevice(0)

  19. gocv.VideoCaptureFile(“a.mp4”)

  20. gocv.IMRead(“test.png”)

  21. for { webcam.Read(&img) window.IMShow(img) window.WaitKey(1) }

  22. for { webcam.Read(&img) window.IMShow(img) window.WaitKey(1) }

  23. gocv.NewWindow("Raw Video Source")

  24. gocv.NewWindow("Raw Video Source") gocv.NewWindow("Raw Video Source")

  25. None

  26. for { webcam.Read(&img) // identify cars window.IMShow(img) window.WaitKey(1) }

  27. None
  28. None
  29. None

  30. 30 frames per second

  31. 1000ms

  32. 33ms

  33. None

  34. ~20ms

  35. None
  36. None
  37. None

  38. 10ms 10ms 10ms 10ms 10ms 10ms 10ms 10ms 10ms 10ms

    10ms 10ms 10ms 10ms 10ms 10ms 10ms 10ms 10ms 10m 10ms 10ms 10ms 10ms 10ms 10ms 10ms 10m 10ms 10ms 10m 10ms 10ms 10ms 10ms 10ms 10ms 10ms 10ms 10ms 10ms 10ms 10ms 10m 10m 10ms 10ms 10ms 10ms
  39. None
  40. None
  41. None
  42. None

  43. HAAR Cascades

  44. HAAR Wavelets

  45. None
  46. None
  47. None
  48. None

  49. ~20ms

  50. None

  51. frameNumber % 1 == 0

  52. frameNumber % 2 == 0

  53. frameNumber % 3 == 0

  54. None

  55. THE AGENDA Realtime processing on video Further processing using Vision

    API Training a custom model on Google Cloud
  56. None
  57. None
  58. None

  59. 2 Events

  60. None
  61. None

  62. ImageNet (14 million images)

  63. > day on

  64. < 6 minutes

  65. None
  66. None
  67. None
  68. None
  69. None
  70. None
  71. None
  72. None
  73. None
  74. None
  75. None
  76. None
  77. None
  78. None
  79. None
  80. None

  81. THE AGENDA Realtime processing on video Vision API Training a

    custom model on Google Cloud
  82. None
  83. None
  84. None
  85. None
  86. None
  87. None
  88. None
  89. None
  90. None
  91. None
  92. None
  93. None
  94. None
  95. None
  96. None
  97. None

  98. FIN

  99. FINN