Go for speed

9d198f37cdf56e90b09b5efd39b36d83?s=47 Nick Bruun
September 18, 2014
Programming
0
72

Go for speed

A look at a use case for Go at Iconfinder, which shaved ~40 ms off asset load times.

9d198f37cdf56e90b09b5efd39b36d83?s=128

Nick Bruun

September 18, 2014
Tweet

Want more?

9d198f37cdf56e90b09b5efd39b36d83?s=48 nickbruun
0
91
9d198f37cdf56e90b09b5efd39b36d83?s=48 nickbruun
2
97
9d198f37cdf56e90b09b5efd39b36d83?s=48 nickbruun
1
140
3ab1249be442027903e1180025340b3f?s=48 reverentgeek
1
100
A9a491b0fcbe0fbce3d64063a37add99?s=48 rmw
1
55
766b9746b59e6f09e280cd33cf4ed419?s=48 skipperchong
0
60
61857dafbd287b3027c4dcea9008ad3c?s=48 carmenhchung
4
120
06f8b41980eb4c577fa40c41d5030c19?s=48 keathley
3
140
C0390e8b11079f8761c0cd3274ed61cb?s=48 productmarketing
2
210
C35e01544a0dd94a2cf1619ee8a42ebb?s=48 clairelew
2
390
6bb82b13cda86d3b821fa44100335ddf?s=48 thoeni
1
110
B3ace07412a5178ea778e7eec161fc0a?s=48 jcasabona
4
200

Transcript

  1. 1.

    Go for speed

  2. 2.

    Nick Bruun github.com/nickbruun @nickbruun bruun.co CTO @ Iconfinder Fairly carnivorous

  3. 3.
    None
  4. 4.
    None
  5. 5.
    None
  6. 6.

    Trouble in icon paradise

  7. 7.
    None
  8. 8.
    None
  9. 9.
    None
  10. 10.
    None
  11. 11.

    41 ms average response time from Django application during peak

    hours
  12. 12.

    ~2,000 ms wasted per search

  13. 13.

    Perceivably slower

  14. 14.

    The internals

  15. 15.
    None
  16. 16.

    Icon ID Icon version ID Raster size https://www.iconfinder.com/icons/298255/677266/128/raster https://cdn0.iconfinder.com/data/icons/seo-smart-pack/128/ grey_new_seo2-43-128.png

    Public raster URL Protected raster URL
  17. 17.
    None
  18. 18.

    Constant

  19. 19.

    Signing requests

  20. 20.

    https://www.iconfinder.com/icons/298255/677266/128/raster?token=…

  21. 21.
    None
  22. 22.

    we know if the user has access right now When

    returning the link,
  23. 23.

    we know if the user has access right now When

    returning the link,
  24. 24.

    We’re okay with “right now” being an approximation

  25. 25.

    Time limited token

  26. 26.

    <token secret> = "<expiration timestamp>-<session ID>-<nonce>-<URL>"

  27. 27.

    <token secret> = "<expiration timestamp>-<session ID>-<nonce>-<URL>" <signature> = hmac_sha1(<token secret>,

    <shared secret>)
  28. 28.

    <token secret> = "<expiration timestamp>-<session ID>-<nonce>-<URL>" <signature> = hmac_sha1(<token secret>,

    <shared secret>) <token> = "<expiration timestamp>-<nonce>-base64(<signature>)"
  29. 29.

    But, who checks the token?

  30. 30.

    Enter Go The World’s least Google-able language… from Google

  31. 31.
    None
  32. 32.

    Why Go?

  33. 33.

    Networked service

  34. 34.

    Highly concurrent ~3,000 requests/second from 100 connections/core

  35. 35.

    Low memory footprint 14.09 MiB after 21 days

  36. 36.

    Low CPU usage

  37. 37.

    Static binary Cross-compilation = deployment heaven

  38. 38.

    Less decisions to make

  39. 39.

    Caveats

  40. 40.

    Structured logging

  41. 41.

    DIY

  42. 42.

    Mature runtime != Mature language

  43. 43.

    Conciseness 608 lines of code

  44. 44.

    The end result

  45. 45.

    1.2 ms average response time at peak hours

  46. 46.

    0.1 % CPU usage at peak hours

  47. 47.

    Go is awesome

  48. 48.

    Go is awesome for simple services

  49. 49.

    Go is a trade-off

  50. 50.

    Go is a trade-off – choose wisely

  51. 51.

    return