$30 off During Our Annual Pro Sale. View Details »

Running your Symfony project on AWS Lambda

nealio82
September 28, 2018

Running your Symfony project on AWS Lambda

Given during Symfony Live London 2018, this presentation showcases a new tool called Bref, which takes the pain out of deploying PHP projects on AWS Lambda, allowing you to focus on your application code while saving money by cutting down on wasted server resources.

See https://github.com/mnapoli/bref for more info

nealio82

September 28, 2018
Tweet

More Decks by nealio82

Other Decks in Programming

Transcript

  1. Running your Symfony
    project on AWS Lambda

    View Slide

  2. View Slide

  3. View Slide

  4. View Slide

  5. View Slide

  6. View Slide

  7. Running your Symfony
    project on AWS Lambda

    View Slide

  8. (coupling yourself to AWS for fun & profit)

    View Slide

  9. fun

    View Slide

  10. profit

    View Slide

  11. EC2

    View Slide

  12. EC2 Data Store

    View Slide

  13. EC2 Data Store
    HTTPS

    View Slide

  14. EC2 Data Store
    Load Balancer
    HTTPS

    View Slide

  15. EC2 Data Store
    Load Balancer
    EC2
    EC2

    View Slide

  16. EC2 Data Store
    Load Balancer
    EC2
    EC2
    $$$
    $$ $$$
    $$$
    $$$

    View Slide

  17. EC2 Data Store
    Load Balancer
    EC2
    EC2

    View Slide

  18. Lambda is a piece of code
    that only costs you money
    while it’s being executed

    View Slide

  19. Lambda & PHP from
    scratch is a PITA

    View Slide

  20. View Slide

  21. Lambda function

    View Slide

  22. Lambda function
    JS Handler

    View Slide

  23. Lambda function
    JS Handler
    PHP Binary

    View Slide

  24. Lambda function
    JS Handler
    PHP Binary

    View Slide

  25. Lambda function
    JS Handler
    PHP Binary

    View Slide

  26. Lambda function
    JS Handler
    PHP Binary

    View Slide

  27. View Slide

  28. mnapoli/bref

    View Slide

  29. • Well documented

    • Serverless framework plugin (easy to get running)

    • Built on top of FIG standards (PSR-7)
    mnapoli/bref

    View Slide

  30. Lambda function
    JS Handler
    PHP Binary

    View Slide

  31. Lambda function
    JS Handler
    PHP Binary
    PSR-7
    bref.php

    View Slide

  32. Lambda function
    JS Handler
    PHP Binary
    PSR-7

    View Slide

  33. Lambda function
    JS Handler
    PHP Binary
    PSR-7
    API Gateway

    View Slide

  34. Lambda function
    JS Handler
    PHP Binary
    API Gateway
    HTTPS
    FREE SSL!!!
    PSR-7

    View Slide

  35. Things to remember

    View Slide

  36. • Application logs are sent to Cloudwatch

    • PHP is running through the CLI SAPI

    View Slide

  37. What we’ll cover

    View Slide

  38. • Setting up a new ‘Hello World’ SF 4 site

    • Setting up a REST API with database migrations

    • Converting an existing site to Lambda

    • Retro-fitting to an older Symfony site

    • Cron tasks

    • Performance

    View Slide

  39. Hello World

    View Slide

  40. • Install Symfony

    • Install Bref

    • Set up some config

    • Deploy

    • Explore the environment

    • Fix any issues

    View Slide

  41. View Slide

  42. View Slide

  43. View Slide

  44. View Slide

  45. View Slide

  46. View Slide

  47. View Slide

  48. View Slide

  49. View Slide

  50. View Slide

  51. View Slide

  52. View Slide

  53. View Slide

  54. use the
    Symfony adapter

    View Slide

  55. View Slide

  56. includes
    Lambda env vars
    package name

    View Slide

  57. View Slide

  58. View Slide

  59. create .bref.yml
    with build hooks

    View Slide

  60. View Slide

  61. View Slide

  62. View Slide

  63. View Slide

  64. View Slide

  65. View Slide

  66. View Slide

  67. View Slide

  68. View Slide

  69. View Slide

  70. View Slide

  71. View Slide

  72. View Slide

  73. click me

    View Slide

  74. oh noes

    View Slide

  75. View Slide

  76. View Slide

  77. View Slide

  78. let’s refresh…

    View Slide

  79. oh noes again!

    View Slide

  80. View Slide

  81. View Slide

  82. let’s refresh again…

    View Slide

  83. View Slide

  84. View Slide

  85. • Installed Symfony

    • Installed Bref

    • Copied config from the docs

    • Deployed

    • Had a look around

    • Used Cloudwatch to help us debug

    View Slide

  86. That’s great, but how
    about doing something
    useful?

    View Slide

  87. View Slide

  88. • Install Api-Platform

    • Install Bref

    • Add a database connection

    • Run Symfony commands

    • Get rid of the ugly Cloudfront hostname

    View Slide

  89. View Slide

  90. View Slide

  91. View Slide

  92. View Slide

  93. View Slide

  94. View Slide

  95. View Slide

  96. View Slide

  97. View Slide

  98. View Slide

  99. • Change logs directory in Kernel class

    • Configure includes in serverless.yml

    • Replace contents of bref.php with Symfony adapter

    • Add cache warmup to .bref.yml

    View Slide

  100. add /dev prefix to routing

    View Slide

  101. Setting up the
    database connection

    View Slide

  102. Lambda function
    JS Handler
    PHP Binary
    PSR-7
    API Gateway

    View Slide

  103. Lambda function
    JS Handler
    PHP Binary
    PSR-7
    API Gateway

    View Slide

  104. Lambda function
    JS Handler
    PHP Binary
    PSR-7
    API Gateway
    Data Store

    View Slide

  105. Lambda function
    JS Handler
    PHP Binary
    PSR-7
    API Gateway
    Data Store
    VPC

    View Slide

  106. ${env:DATABASE_URL}

    View Slide

  107. View Slide

  108. View Slide

  109. Running Symfony
    commands with bref

    View Slide

  110. View Slide

  111. invoke Lambda function

    View Slide

  112. Symfony command

    View Slide

  113. View Slide

  114. View Slide

  115. entry point works!

    View Slide

  116. get empty collection

    View Slide

  117. post a new book

    View Slide

  118. yay!!!

    View Slide

  119. That’s great, but I have a
    really cool domain
    name…

    View Slide

  120. View Slide

  121. View Slide

  122. View Slide

  123. View Slide

  124. View Slide

  125. we can remove /dev route prefix :)

    View Slide

  126. w00t!

    View Slide

  127. • Installed Symfony

    • Installed Api-Platform

    • Installed Bref

    • Configured the standard files

    • Added a database connection through environment vars

    • Ran Symfony commands

    • Added a custom domain name via the AWS GUI

    View Slide

  128. That’s great, but my site
    is more than just a REST
    API…

    View Slide

  129. View Slide

  130. View Slide

  131. View Slide

  132. View Slide

  133. vich/uploader-bundle

    View Slide

  134. • Install Bref to an existing site

    • Move assets to a CDN

    • Move session storage to a centralised location

    • Add image uploading

    View Slide

  135. View Slide

  136. View Slide

  137. View Slide

  138. • Change logs directory in Kernel class

    • Configure includes in serverless.yml

    • Replace contents of bref.php with Symfony adapter

    • Add cache warmup to .bref.yml

    View Slide

  139. View Slide

  140. View Slide

  141. View Slide

  142. View Slide

  143. View Slide

  144. webpack.config.js

    View Slide

  145. process.env.ASSETS_BUCKET_NAME

    View Slide

  146. View Slide

  147. View Slide

  148. View Slide

  149. ${env:ASSETS_BUCKET_NAME}

    View Slide

  150. View Slide

  151. View Slide

  152. Symlinking bug :(

    View Slide

  153. View Slide

  154. View Slide

  155. View Slide

  156. View Slide

  157. %env(ASSETS_BUCKET_NAME)%

    View Slide

  158. refresh… :)

    View Slide

  159. View Slide

  160. got kicked, lol

    View Slide

  161. Lambda function
    JS Handler
    PHP Binary
    PSR-7
    API Gateway
    Data Store

    View Slide

  162. Lambda function
    JS Handler
    PHP Binary
    PSR-7
    API Gateway
    Data Store
    Sessions

    View Slide

  163. Lambda function
    JS Handler
    PHP Binary
    PSR-7
    API Gateway
    Data Store
    JS Handler
    PHP Binary
    PSR-7
    Sessions
    Sessions

    View Slide

  164. Lambda function
    JS Handler
    PHP Binary
    PSR-7
    API Gateway
    Data Store
    JS Handler
    PHP Binary
    PSR-7
    Sessions

    View Slide

  165. View Slide

  166. View Slide

  167. View Slide

  168. View Slide

  169. View Slide

  170. View Slide

  171. View Slide

  172. View Slide

  173. View Slide

  174. migrations worked!

    View Slide

  175. where are my images?

    View Slide

  176. Lambda function
    JS Handler
    PHP Binary
    PSR-7
    API Gateway
    Data Store

    View Slide

  177. Lambda function
    JS Handler
    PHP Binary
    PSR-7
    API Gateway
    Data Store

    View Slide

  178. Lambda function
    JS Handler
    PHP Binary
    PSR-7
    API Gateway
    Data Store
    File Store

    View Slide

  179. original value

    View Slide

  180. point to CDN instead

    View Slide

  181. View Slide

  182. View Slide

  183. create a global twig variable

    View Slide

  184. View Slide

  185. pretty kitties!

    View Slide

  186. Uploading new
    images

    View Slide

  187. Use pre-signed URLs

    View Slide

  188. Client Server Amazon S3

    View Slide

  189. Client Server Amazon S3
    Get Pre-Signed URL

    View Slide

  190. Client Server Amazon S3
    Get Pre-Signed URL
    Get Pre-Signed URL

    View Slide

  191. Client Server Amazon S3
    Get Pre-Signed URL
    Get Pre-Signed URL
    One-time use URL

    View Slide

  192. Client Server Amazon S3
    Get Pre-Signed URL
    Get Pre-Signed URL
    One-time use URL
    One-time use URL

    View Slide

  193. Client Server Amazon S3
    Get Pre-Signed URL
    Get Pre-Signed URL
    One-time use URL
    One-time use URL
    PUT file to One-time use URL
    200 OK

    View Slide

  194. Client Server Amazon S3
    Get Pre-Signed URL
    Get Pre-Signed URL
    One-time use URL
    One-time use URL
    PUT file to One-time use URL
    200 OK
    Update record

    View Slide

  195. Client Server Amazon S3
    Get Pre-Signed URL
    Get Pre-Signed URL
    One-time use URL
    One-time use URL
    PUT file to One-time use URL
    200 OK
    Update record
    Delete previous file

    View Slide

  196. we can delete all of this

    View Slide

  197. and this

    View Slide

  198. View Slide

  199. View Slide

  200. we only want /uploads to be writeable

    View Slide

  201. let’s re-create this in yaml

    View Slide

  202. View Slide

  203. View Slide

  204. View Slide

  205. View Slide

  206. View Slide

  207. View Slide

  208. View Slide

  209. View Slide

  210. View Slide

  211. View Slide

  212. • Added Bref to an existing site

    • Fixed assets by moving them to a CDN

    • Added serverless-s3-uploads plugin

    • Configured CORS & bucket security in serverless.yml

    • Moved session storage to the database

    • Used pre-signed URLs for image uploading

    View Slide

  213. That’s really cool, but I
    need to run cron tasks in
    PHP

    View Slide

  214. View Slide

  215. View Slide

  216. View Slide

  217. View Slide

  218. {
    “cli”: “app:dump-lambda — message=Hello”
    }

    View Slide

  219. View Slide

  220. View Slide

  221. But my site isn’t
    Symfony 4!

    View Slide

  222. View Slide

  223. View Slide

  224. Performance

    View Slide

  225. source: https://github.com/mnapoli/bref-benchmark
    JS vs PHP

    View Slide

  226. View Slide

  227. Lambda function
    JS Handler
    PHP Binary
    PSR-7
    API Gateway
    Data Store
    VPC

    View Slide

  228. source: https://medium.freecodecamp.org/lambda-vpc-cold-starts-a-latency-killer-5408323278dd

    View Slide

  229. source: https://medium.freecodecamp.org/lambda-vpc-cold-starts-a-latency-killer-5408323278dd

    View Slide

  230. source: https://medium.freecodecamp.org/lambda-vpc-cold-starts-a-latency-killer-5408323278dd
    keep VPCs warm

    View Slide

  231. Recap

    View Slide

  232. • Setting up a new ‘Hello World’ SF 4 site

    • Setting up an Api-Platform site with database migrations

    • Converting an existing site to Lambda

    • Retro-fitting to an older Symfony site

    • Cron tasks

    • Performance

    View Slide

  233. Win a Nintendo Switch
    Enter our competition at
    symfony2018.mybuilder.co.uk

    View Slide

  234. joind.in/talk/02a33
    symfony2018.mybuilder.co.uk

    View Slide