Running your Symfony project on AWS Lambda

Given during Symfony Live London 2018, this presentation showcases a new tool called Bref, which takes the pain out of deploying PHP projects on AWS Lambda, allowing you to focus on your application code while saving money by cutting down on wasted server resources.

See https://github.com/mnapoli/bref for more info

Transcript

1. Running your Symfony
   project on AWS Lambda
   

   View Slide

2. View Slide

3. View Slide

4. View Slide

5. View Slide

6. View Slide

7. Running your Symfony
   project on AWS Lambda
   

   View Slide

8. (coupling yourself to AWS for fun & profit)
   

   View Slide

9. fun
   

   View Slide

10. profit
    

    View Slide

11. EC2
    

    View Slide

12. EC2 Data Store
    

    View Slide

13. EC2 Data Store
    HTTPS
    

    View Slide

14. EC2 Data Store
    Load Balancer
    HTTPS
    

    View Slide

15. EC2 Data Store
    Load Balancer
    EC2
    EC2
    

    View Slide

16. EC2 Data Store
    Load Balancer
    EC2
    EC2
    $$$
    $$ $$$
    $$$
    $$$
    

    View Slide

17. EC2 Data Store
    Load Balancer
    EC2
    EC2
    

    View Slide

18. Lambda is a piece of code
    that only costs you money
    while it’s being executed
    

    View Slide

19. Lambda & PHP from
    scratch is a PITA
    

    View Slide

20. View Slide

21. Lambda function
    

    View Slide

22. Lambda function
    JS Handler
    

    View Slide

23. Lambda function
    JS Handler
    PHP Binary
    

    View Slide

24. Lambda function
    JS Handler
    PHP Binary
    

    View Slide

25. Lambda function
    JS Handler
    PHP Binary
    

    View Slide

26. Lambda function
    JS Handler
    PHP Binary
    

    View Slide

27. View Slide

28. mnapoli/bref
    

    View Slide

29. • Well documented
    
    • Serverless framework plugin (easy to get running)
    
    • Built on top of FIG standards (PSR-7)
    mnapoli/bref
    

    View Slide

30. Lambda function
    JS Handler
    PHP Binary
    

    View Slide

31. Lambda function
    JS Handler
    PHP Binary
    PSR-7
    bref.php
    

    View Slide

32. Lambda function
    JS Handler
    PHP Binary
    PSR-7
    

    View Slide

33. Lambda function
    JS Handler
    PHP Binary
    PSR-7
    API Gateway
    

    View Slide

34. Lambda function
    JS Handler
    PHP Binary
    API Gateway
    HTTPS
    FREE SSL!!!
    PSR-7
    

    View Slide

35. Things to remember
    

    View Slide

36. • Application logs are sent to Cloudwatch
    
    • PHP is running through the CLI SAPI
    

    View Slide

37. What we’ll cover
    

    View Slide

38. • Setting up a new ‘Hello World’ SF 4 site
    
    • Setting up a REST API with database migrations
    
    • Converting an existing site to Lambda
    
    • Retro-fitting to an older Symfony site
    
    • Cron tasks
    
    • Performance
    

    View Slide

39. Hello World
    

    View Slide

40. • Install Symfony
    
    • Install Bref
    
    • Set up some config
    
    • Deploy
    
    • Explore the environment
    
    • Fix any issues
    

    View Slide

41. View Slide

42. View Slide

43. View Slide

44. View Slide

45. View Slide

46. View Slide

47. View Slide

48. View Slide

49. View Slide

50. View Slide

51. View Slide

52. View Slide

53. View Slide

54. use the
    Symfony adapter
    

    View Slide

55. View Slide

56. includes
    Lambda env vars
    package name
    

    View Slide

57. View Slide

58. View Slide

59. create .bref.yml
    with build hooks
    

    View Slide

60. View Slide

61. View Slide

62. View Slide

63. View Slide

64. View Slide

65. View Slide

66. View Slide

67. View Slide

68. View Slide

69. View Slide

70. View Slide

71. View Slide

72. View Slide

73. click me
    

    View Slide

74. oh noes
    

    View Slide

75. View Slide

76. View Slide

77. View Slide

78. let’s refresh…
    

    View Slide

79. oh noes again!
    

    View Slide

80. View Slide

81. View Slide

82. let’s refresh again…
    

    View Slide

83. View Slide

84. View Slide

85. • Installed Symfony
    
    • Installed Bref
    
    • Copied config from the docs
    
    • Deployed
    
    • Had a look around
    
    • Used Cloudwatch to help us debug
    

    View Slide

86. That’s great, but how
    about doing something
    useful?
    

    View Slide

87. View Slide

88. • Install Api-Platform
    
    • Install Bref
    
    • Add a database connection
    
    • Run Symfony commands
    
    • Get rid of the ugly Cloudfront hostname
    

    View Slide

89. View Slide

90. View Slide

91. View Slide

92. View Slide

93. View Slide

94. View Slide

95. View Slide

96. View Slide

97. View Slide

98. View Slide

99. • Change logs directory in Kernel class
    
    • Configure includes in serverless.yml
    
    • Replace contents of bref.php with Symfony adapter
    
    • Add cache warmup to .bref.yml
    

    View Slide

100. add /dev prefix to routing
     

     View Slide

101. Setting up the
     database connection
     

     View Slide

102. Lambda function
     JS Handler
     PHP Binary
     PSR-7
     API Gateway
     

     View Slide

103. Lambda function
     JS Handler
     PHP Binary
     PSR-7
     API Gateway
     

     View Slide

104. Lambda function
     JS Handler
     PHP Binary
     PSR-7
     API Gateway
     Data Store
     

     View Slide

105. Lambda function
     JS Handler
     PHP Binary
     PSR-7
     API Gateway
     Data Store
     VPC
     

     View Slide

106. ${env:DATABASE_URL}
     

     View Slide

107. View Slide

108. View Slide

109. Running Symfony
     commands with bref
     

     View Slide

110. View Slide

111. invoke Lambda function
     

     View Slide

112. Symfony command
     

     View Slide

113. View Slide

114. View Slide

115. entry point works!
     

     View Slide

116. get empty collection
     

     View Slide

117. post a new book
     

     View Slide

118. yay!!!
     

     View Slide

119. That’s great, but I have a
     really cool domain
     name…
     

     View Slide

120. View Slide

121. View Slide

122. View Slide

123. View Slide

124. View Slide

125. we can remove /dev route prefix :)
     

     View Slide

126. w00t!
     

     View Slide

127. • Installed Symfony
     
     • Installed Api-Platform
     
     • Installed Bref
     
     • Configured the standard files
     
     • Added a database connection through environment vars
     
     • Ran Symfony commands
     
     • Added a custom domain name via the AWS GUI
     

     View Slide

128. That’s great, but my site
     is more than just a REST
     API…
     

     View Slide

129. View Slide

130. View Slide

131. View Slide

132. View Slide

133. vich/uploader-bundle
     

     View Slide

134. • Install Bref to an existing site
     
     • Move assets to a CDN
     
     • Move session storage to a centralised location
     
     • Add image uploading
     

     View Slide

135. View Slide

136. View Slide

137. View Slide

138. • Change logs directory in Kernel class
     
     • Configure includes in serverless.yml
     
     • Replace contents of bref.php with Symfony adapter
     
     • Add cache warmup to .bref.yml
     

     View Slide

139. View Slide

140. View Slide

141. View Slide

142. View Slide

143. View Slide

144. webpack.config.js
     

     View Slide

145. process.env.ASSETS_BUCKET_NAME
     

     View Slide

146. View Slide

147. View Slide

148. View Slide

149. ${env:ASSETS_BUCKET_NAME}
     

     View Slide

150. View Slide

151. View Slide

152. Symlinking bug :(
     

     View Slide

153. View Slide

154. View Slide

155. View Slide

156. View Slide

157. %env(ASSETS_BUCKET_NAME)%
     

     View Slide

158. refresh… :)
     

     View Slide

159. View Slide

160. got kicked, lol
     

     View Slide

161. Lambda function
     JS Handler
     PHP Binary
     PSR-7
     API Gateway
     Data Store
     

     View Slide

162. Lambda function
     JS Handler
     PHP Binary
     PSR-7
     API Gateway
     Data Store
     Sessions
     

     View Slide

163. Lambda function
     JS Handler
     PHP Binary
     PSR-7
     API Gateway
     Data Store
     JS Handler
     PHP Binary
     PSR-7
     Sessions
     Sessions
     

     View Slide

164. Lambda function
     JS Handler
     PHP Binary
     PSR-7
     API Gateway
     Data Store
     JS Handler
     PHP Binary
     PSR-7
     Sessions
     

     View Slide

165. View Slide

166. View Slide

167. View Slide

168. View Slide

169. View Slide

170. View Slide

171. View Slide

172. View Slide

173. View Slide

174. migrations worked!
     

     View Slide

175. where are my images?
     

     View Slide

176. Lambda function
     JS Handler
     PHP Binary
     PSR-7
     API Gateway
     Data Store
     

     View Slide

177. Lambda function
     JS Handler
     PHP Binary
     PSR-7
     API Gateway
     Data Store
     

     View Slide

178. Lambda function
     JS Handler
     PHP Binary
     PSR-7
     API Gateway
     Data Store
     File Store
     

     View Slide

179. original value
     

     View Slide

180. point to CDN instead
     

     View Slide

181. View Slide

182. View Slide

183. create a global twig variable
     

     View Slide

184. View Slide

185. pretty kitties!
     

     View Slide

186. Uploading new
     images
     

     View Slide

187. Use pre-signed URLs
     

     View Slide

188. Client Server Amazon S3
     

     View Slide

189. Client Server Amazon S3
     Get Pre-Signed URL
     

     View Slide

190. Client Server Amazon S3
     Get Pre-Signed URL
     Get Pre-Signed URL
     

     View Slide

191. Client Server Amazon S3
     Get Pre-Signed URL
     Get Pre-Signed URL
     One-time use URL
     

     View Slide

192. Client Server Amazon S3
     Get Pre-Signed URL
     Get Pre-Signed URL
     One-time use URL
     One-time use URL
     

     View Slide

193. Client Server Amazon S3
     Get Pre-Signed URL
     Get Pre-Signed URL
     One-time use URL
     One-time use URL
     PUT file to One-time use URL
     200 OK
     

     View Slide

194. Client Server Amazon S3
     Get Pre-Signed URL
     Get Pre-Signed URL
     One-time use URL
     One-time use URL
     PUT file to One-time use URL
     200 OK
     Update record
     

     View Slide

195. Client Server Amazon S3
     Get Pre-Signed URL
     Get Pre-Signed URL
     One-time use URL
     One-time use URL
     PUT file to One-time use URL
     200 OK
     Update record
     Delete previous file
     

     View Slide

196. we can delete all of this
     

     View Slide

197. and this
     

     View Slide

198. View Slide

199. View Slide

200. we only want /uploads to be writeable
     

     View Slide

201. let’s re-create this in yaml
     

     View Slide

202. View Slide

203. View Slide

204. View Slide

205. View Slide

206. View Slide

207. View Slide

208. View Slide

209. View Slide

210. View Slide

211. View Slide

212. • Added Bref to an existing site
     
     • Fixed assets by moving them to a CDN
     
     • Added serverless-s3-uploads plugin
     
     • Configured CORS & bucket security in serverless.yml
     
     • Moved session storage to the database
     
     • Used pre-signed URLs for image uploading
     

     View Slide

213. That’s really cool, but I
     need to run cron tasks in
     PHP
     

     View Slide

214. View Slide

215. View Slide

216. View Slide

217. View Slide

218. {
     “cli”: “app:dump-lambda — message=Hello”
     }
     

     View Slide

219. View Slide

220. View Slide

221. But my site isn’t
     Symfony 4!
     

     View Slide

222. View Slide

223. View Slide

224. Performance
     

     View Slide

225. source: https://github.com/mnapoli/bref-benchmark
     JS vs PHP
     

     View Slide

226. View Slide

227. Lambda function
     JS Handler
     PHP Binary
     PSR-7
     API Gateway
     Data Store
     VPC
     

     View Slide

228. source: https://medium.freecodecamp.org/lambda-vpc-cold-starts-a-latency-killer-5408323278dd
     

     View Slide

229. source: https://medium.freecodecamp.org/lambda-vpc-cold-starts-a-latency-killer-5408323278dd
     

     View Slide

230. source: https://medium.freecodecamp.org/lambda-vpc-cold-starts-a-latency-killer-5408323278dd
     keep VPCs warm
     

     View Slide

231. Recap
     

     View Slide

232. • Setting up a new ‘Hello World’ SF 4 site
     
     • Setting up an Api-Platform site with database migrations
     
     • Converting an existing site to Lambda
     
     • Retro-fitting to an older Symfony site
     
     • Cron tasks
     
     • Performance
     

     View Slide

233. Win a Nintendo Switch
     Enter our competition at
     symfony2018.mybuilder.co.uk
     

     View Slide

234. joind.in/talk/02a33
     symfony2018.mybuilder.co.uk
     

     View Slide