Fili Wiese - Improving SEO in Cloud Environments

Transcript

1. Fili SEO consultant @ Search Brothers Improving SEO in Cloud Environments October 17 - 18 2024 CAM Raleigh 409 W. Martin Street Raleigh, NC 27603 fili.link
2. SearchBrothers.com - SEO audits & training by ex-Google Search
3. SearchBrothers.com - SEO audits & training by ex-Google Search In the cloud
4. SearchBrothers.com - SEO audits & training by ex-Google Search Improve crawling
5. SearchBrothers.com - SEO audits & training by ex-Google Search Improve indexing
6. SearchBrothers.com - SEO audits & training by ex-Google Search Improve speed
7. SearchBrothers.com - SEO audits & training by ex-Google Search Improve rankings
8. SearchBrothers.com - SEO audits & training by ex-Google Search Improve sales
9. So what is the problem? SearchBrothers.com fili.link
10. SearchBrothers.com - SEO audits & training by ex-Google Search 60% cn.ie/apm
11. SearchBrothers.com - SEO audits & training by ex-Google Search Unintentional
12. SearchBrothers.com - SEO audits & training by ex-Google Search ?
13. SearchBrothers.com - SEO audits & training by ex-Google Search URL Uniform Resource Locator
14. SearchBrothers.com - SEO audits & training by ex-Google Search scheme://authority/path ?query#fragment
15. SearchBrothers.com - SEO audits & training by ex-Google Search HTTP Request
16. SearchBrothers.com - SEO audits & training by ex-Google Search HTTP Response
17. SearchBrothers.com - SEO audits & training by ex-Google Search HTTP Status Codes http.dev/status
18. SearchBrothers.com - SEO audits & training by ex-Google Search Most relevant
19. SearchBrothers.com - SEO audits & training by ex-Google Search 200 OK http.dev/200
20. Optimize SearchBrothers.com - SEO audits & training by ex-Google Search 404 410 http.dev/404
21. SearchBrothers.com - SEO audits & training by ex-Google Search 301 / 302 / 307 / 308 ? fili.link/fkw
22. SearchBrothers.com - SEO audits & training by ex-Google Search Redirect == Start over
23. SearchBrothers.com - SEO audits & training by ex-Google Search cn.ie/qve
24. SearchBrothers.com - SEO audits & training by ex-Google Search Optimize Immutable
25. SearchBrothers.com - SEO audits & training by ex-Google Search Create Delete
26. SearchBrothers.com - SEO audits & training by ex-Google Search cn.ie/qoa
27. SearchBrothers.com - SEO audits & training by ex-Google Search
28. SearchBrothers.com - SEO audits & training by ex-Google Search
29. SearchBrothers.com - SEO audits & training by ex-Google Search cn.ie/apm Needless duplication
30. SearchBrothers.com - SEO audits & training by ex-Google Search Impacts content quality signals
31. Getting URLs right in Cloud Environments SearchBrothers.com fili.link An ex-Google engineer's how-to
32. SearchBrothers.com - SEO audits & training by ex-Google Search 1.
33. SearchBrothers.com - SEO audits & training by ex-Google Search Know your hostnames
34. SearchBrothers.com - SEO audits & training by ex-Google Search cn.ie/kva
35. SearchBrothers.com - SEO audits & training by ex-Google Search
36. SearchBrothers.com - SEO audits & training by ex-Google Search cn.ie/esk
37. SearchBrothers.com - SEO audits & training by ex-Google Search $ dig A ...
38. SearchBrothers.com - SEO audits & training by ex-Google Search Duplication?
39. SearchBrothers.com - SEO audits & training by ex-Google Search Staging/dev subdomains
40. SearchBrothers.com - SEO audits & training by ex-Google Search
41. SearchBrothers.com - SEO audits & training by ex-Google Search Staging/dev hostnames
42. SearchBrothers.com - SEO audits & training by ex-Google Search
43. SearchBrothers.com - SEO audits & training by ex-Google Search
44. SearchBrothers.com - SEO audits & training by ex-Google Search
45. SearchBrothers.com - SEO audits & training by ex-Google Search Not just for security
46. SearchBrothers.com - SEO audits & training by ex-Google Search Limit content exposure
47. SearchBrothers.com - SEO audits & training by ex-Google Search 2.
48. SearchBrothers.com - SEO audits & training by ex-Google Search Know which URLs bots access
49. SearchBrothers.com - SEO audits & training by ex-Google Search
50. SearchBrothers.com - SEO audits & training by ex-Google Search double-check
51. SearchBrothers.com - SEO audits & training by ex-Google Search double-check
52. SearchBrothers.com - SEO audits & training by ex-Google Search
53. SearchBrothers.com - SEO audits & training by ex-Google Search
54. SearchBrothers.com - SEO audits & training by ex-Google Search
55. SearchBrothers.com - SEO audits & training by ex-Google Search Sample data
56. SearchBrothers.com - SEO audits & training by ex-Google Search Server log files cn.ie/hvw
57. SearchBrothers.com - SEO audits & training by ex-Google Search Correct data?
58. SearchBrothers.com - SEO audits & training by ex-Google Search 127.0.0.1 - - [01/Oct/2022:13:55:36 -0700] "GET / HTTP/1.1" 200 2326
59. SearchBrothers.com - SEO audits & training by ex-Google Search 127.0.0.1 - - [01/Oct/2022:13:55:36 -0700] "GET / HTTP/1.1" 200 2326 127.0.0.1 - - [01/Oct/2022:13:55:36 -0700] "GET / HTTP/1.1" 301 100
60. SearchBrothers.com - SEO audits & training by ex-Google Search https://example.re/ → HTTP 200
61. SearchBrothers.com - SEO audits & training by ex-Google Search https://example.re/ → HTTP 200 http://example.re/ → HTTP 301
62. SearchBrothers.com - SEO audits & training by ex-Google Search cn.ie/tdf cn.ie/aga origin (scheme and authority) double-check
63. SearchBrothers.com - SEO audits & training by ex-Google Search Collect all
64. SearchBrothers.com - SEO audits & training by ex-Google Search
65. SearchBrothers.com - SEO audits & training by ex-Google Search 3.
66. SearchBrothers.com - SEO audits & training by ex-Google Search Blocking bots
67. SearchBrothers.com - SEO audits & training by ex-Google Search Check
68. SearchBrothers.com - SEO audits & training by ex-Google Search Check Bot protection services
69. SearchBrothers.com - SEO audits & training by ex-Google Search double-check cn.ie/umc
70. SearchBrothers.com - SEO audits & training by ex-Google Search Page could not be reached
71. SearchBrothers.com - SEO audits & training by ex-Google Search
72. SearchBrothers.com - SEO audits & training by ex-Google Search Whitelist
73. SearchBrothers.com - SEO audits & training by ex-Google Search Frequent updates
74. SearchBrothers.com - SEO audits & training by ex-Google Search seoapi.com
75. SearchBrothers.com - SEO audits & training by ex-Google Search First allow
76. SearchBrothers.com - SEO audits & training by ex-Google Search First allow Verify
77. SearchBrothers.com - SEO audits & training by ex-Google Search First allow Verify Block if needed
78. SearchBrothers.com - SEO audits & training by ex-Google Search 4.
79. SearchBrothers.com - SEO audits & training by ex-Google Search Are you human?
80. SearchBrothers.com - SEO audits & training by ex-Google Search
81. SearchBrothers.com - SEO audits & training by ex-Google Search cn.ie/vdt
82. SearchBrothers.com - SEO audits & training by ex-Google Search
83. SearchBrothers.com - SEO audits & training by ex-Google Search cn.ie/umc double-check
84. SearchBrothers.com - SEO audits & training by ex-Google Search User-agent: * Disallow: /cdn-cgi/ cn.ie/gqz Image credit: cn.ie/xfm
85. SearchBrothers.com - SEO audits & training by ex-Google Search 5.
86. SearchBrothers.com - SEO audits & training by ex-Google Search Cloud storage
87. SearchBrothers.com - SEO audits & training by ex-Google Search
88. SearchBrothers.com - SEO audits & training by ex-Google Search
89. SearchBrothers.com - SEO audits & training by ex-Google Search
90. SearchBrothers.com - SEO audits & training by ex-Google Search Load balancers
91. SearchBrothers.com - SEO audits & training by ex-Google Search
92. SearchBrothers.com - SEO audits & training by ex-Google Search Containerized / Serverless
93. SearchBrothers.com - SEO audits & training by ex-Google Search
94. SearchBrothers.com - SEO audits & training by ex-Google Search Outsourced hosting
95. SearchBrothers.com - SEO audits & training by ex-Google Search
96. SearchBrothers.com - SEO audits & training by ex-Google Search
97. SearchBrothers.com - SEO audits & training by ex-Google Search
98. SearchBrothers.com - SEO audits & training by ex-Google Search CDN
99. SearchBrothers.com - SEO audits & training by ex-Google Search
100. SearchBrothers.com - SEO audits & training by ex-Google Search
101. SearchBrothers.com - SEO audits & training by ex-Google Search
102. SearchBrothers.com - SEO audits & training by ex-Google Search
103. SearchBrothers.com - SEO audits & training by ex-Google Search
104. SearchBrothers.com - SEO audits & training by ex-Google Search
105. SearchBrothers.com - SEO audits & training by ex-Google Search Canonicals don't always work
106. Case Study SearchBrothers.com fili.link
107. SearchBrothers.com - SEO audits & training by ex-Google Search
108. SearchBrothers.com - SEO audits & training by ex-Google Search
109. SearchBrothers.com - SEO audits & training by ex-Google Search
110. SearchBrothers.com - SEO audits & training by ex-Google Search run Image credits: cn.ie/mnq
111. SearchBrothers.com - SEO audits & training by ex-Google Search
112. SearchBrothers.com - SEO audits & training by ex-Google Search run load balancing Image credits: cn.ie/mnq
113. SearchBrothers.com - SEO audits & training by ex-Google Search run load balancing cdn Image credits: cn.ie/mnq
114. SearchBrothers.com - SEO audits & training by ex-Google Search .a.run.app
115. SearchBrothers.com - SEO audits & training by ex-Google Search host.endswith(“run.app”)
116. SearchBrothers.com - SEO audits & training by ex-Google Search Usual checks
117. SearchBrothers.com - SEO audits & training by ex-Google Search
118. SearchBrothers.com - SEO audits & training by ex-Google Search
119. SearchBrothers.com - SEO audits & training by ex-Google Search
120. SearchBrothers.com - SEO audits & training by ex-Google Search
121. SearchBrothers.com - SEO audits & training by ex-Google Search host.endswith(“.run.app”) host.endswith(“.cqloud.com”)
122. SearchBrothers.com - SEO audits & training by ex-Google Search
123. SearchBrothers.com - SEO audits & training by ex-Google Search
124. SearchBrothers.com - SEO audits & training by ex-Google Search
125. SearchBrothers.com - SEO audits & training by ex-Google Search host.endswith(“.run.app”) host.endswith(“.cqloud.com”) host.endswith(“.googleusercontent.com”)
126. SearchBrothers.com - SEO audits & training by ex-Google Search Load balancer IP address Image credits: cn.ie/mnq
127. SearchBrothers.com - SEO audits & training by ex-Google Search host.endswith(“.run.app”) host.endswith(“.cqloud.com”) host.endswith(“.googleusercontent.com”) is_load_balancer_ip_address
128. SearchBrothers.com - SEO audits & training by ex-Google Search
129. SearchBrothers.com - SEO audits & training by ex-Google Search
130. SearchBrothers.com - SEO audits & training by ex-Google Search App Engine proxies Image credits: cn.ie/mnq
131. SearchBrothers.com - SEO audits & training by ex-Google Search host.endswith(“.run.app”) host.endswith(“.cqloud.com”) host.endswith(“.googleusercontent.com”) is_load_balancer_ip_address host.endswith(“.appspot.com”)
132. SearchBrothers.com - SEO audits & training by ex-Google Search Python (Flask): url_for('index', _external=True)
133. SearchBrothers.com - SEO audits & training by ex-Google Search Python (Flask): url_for('index', _external=True) PHP (Laravel): url('/') or route('index') Node.js (Express): ${req.protocol}://${req.headers.host}${req.originalUrl} Ruby (Sinatra): #{request.scheme}://#{request.host_with_port}/ ASP.NET Core: Url.Action("Index", "Home", null, Request.Scheme)
134. SearchBrothers.com - SEO audits & training by ex-Google Search host.endswith(“.run.app”) host.endswith(“.cqloud.com”) host.endswith(“.googleusercontent.com”) is_load_balancer_ip_address host.endswith(“.appspot.com”)
135. SearchBrothers.com - SEO audits & training by ex-Google Search
136. SearchBrothers.com - SEO audits & training by ex-Google Search “example.com” != host
137. Considerations SearchBrothers.com fili.link An ex-Google engineer's how-to
138. SearchBrothers.com - SEO audits & training by ex-Google Search Prevent indexing
139. SearchBrothers.com - SEO audits & training by ex-Google Search http.dog/301
140. SearchBrothers.com - SEO audits & training by ex-Google Search robots.txt User-agent: * Disallow: /
141. SearchBrothers.com - SEO audits & training by ex-Google Search robotstxt.com
142. SearchBrothers.com - SEO audits & training by ex-Google Search
143. SearchBrothers.com - SEO audits & training by ex-Google Search <?xml version='1.0' encoding='UTF-8'?> <Error> <Code>AccessDenied</Code> <Message>Access denied.</Message> <Details>Anonymous caller does not have storage.objects.list access to the Google Cloud Storage bucket. Permission 'storage.objects.list' denied on resource (or it may not exist).</Details> </Error> 403
144. SearchBrothers.com - SEO audits & training by ex-Google Search <?xml version="1.0" encoding="UTF-8"?> <Error> <Code>NoSuchKey</Code> <Message>The specified key does not exist.</Message> <Key>robots.txt</Key> <RequestId>5GR24N7K1T2S4QNV</RequestId> <HostId>edNvos50FIIRIRD6NpBUcpHC0vJZt9ADkf2qEZysvO BdB7v5Rg9Rh5Z2o9z3v7xy/Sp9UO5/Wao=</HostId> </Error> 404
145. SearchBrothers.com - SEO audits & training by ex-Google Search 4xx (except 429) fili.link/juu & fili.link/qwu Allow: /
146. SearchBrothers.com - SEO audits & training by ex-Google Search Inheritance
147. SearchBrothers.com - SEO audits & training by ex-Google Search
148. SearchBrothers.com - SEO audits & training by ex-Google Search
149. SearchBrothers.com - SEO audits & training by ex-Google Search
150. SearchBrothers.com - SEO audits & training by ex-Google Search
151. SearchBrothers.com - SEO audits & training by ex-Google Search
152. SearchBrothers.com - SEO audits & training by ex-Google Search Disable directory listings
153. SearchBrothers.com - SEO audits & training by ex-Google Search
154. SearchBrothers.com - SEO audits & training by ex-Google Search Utilize noindex
155. SearchBrothers.com - SEO audits & training by ex-Google Search
156. SearchBrothers.com - SEO audits & training by ex-Google Search Alerts
157. SearchBrothers.com - SEO audits & training by ex-Google Search Depending on techstack
158. Speed "things" up BONUS SearchBrothers.com fili.link An ex-Google engineer's how-to
159. SearchBrothers.com - SEO audits & training by ex-Google Search Backend processing cn.ie/huam
160. SearchBrothers.com - SEO audits & training by ex-Google Search If the site slows down or responds with server errors, the crawl capacity limit goes down and Googlebot crawls less. cn.ie/zxv
161. SearchBrothers.com - SEO audits & training by ex-Google Search Network cn.ie/yff
162. SearchBrothers.com - SEO audits & training by ex-Google Search Network stability
163. SearchBrothers.com - SEO audits & training by ex-Google Search Network stability
164. SearchBrothers.com - SEO audits & training by ex-Google Search Latency
165. SearchBrothers.com - SEO audits & training by ex-Google Search
166. SearchBrothers.com - SEO audits & training by ex-Google Search Time To First Byte
167. SearchBrothers.com - SEO audits & training by ex-Google Search Too slow
168. SearchBrothers.com - SEO audits & training by ex-Google Search Better
169. SearchBrothers.com - SEO audits & training by ex-Google Search Serverless
170. SearchBrothers.com - SEO audits & training by ex-Google Search Available instances
171. SearchBrothers.com - SEO audits & training by ex-Google Search Cold start instances
172. SearchBrothers.com - SEO audits & training by ex-Google Search
173. SearchBrothers.com - SEO audits & training by ex-Google Search
174. SearchBrothers.com - SEO audits & training by ex-Google Search > 1 running
175. SearchBrothers.com - SEO audits & training by ex-Google Search TLS
176. SearchBrothers.com - SEO audits & training by ex-Google Search http.dev/1.1 http.dev/2
177. SearchBrothers.com - SEO audits & training by ex-Google Search http.dev/1.1 http.dev/2 http.dev/3
178. SearchBrothers.com - SEO audits & training by ex-Google Search Accept-Encoding: br, gzip, deflate http.dev/compression
179. SearchBrothers.com - SEO audits & training by ex-Google Search Server resources cn.ie/huam
180. SearchBrothers.com - SEO audits & training by ex-Google Search CPU cn.ie/huam
181. SearchBrothers.com - SEO audits & training by ex-Google Search RAM cn.ie/huam
182. SearchBrothers.com - SEO audits & training by ex-Google Search Disk cn.ie/huam
183. SearchBrothers.com - SEO audits & training by ex-Google Search Increase resources
184. SearchBrothers.com - SEO audits & training by ex-Google Search Web Vitals cn.ie/vge
185. SearchBrothers.com - SEO audits & training by ex-Google Search Server software cn.ie/huam
186. SearchBrothers.com - SEO audits & training by ex-Google Search
187. SearchBrothers.com - SEO audits & training by ex-Google Search
188. SearchBrothers.com - SEO audits & training by ex-Google Search Identify bottlenecks
189. SearchBrothers.com - SEO audits & training by ex-Google Search Distance to user cn.ie/huam
190. SearchBrothers.com - SEO audits & training by ex-Google Search Cloud provider
191. SearchBrothers.com - SEO audits & training by ex-Google Search
192. SearchBrothers.com - SEO audits & training by ex-Google Search
193. SearchBrothers.com - SEO audits & training by ex-Google Search
194. SearchBrothers.com - SEO audits & training by ex-Google Search
195. SearchBrothers.com - SEO audits & training by ex-Google Search In-memory cn.ie/dqx Image credits: cn.ie/ftn
196. SearchBrothers.com - SEO audits & training by ex-Google Search Disk caching cn.ie/uosc
197. SearchBrothers.com - SEO audits & training by ex-Google Search Combination
198. SearchBrothers.com - SEO audits & training by ex-Google Search http.dev/caching Image credits: cn.ie/adiho
199. SearchBrothers.com - SEO audits & training by ex-Google Search Content Delivery Network
200. SearchBrothers.com - SEO audits & training by ex-Google Search cn.ie/bkkf cn.ie/mgoj image credits: cn.ie/hwjyv
201. SearchBrothers.com - SEO audits & training by ex-Google Search
202. SearchBrothers.com - SEO audits & training by ex-Google Search
203. SearchBrothers.com - SEO audits & training by ex-Google Search Database cn.ie/huam
204. SearchBrothers.com - SEO audits & training by ex-Google Search
205. SearchBrothers.com - SEO audits & training by ex-Google Search Database latency cn.ie/huam
206. SearchBrothers.com - SEO audits & training by ex-Google Search Query complexity cn.ie/huam
207. SearchBrothers.com - SEO audits & training by ex-Google Search Joins?
208. SearchBrothers.com - SEO audits & training by ex-Google Search SQL vs NoSQL
209. SearchBrothers.com - SEO audits & training by ex-Google Search cn.ie/huam
210. SearchBrothers.com - SEO audits & training by ex-Google Search cn.ie/huam
211. SearchBrothers.com - SEO audits & training by ex-Google Search cn.ie/huam
212. SearchBrothers.com - SEO audits & training by ex-Google Search <title> <?php get_bloginfo('name'); ?> - <?php get_bloginfo('description');?> </title> <link rel="shortcut icon" type="image/x-icon" href="<?php get_bloginfo('template_url'); ?>/favicon.ico" /> <link rel="stylesheet" type="text/css" media="screen" href="<?php get_bloginfo('stylesheet_url'); ?>"/> <link rel="alternate" type="application/rss+xml" title="RSS" href="<?php get_bloginfo('rss_url'); ?>" />
213. SearchBrothers.com - SEO audits & training by ex-Google Search Global variables
214. SearchBrothers.com - SEO audits & training by ex-Google Search Assets
215. SearchBrothers.com - SEO audits & training by ex-Google Search Cloud storage
216. SearchBrothers.com - SEO audits & training by ex-Google Search
217. SearchBrothers.com - SEO audits & training by ex-Google Search Test what works for you!
218. SearchBrothers.com - SEO audits & training by ex-Google Search HTTP Headers Server-Timing: cache;desc=”Read from Cache”;dur=15.1 http.dev/server-timing cn.ie/gta cn.ie/iuo
219. SearchBrothers.com - SEO audits & training by ex-Google Search Crawl requests
220. SearchBrothers.com - SEO audits & training by ex-Google Search If the site responds quickly for a while, the crawl capacity limit goes up, meaning more connections can be used to crawl. cn.ie/zxv
221. Takeaways SearchBrothers.com fili.link
222. SearchBrothers.com - SEO audits & training by ex-Google Search Content quality signals
223. SearchBrothers.com - SEO audits & training by ex-Google Search Audit regularly
224. SearchBrothers.com - SEO audits & training by ex-Google Search Tackle
225. SearchBrothers.com - SEO audits & training by ex-Google Search Avoid duplication
226. SearchBrothers.com - SEO audits & training by ex-Google Search Optimize the backend cn.ie/huam
227. SEO consultant ex-Google engineer ex-Google Search fili > fili.com @fili@seo.chat @seo.guru
228. SearchBrothers.com SEO audits & training by ex-Google Search