Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Sign up for free
Menu
Search
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Pricing
Search
Sign in
Sign up for free
From Crawl To Clarity Automating SEO Audits Wit...
Search
Sponsored
·
SiteGround - Reliable hosting with speed, security, and support you can count on.
→
Jonathon Roberts
April 27, 2026
Marketing & SEO
560
0
Share
Embed
Copy iframe code
Copy JS code
Copy link
Start on current slide
From Crawl To Clarity Automating SEO Audits With Node.JS
Jonathon Roberts
April 27, 2026
Transcript
84 slides
None
Technical Lead, Fly High Media Interested in Speeding up SEO
auditing & workflows
WANT TO FOLLOW ALONG WITH THE SLIDES?
TECHNICAL AUDITS WERE TAKING TOO LONG!
None
TOOLS Web Server LLM of Choice Domain Name
HAS ANYONE USED NODE.JS BEFORE?
WHAT IS NODE.JS?
FREE JAVASCRIPT FRAMEWORK
ALLOWS DEVELOPERS TO CREATE CUSTOM TOOLS
WHY AUTOMATE SEO AUDITS THIS WAY?
REDUCE WORKLOAD
CUSTOMISABLE
LOW COST
WHAT CAN WE AUDIT?
HTML STATUS CODES (404, 301, ETC..)
CANONICAL TAG ISSUES
PAGINATION ISSUES
METADATA ISSUES AT SCALE
HREFLANG ISSUES
XML SITEMAP CHECKS
REDIRECT CHAINS & LOOPS
IMAGE ALT TEXT
URL STRUCTURE
PAGE SPEED ISSUES
BROKEN INTERNAL/EXTERNAL LINKS
SCHEMA MARKUP
PAGE SIZE IS LESS THAN 2MB GOOGLE NEW CRAWLING LIMIT
- FEB 2026
HOW CAN WE BUILD AN AUDITING TOOL?
LLMS CAN CREATE THE CODE FOR ME!
None
“I WANT TO CREATE A WEB APP THAT ALLOWS ME
TO CRAWL WEBSITES FOR ANY TECHNICAL SEO ISSUES USING NODEJS”
None
USE A CODE EDITOR LIKE VISUAL STUDIO CODE TO CREATE
THE DIRECTORY
None
None
WE NOW NEED TO SETUP A SERVER TO HOST THE
APP ON
None
HETZNER SERVER SETUP Use a Server Local to You (Helsinki
for UK) Ubuntu Server Shared vCPU or Dedicated vCPU
WHAT IS SSH? SSH is a secure digital tunnel that
allows you to safely log into a website's server to manage backend files directly.
HOW TO ACCESS SSH? Use the Hetzner’s Server Console SSH
software e.g. Termius
INSTALL APP FROM GITHUB cd ~/apps/ git clone https://github.com/yourusername/seo-crawler.git cd
seo-crawler
INSTALL NODE DEPENDENCIES npm install
RUN THE APP npm run dev
WANT TO PUT IT ON A DOMAIN/SUBDOMAIN?
REGISTER YOUR DOMAIN
POINT THE DOMAIN/SUBDOMAIN TO THE SERVER IP ADDRESS
None
DOMAIN WILL NOW LOAD YOUR SERVER
AN EASIER WAY TO SETUP (IF YOU HAVE THIS FEATURE
IN CPANEL)
BUILT INTO CPANEL
INSTALL USING WHM OR ASK YOUR HOSTING COMPANY
None
UPLOAD YOUR NODE.JS APP TO A DIRECTORY ON YOUR SERVER
AND MAKE A NOTE OF THE DIRECTORY YOU SAVED IT IN
None
None
ENTER THE DIRECTORY YOU PUT THE CODE IN
None
SELECT THE DOMAIN / SUBDIRECTORY YOU WANT TO LOAD THE
APP FROM
None
ENTER THE STARTUP FILE NORMALLY SOMETHING LIKE SERVER.JS / YOU
CAN ASK THE LLM YOU USE TO CREATE THE APP FOR THIS
None
IF USING A DIFFERENT DIRECTORY TO THE ONE YOU’RE LOADING
THE APP CODE FROM YOU NEED TO ADD BASE_URL TO THE ENVIRONMENT VARIABLES
None
THEN JUST CLICK ‘CREATE’
None
None
None
YOU DON’T HAVE TO USE CHATGPT/ANY OTHER AI
Google Antigravity App
Windsurf
Vercel App
IF THERE ARE NO ISSUES YOUR APP SHOULD LOAD UP
TROUBLESHOOTING
USE AI TOOLS
NPM AUDIT WILL FLAG VULNERABILITIES
COMMON ISSUES
500 ERROR ON SERVER
USE AI TOOLS
None
None
ASSESS THE TOP 5 PRIORITIES LONG TERM FIXES, QUICK WINS
ACCESS TO THE SLIDES SPEAKERDECK.COM/JONATHONROBERTSSEO
linkedin.com/in/jonathon-roberts-seo/ flyhighmedia.co.uk
[email protected]
More Decks by Jonathon Roberts
See All by Jonathon Roberts
Vibe Coding Your Way To Custom SEO Tools
jonathonrobertsseo
0
65
How to Use AI to harness Google APIs
jonathonrobertsseo
0
1.1k
TechSEO North Feb 2025 - How To Implement Schema to Custom CMSs
jonathonrobertsseo
0
110
BrightonSEO October 2024 - How to Speed Up Content Audits using ChatGPT
jonathonrobertsseo
3
1.1k
Other Decks in Marketing & SEO
See All in Marketing & SEO
Google Search Console to Big Query Export - The Almost Free SEO Database Full of Gold
charlesmeaden
PRO
0
130
PDPs Over PLPs: How to Win Organic Visibility with Product Pages
gkoivikko
0
310
Why Tier 2 Backlinks Aren't Indexed: The Stall Map
speedyindexteam
PRO
1
1.3k
生成AIを使ってエンジニアとタッグを組んだ話
yoshimuranaoko
2
270
Measure What Matters - Croatia SEO Summit 2026
amandafloq
1
160
【PMM JAPAN CONFERENCE 2026】キーノート_なぜ今越境人材なのか
yoshiesan
0
340
The New Citation Economy | AEO Research Deck Sept 2026
joshbly
0
330
Taming the Bots: AI Crawler Management for the Modern SEO
athenseo
0
110
国境を越えて大ウケ!「会議脱出ボタン」LTの裏側とスライドの哲学
kizawa2020
1
140
E-A-T: Myths, Truths, And Implications for SEO
portentint
PRO
0
160
Feed the machine
katarinadahlin
PRO
0
130
Buying Ads in ChatGPT: what the data says so far
joss1
0
250
Featured
See All Featured
Lightning Talk: Beautiful Slides for Beginners
inesmontani
PRO
2
850
Future Trends and Review - Lecture 12 - Web Technologies (1019888BNR)
signer
PRO
0
3.8k
Prompt Engineering for Job Search
mfonobong
0
590
KATA
mclloyd
PRO
35
16k
Data-driven link building: lessons from a $708K investment (BrightonSEO talk)
szymonslowik
1
1.4k
The Impact of AI in SEO - AI Overviews June 2024 Edition
aleyda
6
1.3k
Jess Joyce - The Pitfalls of Following Frameworks
techseoconnect
PRO
1
480
Accessibility Awareness
sabderemane
1
310
The SEO identity crisis: Don't let AI make you average
varn
0
630
What’s in a name? Adding method to the madness
productmarketing
PRO
24
4.2k
Visualizing Your Data: Incorporating Mongo into Loggly Infrastructure
mongodb
50
10k
How to audit for AI Accessibility on your Front & Back End
davetheseo
0
640