Audit any website for
SEO & AI Search Readiness
130+ checks across technical SEO, performance, security, structured data, and generative engine optimization (GEO). Get actionable reports, export for your team, or feed them directly to AI agents.
Everything you need to audit a website
From classic SEO to cutting-edge AI optimization
Real-time Progress
Watch issues appear live as pages are crawled via Server-Sent Events. No more waiting for the full scan.
GEO Analysis
24 dedicated rules for AI search readiness: crawler access, llms.txt, content citability, entity authority.
Rule Presets
Full Scan, Essential, Blog, E-Commerce, Video, Landing Page, Technical-only, or GEO-only presets.
Export Reports
Export as CSV for spreadsheets or Markdown for AI agents. Select only the rules that matter to you.
CI/CD SDK
Standalone CLI binary for deployment pipelines. Catch SEO regressions before they reach production.
Localhost Crawling
Test your dev server before deploying. Audit local builds, staging environments, or any running server.
Sitemap Analysis
Validates all URLs in your sitemap, detects orphan pages, broken links, and redirect chains.
Docker Ready
Multi-stage Docker build included. Deploy with a single command on any infrastructure.
15 Audit Categories, 130+ Rules
Comprehensive coverage from basics to advanced AI optimization
On-Page SEO
Title, meta description, headings, images, alt text
Technical SEO
Canonical, robots.txt, sitemap, redirects, HTTP status
GEO
AI crawler access, llms.txt, citability, entity authority
Performance
Page size, TTFB, compression, render blocking
Security
HTTPS, HSTS, CSP, XFO, security headers
Social / Open Graph
OG tags, Twitter cards, social metadata
Links
Internal/external links, broken links, anchor text
E-E-A-T
Author, about, contact, privacy pages
URL Structure
Lowercase, length, special characters
Accessibility
Language, viewport, ARIA labels
Structured Data
JSON-LD, breadcrumbs, schema validation
Duplicate Content
Duplicate titles, descriptions, body
CI/CD SDK
Catch SEO regressions in your deployment pipeline
# Scan a running server
seo-crawler --mode=full --url=http://localhost:3000
# Auto-start server, scan, then stop
seo-crawler \
--mode=full \
--start-cmd="npm run dev" \
--wait-for=http://localhost:3000 \
--url=http://localhost:3000 \
--fail-on=high
# Scan static HTML files
seo-crawler --mode=static --dir=./distDownload the binary and run in any CI pipeline
Linux, macOS, and Windows binaries available
Fail builds on critical, high, medium, or low issues
Ready to audit your website?
Get started in under a minute. Clone, run, analyze.
git clone https://github.com/booltools/booltools-seo-crawler.git