# AEO Audit for crawlproof.com **Target:** https://crawlproof.com/ **Score:** 68 / 100 **Generated:** 2026-05-13T08:45:18.887Z **Pages crawled:** 9 **Findings:** 42 pass · 15 warn · 0 fail · 0 unknown --- ## 1. Crawl Summary - ✅ **Fetched 9 of 9 pages successfully** Target: https://crawlproof.com ## 2. Data Found | Data Point | Found? | Source | Notes | |---|---:|---|---| | Pricing | Yes | Pricing page | https://crawlproof.com/pricing | | Customer logos | No | — | — | | Social proof | No | — | — | | Recent launches | Yes | Press/news pages | https://crawlproof.com/blog | | Blog post activity | Yes | Blog | https://crawlproof.com/blog | | New hires | No | — | Often only on a /blog/team or LinkedIn page | | Headline copy | Yes | Homepage | See your site the way AI crawlers do. | | Positioning | No | — | — | | Executive team | Yes | About/team page | https://crawlproof.com/about | | Product/service descriptions | Yes | Homepage | From meta description | | Case studies or testimonials | No | — | — | | Contact/demo/signup paths | Yes | Navigation links | — | ## 3. Homepage Audit - ⚠️ **Long meta description (171 chars)** Snippets truncate around 160 chars. Tighten to keep the key sentence visible. - ✅ **Homepage fetched successfully** HTTP 200 · 42975 bytes · 117ms - ✅ **Page load time: 0.12s** Fast — well within AI crawler budgets. - ✅ ** declared** - ✅ **Single H1** See your site the way AI crawlers do. - ✅ **`` present (50 chars)** - ✅ **Canonical present** https://crawlproof.com - ✅ **Open Graph tags complete** - ✅ **Twitter Card tags complete** - ✅ **Critical content is server-rendered** Raw and rendered text are within 8% of each other. - ✅ **Content volume: 426 words** Substantive content — AI models have enough to summarize and recommend. - ✅ **Heading structure: 16 (h1:1, h2:4, h3:11)** Multiple headings help AI chunk and outline your page. - ✅ **Internal links: 16** 16 internal + 0 external links help crawlers navigate. ## 4. Schema / Structured Data Audit - ✅ **6 JSON-LD block(s) found** Types: WebSite, Organization, SoftwareApplication, Organization, SoftwareApplication, FAQPage - ✅ **Organization present** - ✅ **WebSite present** - ✅ **SoftwareApplication present** - ✅ **FAQPage JSON-LD present** ## 5. robots.txt and sitemap.xml Audit - ✅ **robots.txt present** 336 chars - ✅ **robots.txt references sitemap(s)** - ✅ **sitemap.xml present (14 URLs)** ## 6. LLM / AI Crawler Accessibility - ⚠️ **/.well-known/security.txt missing** Publish a /.well-known/security.txt with at least a Contact: line. Crawlers and security researchers expect it; AI systems use it as a trust signal. - ✅ **GPTBot has explicit rules** An explicit User-agent block exists. Make sure it allows the paths you want indexed. - ✅ **ClaudeBot has explicit rules** An explicit User-agent block exists. Make sure it allows the paths you want indexed. - ✅ **PerplexityBot has explicit rules** An explicit User-agent block exists. Make sure it allows the paths you want indexed. - ✅ **Google-Extended has explicit rules** An explicit User-agent block exists. Make sure it allows the paths you want indexed. - ✅ **OAI-SearchBot has explicit rules** An explicit User-agent block exists. Make sure it allows the paths you want indexed. - ✅ **Applebot-Extended has explicit rules** An explicit User-agent block exists. Make sure it allows the paths you want indexed. - ✅ **CCBot has explicit rules** An explicit User-agent block exists. Make sure it allows the paths you want indexed. - ✅ **llms.txt present** 1583 chars - ✅ **skill.md present** - ✅ **/.well-known/ai-plugin.json present** ## 7. Positioning Clarity - ⚠️ **Value-prop language not detected** Pages with phrases like 'we help X', 'platform for Y', 'built for Z' are easier for LLMs to summarize. - ✅ **About/Team path discoverable** - ✅ **H1 communicates value** See your site the way AI crawlers do. - ✅ **Pricing path discoverable** - ✅ **Contact / signup path discoverable** ## 8. Missing or Hard-to-Find Information - ⚠️ **5 data point(s) could not be found from public pages** · Customer logos · Social proof · New hires · Positioning · Case studies or testimonials ## 9. Recommended Fixes - ⚠️ **Add a meta description** 50–160 chars. Repeat your core value prop in plain language; this often becomes the AI snippet. ```html <meta name="description" content="CrawlProof shows you exactly how AI crawlers see your site, then tells you what to fix." /> ``` - ⚠️ **Publish /.well-known/security.txt** A security contact builds trust with crawlers and researchers. Minimal example: ``` Contact: mailto:security@yourdomain.com Expires: 2027-01-01T00:00:00.000Z Preferred-Languages: en ``` - ⚠️ **State your audience explicitly** Use phrases like 'Built for B2B SaaS marketing teams' on the homepage and About page. ## 10. Priority To-Do List - [ ] **P3** — Add a meta description 50–160 chars. Repeat your core value prop in plain language; this often becomes the AI snippet. ```html <meta name="description" content="CrawlProof shows you exactly how AI crawlers see your site, then tells you what to fix." /> ``` - [ ] **P3** — Publish /.well-known/security.txt A security contact builds trust with crawlers and researchers. Minimal example: ``` Contact: mailto:security@yourdomain.com Expires: 2027-01-01T00:00:00.000Z Preferred-Languages: en ``` - [ ] **P3** — State your audience explicitly Use phrases like 'Built for B2B SaaS marketing teams' on the homepage and About page. --- _Report by [CrawlProof](https://crawlproof.com). Reusable after every major website change._