1. Crawl Summary

pass

Fetched 9 of 9 pages successfully

Target: https://crawlproof.com

Evidence

{
  "pages": [
    {
      "url": "https://crawlproof.com",
      "bytes": 42975,
      "status": 200,
      "fetchMs": 117
    },
    {
      "url": "https://crawlproof.com/about",
      "bytes": 22409,
      "status": 200,
      "fetchMs": 104
    },
    {
      "url": "https://crawlproof.com/pricing",
      "bytes": 34336,
      "status": 200,
      "fetchMs": 103
    },
    {
      "url": "https://crawlproof.com/blog",
      "bytes": 21839,
      "status": 200,
      "fetchMs": 96
    },
    {
      "url": "https://crawlproof.com/",
      "bytes": 42975,
      "status": 200,
      "fetchMs": 103
    },
    {
      "url": "https://crawlproof.com/recent",
      "bytes": 44320,
      "status": 200,
      "fetchMs": 104
    },
    {
      "url": "https://crawlproof.com/login",
      "bytes": 17254,
      "status": 200,
      "fetchMs": 95
    },
    {
      "url": "https://crawlproof.com/signup",
      "bytes": 14735,
      "status": 200,
      "fetchMs": 218
    },
    {
      "url": "https://crawlproof.com/bot",
      "bytes": 22795,
      "status": 200,
      "fetchMs": 103
    }
  ],
  "origin": "https://crawlproof.com",
  "target": "https://crawlproof.com"
}

P5

2. Data Found

Data Point	Found?	Source	Notes
Pricing	Yes	Pricing page	https://crawlproof.com/pricing
Customer logos	No	—	—
Social proof	No	—	—
Recent launches	Yes	Press/news pages	https://crawlproof.com/blog
Blog post activity	Yes	Blog	https://crawlproof.com/blog
New hires	No	—	Often only on a /blog/team or LinkedIn page
Headline copy	Yes	Homepage	See your site the way AI crawlers do.
Positioning	No	—	—
Executive team	Yes	About/team page	https://crawlproof.com/about
Product/service descriptions	Yes	Homepage	From meta description
Case studies or testimonials	No	—	—
Contact/demo/signup paths	Yes	Navigation links	—

3. Homepage Audit

warn

Long meta description (171 chars)

Snippets truncate around 160 chars. Tighten to keep the key sentence visible.

Evidence

{
  "description": "CrawlProof runs an AEO audit on any URL and reports what LLM crawlers and answer engines can actually find — content, schema, robots rules, AI-bot access, and positioning."
}

P3

pass
Homepage fetched successfully
HTTP 200 · 42975 bytes · 117ms
Evidence
```
{
  "bytes": 42975,
  "status": 200,
  "fetchMs": 117
}
```
P5
pass
Page load time: 0.12s
Fast — well within AI crawler budgets.
Evidence
```
{
  "fetchMs": 117
}
```
P5
pass
<html lang="en"> declared
Evidence
```
{
  "lang": "en"
}
```
P5
pass
Single H1
See your site the way AI crawlers do.
Evidence
```
{
  "h1": "See your site the way AI crawlers do."
}
```
P5

pass

`<title>` present (50 chars)

Evidence

{
  "title": "CrawlProof — See your site the way AI crawlers do."
}

P5

pass
Canonical present
https://crawlproof.com
Evidence
```
{
  "canonical": "https://crawlproof.com"
}
```
P5

pass

Open Graph tags complete

Evidence

{
  "image": "https://crawlproof.com/opengraph-image?2783aefbb5ea2cee",
  "title": "CrawlProof — See your site the way AI crawlers do.",
  "description": "CrawlProof runs an AEO audit on any URL and reports what LLM crawlers and answer engines can actually find — content, schema, robots rules, AI-bot access, and positioning."
}

P5

pass

Twitter Card tags complete

Evidence

{
  "card": "summary_large_image",
  "image": "https://crawlproof.com/opengraph-image?2783aefbb5ea2cee",
  "title": "CrawlProof — See your site the way AI crawlers do.",
  "description": "CrawlProof runs an AEO audit on any URL and reports what LLM crawlers and answer engines can actually find — content, schema, robots rules, AI-bot access, and positioning."
}

P5

pass
Critical content is server-rendered
Raw and rendered text are within 8% of each other.
Evidence
```
{
  "ratio": 0.07718484145398298,
  "rawTextLen": 32325,
  "renderedTextLen": 2495
}
```
P5
pass
Content volume: 426 words
Substantive content — AI models have enough to summarize and recommend.
Evidence
```
{
  "wordCount": 426
}
```
P5
pass
Heading structure: 16 (h1:1, h2:4, h3:11)
Multiple headings help AI chunk and outline your page.
Evidence
```
{
  "h1": 1,
  "h2": 4,
  "h3": 11
}
```
P5
pass
Internal links: 16
16 internal + 0 external links help crawlers navigate.
Evidence
```
{
  "external": 0,
  "internal": 16
}
```
P5

4. Schema / Structured Data Audit

pass

6 JSON-LD block(s) found

Types: WebSite, Organization, SoftwareApplication, Organization, SoftwareApplication, FAQPage

Evidence

{
  "types": [
    "WebSite",
    "Organization",
    "SoftwareApplication",
    "Organization",
    "SoftwareApplication",
    "FAQPage"
  ],
  "blocks": 6
}

P5

pass
Organization present
P5
pass
WebSite present
P5
pass
SoftwareApplication present
P5
pass
FAQPage JSON-LD present
P5

5. robots.txt and sitemap.xml Audit

pass

robots.txt present

336 chars

Evidence

{
  "snippet": "User-Agent: *\nAllow: /\n\nUser-Agent: GPTBot\nAllow: /\n\nUser-Agent: ClaudeBot\nAllow: /\n\nUser-Agent: PerplexityBot\nAllow: /\n\nUser-Agent: Google-Extended\nAllow: /\n\nUser-Agent: OAI-SearchBot\nAllow: /\n\nUser-Agent: Applebot-Extended\nAllow: /\n\nUser-Agent: CCBot\nAllow: /\n\nHost: https://crawlproof.com\nSitemap: https://crawlproof.com/sitemap.xml\n"
}

P5

pass

robots.txt references sitemap(s)

Evidence

{
  "sitemaps": [
    "https://crawlproof.com/sitemap.xml"
  ]
}

P5

pass

sitemap.xml present (14 URLs)

Evidence

{
  "snippet": "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<urlset xmlns=\"http://www.sitemaps.org/schemas/sitemap/0.9\">\n<url>\n<loc>https://crawlproof.com/</loc>\n<lastmod>2026-05-13T08:23:26.777Z</lastmod>\n<changefreq>weekly</changefreq>\n<priority>1</priority>\n</url>\n<url>\n<loc>https://crawlproof.com/pricing</loc>\n<lastmod>2026-05-13T08:23:26.777Z</lastmod>\n<changefreq>monthly</changefreq>\n<priority>0.9</priority>\n</url>\n<url>\n<loc>https://crawlproof.com/about</loc>\n<lastmod>2026-05-13T08:23:26.777Z</lastmod>\n<changefreq>monthly</changefreq>\n<priority>0.7</priority>\n</url>\n<url>\n<loc>https://crawlproof.com/blog</loc>\n<lastmod>2026-05-13T08:23:26.777Z</lastmod>\n<changefreq>weekly</changefreq>\n<priority>0.8</priority>\n</url>\n<url>\n<loc>https://crawlproof.com/recent</loc>\n<lastmod>2026-05-13T08:23:26.777Z</lastmo",
  "urlCount": 14
}

P5

6. LLM / AI Crawler Accessibility

warn
/.well-known/security.txt missing
Publish a /.well-known/security.txt with at least a Contact: line. Crawlers and security researchers expect it; AI systems use it as a trust signal.
P3
pass
GPTBot has explicit rules
An explicit User-agent block exists. Make sure it allows the paths you want indexed.
P5
pass
ClaudeBot has explicit rules
An explicit User-agent block exists. Make sure it allows the paths you want indexed.
P5
pass
PerplexityBot has explicit rules
An explicit User-agent block exists. Make sure it allows the paths you want indexed.
P5
pass
Google-Extended has explicit rules
An explicit User-agent block exists. Make sure it allows the paths you want indexed.
P5
pass
OAI-SearchBot has explicit rules
An explicit User-agent block exists. Make sure it allows the paths you want indexed.
P5
pass
Applebot-Extended has explicit rules
An explicit User-agent block exists. Make sure it allows the paths you want indexed.
P5
pass
CCBot has explicit rules
An explicit User-agent block exists. Make sure it allows the paths you want indexed.
P5

pass

llms.txt present

1583 chars

Evidence

{
  "snippet": "# CrawlProof\n\n> See your site the way AI crawlers do. CrawlProof runs an AEO audit on any URL and produces a structured report of what LLM crawlers and answer engines can actually find — content, schema, robots rules, AI-bot access, positioning clarity, and recommended fixes.\n\n## Product\n- Free single-URL AEO audit, 10 per day per IP, no signup required.\n- Signed-in users get 3 free credits; addit"
}

P5

pass
skill.md present
P5
pass
/.well-known/ai-plugin.json present
P5

7. Positioning Clarity

warn
Value-prop language not detected
Pages with phrases like 'we help X', 'platform for Y', 'built for Z' are easier for LLMs to summarize.
P3
pass
Contact / signup path discoverable
P5
pass
About/Team path discoverable
P5
pass
H1 communicates value
See your site the way AI crawlers do.
P5
pass
Pricing path discoverable
P5

8. Missing or Hard-to-Find Information

warn
5 data point(s) could not be found from public pages
· Customer logos · Social proof · New hires · Positioning · Case studies or testimonials
Evidence
```
{
  "missing": [
    "Customer logos",
    "Social proof",
    "New hires",
    "Positioning",
    "Case studies or testimonials"
  ]
}
```
P3

9. Recommended Fixes

warn
Add a meta description
50–160 chars. Repeat your core value prop in plain language; this often becomes the AI snippet. ```html <meta name="description" content="CrawlProof shows you exactly how AI crawlers see your site, then tells you what to fix." /> ```
Evidence
```
{
  "for": "homepage.description"
}
```
P3
warn
Publish /.well-known/security.txt
A security contact builds trust with crawlers and researchers. Minimal example: ``` Contact: mailto:security@yourdomain.com Expires: 2027-01-01T00:00:00.000Z Preferred-Languages: en ```
Evidence
```
{
  "for": "security_txt"
}
```
P3
warn
State your audience explicitly
Use phrases like 'Built for B2B SaaS marketing teams' on the homepage and About page.
Evidence
```
{
  "for": "positioning.audience"
}
```
P3

10. Priority To-Do List

warn
[ ] Add a meta description
50–160 chars. Repeat your core value prop in plain language; this often becomes the AI snippet. ```html <meta name="description" content="CrawlProof shows you exactly how AI crawlers see your site, then tells you what to fix." /> ```
Evidence
```
{
  "priority": 3
}
```
P3
warn
[ ] Publish /.well-known/security.txt
A security contact builds trust with crawlers and researchers. Minimal example: ``` Contact: mailto:security@yourdomain.com Expires: 2027-01-01T00:00:00.000Z Preferred-Languages: en ```
Evidence
```
{
  "priority": 3
}
```
P3
warn
[ ] State your audience explicitly
Use phrases like 'Built for B2B SaaS marketing teams' on the homepage and About page.
Evidence
```
{
  "priority": 3
}
```
P3

AEO Audit for crawlproof.com

1. Crawl Summary

2. Data Found

3. Homepage Audit

4. Schema / Structured Data Audit

5. robots.txt and sitemap.xml Audit

6. LLM / AI Crawler Accessibility

7. Positioning Clarity

8. Missing or Hard-to-Find Information

9. Recommended Fixes

10. Priority To-Do List

https://crawlproof.com/

1. Crawl Summary

2. Data Found

3. Homepage Audit

4. Schema / Structured Data Audit

5. robots.txt and sitemap.xml Audit

6. LLM / AI Crawler Accessibility

7. Positioning Clarity

8. Missing or Hard-to-Find Information

9. Recommended Fixes

10. Priority To-Do List

Track this site week over week

Your charts, not these.