1. Crawl Summary

fail

Fetched 0 of 1 pages successfully

Target: http://reddit.com

Evidence

{
  "pages": [
    {
      "url": "http://reddit.com",
      "bytes": 190240,
      "status": 403,
      "fetchMs": 76
    }
  ],
  "origin": "http://reddit.com",
  "target": "http://reddit.com"
}

P1

2. Data Found

Data Point	Found?	Source	Notes
Pricing	No	—	—
Customer logos	No	—	—
Social proof	No	—	—
Recent launches	No	—	—
Blog post activity	No	—	—
New hires	No	—	Often only on a /blog/team or LinkedIn page
Headline copy	No	—	—
Positioning	No	—	—
Executive team	No	—	—
Product/service descriptions	No	—	—
Case studies or testimonials	No	—	—
Contact/demo/signup paths	No	—	—

3. Homepage Audit

fail
Homepage could not be fetched
HTTP 403
P1
warn
Charset not declared
Add `<meta charset="utf-8">` as the first child of <head>.
P3
warn
Favicon missing
Add `<link rel="icon" href="/favicon.ico">` (and an apple-touch-icon) so AI citation cards have a brand mark.
P4

4. Content Quality

fail
Snippet-ready blocks: 0 (ul:0, ol:0, table:0)
Add bullet lists, numbered steps, or a comparison table. Answer engines prefer structured blocks over prose.
Evidence
```
{
  "ol": 0,
  "ul": 0,
  "tables": 0
}
```
P2
fail
Text-to-HTML ratio: 0.1%
Very low text density. AI crawlers will struggle to find substantive content.
Evidence
```
{
  "ratio": 0.0011459329892029983,
  "htmlBytes": 190238,
  "textChars": 218
}
```
P2
warn
No question-style headings found
Phrase at least one heading as a user question (e.g. 'How does pricing work?') to match conversational AI queries.
P3
warn
No date signal found
Add <time datetime="…"> or article:published_time meta. AI ranking weights freshness.
P3
warn
No author byline found
Add `<meta name="author" content="Name">` or a visible byline with `rel="author"`. Strengthens E-E-A-T signals.
P4

5. Schema / Structured Data Audit

fail
No JSON-LD structured data found
Add JSON-LD blocks (Organization, SoftwareApplication, FAQPage, BreadcrumbList) so AI answer engines can ingest your data without guessing.
P1

6. Links & Images

fail

2 broken link(s) in first 2

· 404 — https://www.reddit.com/login/ · 403 — https://support.reddithelp.com/hc/en-us/requests/new?ticket_form_id=21879292693140

Evidence

{
  "broken": 2,
  "sampled": 2,
  "examples": [
    {
      "url": "https://www.reddit.com/login/",
      "status": 404
    },
    {
      "url": "https://support.reddithelp.com/hc/en-us/requests/new?ticket_form_id=21879292693140",
      "status": 403
    }
  ]
}

P1

warn
Modern image formats: 0% (0/1 webp/avif)
0 legacy (png/jpg/gif) image(s). Convert hero/above-the-fold images to WebP or AVIF.
Evidence
```
{
  "total": 1,
  "legacy": 0,
  "modern": 0
}
```
P3
fail
Explicit dimensions: 0% (0/1)
Add width and height attributes on <img> tags to prevent CLS.
Evidence
```
{
  "total": 1,
  "withDims": 0
}
```
P3
pass
External nofollow: 0% (0/2)
Healthy mix of follow and nofollow outbound links.
P5

7. Performance

warn
Inline JS+CSS bulk: 99 KB
Move large inline scripts/styles to external files to enable caching.
Evidence
```
{
  "inlineJsBytes": 0,
  "inlineCssBytes": 101365
}
```
P3
pass
Response time: 76ms
Fast first response.
Evidence
```
{
  "bytes": 190240,
  "fetchMs": 76
}
```
P5
pass
Cache-Control set
Cache-Control: private, no-store
Evidence
```
{
  "cdn": [],
  "cacheControl": "private, no-store"
}
```
P5
pass
Page size: 186 KB
Compact HTML payload — well within AI crawler limits.
Evidence
```
{
  "bytes": 190240
}
```
P5

pass

Resource requests: 1 (scripts:0, css:0, img:1)

Reasonable request count.

Evidence

{
  "imgs": 1,
  "styles": 0,
  "scripts": 0,
  "inlineStyles": 1,
  "inlineScripts": 0
}

P5

pass
No render-blocking head scripts
All head scripts use async or defer.
P5

8. Security

warn
Content-Security-Policy missing
Define a CSP to limit script sources — large reduction in XSS surface.
P3
warn
Referrer-Policy missing
Add `Referrer-Policy: strict-origin-when-cross-origin` for safer referrers.
P4
warn
Permissions-Policy missing
Restrict browser features (camera, mic, geolocation) you don't use.
P4
pass
X-Content-Type-Options set
nosniff
Evidence
```
{
  "value": "nosniff"
}
```
P5

pass

Served over HTTPS

Evidence

{
  "finalUrl": "https://www.reddit.com/"
}

P5

pass
No mixed content detected
P5
pass
HSTS set
max-age=31536000; includeSubdomains
Evidence
```
{
  "value": "max-age=31536000; includeSubdomains"
}
```
P5
pass
X-Frame-Options set
SAMEORIGIN
Evidence
```
{
  "value": "SAMEORIGIN"
}
```
P5

9. robots.txt and sitemap.xml Audit

fail
sitemap.xml not found
Add /sitemap.xml — required for reliable AI/SERP discovery.
P1
warn
robots.txt does not reference a Sitemap
Add `Sitemap: https://yoursite.com/sitemap.xml` to robots.txt.
P3

pass

robots.txt present

538 chars

Evidence

{
  "snippet": "# Welcome to Reddit's robots.txt\n# Reddit believes in an open internet, but not the misuse of public content.\n# See https://support.reddithelp.com/hc/en-us/articles/26410290525844-Public-Content-Policy Reddit's Public Content Policy for access and use restrictions to Reddit content.\n# See https://www.reddit.com/r/reddit4researchers/ for details on how Reddit continues to support research and non-commercial use.\n# policy: https://support.reddithelp.com/hc/en-us/articles/26410290525844-Public-Content-Policy\n\nUser-agent: *\nDisallow: /\n"
}

P5

10. LLM / AI Crawler Accessibility

fail
GPTBot blocked via wildcard
User-agent: * is disallowed from / and no explicit rule for GPTBot overrides it.
P1
fail
ClaudeBot blocked via wildcard
User-agent: * is disallowed from / and no explicit rule for ClaudeBot overrides it.
P1
fail
PerplexityBot blocked via wildcard
User-agent: * is disallowed from / and no explicit rule for PerplexityBot overrides it.
P1
fail
Google-Extended blocked via wildcard
User-agent: * is disallowed from / and no explicit rule for Google-Extended overrides it.
P1
fail
OAI-SearchBot blocked via wildcard
User-agent: * is disallowed from / and no explicit rule for OAI-SearchBot overrides it.
P1
fail
Applebot-Extended blocked via wildcard
User-agent: * is disallowed from / and no explicit rule for Applebot-Extended overrides it.
P1
fail
CCBot blocked via wildcard
User-agent: * is disallowed from / and no explicit rule for CCBot overrides it.
P1
warn
llms.txt missing
Add /llms.txt — a concise, link-rich summary that helps LLMs orient on your site.
P2
warn
skill.md missing
Add /skill.md describing what your site lets agents do — speeds up agent task routing.
P3
warn
/.well-known/security.txt missing
Publish a /.well-known/security.txt with at least a Contact: line. Crawlers and security researchers expect it; AI systems use it as a trust signal.
P3

11. Positioning Clarity

warn
H1 missing or too short to convey value
Add a clear, single-sentence H1 like 'We help X do Y.'
P1
fail
No discoverable CTA
Add a clearly-labeled Contact, Demo, or Sign up link to the nav or hero.
P1
warn
No clear About/Team link
Add an About or Team link in the nav or footer so LLMs can identify the company.
P2
warn
No pricing/plans link found
AI summaries commonly include pricing. Add a /pricing page even if pricing is custom.
P2
warn
Value-prop language not detected
Pages with phrases like 'we help X', 'platform for Y', 'built for Z' are easier for LLMs to summarize.
P3

12. Missing or Hard-to-Find Information

fail

12 data point(s) could not be found from public pages

· Pricing · Customer logos · Social proof · Recent launches · Blog post activity · New hires · Headline copy · Positioning · Executive team · Product/service descriptions · Case studies or testimonials · Contact/demo/signup paths

Evidence

{
  "missing": [
    "Pricing",
    "Customer logos",
    "Social proof",
    "Recent launches",
    "Blog post activity",
    "New hires",
    "Headline copy",
    "Positioning",
    "Executive team",
    "Product/service descriptions",
    "Case studies or testimonials",
    "Contact/demo/signup paths"
  ]
}

P1

13. Recommended Fixes

warn
Fix broken homepage links
We HEAD-probed the first 20 unique homepage links and found 4xx/5xx responses. Repair or remove them — broken links erode crawler trust.
Evidence
```
{
  "for": "links.broken_sample"
}
```
P1
warn
Allow GPTBot in robots.txt
Add an explicit User-agent: GPTBot Allow: / block so this AI crawler can read your site.
Evidence
```
{
  "for": "aibot.GPTBot"
}
```
P1
warn
Allow ClaudeBot in robots.txt
Add an explicit User-agent: ClaudeBot Allow: / block so this AI crawler can read your site.
Evidence
```
{
  "for": "aibot.ClaudeBot"
}
```
P1
warn
Allow PerplexityBot in robots.txt
Add an explicit User-agent: PerplexityBot Allow: / block so this AI crawler can read your site.
Evidence
```
{
  "for": "aibot.PerplexityBot"
}
```
P1
warn
Allow Google-Extended in robots.txt
Add an explicit User-agent: Google-Extended Allow: / block so this AI crawler can read your site.
Evidence
```
{
  "for": "aibot.Google-Extended"
}
```
P1
warn
Allow OAI-SearchBot in robots.txt
Add an explicit User-agent: OAI-SearchBot Allow: / block so this AI crawler can read your site.
Evidence
```
{
  "for": "aibot.OAI-SearchBot"
}
```
P1
warn
Allow Applebot-Extended in robots.txt
Add an explicit User-agent: Applebot-Extended Allow: / block so this AI crawler can read your site.
Evidence
```
{
  "for": "aibot.Applebot-Extended"
}
```
P1
warn
Allow CCBot in robots.txt
Add an explicit User-agent: CCBot Allow: / block so this AI crawler can read your site.
Evidence
```
{
  "for": "aibot.CCBot"
}
```
P1
warn
Rewrite the homepage H1 to be self-evident
Replace clever copy with literal copy. 'We help X do Y' beats 'Reimagine Y'.
Evidence
```
{
  "for": "positioning.what"
}
```
P1
warn
Add a discoverable CTA
Place 'Contact sales' or 'Start free' in the top-right of the nav. LLMs cite the visible label.
Evidence
```
{
  "for": "positioning.cta"
}
```
P1
warn
Publish a sitemap.xml
Generate /sitemap.xml automatically (Next.js: app/sitemap.ts). Include every canonical URL.
Evidence
```
{
  "for": "sitemap.exists"
}
```
P1
warn
Add JSON-LD structured data
Start with Organization on the root layout and SoftwareApplication or Product on /pricing. Add FAQPage on any FAQ section.
Evidence
```
{
  "for": "schema.any"
}
```
P1
warn
Add lists or comparison tables
Answer engines lift bulleted lists, numbered steps, and tables verbatim. Add at least 2 snippet-ready blocks to the homepage.
Evidence
```
{
  "for": "content.snippet_blocks"
}
```
P2
warn
Raise your text-to-HTML ratio
Strip unused inline scripts/styles and move large bundles to external files. AI crawlers struggle when most of the response is markup.
Evidence
```
{
  "for": "content.text_ratio"
}
```
P2
warn
Add /llms.txt
A short Markdown-flavored summary at the root. Include your H1, value prop, top 5–10 links, and pricing summary.
Evidence
```
{
  "for": "llms_txt"
}
```
P2
warn
Make your About/Team page reachable
Add a top-nav or footer link to /about or /team so LLMs can identify the entity behind the site.
Evidence
```
{
  "for": "positioning.who"
}
```
P2
warn
Add a /pricing page
Even contact-us pricing benefits from a /pricing page that LLMs can link to in answers.
Evidence
```
{
  "for": "positioning.pricing"
}
```
P2
warn
State your audience explicitly
Use phrases like 'Built for B2B SaaS marketing teams' on the homepage and About page.
Evidence
```
{
  "for": "positioning.audience"
}
```
P3
warn
Reference your sitemap in robots.txt
Add `Sitemap: https://yoursite.com/sitemap.xml` so crawlers don't have to guess.
Evidence
```
{
  "for": "robots.sitemap_ref"
}
```
P3
warn
Phrase a heading as a user question
Use headings like 'How does pricing work?' or 'Who is this for?' — they map directly to conversational AI queries.
Evidence
```
{
  "for": "content.qa_headings"
}
```
P3
warn
Publish a date signal
Add `<time datetime="2026-05-17">` or `<meta property="article:published_time">`. AI ranking heavily weights freshness.
Evidence
```
{
  "for": "content.date_signal"
}
```
P3
warn
Declare charset
Add `<meta charset="utf-8">` as the first child of <head> so non-ASCII content is parsed reliably.
Evidence
```
{
  "for": "meta.charset"
}
```
P3
warn
Use modern image formats
Serve WebP or AVIF for hero/above-the-fold images. Keep legacy PNG/JPG only as <picture> fallbacks.
Evidence
```
{
  "for": "images.format"
}
```
P3
warn
Set width/height on images
Explicit dimensions prevent Cumulative Layout Shift and help AI extractors reserve space correctly.
Evidence
```
{
  "for": "images.dimensions"
}
```
P3
warn
Add /skill.md
Describe what an agent can do with your site (e.g., 'Search docs', 'Look up pricing'). Useful for agentic flows.
Evidence
```
{
  "for": "skill_md"
}
```
P3
warn
Publish /.well-known/security.txt
A security contact builds trust with crawlers and researchers. Minimal example: ``` Contact: mailto:security@yourdomain.com Expires: 2027-01-01T00:00:00.000Z Preferred-Languages: en ```
Evidence
```
{
  "for": "security_txt"
}
```
P3
warn
Externalize large inline JS/CSS
Inline blobs aren't cacheable. Move >50 KB inline payloads to versioned external files.
Evidence
```
{
  "for": "perf.inline_bulk"
}
```
P3
warn
Define a Content-Security-Policy
Start with `Content-Security-Policy-Report-Only` to learn safe sources, then enforce. Cuts XSS blast radius.
Evidence
```
{
  "for": "security.csp"
}
```
P3
warn
Declare an author byline
Add `<meta name="author" content="Name">` or a visible byline with `rel="author"`. Combine with Person JSON-LD for E-E-A-T.
Evidence
```
{
  "for": "content.author"
}
```
P4
warn
Add a favicon
Add `<link rel="icon" href="/favicon.ico">` and an `apple-touch-icon` so AI citation cards show your brand mark.
Evidence
```
{
  "for": "meta.favicon"
}
```
P4
warn
Set a Referrer-Policy
`Referrer-Policy: strict-origin-when-cross-origin` is a safe default.
Evidence
```
{
  "for": "security.referrer"
}
```
P4
warn
Set a Permissions-Policy
Restrict browser features you don't use, e.g. `Permissions-Policy: camera=(), microphone=(), geolocation=()`.
Evidence
```
{
  "for": "security.permissions"
}
```
P4

14. Priority To-Do List

warn
[ ] Fix broken homepage links
We HEAD-probed the first 20 unique homepage links and found 4xx/5xx responses. Repair or remove them — broken links erode crawler trust.
Evidence
```
{
  "priority": 1
}
```
P1
warn
[ ] Allow GPTBot in robots.txt
Add an explicit User-agent: GPTBot Allow: / block so this AI crawler can read your site.
Evidence
```
{
  "priority": 1
}
```
P1
warn
[ ] Allow ClaudeBot in robots.txt
Add an explicit User-agent: ClaudeBot Allow: / block so this AI crawler can read your site.
Evidence
```
{
  "priority": 1
}
```
P1
warn
[ ] Allow PerplexityBot in robots.txt
Add an explicit User-agent: PerplexityBot Allow: / block so this AI crawler can read your site.
Evidence
```
{
  "priority": 1
}
```
P1
warn
[ ] Allow Google-Extended in robots.txt
Add an explicit User-agent: Google-Extended Allow: / block so this AI crawler can read your site.
Evidence
```
{
  "priority": 1
}
```
P1
warn
[ ] Allow OAI-SearchBot in robots.txt
Add an explicit User-agent: OAI-SearchBot Allow: / block so this AI crawler can read your site.
Evidence
```
{
  "priority": 1
}
```
P1
warn
[ ] Allow Applebot-Extended in robots.txt
Add an explicit User-agent: Applebot-Extended Allow: / block so this AI crawler can read your site.
Evidence
```
{
  "priority": 1
}
```
P1
warn
[ ] Allow CCBot in robots.txt
Add an explicit User-agent: CCBot Allow: / block so this AI crawler can read your site.
Evidence
```
{
  "priority": 1
}
```
P1
warn
[ ] Rewrite the homepage H1 to be self-evident
Replace clever copy with literal copy. 'We help X do Y' beats 'Reimagine Y'.
Evidence
```
{
  "priority": 1
}
```
P1
warn
[ ] Add a discoverable CTA
Place 'Contact sales' or 'Start free' in the top-right of the nav. LLMs cite the visible label.
Evidence
```
{
  "priority": 1
}
```
P1
warn
[ ] Publish a sitemap.xml
Generate /sitemap.xml automatically (Next.js: app/sitemap.ts). Include every canonical URL.
Evidence
```
{
  "priority": 1
}
```
P1
warn
[ ] Add JSON-LD structured data
Start with Organization on the root layout and SoftwareApplication or Product on /pricing. Add FAQPage on any FAQ section.
Evidence
```
{
  "priority": 1
}
```
P1
warn
[ ] Add lists or comparison tables
Answer engines lift bulleted lists, numbered steps, and tables verbatim. Add at least 2 snippet-ready blocks to the homepage.
Evidence
```
{
  "priority": 2
}
```
P2
warn
[ ] Raise your text-to-HTML ratio
Strip unused inline scripts/styles and move large bundles to external files. AI crawlers struggle when most of the response is markup.
Evidence
```
{
  "priority": 2
}
```
P2
warn
[ ] Add /llms.txt
A short Markdown-flavored summary at the root. Include your H1, value prop, top 5–10 links, and pricing summary.
Evidence
```
{
  "priority": 2
}
```
P2
warn
[ ] Make your About/Team page reachable
Add a top-nav or footer link to /about or /team so LLMs can identify the entity behind the site.
Evidence
```
{
  "priority": 2
}
```
P2
warn
[ ] Add a /pricing page
Even contact-us pricing benefits from a /pricing page that LLMs can link to in answers.
Evidence
```
{
  "priority": 2
}
```
P2
warn
[ ] Phrase a heading as a user question
Use headings like 'How does pricing work?' or 'Who is this for?' — they map directly to conversational AI queries.
Evidence
```
{
  "priority": 3
}
```
P3
warn
[ ] Publish a date signal
Add `<time datetime="2026-05-17">` or `<meta property="article:published_time">`. AI ranking heavily weights freshness.
Evidence
```
{
  "priority": 3
}
```
P3
warn
[ ] Declare charset
Add `<meta charset="utf-8">` as the first child of <head> so non-ASCII content is parsed reliably.
Evidence
```
{
  "priority": 3
}
```
P3

AEO Audit for reddit.com

1. Crawl Summary

2. Data Found

3. Homepage Audit

4. Content Quality

5. Schema / Structured Data Audit

6. Links & Images

7. Performance

8. Security

9. robots.txt and sitemap.xml Audit

10. LLM / AI Crawler Accessibility

11. Positioning Clarity

12. Missing or Hard-to-Find Information

13. Recommended Fixes

14. Priority To-Do List

http://reddit.com/

1. Crawl Summary

2. Data Found

3. Homepage Audit

4. Content Quality

5. Schema / Structured Data Audit

6. Links & Images

7. Performance

8. Security

9. robots.txt and sitemap.xml Audit

10. LLM / AI Crawler Accessibility

11. Positioning Clarity

12. Missing or Hard-to-Find Information

13. Recommended Fixes

14. Priority To-Do List

Track this site week over week

Your charts, not these.