AEO audit for threatcrush.com

1. Crawl Summary

pass

Fetched 9 of 9 pages successfully

Target: https://threatcrush.com

Evidence

{
  "pages": [
    {
      "url": "https://threatcrush.com",
      "bytes": 81250,
      "status": 200,
      "fetchMs": 61
    },
    {
      "url": "https://threatcrush.com/pricing",
      "bytes": 29539,
      "status": 200,
      "fetchMs": 32
    },
    {
      "url": "https://threatcrush.com/blog",
      "bytes": 45864,
      "status": 200,
      "fetchMs": 284
    },
    {
      "url": "https://threatcrush.com/docs",
      "bytes": 65178,
      "status": 200,
      "fetchMs": 36
    },
    {
      "url": "https://threatcrush.com/docs/modules",
      "bytes": 62360,
      "status": 200,
      "fetchMs": 34
    },
    {
      "url": "https://threatcrush.com/",
      "bytes": 81250,
      "status": 200,
      "fetchMs": 36
    },
    {
      "url": "https://threatcrush.com/store",
      "bytes": 30968,
      "status": 200,
      "fetchMs": 28
    },
    {
      "url": "https://threatcrush.com/get-whitepaper",
      "bytes": 38691,
      "status": 200,
      "fetchMs": 34
    },
    {
      "url": "https://threatcrush.com/store/publish",
      "bytes": 30371,
      "status": 200,
      "fetchMs": 70
    }
  ],
  "origin": "https://threatcrush.com",
  "target": "https://threatcrush.com"
}

P5

2. Data Found

Data Point	Found?	Source	Notes
Pricing	Yes	Pricing page	https://threatcrush.com/pricing
Customer logos	No	—	—
Social proof	No	—	—
Recent launches	Yes	Press/news pages	https://threatcrush.com/blog
Blog post activity	Yes	Blog	https://threatcrush.com/blog
New hires	No	—	Often only on a /blog/team or LinkedIn page
Headline copy	Yes	Homepage	Crush Every ThreatBefore It Crushes You
Positioning	No	—	—
Executive team	No	—	—
Product/service descriptions	Yes	Homepage	From meta description
Case studies or testimonials	No	—	—
Contact/demo/signup paths	No	—	—

3. Homepage Audit

pass
Homepage fetched successfully
HTTP 200 · 81250 bytes · 61ms
Evidence
```
{
  "bytes": 81250,
  "status": 200,
  "fetchMs": 61
}
```
P5
pass
Single H1
Crush Every ThreatBefore It Crushes You
Evidence
```
{
  "h1": "Crush Every ThreatBefore It Crushes You"
}
```
P5

pass

`<title>` present

Evidence

{
  "title": "ThreatCrush — Real-Time Threat Intelligence Platform"
}

P5

pass

Meta description present

Evidence

{
  "description": "Crush every threat before it crushes you. Real-time threat feeds, vulnerability tracking, attack surface monitoring, and threat actor intelligence."
}

P5

pass
Canonical present
https://threatcrush.com
Evidence
```
{
  "canonical": "https://threatcrush.com"
}
```
P5

pass

Open Graph tags complete

Evidence

{
  "image": "https://threatcrush.com/banner.png",
  "title": "ThreatCrush — Real-Time Threat Intelligence Platform",
  "description": "Crush every threat before it crushes you. Lifetime access to real-time threat intelligence."
}

P5

pass
Alt text coverage: 100%
6/6 images have alt text.
P5

4. Schema / Structured Data Audit

warn
WebSite missing
Adding WebSite JSON-LD helps LLMs identify your entity.
P3
warn
SoftwareApplication missing
Adding SoftwareApplication JSON-LD helps LLMs identify your entity.
P3
warn
FAQPage JSON-LD missing
Add an FAQPage block on pages that answer common questions — high-value for AI summaries.
P3
pass
1 JSON-LD block(s) found
Types: Organization
Evidence
```
{
  "types": [
    "Organization"
  ],
  "blocks": 1
}
```
P5
pass
Organization present
P5

5. robots.txt and sitemap.xml Audit

pass

robots.txt present

190 chars

Evidence

{
  "snippet": "User-Agent: *\nAllow: /\nDisallow: /admin\nDisallow: /admin/\nDisallow: /account\nDisallow: /dashboard\nDisallow: /api/\n\nHost: https://threatcrush.com\nSitemap: https://threatcrush.com/sitemap.xml\n"
}

P5

pass

robots.txt references sitemap(s)

Evidence

{
  "sitemaps": [
    "https://threatcrush.com/sitemap.xml"
  ]
}

P5

pass

sitemap.xml present (14 URLs)

Evidence

{
  "snippet": "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<urlset xmlns=\"http://www.sitemaps.org/schemas/sitemap/0.9\">\n<url>\n<loc>https://threatcrush.com</loc>\n<changefreq>weekly</changefreq>\n<priority>1</priority>\n</url>\n<url>\n<loc>https://threatcrush.com/blog</loc>\n<changefreq>daily</changefreq>\n<priority>0.7</priority>\n</url>\n<url>\n<loc>https://threatcrush.com/store</loc>\n<changefreq>weekly</changefreq>\n<priority>0.7</priority>\n</url>\n<url>\n<loc>https://threatcrush.com/docs</loc>\n<changefreq>weekly</changefreq>\n<priority>0.7</priority>\n</url>\n<url>\n<loc>https://threatcrush.com/pricing</loc>\n<changefreq>weekly</changefreq>\n<priority>0.7</priority>\n</url>\n<url>\n<loc>https://threatcrush.com/investors</loc>\n<changefreq>weekly</changefreq>\n<priority>0.7</priority>\n</url>\n<url>\n<loc>https://threatcrush.com/get-",
  "urlCount": 14
}

P5

6. LLM / AI Crawler Accessibility

warn
GPTBot not explicitly addressed
No User-agent: GPTBot block in robots.txt. We recommend explicit Allow rules so crawlers don't fall back to defaults.
P3
warn
ClaudeBot not explicitly addressed
No User-agent: ClaudeBot block in robots.txt. We recommend explicit Allow rules so crawlers don't fall back to defaults.
P3
warn
PerplexityBot not explicitly addressed
No User-agent: PerplexityBot block in robots.txt. We recommend explicit Allow rules so crawlers don't fall back to defaults.
P3
warn
Google-Extended not explicitly addressed
No User-agent: Google-Extended block in robots.txt. We recommend explicit Allow rules so crawlers don't fall back to defaults.
P3
warn
OAI-SearchBot not explicitly addressed
No User-agent: OAI-SearchBot block in robots.txt. We recommend explicit Allow rules so crawlers don't fall back to defaults.
P3
warn
Applebot-Extended not explicitly addressed
No User-agent: Applebot-Extended block in robots.txt. We recommend explicit Allow rules so crawlers don't fall back to defaults.
P3
warn
CCBot not explicitly addressed
No User-agent: CCBot block in robots.txt. We recommend explicit Allow rules so crawlers don't fall back to defaults.
P3
warn
skill.md missing
Add /skill.md describing what your site lets agents do — speeds up agent task routing.
P3

pass

llms.txt present

1411 chars

Evidence

{
  "snippet": "# ThreatCrush\n\n> All-in-one security agent for builders. ThreatCrush is a Continuous Threat\n> Exposure Management (CTEM) platform that monitors, detects, scans, and\n> protects servers in real time — open-source CLI, daemon, desktop app, and\n> hosted dashboard.\n\n## What We Do\n- Real-time threat intelligence and exposure monitoring (CTEM)\n- Server agent + daemon: live syslog, auth, firewall, and pro"
}

P5

7. Positioning Clarity

warn
No clear About/Team link
Add an About or Team link in the nav or footer so LLMs can identify the company.
P2
warn
Value-prop language not detected
Pages with phrases like 'we help X', 'platform for Y', 'built for Z' are easier for LLMs to summarize.
P3
pass
H1 communicates value
Crush Every ThreatBefore It Crushes You
P5
pass
Pricing path discoverable
P5
pass
Contact / signup path discoverable
P5

8. Missing or Hard-to-Find Information

fail
7 data point(s) could not be found from public pages
· Customer logos · Social proof · New hires · Positioning · Executive team · Case studies or testimonials · Contact/demo/signup paths
Evidence
```
{
  "missing": [
    "Customer logos",
    "Social proof",
    "New hires",
    "Positioning",
    "Executive team",
    "Case studies or testimonials",
    "Contact/demo/signup paths"
  ]
}
```
P1

9. Recommended Fixes

warn
Make your About/Team page reachable
Add a top-nav or footer link to /about or /team so LLMs can identify the entity behind the site.
Evidence
```
{
  "for": "positioning.who"
}
```
P2
warn
Add /skill.md
Describe what an agent can do with your site (e.g., 'Search docs', 'Look up pricing'). Useful for agentic flows.
Evidence
```
{
  "for": "skill_md"
}
```
P3
warn
Allow GPTBot in robots.txt
Add an explicit User-agent: GPTBot Allow: / block so this AI crawler can read your site.
Evidence
```
{
  "for": "aibot.GPTBot"
}
```
P3
warn
Allow ClaudeBot in robots.txt
Add an explicit User-agent: ClaudeBot Allow: / block so this AI crawler can read your site.
Evidence
```
{
  "for": "aibot.ClaudeBot"
}
```
P3
warn
Allow PerplexityBot in robots.txt
Add an explicit User-agent: PerplexityBot Allow: / block so this AI crawler can read your site.
Evidence
```
{
  "for": "aibot.PerplexityBot"
}
```
P3
warn
Allow Google-Extended in robots.txt
Add an explicit User-agent: Google-Extended Allow: / block so this AI crawler can read your site.
Evidence
```
{
  "for": "aibot.Google-Extended"
}
```
P3
warn
Allow OAI-SearchBot in robots.txt
Add an explicit User-agent: OAI-SearchBot Allow: / block so this AI crawler can read your site.
Evidence
```
{
  "for": "aibot.OAI-SearchBot"
}
```
P3
warn
Allow Applebot-Extended in robots.txt
Add an explicit User-agent: Applebot-Extended Allow: / block so this AI crawler can read your site.
Evidence
```
{
  "for": "aibot.Applebot-Extended"
}
```
P3
warn
Allow CCBot in robots.txt
Add an explicit User-agent: CCBot Allow: / block so this AI crawler can read your site.
Evidence
```
{
  "for": "aibot.CCBot"
}
```
P3
warn
State your audience explicitly
Use phrases like 'Built for B2B SaaS marketing teams' on the homepage and About page.
Evidence
```
{
  "for": "positioning.audience"
}
```
P3
warn
Add WebSite JSON-LD
Helps engines understand the root site and enables sitelinks-search-box features.
Evidence
```
{
  "for": "schema.web"
}
```
P3
warn
Add Product / SoftwareApplication JSON-LD
On /pricing and feature pages — include offers, name, applicationCategory.
Evidence
```
{
  "for": "schema.product"
}
```
P3
warn
Add FAQPage JSON-LD
Wrap your homepage FAQ in FAQPage JSON-LD; it routinely lifts AI answer inclusion.
Evidence
```
{
  "for": "schema.faq"
}
```
P3

10. Priority To-Do Checklist

warn
[ ] Make your About/Team page reachable
Add a top-nav or footer link to /about or /team so LLMs can identify the entity behind the site.
Evidence
```
{
  "priority": 2
}
```
P2
warn
[ ] Allow GPTBot in robots.txt
Add an explicit User-agent: GPTBot Allow: / block so this AI crawler can read your site.
Evidence
```
{
  "priority": 3
}
```
P3
warn
[ ] Allow ClaudeBot in robots.txt
Add an explicit User-agent: ClaudeBot Allow: / block so this AI crawler can read your site.
Evidence
```
{
  "priority": 3
}
```
P3
warn
[ ] Allow PerplexityBot in robots.txt
Add an explicit User-agent: PerplexityBot Allow: / block so this AI crawler can read your site.
Evidence
```
{
  "priority": 3
}
```
P3
warn
[ ] Allow Google-Extended in robots.txt
Add an explicit User-agent: Google-Extended Allow: / block so this AI crawler can read your site.
Evidence
```
{
  "priority": 3
}
```
P3
warn
[ ] Allow OAI-SearchBot in robots.txt
Add an explicit User-agent: OAI-SearchBot Allow: / block so this AI crawler can read your site.
Evidence
```
{
  "priority": 3
}
```
P3
warn
[ ] Allow Applebot-Extended in robots.txt
Add an explicit User-agent: Applebot-Extended Allow: / block so this AI crawler can read your site.
Evidence
```
{
  "priority": 3
}
```
P3
warn
[ ] Allow CCBot in robots.txt
Add an explicit User-agent: CCBot Allow: / block so this AI crawler can read your site.
Evidence
```
{
  "priority": 3
}
```
P3
warn
[ ] Add /skill.md
Describe what an agent can do with your site (e.g., 'Search docs', 'Look up pricing'). Useful for agentic flows.
Evidence
```
{
  "priority": 3
}
```
P3
warn
[ ] State your audience explicitly
Use phrases like 'Built for B2B SaaS marketing teams' on the homepage and About page.
Evidence
```
{
  "priority": 3
}
```
P3
warn
[ ] Add WebSite JSON-LD
Helps engines understand the root site and enables sitelinks-search-box features.
Evidence
```
{
  "priority": 3
}
```
P3
warn
[ ] Add Product / SoftwareApplication JSON-LD
On /pricing and feature pages — include offers, name, applicationCategory.
Evidence
```
{
  "priority": 3
}
```
P3
warn
[ ] Add FAQPage JSON-LD
Wrap your homepage FAQ in FAQPage JSON-LD; it routinely lifts AI answer inclusion.
Evidence
```
{
  "priority": 3
}
```
P3

1. Crawl Summary

2. Data Found

3. Homepage Audit

4. Schema / Structured Data Audit

5. robots.txt and sitemap.xml Audit

6. LLM / AI Crawler Accessibility

7. Positioning Clarity

8. Missing or Hard-to-Find Information

9. Recommended Fixes

10. Priority To-Do Checklist

https://threatcrush.com/

1. Crawl Summary

2. Data Found

3. Homepage Audit

4. Schema / Structured Data Audit

5. robots.txt and sitemap.xml Audit

6. LLM / AI Crawler Accessibility

7. Positioning Clarity

8. Missing or Hard-to-Find Information

9. Recommended Fixes

10. Priority To-Do Checklist

Track this site week over week

Score over time

Findings by status

Findings by section

Open issues by priority

Your charts, not these.