1. Crawl Summary

pass

Fetched 1 of 3 pages successfully

Target: https://classroom.google.com

Evidence

{
  "pages": [
    {
      "url": "https://classroom.google.com",
      "bytes": 924108,
      "status": 200,
      "fetchMs": 466
    },
    {
      "url": "https://classroom.google.com/signin/usernamerecovery?continue=https://classroom.google.com/&dsh=S1107696749:1778655451954961&emr=1&flowEntry=ServiceLogin&flowName=WebLiteSignIn&followup=https://classroom.google.com/&ifkv=AWa2PascVGp_RIQiwFqZ2r8NcU67x8ERnvYUAqT2g2nFfsA8HAtvxSBW_yByyubS-B01iecRDlwA&service=classroom",
      "bytes": 1652,
      "status": 404,
      "fetchMs": 366
    },
    {
      "url": "https://classroom.google.com/lifecycle/flows/signup?continue=https://classroom.google.com/&dsh=S1107696749:1778655451954961&emr=1&flowEntry=SignUp&flowName=GlifWebSignIn&followup=https://classroom.google.com/&ifkv=AWa2PascVGp_RIQiwFqZ2r8NcU67x8ERnvYUAqT2g2nFfsA8HAtvxSBW_yByyubS-B01iecRDlwA&service=classroom",
      "bytes": 1652,
      "status": 404,
      "fetchMs": 303
    }
  ],
  "origin": "https://classroom.google.com",
  "target": "https://classroom.google.com"
}

P5

2. Data Found

Data Point	Found?	Source	Notes
Pricing	No	—	—
Customer logos	No	—	—
Social proof	No	—	—
Recent launches	No	—	—
Blog post activity	No	—	—
New hires	No	—	Often only on a /blog/team or LinkedIn page
Headline copy	Yes	Homepage	Sign in
Positioning	No	—	—
Executive team	No	—	—
Product/service descriptions	No	—	—
Case studies or testimonials	No	—	—
Contact/demo/signup paths	No	—	—

3. Homepage Audit

fail
Content volume: 39 words
Very thin content. AI models need substantive text to understand and recommend your site.
Evidence
```
{
  "wordCount": 39
}
```
P1
warn
Missing meta description
Add a `<meta name="description">` to control the snippet AI/SERP show.
P2
warn
Short `<title>` (25 chars)
Aim for 30–60 chars. Lead with brand or product, then value prop.
Evidence
```
{
  "title": "Sign in - Google Accounts"
}
```
P3
warn
Missing canonical link
Add `<link rel="canonical" href="https://your-domain">` to prevent dup-content confusion.
P3
fail
Open Graph: missing title, description, image
P3
warn
No Twitter Card tags
Add twitter:card, twitter:title, twitter:description, twitter:image for richer previews in social and AI agent surfaces.
P3
warn
Heading structure: 1 (h1:1, h2:0, h3:0)
Few headings make it hard for AI to understand sectioning. Use h2/h3 to label each section.
Evidence
```
{
  "h1": 1,
  "h2": 0,
  "h3": 0
}
```
P3
warn
Internal links: 2
Few internal links. Add a nav/footer with links to your key pages so AI crawlers can discover them.
Evidence
```
{
  "external": 4,
  "internal": 2
}
```
P3
pass
Homepage fetched successfully
HTTP 200 · 924108 bytes · 466ms
Evidence
```
{
  "bytes": 924108,
  "status": 200,
  "fetchMs": 466
}
```
P5
pass
Page load time: 0.47s
Fast — well within AI crawler budgets.
Evidence
```
{
  "fetchMs": 466
}
```
P5
pass
<html lang="en-US"> declared
Evidence
```
{
  "lang": "en-US"
}
```
P5
pass
Single H1
Sign in
Evidence
```
{
  "h1": "Sign in"
}
```
P5
pass
Critical content is server-rendered
Raw and rendered text are within 0% of each other.
Evidence
```
{
  "ratio": 0.0010942584949911822,
  "rawTextLen": 880048,
  "renderedTextLen": 963
}
```
P5
pass
Alt text coverage: 100%
1/1 images have alt text.
P5

4. Schema / Structured Data Audit

fail
No JSON-LD structured data found
Add JSON-LD blocks (Organization, SoftwareApplication, FAQPage, BreadcrumbList) so AI answer engines can ingest your data without guessing.
P1

5. robots.txt and sitemap.xml Audit

fail
sitemap.xml not found
Add /sitemap.xml — required for reliable AI/SERP discovery.
P1
warn
robots.txt does not reference a Sitemap
Add `Sitemap: https://yoursite.com/sitemap.xml` to robots.txt.
P3

pass

robots.txt present

153 chars

Evidence

{
  "snippet": "User-agent: *\nCrawl-delay: 1\nAllow: /$\nAllow: /?hl=\nAllow: /h$\nAllow: /h?hl=\nAllow: /u/0/$\nAllow: /u/0/h\nAllow: /u/0/h?hl=\nDisallow: /?hl=*&\nDisallow: /\n"
}

P5

6. LLM / AI Crawler Accessibility

fail
GPTBot blocked via wildcard
User-agent: * is disallowed from / and no explicit rule for GPTBot overrides it.
P1
fail
ClaudeBot blocked via wildcard
User-agent: * is disallowed from / and no explicit rule for ClaudeBot overrides it.
P1
fail
PerplexityBot blocked via wildcard
User-agent: * is disallowed from / and no explicit rule for PerplexityBot overrides it.
P1
fail
Google-Extended blocked via wildcard
User-agent: * is disallowed from / and no explicit rule for Google-Extended overrides it.
P1
fail
OAI-SearchBot blocked via wildcard
User-agent: * is disallowed from / and no explicit rule for OAI-SearchBot overrides it.
P1
fail
Applebot-Extended blocked via wildcard
User-agent: * is disallowed from / and no explicit rule for Applebot-Extended overrides it.
P1
fail
CCBot blocked via wildcard
User-agent: * is disallowed from / and no explicit rule for CCBot overrides it.
P1
warn
llms.txt missing
Add /llms.txt — a concise, link-rich summary that helps LLMs orient on your site.
P2
warn
skill.md missing
Add /skill.md describing what your site lets agents do — speeds up agent task routing.
P3
warn
/.well-known/security.txt missing
Publish a /.well-known/security.txt with at least a Contact: line. Crawlers and security researchers expect it; AI systems use it as a trust signal.
P3

7. Positioning Clarity

warn
H1 missing or too short to convey value
Sign in
P1
warn
No pricing/plans link found
AI summaries commonly include pricing. Add a /pricing page even if pricing is custom.
P2
warn
Value-prop language not detected
Pages with phrases like 'we help X', 'platform for Y', 'built for Z' are easier for LLMs to summarize.
P3
pass
About/Team path discoverable
P5
pass
Contact / signup path discoverable
P5

8. Missing or Hard-to-Find Information

fail
11 data point(s) could not be found from public pages
· Pricing · Customer logos · Social proof · Recent launches · Blog post activity · New hires · Positioning · Executive team · Product/service descriptions · Case studies or testimonials · Contact/demo/signup paths
Evidence
```
{
  "missing": [
    "Pricing",
    "Customer logos",
    "Social proof",
    "Recent launches",
    "Blog post activity",
    "New hires",
    "Positioning",
    "Executive team",
    "Product/service descriptions",
    "Case studies or testimonials",
    "Contact/demo/signup paths"
  ]
}
```
P1

9. Recommended Fixes

warn
Add more substantive homepage content
AI models need 300+ words of visible body text to summarize and recommend a site. Add a value-prop paragraph, a short FAQ, and a 'how it works' section.
Evidence
```
{
  "for": "homepage.word_count"
}
```
P1
warn
Allow GPTBot in robots.txt
Add an explicit User-agent: GPTBot Allow: / block so this AI crawler can read your site.
Evidence
```
{
  "for": "aibot.GPTBot"
}
```
P1
warn
Allow ClaudeBot in robots.txt
Add an explicit User-agent: ClaudeBot Allow: / block so this AI crawler can read your site.
Evidence
```
{
  "for": "aibot.ClaudeBot"
}
```
P1
warn
Allow PerplexityBot in robots.txt
Add an explicit User-agent: PerplexityBot Allow: / block so this AI crawler can read your site.
Evidence
```
{
  "for": "aibot.PerplexityBot"
}
```
P1
warn
Allow Google-Extended in robots.txt
Add an explicit User-agent: Google-Extended Allow: / block so this AI crawler can read your site.
Evidence
```
{
  "for": "aibot.Google-Extended"
}
```
P1
warn
Allow OAI-SearchBot in robots.txt
Add an explicit User-agent: OAI-SearchBot Allow: / block so this AI crawler can read your site.
Evidence
```
{
  "for": "aibot.OAI-SearchBot"
}
```
P1
warn
Allow Applebot-Extended in robots.txt
Add an explicit User-agent: Applebot-Extended Allow: / block so this AI crawler can read your site.
Evidence
```
{
  "for": "aibot.Applebot-Extended"
}
```
P1
warn
Allow CCBot in robots.txt
Add an explicit User-agent: CCBot Allow: / block so this AI crawler can read your site.
Evidence
```
{
  "for": "aibot.CCBot"
}
```
P1
warn
Rewrite the homepage H1 to be self-evident
Replace clever copy with literal copy. 'We help X do Y' beats 'Reimagine Y'.
Evidence
```
{
  "for": "positioning.what"
}
```
P1
warn
Publish a sitemap.xml
Generate /sitemap.xml automatically (Next.js: app/sitemap.ts). Include every canonical URL.
Evidence
```
{
  "for": "sitemap.exists"
}
```
P1
warn
Add JSON-LD structured data
Start with Organization on the root layout and SoftwareApplication or Product on /pricing. Add FAQPage on any FAQ section.
Evidence
```
{
  "for": "schema.any"
}
```
P1
warn
Add a meta description
50–160 chars. Repeat your core value prop in plain language; this often becomes the AI snippet. ```html <meta name="description" content="CrawlProof shows you exactly how AI crawlers see your site, then tells you what to fix." /> ```
Evidence
```
{
  "for": "homepage.description"
}
```
P2
warn
Add /llms.txt
A short Markdown-flavored summary at the root. Include your H1, value prop, top 5–10 links, and pricing summary.
Evidence
```
{
  "for": "llms_txt"
}
```
P2
warn
Add a /pricing page
Even contact-us pricing benefits from a /pricing page that LLMs can link to in answers.
Evidence
```
{
  "for": "positioning.pricing"
}
```
P2
warn
Set a meaningful `<title>`
30–60 chars. Lead with the brand or product, then the value prop. ```html <title>CrawlProof — AEO audits for AI crawlers</title> ```
Evidence
```
{
  "for": "homepage.title"
}
```
P3
warn
Add a canonical link
Prevents dup-content drift and tells AI crawlers which URL is authoritative. ```html <link rel="canonical" href="https://yoursite.com/" /> ```
Evidence
```
{
  "for": "homepage.canonical"
}
```
P3
warn
Complete Open Graph tags
AI bots use OG for fast disambiguation. Add all four: ```html <meta property="og:title" content="Your Page Title" /> <meta property="og:description" content="50–160 char description of this page." /> <meta property="og:image" content="https://yoursite.com/og-image.jpg" /> <meta property="og:url" content="https://yoursite.com/" /> <meta property="og:type" content="website" /> <meta property="og:site_name" content="YourSite" /> ```
Evidence
```
{
  "for": "homepage.og"
}
```
P3
warn
Add Twitter Card meta tags
Used by social platforms and AI agents for richer previews. ```html <meta name="twitter:card" content="summary_large_image" /> <meta name="twitter:title" content="Your Page Title" /> <meta name="twitter:description" content="50–160 char description." /> <meta name="twitter:image" content="https://yoursite.com/og-image.jpg" /> ```
Evidence
```
{
  "for": "homepage.twitter"
}
```
P3
warn
Add structured headings
Use h2 for each section and h3 for sub-points. AI uses these to outline and chunk the page.
Evidence
```
{
  "for": "homepage.heading_structure"
}
```
P3
warn
Add internal navigation links
Top nav + footer with links to /pricing, /docs, /about, /contact gives AI crawlers an entry point to the rest of the site.
Evidence
```
{
  "for": "homepage.internal_links"
}
```
P3
warn
Add /skill.md
Describe what an agent can do with your site (e.g., 'Search docs', 'Look up pricing'). Useful for agentic flows.
Evidence
```
{
  "for": "skill_md"
}
```
P3
warn
Publish /.well-known/security.txt
A security contact builds trust with crawlers and researchers. Minimal example: ``` Contact: mailto:security@yourdomain.com Expires: 2027-01-01T00:00:00.000Z Preferred-Languages: en ```
Evidence
```
{
  "for": "security_txt"
}
```
P3
warn
State your audience explicitly
Use phrases like 'Built for B2B SaaS marketing teams' on the homepage and About page.
Evidence
```
{
  "for": "positioning.audience"
}
```
P3
warn
Reference your sitemap in robots.txt
Add `Sitemap: https://yoursite.com/sitemap.xml` so crawlers don't have to guess.
Evidence
```
{
  "for": "robots.sitemap_ref"
}
```
P3

10. Priority To-Do List

warn
[ ] Add more substantive homepage content
AI models need 300+ words of visible body text to summarize and recommend a site. Add a value-prop paragraph, a short FAQ, and a 'how it works' section.
Evidence
```
{
  "priority": 1
}
```
P1
warn
[ ] Allow GPTBot in robots.txt
Add an explicit User-agent: GPTBot Allow: / block so this AI crawler can read your site.
Evidence
```
{
  "priority": 1
}
```
P1
warn
[ ] Allow ClaudeBot in robots.txt
Add an explicit User-agent: ClaudeBot Allow: / block so this AI crawler can read your site.
Evidence
```
{
  "priority": 1
}
```
P1
warn
[ ] Allow PerplexityBot in robots.txt
Add an explicit User-agent: PerplexityBot Allow: / block so this AI crawler can read your site.
Evidence
```
{
  "priority": 1
}
```
P1
warn
[ ] Allow Google-Extended in robots.txt
Add an explicit User-agent: Google-Extended Allow: / block so this AI crawler can read your site.
Evidence
```
{
  "priority": 1
}
```
P1
warn
[ ] Allow OAI-SearchBot in robots.txt
Add an explicit User-agent: OAI-SearchBot Allow: / block so this AI crawler can read your site.
Evidence
```
{
  "priority": 1
}
```
P1
warn
[ ] Allow Applebot-Extended in robots.txt
Add an explicit User-agent: Applebot-Extended Allow: / block so this AI crawler can read your site.
Evidence
```
{
  "priority": 1
}
```
P1
warn
[ ] Allow CCBot in robots.txt
Add an explicit User-agent: CCBot Allow: / block so this AI crawler can read your site.
Evidence
```
{
  "priority": 1
}
```
P1
warn
[ ] Rewrite the homepage H1 to be self-evident
Replace clever copy with literal copy. 'We help X do Y' beats 'Reimagine Y'.
Evidence
```
{
  "priority": 1
}
```
P1
warn
[ ] Publish a sitemap.xml
Generate /sitemap.xml automatically (Next.js: app/sitemap.ts). Include every canonical URL.
Evidence
```
{
  "priority": 1
}
```
P1
warn
[ ] Add JSON-LD structured data
Start with Organization on the root layout and SoftwareApplication or Product on /pricing. Add FAQPage on any FAQ section.
Evidence
```
{
  "priority": 1
}
```
P1
warn
[ ] Add a meta description
50–160 chars. Repeat your core value prop in plain language; this often becomes the AI snippet. ```html <meta name="description" content="CrawlProof shows you exactly how AI crawlers see your site, then tells you what to fix." /> ```
Evidence
```
{
  "priority": 2
}
```
P2
warn
[ ] Add /llms.txt
A short Markdown-flavored summary at the root. Include your H1, value prop, top 5–10 links, and pricing summary.
Evidence
```
{
  "priority": 2
}
```
P2
warn
[ ] Add a /pricing page
Even contact-us pricing benefits from a /pricing page that LLMs can link to in answers.
Evidence
```
{
  "priority": 2
}
```
P2
warn
[ ] Set a meaningful `<title>`
30–60 chars. Lead with the brand or product, then the value prop. ```html <title>CrawlProof — AEO audits for AI crawlers</title> ```
Evidence
```
{
  "priority": 3
}
```
P3
warn
[ ] Add a canonical link
Prevents dup-content drift and tells AI crawlers which URL is authoritative. ```html <link rel="canonical" href="https://yoursite.com/" /> ```
Evidence
```
{
  "priority": 3
}
```
P3
warn
[ ] Complete Open Graph tags
AI bots use OG for fast disambiguation. Add all four: ```html <meta property="og:title" content="Your Page Title" /> <meta property="og:description" content="50–160 char description of this page." /> <meta property="og:image" content="https://yoursite.com/og-image.jpg" /> <meta property="og:url" content="https://yoursite.com/" /> <meta property="og:type" content="website" /> <meta property="og:site_name" content="YourSite" /> ```
Evidence
```
{
  "priority": 3
}
```
P3
warn
[ ] Add Twitter Card meta tags
Used by social platforms and AI agents for richer previews. ```html <meta name="twitter:card" content="summary_large_image" /> <meta name="twitter:title" content="Your Page Title" /> <meta name="twitter:description" content="50–160 char description." /> <meta name="twitter:image" content="https://yoursite.com/og-image.jpg" /> ```
Evidence
```
{
  "priority": 3
}
```
P3
warn
[ ] Add structured headings
Use h2 for each section and h3 for sub-points. AI uses these to outline and chunk the page.
Evidence
```
{
  "priority": 3
}
```
P3
warn
[ ] Add internal navigation links
Top nav + footer with links to /pricing, /docs, /about, /contact gives AI crawlers an entry point to the rest of the site.
Evidence
```
{
  "priority": 3
}
```
P3

AEO Audit for classroom.google.com

1. Crawl Summary

2. Data Found

3. Homepage Audit

4. Schema / Structured Data Audit

5. robots.txt and sitemap.xml Audit

6. LLM / AI Crawler Accessibility

7. Positioning Clarity

8. Missing or Hard-to-Find Information

9. Recommended Fixes

10. Priority To-Do List

https://classroom.google.com/

1. Crawl Summary

2. Data Found

3. Homepage Audit

4. Schema / Structured Data Audit

5. robots.txt and sitemap.xml Audit

6. LLM / AI Crawler Accessibility

7. Positioning Clarity

8. Missing or Hard-to-Find Information

9. Recommended Fixes

10. Priority To-Do List

Track this site week over week

Your charts, not these.