` present (48 chars)** - ✅ **Meta description present (66 chars)** - ✅ **Canonical present** https://floot.com - ✅ **Open Graph tags complete** - ✅ **Twitter Card tags complete** - ✅ **Critical content is server-rendered** Raw and rendered text are within 9% of each other. - ✅ **Alt text coverage: 100%** 6/6 images have alt text. - ✅ **Content volume: 708 words** Substantive content — AI models have enough to summarize and recommend. - ✅ **Heading structure: 28 (h1:1, h2:11, h3:16)** Multiple headings help AI chunk and outline your page. - ✅ **Internal links: 38** 38 internal + 7 external links help crawlers navigate. - ✅ **Favicon declared** ## 4. Content Quality - ❌ **Text-to-HTML ratio: 4.5%** Very low text density. AI crawlers will struggle to find substantive content. - ⚠️ **No date signal found** Add <time datetime="…"> or article:published_time meta. AI ranking weights freshness. - ✅ **Heading levels are well-ordered** 28 headings nested in order. - ✅ **Snippet-ready blocks: 8 (ul:8, ol:0, table:0)** Lists and tables are extracted verbatim by AI answer engines. - ✅ **10 question-style heading(s)** Questions in headings map cleanly to user queries. Pair with FAQPage JSON-LD for max lift. - ✅ **Author byline declared** ## 5. Schema / Structured Data Audit - ⚠️ **WebSite missing** Adding WebSite JSON-LD helps LLMs identify your entity. - ⚠️ **SoftwareApplication missing** Adding SoftwareApplication JSON-LD helps LLMs identify your entity. - ⚠️ **FAQPage JSON-LD missing** Add an FAQPage block on pages that answer common questions — high-value for AI summaries. - ⚠️ **Article / BlogPosting JSON-LD not found** Add Article / BlogPosting where applicable so AI answer engines can resolve the entity precisely. - ⚠️ **BreadcrumbList JSON-LD not found** Add BreadcrumbList where applicable so AI answer engines can resolve the entity precisely. - ⚠️ **Product / Offer JSON-LD not found** Add Product / Offer where applicable so AI answer engines can resolve the entity precisely. - ⚠️ **LocalBusiness JSON-LD not found** Add LocalBusiness where applicable so AI answer engines can resolve the entity precisely. - ⚠️ **Person (author / founder) JSON-LD not found** Add Person (author / founder) where applicable so AI answer engines can resolve the entity precisely. - ⚠️ **HowTo JSON-LD not found** Add HowTo where applicable so AI answer engines can resolve the entity precisely. - ⚠️ **VideoObject JSON-LD not found** Add VideoObject where applicable so AI answer engines can resolve the entity precisely. - ✅ **1 JSON-LD block(s) found** Types: Organization - ✅ **Organization present** ## 6. Links & Images - ⚠️ **Modern image formats: 0% (0/6 webp/avif)** 4 legacy (png/jpg/gif) image(s). Convert hero/above-the-fold images to WebP or AVIF. - ❌ **Lazy loading: 0% (0/6)** Add `loading="lazy"` to below-the-fold images to reduce initial payload. - ❌ **Explicit dimensions: 17% (1/6)** Add width and height attributes on <img> tags to prevent CLS. - ⚠️ **1 broken link(s) in first 20** · 403 — https://reddit.com/r/floot - ⚠️ **Responsive srcset: 0/6** Use srcset/sizes to serve appropriately-sized images on mobile. Reduces wasted bytes. - ✅ **External nofollow: 0% (0/7)** Healthy mix of follow and nofollow outbound links. ## 7. Performance - ⚠️ **Resource requests: 57 (scripts:29, css:22, img:6)** High request count. Bundle scripts/styles and use sprites or CSS for icons. - ⚠️ **1 render-blocking script(s) in <head>** Move non-critical scripts to end of <body> or add `defer`/`async`. - ✅ **Page size: 112 KB** Compact HTML payload — well within AI crawler limits. - ✅ **Inline JS+CSS bulk: 47 KB** Inline payload is modest. - ✅ **Response time: 126ms** Fast first response. - ✅ **Cache-Control set (CDN: CloudFront)** Cache-Control: s-maxage=31536000, CDN detected: CloudFront ## 8. Security - ⚠️ **HSTS missing** Add `Strict-Transport-Security: max-age=31536000; includeSubDomains` once you're confident in https. - ⚠️ **Content-Security-Policy missing** Define a CSP to limit script sources — large reduction in XSS surface. - ⚠️ **X-Content-Type-Options missing** Add `X-Content-Type-Options: nosniff` to block MIME-type sniffing. - ⚠️ **Referrer-Policy missing** Add `Referrer-Policy: strict-origin-when-cross-origin` for safer referrers. - ⚠️ **Permissions-Policy missing** Restrict browser features (camera, mic, geolocation) you don't use. - ✅ **Served over HTTPS** - ✅ **No mixed content detected** - ✅ **X-Frame-Options set** SAMEORIGIN ## 9. robots.txt and sitemap.xml Audit - ✅ **robots.txt present** 62 chars - ✅ **robots.txt references sitemap(s)** - ✅ **sitemap.xml present (246 URLs)** ## 10. LLM / AI Crawler Accessibility - ⚠️ **llms.txt missing** Add /llms.txt — a concise, link-rich summary that helps LLMs orient on your site. - ⚠️ **GPTBot not explicitly addressed** No User-agent: GPTBot block in robots.txt. We recommend explicit Allow rules so crawlers don't fall back to defaults. - ⚠️ **ClaudeBot not explicitly addressed** No User-agent: ClaudeBot block in robots.txt. We recommend explicit Allow rules so crawlers don't fall back to defaults. - ⚠️ **PerplexityBot not explicitly addressed** No User-agent: PerplexityBot block in robots.txt. We recommend explicit Allow rules so crawlers don't fall back to defaults. - ⚠️ **Google-Extended not explicitly addressed** No User-agent: Google-Extended block in robots.txt. We recommend explicit Allow rules so crawlers don't fall back to defaults. - ⚠️ **OAI-SearchBot not explicitly addressed** No User-agent: OAI-SearchBot block in robots.txt. We recommend explicit Allow rules so crawlers don't fall back to defaults. - ⚠️ **Applebot-Extended not explicitly addressed** No User-agent: Applebot-Extended block in robots.txt. We recommend explicit Allow rules so crawlers don't fall back to defaults. - ⚠️ **CCBot not explicitly addressed** No User-agent: CCBot block in robots.txt. We recommend explicit Allow rules so crawlers don't fall back to defaults. - ⚠️ **skill.md missing** Add /skill.md describing what your site lets agents do — speeds up agent task routing. - ⚠️ **/.well-known/security.txt missing** Publish a /.well-known/security.txt with at least a Contact: line. Crawlers and security researchers expect it; AI systems use it as a trust signal. ## 11. Positioning Clarity - ❌ **No discoverable CTA** Add a clearly-labeled Contact, Demo, or Sign up link to the nav or hero. - ✅ **About/Team path discoverable** - ✅ **H1 communicates value** The easiest way to build apps and websites - ✅ **Value-prop language detected** - ✅ **Pricing path discoverable** ## 12. Missing or Hard-to-Find Information - ❌ **6 data point(s) could not be found from public pages** · Customer logos · Social proof · New hires · Executive team · Case studies or testimonials · Contact/demo/signup paths ## 13. Recommended Fixes - ⚠️ **Add a discoverable CTA** Place 'Contact sales' or 'Start free' in the top-right of the nav. LLMs cite the visible label. - ⚠️ **Raise your text-to-HTML ratio** Strip unused inline scripts/styles and move large bundles to external files. AI crawlers struggle when most of the response is markup. - ⚠️ **Add /llms.txt** A short Markdown-flavored summary at the root. Include your H1, value prop, top 5–10 links, and pricing summary. - ⚠️ **Publish a date signal** Add `<time datetime="2026-05-17">` or `<meta property="article:published_time">`. AI ranking heavily weights freshness. - ⚠️ **Use modern image formats** Serve WebP or AVIF for hero/above-the-fold images. Keep legacy PNG/JPG only as <picture> fallbacks. - ⚠️ **Lazy-load below-the-fold images** Add `loading="lazy"` on `<img>` tags that aren't in the initial viewport. Reduces first-paint payload. - ⚠️ **Set width/height on images** Explicit dimensions prevent Cumulative Layout Shift and help AI extractors reserve space correctly. - ⚠️ **Fix broken homepage links** We HEAD-probed the first 20 unique homepage links and found 4xx/5xx responses. Repair or remove them — broken links erode crawler trust. - ⚠️ **Allow GPTBot in robots.txt** Add an explicit User-agent: GPTBot Allow: / block so this AI crawler can read your site. - ⚠️ **Allow ClaudeBot in robots.txt** Add an explicit User-agent: ClaudeBot Allow: / block so this AI crawler can read your site. - ⚠️ **Allow PerplexityBot in robots.txt** Add an explicit User-agent: PerplexityBot Allow: / block so this AI crawler can read your site. - ⚠️ **Allow Google-Extended in robots.txt** Add an explicit User-agent: Google-Extended Allow: / block so this AI crawler can read your site. - ⚠️ **Allow OAI-SearchBot in robots.txt** Add an explicit User-agent: OAI-SearchBot Allow: / block so this AI crawler can read your site. - ⚠️ **Allow Applebot-Extended in robots.txt** Add an explicit User-agent: Applebot-Extended Allow: / block so this AI crawler can read your site. - ⚠️ **Allow CCBot in robots.txt** Add an explicit User-agent: CCBot Allow: / block so this AI crawler can read your site. - ⚠️ **Add /skill.md** Describe what an agent can do with your site (e.g., 'Search docs', 'Look up pricing'). Useful for agentic flows. - ⚠️ **Publish /.well-known/security.txt** A security contact builds trust with crawlers and researchers. Minimal example: ``` Contact: mailto:security@yourdomain.com Expires: 2027-01-01T00:00:00.000Z Preferred-Languages: en ``` - ⚠️ **Reduce resource count** Bundle scripts/styles, sprite or inline-SVG your icons, and use system fonts where possible. - ⚠️ **Eliminate render-blocking head scripts** Add `defer` or `async` to any `<script src="…">` in `<head>`, or move it to the end of `<body>`. - ⚠️ **Add WebSite JSON-LD** Helps engines understand the root site and enables sitelinks-search-box features. - ⚠️ **Add Product / SoftwareApplication JSON-LD** On /pricing and feature pages — include offers, name, applicationCategory. - ⚠️ **Add FAQPage JSON-LD** Wrap your homepage FAQ in FAQPage JSON-LD; it routinely lifts AI answer inclusion. - ⚠️ **Add Article / BlogPosting JSON-LD** On every blog/article page, include Article JSON-LD with headline, author, datePublished, dateModified. AI engines weight these heavily for freshness and authority. - ⚠️ **Add BreadcrumbList JSON-LD** Helps AI engines understand site hierarchy and improves citation context. - ⚠️ **Add Product / SoftwareApplication JSON-LD** On /pricing and feature pages — include offers, name, applicationCategory. - ⚠️ **Enable HSTS** Add `Strict-Transport-Security: max-age=31536000; includeSubDomains` once you're confident every subdomain is https-ready. - ⚠️ **Define a Content-Security-Policy** Start with `Content-Security-Policy-Report-Only` to learn safe sources, then enforce. Cuts XSS blast radius. - ⚠️ **Use srcset/sizes for responsive images** Serve appropriately-sized images per viewport — saves bytes on mobile crawls. - ⚠️ **Add LocalBusiness JSON-LD (if you have a physical location)** Include address, geo, openingHours, telephone. Required for AI engines to surface you in 'near me' queries. - ⚠️ **Add Person JSON-LD for authors / founders** Mark up bylines and founder bios with Person schema — name, jobTitle, sameAs (their profiles). Strengthens E-E-A-T. - ⚠️ **Add HowTo JSON-LD for step-by-step content** For any 'how to' page, wrap the steps in HowTo JSON-LD. AI step-by-step answers cite these heavily. - ⚠️ **Add VideoObject JSON-LD** For embedded videos, include VideoObject with thumbnailUrl, uploadDate, duration. AI engines cite these in multimedia answers. - ⚠️ **Add X-Content-Type-Options** `X-Content-Type-Options: nosniff` prevents browsers from MIME-sniffing responses. - ⚠️ **Set a Referrer-Policy** `Referrer-Policy: strict-origin-when-cross-origin` is a safe default. - ⚠️ **Set a Permissions-Policy** Restrict browser features you don't use, e.g. `Permissions-Policy: camera=(), microphone=(), geolocation=()`. ## 14. Priority To-Do List - [ ] **P1** — Add a discoverable CTA Place 'Contact sales' or 'Start free' in the top-right of the nav. LLMs cite the visible label. - [ ] **P2** — Raise your text-to-HTML ratio Strip unused inline scripts/styles and move large bundles to external files. AI crawlers struggle when most of the response is markup. - [ ] **P2** — Add /llms.txt A short Markdown-flavored summary at the root. Include your H1, value prop, top 5–10 links, and pricing summary. - [ ] **P3** — Publish a date signal Add `<time datetime="2026-05-17">` or `<meta property="article:published_time">`. AI ranking heavily weights freshness. - [ ] **P3** — Use modern image formats Serve WebP or AVIF for hero/above-the-fold images. Keep legacy PNG/JPG only as <picture> fallbacks. - [ ] **P3** — Lazy-load below-the-fold images Add `loading="lazy"` on `<img>` tags that aren't in the initial viewport. Reduces first-paint payload. - [ ] **P3** — Set width/height on images Explicit dimensions prevent Cumulative Layout Shift and help AI extractors reserve space correctly. - [ ] **P3** — Fix broken homepage links We HEAD-probed the first 20 unique homepage links and found 4xx/5xx responses. Repair or remove them — broken links erode crawler trust. - [ ] **P3** — Allow GPTBot in robots.txt Add an explicit User-agent: GPTBot Allow: / block so this AI crawler can read your site. - [ ] **P3** — Allow ClaudeBot in robots.txt Add an explicit User-agent: ClaudeBot Allow: / block so this AI crawler can read your site. - [ ] **P3** — Allow PerplexityBot in robots.txt Add an explicit User-agent: PerplexityBot Allow: / block so this AI crawler can read your site. - [ ] **P3** — Allow Google-Extended in robots.txt Add an explicit User-agent: Google-Extended Allow: / block so this AI crawler can read your site. - [ ] **P3** — Allow OAI-SearchBot in robots.txt Add an explicit User-agent: OAI-SearchBot Allow: / block so this AI crawler can read your site. - [ ] **P3** — Allow Applebot-Extended in robots.txt Add an explicit User-agent: Applebot-Extended Allow: / block so this AI crawler can read your site. - [ ] **P3** — Allow CCBot in robots.txt Add an explicit User-agent: CCBot Allow: / block so this AI crawler can read your site. - [ ] **P3** — Add /skill.md Describe what an agent can do with your site (e.g., 'Search docs', 'Look up pricing'). Useful for agentic flows. - [ ] **P3** — Publish /.well-known/security.txt A security contact builds trust with crawlers and researchers. Minimal example: ``` Contact: mailto:security@yourdomain.com Expires: 2027-01-01T00:00:00.000Z Preferred-Languages: en ``` - [ ] **P3** — Reduce resource count Bundle scripts/styles, sprite or inline-SVG your icons, and use system fonts where possible. - [ ] **P3** — Eliminate render-blocking head scripts Add `defer` or `async` to any `<script src="…">` in `<head>`, or move it to the end of `<body>`. - [ ] **P3** — Add WebSite JSON-LD Helps engines understand the root site and enables sitelinks-search-box features. --- _Report by [CrawlProof](https://crawlproof.com). Reusable after every major website change.

# AEO Audit for floot.com **Target:** https://floot.com/ **Score:** 45 / 100 **Generated:** 2026-05-21T02:34:02.962Z **Pages crawled:** 9 **Findings:** 43 pass · 92 warn · 5 fail · 0 unknown --- ## 1. Crawl Summary - ✅ **Fetched 9 of 9 pages successfully** Target: https://floot.com ## 2. Data Found | Data Point | Found? | Source | Notes | |---|---:|---|---| | Pricing | Yes | Pricing page | https://floot.com/en/pricing | | Customer logos | No | — | — | | Social proof | No | — | — | | Recent launches | Yes | Press/news pages | https://floot.com/blog | | Blog post activity | Yes | Blog | https://floot.com/blog | | New hires | No | — | Often only on a /blog/team or LinkedIn page | | Headline copy | Yes | Homepage | The easiest way to build apps and websites | | Positioning | Yes | Homepage | easiest way | | Executive team | No | — | — | | Product/service descriptions | Yes | Homepage | From meta description | | Case studies or testimonials | No | — | — | | Contact/demo/signup paths | No | — | — | ## 3. Homepage Audit - ✅ **Homepage fetched successfully** HTTP 200 · 114314 bytes · 126ms - ✅ **Page load time: 0.13s** Fast — well within AI crawler budgets. - ✅ ** declared** - ✅ **Single H1** The easiest way to build apps and websites - ✅ **`` present (48 chars)** - ✅ **Meta description present (66 chars)** - ✅ **Canonical present** https://floot.com - ✅ **Open Graph tags complete** - ✅ **Twitter Card tags complete** - ✅ **Critical content is server-rendered** Raw and rendered text are within 9% of each other. - ✅ **Alt text coverage: 100%** 6/6 images have alt text. - ✅ **Content volume: 708 words** Substantive content — AI models have enough to summarize and recommend. - ✅ **Heading structure: 28 (h1:1, h2:11, h3:16)** Multiple headings help AI chunk and outline your page. - ✅ **Internal links: 38** 38 internal + 7 external links help crawlers navigate. - ✅ **Favicon declared** ## 4. Content Quality - ❌ **Text-to-HTML ratio: 4.5%** Very low text density. AI crawlers will struggle to find substantive content. - ⚠️ **No date signal found** Add <time datetime="…"> or article:published_time meta. AI ranking weights freshness. - ✅ **Heading levels are well-ordered** 28 headings nested in order. - ✅ **Snippet-ready blocks: 8 (ul:8, ol:0, table:0)** Lists and tables are extracted verbatim by AI answer engines. - ✅ **10 question-style heading(s)** Questions in headings map cleanly to user queries. Pair with FAQPage JSON-LD for max lift. - ✅ **Author byline declared** ## 5. Schema / Structured Data Audit - ⚠️ **WebSite missing** Adding WebSite JSON-LD helps LLMs identify your entity. - ⚠️ **SoftwareApplication missing** Adding SoftwareApplication JSON-LD helps LLMs identify your entity. - ⚠️ **FAQPage JSON-LD missing** Add an FAQPage block on pages that answer common questions — high-value for AI summaries. - ⚠️ **Article / BlogPosting JSON-LD not found** Add Article / BlogPosting where applicable so AI answer engines can resolve the entity precisely. - ⚠️ **BreadcrumbList JSON-LD not found** Add BreadcrumbList where applicable so AI answer engines can resolve the entity precisely. - ⚠️ **Product / Offer JSON-LD not found** Add Product / Offer where applicable so AI answer engines can resolve the entity precisely. - ⚠️ **LocalBusiness JSON-LD not found** Add LocalBusiness where applicable so AI answer engines can resolve the entity precisely. - ⚠️ **Person (author / founder) JSON-LD not found** Add Person (author / founder) where applicable so AI answer engines can resolve the entity precisely. - ⚠️ **HowTo JSON-LD not found** Add HowTo where applicable so AI answer engines can resolve the entity precisely. - ⚠️ **VideoObject JSON-LD not found** Add VideoObject where applicable so AI answer engines can resolve the entity precisely. - ✅ **1 JSON-LD block(s) found** Types: Organization - ✅ **Organization present** ## 6. Links & Images - ⚠️ **Modern image formats: 0% (0/6 webp/avif)** 4 legacy (png/jpg/gif) image(s). Convert hero/above-the-fold images to WebP or AVIF. - ❌ **Lazy loading: 0% (0/6)** Add `loading="lazy"` to below-the-fold images to reduce initial payload. - ❌ **Explicit dimensions: 17% (1/6)** Add width and height attributes on <img> tags to prevent CLS. - ⚠️ **1 broken link(s) in first 20** · 403 — https://reddit.com/r/floot - ⚠️ **Responsive srcset: 0/6** Use srcset/sizes to serve appropriately-sized images on mobile. Reduces wasted bytes. - ✅ **External nofollow: 0% (0/7)** Healthy mix of follow and nofollow outbound links. ## 7. Performance - ⚠️ **Resource requests: 57 (scripts:29, css:22, img:6)** High request count. Bundle scripts/styles and use sprites or CSS for icons. - ⚠️ **1 render-blocking script(s) in <head>** Move non-critical scripts to end of <body> or add `defer`/`async`. - ✅ **Page size: 112 KB** Compact HTML payload — well within AI crawler limits. - ✅ **Inline JS+CSS bulk: 47 KB** Inline payload is modest. - ✅ **Response time: 126ms** Fast first response. - ✅ **Cache-Control set (CDN: CloudFront)** Cache-Control: s-maxage=31536000, CDN detected: CloudFront ## 8. Security - ⚠️ **HSTS missing** Add `Strict-Transport-Security: max-age=31536000; includeSubDomains` once you're confident in https. - ⚠️ **Content-Security-Policy missing** Define a CSP to limit script sources — large reduction in XSS surface. - ⚠️ **X-Content-Type-Options missing** Add `X-Content-Type-Options: nosniff` to block MIME-type sniffing. - ⚠️ **Referrer-Policy missing** Add `Referrer-Policy: strict-origin-when-cross-origin` for safer referrers. - ⚠️ **Permissions-Policy missing** Restrict browser features (camera, mic, geolocation) you don't use. - ✅ **Served over HTTPS** - ✅ **No mixed content detected** - ✅ **X-Frame-Options set** SAMEORIGIN ## 9. robots.txt and sitemap.xml Audit - ✅ **robots.txt present** 62 chars - ✅ **robots.txt references sitemap(s)** - ✅ **sitemap.xml present (246 URLs)** ## 10. LLM / AI Crawler Accessibility - ⚠️ **llms.txt missing** Add /llms.txt — a concise, link-rich summary that helps LLMs orient on your site. - ⚠️ **GPTBot not explicitly addressed** No User-agent: GPTBot block in robots.txt. We recommend explicit Allow rules so crawlers don't fall back to defaults. - ⚠️ **ClaudeBot not explicitly addressed** No User-agent: ClaudeBot block in robots.txt. We recommend explicit Allow rules so crawlers don't fall back to defaults. - ⚠️ **PerplexityBot not explicitly addressed** No User-agent: PerplexityBot block in robots.txt. We recommend explicit Allow rules so crawlers don't fall back to defaults. - ⚠️ **Google-Extended not explicitly addressed** No User-agent: Google-Extended block in robots.txt. We recommend explicit Allow rules so crawlers don't fall back to defaults. - ⚠️ **OAI-SearchBot not explicitly addressed** No User-agent: OAI-SearchBot block in robots.txt. We recommend explicit Allow rules so crawlers don't fall back to defaults. - ⚠️ **Applebot-Extended not explicitly addressed** No User-agent: Applebot-Extended block in robots.txt. We recommend explicit Allow rules so crawlers don't fall back to defaults. - ⚠️ **CCBot not explicitly addressed** No User-agent: CCBot block in robots.txt. We recommend explicit Allow rules so crawlers don't fall back to defaults. - ⚠️ **skill.md missing** Add /skill.md describing what your site lets agents do — speeds up agent task routing. - ⚠️ **/.well-known/security.txt missing** Publish a /.well-known/security.txt with at least a Contact: line. Crawlers and security researchers expect it; AI systems use it as a trust signal. ## 11. Positioning Clarity - ❌ **No discoverable CTA** Add a clearly-labeled Contact, Demo, or Sign up link to the nav or hero. - ✅ **About/Team path discoverable** - ✅ **H1 communicates value** The easiest way to build apps and websites - ✅ **Value-prop language detected** - ✅ **Pricing path discoverable** ## 12. Missing or Hard-to-Find Information - ❌ **6 data point(s) could not be found from public pages** · Customer logos · Social proof · New hires · Executive team · Case studies or testimonials · Contact/demo/signup paths ## 13. Recommended Fixes - ⚠️ **Add a discoverable CTA** Place 'Contact sales' or 'Start free' in the top-right of the nav. LLMs cite the visible label. - ⚠️ **Raise your text-to-HTML ratio** Strip unused inline scripts/styles and move large bundles to external files. AI crawlers struggle when most of the response is markup. - ⚠️ **Add /llms.txt** A short Markdown-flavored summary at the root. Include your H1, value prop, top 5–10 links, and pricing summary. - ⚠️ **Publish a date signal** Add `<time datetime="2026-05-17">` or `<meta property="article:published_time">`. AI ranking heavily weights freshness. - ⚠️ **Use modern image formats** Serve WebP or AVIF for hero/above-the-fold images. Keep legacy PNG/JPG only as <picture> fallbacks. - ⚠️ **Lazy-load below-the-fold images** Add `loading="lazy"` on `<img>` tags that aren't in the initial viewport. Reduces first-paint payload. - ⚠️ **Set width/height on images** Explicit dimensions prevent Cumulative Layout Shift and help AI extractors reserve space correctly. - ⚠️ **Fix broken homepage links** We HEAD-probed the first 20 unique homepage links and found 4xx/5xx responses. Repair or remove them — broken links erode crawler trust. - ⚠️ **Allow GPTBot in robots.txt** Add an explicit User-agent: GPTBot Allow: / block so this AI crawler can read your site. - ⚠️ **Allow ClaudeBot in robots.txt** Add an explicit User-agent: ClaudeBot Allow: / block so this AI crawler can read your site. - ⚠️ **Allow PerplexityBot in robots.txt** Add an explicit User-agent: PerplexityBot Allow: / block so this AI crawler can read your site. - ⚠️ **Allow Google-Extended in robots.txt** Add an explicit User-agent: Google-Extended Allow: / block so this AI crawler can read your site. - ⚠️ **Allow OAI-SearchBot in robots.txt** Add an explicit User-agent: OAI-SearchBot Allow: / block so this AI crawler can read your site. - ⚠️ **Allow Applebot-Extended in robots.txt** Add an explicit User-agent: Applebot-Extended Allow: / block so this AI crawler can read your site. - ⚠️ **Allow CCBot in robots.txt** Add an explicit User-agent: CCBot Allow: / block so this AI crawler can read your site. - ⚠️ **Add /skill.md** Describe what an agent can do with your site (e.g., 'Search docs', 'Look up pricing'). Useful for agentic flows. - ⚠️ **Publish /.well-known/security.txt** A security contact builds trust with crawlers and researchers. Minimal example: ``` Contact: mailto:security@yourdomain.com Expires: 2027-01-01T00:00:00.000Z Preferred-Languages: en ``` - ⚠️ **Reduce resource count** Bundle scripts/styles, sprite or inline-SVG your icons, and use system fonts where possible. - ⚠️ **Eliminate render-blocking head scripts** Add `defer` or `async` to any `<script src="…">` in `<head>`, or move it to the end of `<body>`. - ⚠️ **Add WebSite JSON-LD** Helps engines understand the root site and enables sitelinks-search-box features. - ⚠️ **Add Product / SoftwareApplication JSON-LD** On /pricing and feature pages — include offers, name, applicationCategory. - ⚠️ **Add FAQPage JSON-LD** Wrap your homepage FAQ in FAQPage JSON-LD; it routinely lifts AI answer inclusion. - ⚠️ **Add Article / BlogPosting JSON-LD** On every blog/article page, include Article JSON-LD with headline, author, datePublished, dateModified. AI engines weight these heavily for freshness and authority. - ⚠️ **Add BreadcrumbList JSON-LD** Helps AI engines understand site hierarchy and improves citation context. - ⚠️ **Add Product / SoftwareApplication JSON-LD** On /pricing and feature pages — include offers, name, applicationCategory. - ⚠️ **Enable HSTS** Add `Strict-Transport-Security: max-age=31536000; includeSubDomains` once you're confident every subdomain is https-ready. - ⚠️ **Define a Content-Security-Policy** Start with `Content-Security-Policy-Report-Only` to learn safe sources, then enforce. Cuts XSS blast radius. - ⚠️ **Use srcset/sizes for responsive images** Serve appropriately-sized images per viewport — saves bytes on mobile crawls. - ⚠️ **Add LocalBusiness JSON-LD (if you have a physical location)** Include address, geo, openingHours, telephone. Required for AI engines to surface you in 'near me' queries. - ⚠️ **Add Person JSON-LD for authors / founders** Mark up bylines and founder bios with Person schema — name, jobTitle, sameAs (their profiles). Strengthens E-E-A-T. - ⚠️ **Add HowTo JSON-LD for step-by-step content** For any 'how to' page, wrap the steps in HowTo JSON-LD. AI step-by-step answers cite these heavily. - ⚠️ **Add VideoObject JSON-LD** For embedded videos, include VideoObject with thumbnailUrl, uploadDate, duration. AI engines cite these in multimedia answers. - ⚠️ **Add X-Content-Type-Options** `X-Content-Type-Options: nosniff` prevents browsers from MIME-sniffing responses. - ⚠️ **Set a Referrer-Policy** `Referrer-Policy: strict-origin-when-cross-origin` is a safe default. - ⚠️ **Set a Permissions-Policy** Restrict browser features you don't use, e.g. `Permissions-Policy: camera=(), microphone=(), geolocation=()`. ## 14. Priority To-Do List - [ ] **P1** — Add a discoverable CTA Place 'Contact sales' or 'Start free' in the top-right of the nav. LLMs cite the visible label. - [ ] **P2** — Raise your text-to-HTML ratio Strip unused inline scripts/styles and move large bundles to external files. AI crawlers struggle when most of the response is markup. - [ ] **P2** — Add /llms.txt A short Markdown-flavored summary at the root. Include your H1, value prop, top 5–10 links, and pricing summary. - [ ] **P3** — Publish a date signal Add `<time datetime="2026-05-17">` or `<meta property="article:published_time">`. AI ranking heavily weights freshness. - [ ] **P3** — Use modern image formats Serve WebP or AVIF for hero/above-the-fold images. Keep legacy PNG/JPG only as <picture> fallbacks. - [ ] **P3** — Lazy-load below-the-fold images Add `loading="lazy"` on `<img>` tags that aren't in the initial viewport. Reduces first-paint payload. - [ ] **P3** — Set width/height on images Explicit dimensions prevent Cumulative Layout Shift and help AI extractors reserve space correctly. - [ ] **P3** — Fix broken homepage links We HEAD-probed the first 20 unique homepage links and found 4xx/5xx responses. Repair or remove them — broken links erode crawler trust. - [ ] **P3** — Allow GPTBot in robots.txt Add an explicit User-agent: GPTBot Allow: / block so this AI crawler can read your site. - [ ] **P3** — Allow ClaudeBot in robots.txt Add an explicit User-agent: ClaudeBot Allow: / block so this AI crawler can read your site. - [ ] **P3** — Allow PerplexityBot in robots.txt Add an explicit User-agent: PerplexityBot Allow: / block so this AI crawler can read your site. - [ ] **P3** — Allow Google-Extended in robots.txt Add an explicit User-agent: Google-Extended Allow: / block so this AI crawler can read your site. - [ ] **P3** — Allow OAI-SearchBot in robots.txt Add an explicit User-agent: OAI-SearchBot Allow: / block so this AI crawler can read your site. - [ ] **P3** — Allow Applebot-Extended in robots.txt Add an explicit User-agent: Applebot-Extended Allow: / block so this AI crawler can read your site. - [ ] **P3** — Allow CCBot in robots.txt Add an explicit User-agent: CCBot Allow: / block so this AI crawler can read your site. - [ ] **P3** — Add /skill.md Describe what an agent can do with your site (e.g., 'Search docs', 'Look up pricing'). Useful for agentic flows. - [ ] **P3** — Publish /.well-known/security.txt A security contact builds trust with crawlers and researchers. Minimal example: ``` Contact: mailto:security@yourdomain.com Expires: 2027-01-01T00:00:00.000Z Preferred-Languages: en ``` - [ ] **P3** — Reduce resource count Bundle scripts/styles, sprite or inline-SVG your icons, and use system fonts where possible. - [ ] **P3** — Eliminate render-blocking head scripts Add `defer` or `async` to any `<script src="…">` in `<head>`, or move it to the end of `<body>`. - [ ] **P3** — Add WebSite JSON-LD Helps engines understand the root site and enables sitelinks-search-box features. --- _Report by [CrawlProof](https://crawlproof.com). Reusable after every major website change._