---
name: seo-agent-readiness
description: Check that a website can be crawled, read and understood by search engines and AI assistants, page by page, and say what to fix first.
---

# Checklist: SEO in 2026: get found by search engines and AI agents

Work through the steps in order on the site you are given. Each step says what to do and how to verify it from outside, with plain HTTP requests and no JavaScript unless the step says so. Report each step as pass, fail or not checked, with the URL and what you saw.

The reasoning behind every step: https://witnessqa.com/learn/seo-for-search-and-ai-agents/ (Markdown: https://witnessqa.com/learn/seo-for-search-and-ai-agents/index.md). To run the checks marked "WitnessQA checks" automatically, start a free audit at https://witnessqa.com/.

## Steps

1. **Let search and AI crawlers in.** robots.txt must not block the crawlers that decide whether you appear in answers. Googlebot and Bingbot for search, OAI-SearchBot for ChatGPT search, Claude-SearchBot for Claude, PerplexityBot for Perplexity.
   Verify: Fetch /robots.txt. It answers 200 (or 404, which means everything is allowed). No group for these user agents, and no `User-agent: *` group, has `Disallow: /`.
   WitnessQA checks: [seo_robots_blocks_all](https://witnessqa.com/docs/checks/#seo_robots_blocks_all), [seo_robots_blocks_search](https://witnessqa.com/docs/checks/#seo_robots_blocks_search), [seo_robots_blocks_ai_search](https://witnessqa.com/docs/checks/#seo_robots_blocks_ai_search), [seo_robots_error](https://witnessqa.com/docs/checks/#seo_robots_error), [seo_robots_missing](https://witnessqa.com/docs/checks/#seo_robots_missing)
2. **Keep pages you want found indexable.** Remove noindex from every page that should appear in search, both the robots meta tag and the X-Robots-Tag header.
   Verify: For each key page, read the response headers and the HTML head. Neither contains `noindex`.
   WitnessQA checks: [seo_noindex](https://witnessqa.com/docs/checks/#seo_noindex)
3. **Put the content in the HTML.** The main heading, the text and the links of each page are in the HTML the server sends, not added later by JavaScript. Many AI crawlers do not run JavaScript.
   Verify: Fetch the page without running scripts. The H1 and the main text are in the response body, and so are the title, description and canonical.
   WitnessQA checks: [seo_js_only_content](https://witnessqa.com/docs/checks/#seo_js_only_content), [seo_js_only_head](https://witnessqa.com/docs/checks/#seo_js_only_head), [seo_not_rendered](https://witnessqa.com/docs/checks/#seo_not_rendered)
4. **Publish one host, over HTTPS.** Every page answers on one host name over HTTPS. The other host name (www or not) and plain HTTP redirect there with one permanent redirect.
   Verify: Request http:// and the other host name for the home page. Each answers 301 or 308 straight to the main https:// URL.
   WitnessQA checks: [seo_https_redirect](https://witnessqa.com/docs/checks/#seo_https_redirect), [seo_host_redirect](https://witnessqa.com/docs/checks/#seo_host_redirect)
5. **Keep a sitemap of the pages that matter.** /sitemap.xml lists every page you want found, by its final URL, and robots.txt points to it.
   Verify: Fetch the sitemap. It is valid XML, every URL in it answers 200 without a redirect, and the pages linked from the home page are in it.
   WitnessQA checks: [seo_sitemap_missing](https://witnessqa.com/docs/checks/#seo_sitemap_missing), [seo_sitemap_invalid](https://witnessqa.com/docs/checks/#seo_sitemap_invalid), [seo_sitemap_broken](https://witnessqa.com/docs/checks/#seo_sitemap_broken), [seo_sitemap_redirect](https://witnessqa.com/docs/checks/#seo_sitemap_redirect), [seo_sitemap_missing_pages](https://witnessqa.com/docs/checks/#seo_sitemap_missing_pages)
6. **Say which URL is the real one.** Each page has a canonical link to itself, or to the page it duplicates.
   Verify: Read `<link rel="canonical">` on each page. It exists, it is absolute, and the URL it names answers 200.
   WitnessQA checks: [seo_canonical_missing](https://witnessqa.com/docs/checks/#seo_canonical_missing), [seo_canonical_elsewhere](https://witnessqa.com/docs/checks/#seo_canonical_elsewhere), [seo_canonical_broken](https://witnessqa.com/docs/checks/#seo_canonical_broken)
7. **Write a title for each page.** A unique title that says what the page is, with the main phrase people search for near the start. Short enough that it is not cut off, about 60 characters.
   Verify: Read `<title>` on each page. It exists, it is not shared with another page, and it is neither a single word nor far past 60 characters.
   WitnessQA checks: [seo_title_missing](https://witnessqa.com/docs/checks/#seo_title_missing), [seo_title_short](https://witnessqa.com/docs/checks/#seo_title_short), [seo_title_long](https://witnessqa.com/docs/checks/#seo_title_long), [seo_duplicate_title](https://witnessqa.com/docs/checks/#seo_duplicate_title)
8. **Write a description for each page.** A unique one or two sentence summary, written like an ad for the page, about 150 to 160 characters.
   Verify: Read `<meta name="description">` on each page. It exists, it is not shared with another page, and it is not far past 160 characters.
   WitnessQA checks: [seo_description_missing](https://witnessqa.com/docs/checks/#seo_description_missing), [seo_description_long](https://witnessqa.com/docs/checks/#seo_description_long), [seo_duplicate_description](https://witnessqa.com/docs/checks/#seo_duplicate_description)
9. **Structure the page with headings.** One H1 that names the topic, then H2 sections and H3 subsections in order. Where a heading asks a question, the first sentence under it answers it.
   Verify: List the headings of each page. There is exactly one H1 and no level is skipped (no H4 straight after an H2).
   WitnessQA checks: [seo_h1_missing](https://witnessqa.com/docs/checks/#seo_h1_missing), [seo_h1_multiple](https://witnessqa.com/docs/checks/#seo_h1_multiple), [seo_heading_skip](https://witnessqa.com/docs/checks/#seo_heading_skip)
10. **Describe the business and the page with structured data.** Add JSON-LD that matches what the page shows. Organization or LocalBusiness on the home page, Product, Article or FAQPage where they fit.
   Verify: Parse every `<script type="application/ld+json">`. Each one is valid JSON with a `@type`, and the home page has at least one.
   WitnessQA checks: [seo_structured_data_invalid](https://witnessqa.com/docs/checks/#seo_structured_data_invalid), [seo_structured_data_missing](https://witnessqa.com/docs/checks/#seo_structured_data_missing)
11. **Link pages to each other.** Every page is reachable from a link on another page, related pages link to each other, and the pages that sell are linked from the pages that teach. No link is broken.
   Verify: Follow the links on each page. Every same-site link answers below 400, and every key page has at least one link pointing to it.
   WitnessQA checks: [broken_link](https://witnessqa.com/docs/checks/#broken_link)
12. **Describe every image.** Images that carry meaning have alt text that says what they show. Serve them in a modern format, at the size they are shown.
   Verify: List the `<img>` elements. Each meaningful one has a non-empty alt, and none is far larger than its displayed size.
   WitnessQA checks: [seo_image_alt](https://witnessqa.com/docs/checks/#seo_image_alt), [speed_image_format](https://witnessqa.com/docs/checks/#speed_image_format), [speed_image_size](https://witnessqa.com/docs/checks/#speed_image_size)
13. **Declare the language and the mobile layout.** Set `lang` on the html element and a viewport meta tag, and make sure nothing is wider than a phone screen.
   Verify: The html element has `lang`, the head has `<meta name="viewport">`, and on a 390 px wide screen the page does not scroll sideways.
   WitnessQA checks: [seo_lang_missing](https://witnessqa.com/docs/checks/#seo_lang_missing), [seo_viewport_missing](https://witnessqa.com/docs/checks/#seo_viewport_missing), [mobile_overflow](https://witnessqa.com/docs/checks/#mobile_overflow)
14. **Set the preview for shared links.** Add Open Graph title, description and image, so a link to the page looks right in chats and social posts.
   Verify: The head has `og:title` and `og:description`, and `og:image` points to an image that answers 200.
   WitnessQA checks: [seo_og_missing](https://witnessqa.com/docs/checks/#seo_og_missing)
15. **Make the main content appear fast.** The main content of a page appears within 2.5 seconds on a phone and the layout does not jump while it loads.
   Verify: Measure a key page on a throttled phone profile. Largest Contentful Paint is at most 2.5 s and Cumulative Layout Shift at most 0.1.
   WitnessQA checks: [speed_lcp](https://witnessqa.com/docs/checks/#speed_lcp), [speed_cls](https://witnessqa.com/docs/checks/#speed_cls)
16. **Offer a Markdown map for agents (optional).** Publish /llms.txt with a short summary of the site and links to its key pages, and Markdown copies of pages agents need. It is a proposal, not a standard, and search engines do not need it.
   Verify: Fetch /llms.txt. If it exists it starts with an H1, and the links in it answer 200.
17. **Register with the search engines' own tools.** Verify the site in Google Search Console and Bing Webmaster Tools and submit the sitemap in both. They are the only first-hand data on how you appear.
   Verify: Ask the site owner. This cannot be checked from outside.