When analyzing a site for SEO or accessibility, the temptation is to simplify: strip out styles, images, JavaScript, and look at the «pure text». The problem is that this operation removes the wrong layer.
A search engine or an AI agent doesn't need to see the site like a user does. It needs to understand the page's hierarchy: what's a title, what's a list, what's a navigation section. This information lives in semantic HTML, not in the text. When you convert to markdown or plain text, that structure disappears.
For those managing complex sites — e-commerce, portals, institutional sites — this means an audit conducted on extracted text can give a distorted reading. The priority needs to shift: check semantic tags, heading hierarchy, ARIA landmarks. These are what a crawler actually reads.
The problem that no text audit can see
There's a common practice in SEO audits: extracting a page's content in text or markdown format — that is, the lightweight markup format used by many editors and AI tools — to "see what Google sees." The idea seems sensible. In reality, it starts from a flawed assumption.
A crawler — the automated program search engines use to read pages — doesn't read text. It reads HTML. And in HTML there isn't just content: there's structure. A <h1>says that phrase is the main title. A <nav>says that block is navigation. A <article>delimit self-contained content. When converting to text or markdown, all of this disappears. The words remain, but their structural meaning does not.
As explained by the analysis published on Search Engine Journal , stripping away the visual layer leaves intact the structure that a machine uses. Stripping away the structure — as markdown conversion does — leaves only words that a machine can read, but not interpret.
What a crawler really reads (and what AI agents read)
The distinction is more relevant today than it was two years ago. AI agents — systems that answer questions by synthesizing content from the web — behave similarly to traditional crawlers: they look for structural signals to understand what's important on a page.
The signals that matter:
- Heading hierarchy (H1, H2, H3): tells the system how the content is organized
- HTML5 semantic tags how
<main>,<section>,<aside>,<footer>: they delimit the functional areas of the page - ARIA attributes (Accessible Rich Internet Applications): additional labels that clarify the role of interactive elements
- Structured markup (Schema.org): machine-readable data describing the content type — product, article, event, FAQ
None of this survives a plain text conversion. If your audit stops at the extracted text, you're looking at a shadow of the site, not the site.
Where crawlability breaks on complex sites
For a five-page showcase site, the risk is low. For an e-commerce site with thousands of product pages, a portal with editorial sections, or an institutional site with restricted areas, the semantic structure is often the invisible breaking point.
Typical cases:
- Headings used for style, not hierarchy — an H3 that is actually a subheading of a main section, not a paragraph
- Main content inside
<div>generic ones instead of semantic tags — the crawler doesn't understand what is navigation and what is content - JavaScript that generates content after loading — if the crawler doesn't run the script, the page appears empty
- Schema.org markup missing or poorly filled — AI answers that cite sources prefer pages with clear structured data
These problems don't show up by looking at the extracted text. They show up by looking at the DOM — the HTML structure as the browser builds it — and the crawl logs.
Four steps for a structure-oriented audit
If you manage or oversee a site with more than a few dozen pages, these are the checks to do before any other SEO analysis.
1. Check the heading hierarchy
Each page should have only one H1. H2s should reflect the main sections of the content, not be used to enlarge text. Tools like Firefox's Web Developer Toolbar or Chrome's DevTools show the heading structure at a glance.
2. Check semantic tags in the source code
Open the page source and search for <main>, <nav>, <article>, <section>. If you only find <div>everywhere, the semantic structure is absent.
3. Test JavaScript rendering
Google Search Console has a URL inspection tool that shows the page as Googlebot sees it after rendering. If the main content only appears after scripts run, check that the crawler can read it.
4. Check structured markup
Use Google's Rich Results Test to see which Schema.org data is present and if it's valid. Pages with correct markup are more likely to be cited in AI responses — a topic we explored in the analysis on how to map the sources that dominate AI citations in your industry .
The mistake to avoid when reading this analysis
The most common mistake is thinking that semantic structure is a technical problem to delegate to the developer and forget about. It is not.
HTML structure is the foundation upon which all visibility analyses rest. If it's not solid, the data you see in Search Console can be misleading — a point that also emerges when comparing real SEO position and AI Overview , where the same page may seem well-positioned but doesn't appear where it really counts.
Semantic structure is also what determines whether a site passes anti-spam system filters. With the Google Spam Update of September 2026 , pages with poorly structured or hard-to-interpret content for crawlers have ended up under scrutiny. And the system Google's SAFE for AI spam detection works precisely by analyzing structural signals, not just text.
The starting point for those who want to improve their SEO visibility in the AI era it's not about writing more or optimizing keywords. It's about ensuring what's already written is machine-readable in the right way. This is even more true as search engines shift traffic to direct answers: if the structure isn't clear, the content won't be cited, and the SEO traffic drop that follows seems inexplicable.
SHM Studio tackles these audits starting from the HTML itself, not from the extracted text. If the site has crawlability issues or visibility problems in AI responses, the right place to start is the structure, not the content.
Related articles
Discover more articles exploring similar topics, selected to offer you a more complete and stimulating perspective. Each piece of content is carefully chosen to enrich your experience.