Braincast
Resumo do episódio
Should you publish your content as a PDF or stick strictly to standard HTML? Does Google treat PDF files differently when it comes to indexing, ranking, and AI search features? In this episode of Search Off the Record, Martin Splitt and John Mueller from the Google Search Relations team demystify how Google Search handles PDF documents. They break down some of Google's internal pipelines, explain why putting an LLMs.txt file inside a PDF is a bad idea, explore common technical traps like rasterized pages and canonicalization issues, and share practical advice on managing PDFs for SEO, AEO (SEO), and user experience. In this episode, you'll learn: Google's PDF converter pipeline: How Google converts binary PDF containers into HTML pages during indexing so the rest of the pipeline can process them normally. LLMs.txt as a PDF: Why saving an LLMs.txt file as a PDF is a bad idea, even if you like LLMs.txt. File limits & Project Gutenberg: Why crawling limits exist, and how HTML and PDF size limits function in the…
Should you publish your content as a PDF or stick strictly to standard HTML? Does Google treat PDF files differently when it comes to indexing, ranking, and AI search features? In this episode of Search Off the Record, Martin Splitt and John Mueller from the Google Search Relations team demystify how Google Search handles PDF documents. They break down some of Google's internal pipelines, explain why putting an LLMs.txt file inside a PDF is a bad idea, explore common technical traps like rasterized pages and canonicalization issues, and share practical advice on managing PDFs for SEO, AEO (SEO), and user experience. In this episode, you'll learn: Google's PDF converter pipeline: How Google converts binary PDF containers into HTML pages during indexing so the rest of the pipeline can process them normally. LLMs.txt as a PDF: Why saving an LLMs.txt file as a PDF is a bad idea, even if you like LLMs.txt. File limits & Project Gutenberg: Why crawling limits exist, and how HTML and PDF size limits function in the…
Episódios
117-
PDFs in Search: Indexing, AI & Pitfalls
OuvidoShould you publish your content as a PDF or stick strictly to standard HTML? Does Google treat PDF files differently when it comes to indexing, ranking, and AI search features? In this episode of Search Off the Record, Martin Splitt and John Mueller from the Google Search Relations team demystify how Google Search handles PDF documents. They break down some of Google's internal pipelines, explain why putting an LLMs.txt file inside a PDF is a bad idea, explore common technical traps like rasterized pages and canonicalization issues, and share practical advice on managing PDFs for SEO, AEO (SEO), and user experience. In this episode, you'll learn: Google's PDF converter pipeline: How Google converts binary PDF containers into HTML pages during indexing so the rest of the pipeline can process them normally. LLMs.txt as a PDF: Why saving an LLMs.txt file as a PDF is a bad idea, even if you like LLMs.txt. File limits & Project Gutenberg: Why crawling limits exist, and how HTML and PDF size limits function in the…
116-
Do sitemaps still matter?
OuvidoSitemaps have been a core element of web development and search engine optimization for two decades, yet Search Console warnings like "Couldn't fetch" continue to generate concern among site owners. Are XML sitemaps still necessary with modern search crawlers, or can search engines and AI bots figure out site structure on their own? In this episode of Search off the Record, Google Search Relations team members Martin Splitt and John Mueller break down the history, technical specifications, and some misconceptions surrounding sitemaps, RSS feeds, LLMs.txt, canonicalization signals, and Search Console indexing behaviors. In this episode, you'll learn: The Origins of Sitemaps: How early web crawling challenges led to the sitemap standard and how building a sitemap generator started John Mueller's career at Google. Obsolete vs. Active XML Fields: Why Google dropped support for the priority and changefreq tags, and how the lastmod date is actually evaluated. XML Sitemaps vs. RSS Feeds: How RSS feeds function as…
115-
Should you block your Search result pages?
OuvidoIs your website's internal search feature secretly acting as an open invitation for crawling lots and lots? In this episode of Search off the Record, Martin Splitt and John Mueller pull back the curtain on how internal search results pages can turn into "infinite crawl spaces" that trap Googlebot, waste your crawl budget, and spike your database load. They break down the critical technical differences between blocking search pages via robots.txt versus noindex tags, and expose the massive security liabilities of leaving these pages indexable. In this episode, you'll learn: The "Infinite Crawl Space" Concept: How Googlebot treats internal search functions as infinite crawl spaces that can generate an endless loop of new URLs. Server Strain & Performance: Why uncached internal search pages force constant database lookups and ranking calculations, slowing down your website for real users. Robots.txt vs. Noindex: The distinct technical trade-offs of using a broad robots.txt disallow rule versus a robots meta tag…
114-
How to read the Indexing Report
OuvidoShould you panic when your Search Console indexing report is showing pages that aren't indexed? Is a 404 error code always a sign of a broken website? In this episode of Search Off the Record, Martin Splitt and John Mueller from the Google Search Relations team dive deep into the Page Indexing report in Google Search Console. They unpack why treating this report as a static inventory checklist to "fix" things is the wrong response, how to spot massive SEO-ruining hosting or CDN traps, and why a healthy website doesn't actually need a 100% index rate. In this episode, you'll learn: The Indexing Report Shift: Insights from the Search Console team's Hillel on why you should look for trend lines and systemic patterns rather than treating the report as a giant list of errors. When 404s are Good: Why expected 404 errors are technically correct for deleted content, and how to survive the "boss panic" of numbers that won't go down. The Domain Property Advantage: How setting up a domain property handles canonical…
113-
Should I use markdown for my site?
OuvidoShould you convert your website into Markdown to help Large Language Models (LLMs) understand your content better? Is "llms.txt" worth the effort for SEO? In this episode of Search Off the Record, Martin Splitt and John Mueller from the Google Search Relations team dive deep into the history of Markdown, its rise in the AI era, and whether it holds any real weight for search engine discovery. In this episode, you'll learn: The Origins of Markdown: From John Gruber and Aaron Swartz to its status as the "language of GitHub." Markdown vs. HTML: Why the "cleanliness" of Markdown is tempting for developers but potentially risky for site structure. LLMs & Markdown: Do AI crawlers actually prefer Markdown, or are they already experts at parsing HTML? The "Parallel Version" Trap: Why creating a separate text/Markdown version of your site for AI can lead to the same maintenance nightmares as dynamic rendering. Use Cases that Make Sense: When Markdown is actually superior (like developer documentation) and when it's…
