# Notes on search, AI answers and the code behind them.

URL: https://serpel.app/blog

Practical guides on how search engines and AI assistants find, read and cite websites. Written by the Serpel team, with sources for every claim.

- [AI crawlers: which to allow, which to block, and how to do it](https://serpel.app/blog/ai-crawlers): A practical list of AI crawlers: what GPTBot, ClaudeBot and others do, which to allow or block, plus robots.txt examples you can copy and test.
- [AI SEO: how to use AI for SEO work and how to optimise for AI search](https://serpel.app/blog/ai-seo): AI SEO means using AI to do SEO work and optimising for AI search. What to automate, where AI fails, what Google allows and which tool types exist.
- [Answer engine optimization (AEO): what it is and how to do it](https://serpel.app/blog/answer-engine-optimization): Answer engine optimization (AEO) means writing content AI answers can cite: how engines pick sources, which page patterns help and how to measure.
- [Best AI visibility tools in 2026: what they track and what they cost](https://serpel.app/blog/best-ai-visibility-tools): The best AI visibility tools compared: what Semrush, Ahrefs, Peec AI, Otterly.AI, Profound and Serpel track, their public pricing and how to choose.
- [Bing Search Console: how to set up Bing Webmaster Tools](https://serpel.app/blog/bing-webmaster-tools): Bing Search Console is Bing Webmaster Tools. Set it up step by step: import from Google, verify, submit sitemaps, use IndexNow and read the reports.
- [Core Web Vitals test: how to measure and fix LCP, INP and CLS](https://serpel.app/blog/core-web-vitals-test): Run a Core Web Vitals test with PageSpeed Insights, Search Console, Lighthouse, CrUX and Serpel, then fix LCP, INP and CLS with a table of causes.
- [Generative engine optimization (GEO): what it is and what works](https://serpel.app/blog/generative-engine-optimization): Generative engine optimization (GEO) is how you get cited in AI answers. See what the research found, what Google says and a checklist you can use.
- [GEO vs SEO: what is different, what stays the same and how to measure it](https://serpel.app/blog/geo-vs-seo): GEO vs SEO: SEO earns rankings and clicks, GEO earns citations in AI answers. See the differences, what stays the same and how to measure both.
- [Google Search Console MCP: connect your agent to search data](https://serpel.app/blog/google-search-console-mcp): Set up a Google Search Console MCP server for Claude Code and other agents: the options compared and Serpel’s search performance tool step by step.
- [SEO for ChatGPT: how to rank in ChatGPT search and get cited](https://serpel.app/blog/how-to-rank-in-chatgpt): SEO for ChatGPT means letting OAI-SearchBot in and being quotable. How ChatGPT search picks sources, what to do and how to check citations.
- [JavaScript SEO: how Google crawls, renders and indexes JavaScript](https://serpel.app/blog/javascript-seo): JavaScript SEO explained: how Googlebot crawls, renders and indexes JS, which rendering strategy to choose and how to test what Google sees.
- [LLM SEO: how to get found and cited by AI assistants](https://serpel.app/blog/llm-seo): LLM SEO makes your site easy for ChatGPT, Claude and Gemini to find and cite. Training data vs live retrieval, crawler access, llms.txt and how to measure.
- [llms.txt example: 3 complete files for docs, shops and blogs](https://serpel.app/blog/llms-txt-examples): Three complete llms.txt examples for a SaaS docs site, an online shop and a blog, plus the format rules, llms-full.txt and a validation script.
- [Next.js SEO: the App Router guide to metadata, sitemaps and rendering](https://serpel.app/blog/nextjs-seo): Next.js SEO best practices for the App Router: metadata, sitemaps, robots, JSON-LD, rendering and Core Web Vitals, with working code for Next.js 15 and 16.
- [SEO audit report example: Serpel’s own crawl of serpel.app](https://serpel.app/blog/seo-audit-report-example): An SEO audit report example from Serpel’s own crawl of serpel.app: score, issues by severity, Core Web Vitals, fixes and a format you can copy.
- [Soft 404 errors: what they are and how to fix them](https://serpel.app/blog/soft-404): What is a soft 404? How Google defines it, what causes soft 404 errors, how Search Console reports them and how to fix each case, plus how to detect them.