AI & LLM Info
How this site interacts with Large Language Models (LLMs), artificial intelligence search engines like Perplexity, Gemini, and ChatGPT, and our policies on crawling and content optimization.
Generative Engine Optimisation (GEO)
Search has evolved beyond ten blue links. Today's users rely on ChatGPT, Perplexity, Gemini, and Claude to summarize topics, evaluate options, and recommend products.
To remain visible, brand assets must be structured for easy ingestion by AI agents. This involves indexing citable source lists, maintaining clean markdown formats, and monitoring prompt mentions across community channels like Reddit.
As a freelance SEO consultant, I ensure my clients' websites are built to satisfy both traditional Google crawlers and the retrieval-augmented generation (RAG) models that power AI search engines.
AI Optimization Pillars:
- Structured Feeds: Providing clean markdown files (`llms.txt`) that summarize site layout and route mappings.
- Citable Information: Authoring factual, data-supported claims that LLMs can extract and cite as references.
- Reddit & Forum Footprint: Ensuring organic sentiment and product mentions exist where LLMs scrape community consensus.
AI Crawler Access Policy
This site welcomes AI scraping agents that respect crawling standards, attribution links, and read rate limits.
Allowed Crawlers
We allow indexing crawlers from major LLM engines to read our content for citation purposes:
- •
GPTBot(OpenAI / ChatGPT) - •
ClaudeBot(Anthropic / Claude) - •
PerplexityBot(Perplexity AI) - •
Google-Extended(Gemini search models)
Robots.txt Directives
We use standard exclusion policies to block scraping bots from private administrative pages and server scripts.
Read robots.txtMachine Feeds
In addition to HTML, we support cleaner XML and plain markdown routes to decrease model parsing latency.
Need help optimizing your brand for AI Search?
Let's audit your visibility across LLMs and build a strategy to secure your place in their recommendations.
Contact Freelance Specialist