https://ironbullroof.com/robots.txt " # --------------------------- User-agent: * Disallow: Sitemap: https://ironbullroof.com/sitemap.xml # --------------------------- # LLM files Allow: /llms.txt Allow: /llms-full.txt # ------------------------------------------------------------ # AI retrieval bots - allowed for live answers, citations, and user-initiated shopping assistance # These agents may access public content, but must avoid private ecommerce paths. # ------------------------------------------------------------ User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: Claude-User User-agent: Claude-SearchBot User-agent: PerplexityBot User-agent: Perplexity-User User-agent: DuckAssistBot # ------------------------------------------------------------ # AI training crawlers - disallowed # Blocks broad model-training or dataset-collection access while keeping live AI retrieval available above. # ------------------------------------------------------------ User-agent: GPTBot User-agent: ClaudeBot User-agent: CCBot User-agent: Google-Extended User-agent: Applebot-Extended User-agent: Bytespider User-agent: Amazonbot User-agent: Meta-ExternalAgent User-agent: meta-externalagent User-agent: Meta-ExternalFetcher User-agent: meta-externalfetcher Disallow: / # --------------------------- "