# Proxy Archive — keep crawlers off combinatorial filter URLs. # (Query-string Disallow is best-effort; nginx rate limits are the real defense.) User-agent: * Disallow: /api/ Disallow: /checkout Disallow: /return Allow: / User-agent: GPTBot Disallow: / User-agent: CCBot Disallow: / User-agent: anthropic-ai Disallow: / User-agent: Bytespider Disallow: /