مولد قواعد زواحف الذكاء الاصطناعي

# AI crawler policy
# Review these rules with your legal and content teams before publishing.

# GPTBot: OpenAI training crawler
User-agent: GPTBot
Disallow: /

# OAI-SearchBot: OpenAI search crawler
User-agent: OAI-SearchBot
Allow: /

# ClaudeBot: Anthropic training crawler
User-agent: ClaudeBot
Disallow: /

# Claude-SearchBot: Anthropic search crawler
User-agent: Claude-SearchBot
Allow: /

# PerplexityBot: Perplexity search crawler
User-agent: PerplexityBot
Allow: /

# Google-Extended: Google Gemini training control
User-agent: Google-Extended
Disallow: /

# Bytespider: ByteDance AI crawler
User-agent: Bytespider
Disallow: /

User-agent: *
Allow: /

Sitemap: https://example.com/sitemap.xml

هذه الأداة تنشئ النص محليًا. robots.txt لا يفرض الحماية الأمنية؛ استخدم المصادقة أو جدار الحماية للمحتوى الحساس.