# robots.txt for Defence News Nexus (https://defencenewsnexus.in) User-agent: * Allow: / Allow: /posts/ Allow: /images/ Allow: /llms.txt Allow: /llms-full.txt Allow: /sitemap.xml Allow: /rss.xml # Allow AI Search & Indexing Crawlers User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: ClaudeBot Allow: / User-agent: PerplexityBot Allow: / User-agent: Google-Extended Allow: / User-agent: Applebot-Extended Allow: / User-agent: Bytespider Allow: / # Sitemap Index Location Sitemap: https://defencenewsnexus.in/sitemap.xml