User-agent: MJ12bot Disallow: / User-agent: BLEXBot Disallow: / User-agent: * Disallow: /hu/signup Disallow: /hu/login Disallow: /hu/dashboard Disallow: /hu/account Disallow: /hu/settings Disallow: /hu/contact Disallow: /hu/rating Disallow: /hu/notification Disallow: /hu/favorite Disallow: /hu/*contact$ Disallow: /hu/messages Disallow: /hu/premium-services?selected=* Disallow: /hu/premium-services/rentals Disallow: /hu/tenants/relevant Disallow: /en/signup Disallow: /en/login Disallow: /en/dashboard Disallow: /en/account Disallow: /en/settings Disallow: /en/contact Disallow: /en/rating Disallow: /en/notification Disallow: /en/favorite Disallow: /en/*contact$ Disallow: /en/messages Disallow: /en/premium-services?selected=* Disallow: /en/premium-services/rentals Disallow: /en/tenants/relevant Disallow: /api Disallow: /compiled Disallow: /media Disallow: /rest Disallow: /platform # AI/LLM crawlers (GPTBot, ChatGPT-User, ClaudeBot, anthropic-ai, PerplexityBot, # Google-Extended, CCBot, Applebot-Extended, Amazonbot, etc.) are intentionally # not blocked here - they fall under the "User-agent: *" group above and follow # the same rules. Do not add a blanket Disallow for them. Sitemap: https://www.rentingo.com/sitemap.xml