infoalloggi-monorepo/apps/infoalloggi/public/robots.txt

11 lines
No EOL
216 B
Text

User-agent: *
Allow: /
Disallow: /api/
Disallow: /area-riservata/
Disallow: /login
Disallow: /servizio/
Disallow: /auth/
Disallow: /test
# Crawl delay (optional - adjust based on your server capacity)
Crawl-delay: 1