infoalloggi-monorepo/apps/infoalloggi/public/robots.txt

7 lines
No EOL
145 B
Text

User-agent: *
Allow: /
Disallow: /api/
Disallow: /area-riservata/
# Crawl delay (optional - adjust based on your server capacity)
Crawl-delay: 1