User-agent: * Disallow: /api/ Disallow: /_next/ Disallow: /static/ Disallow: /server/ Disallow: /private/ Disallow: /admin/ Disallow: /dashboard/ Allow: /public/ Allow: /static/images/ # Allow Facebook's scraper User-agent: facebookexternalhit Allow: / # Allow WhatsApp's scraper User-agent: WhatsApp Allow: /