# robots.txt for https://www.osint4fun.eu/ User-agent: ia_archiver Disallow: / User-agent: * Disallow: /login/ Disallow: /register/ Disallow: /challenge/verify/ Allow: / Sitemap: https://www.osint4fun.eu/sitemap.xml