# Exclude Files From All Robots: User-agent: * Disallow: /assets/ Disallow: /cgi-bin/ # Optional sitemap URL: Sitemap: sitemap.xml # End robots.txt file