User-agent: Twitterbot Disallow: Disallow: /cgi-bin/ Sitemap: /sitemap.xml