# For domain: http://www.whatsthatcode.com # All robots will spider the domain User-agent: * Disallow: User-agent: Googlebot Allow: /google_sm.xml # Disallow directory /includes/ User-agent: * Disallow: /maintenance/ Disallow: /flooddata/ Disallow: /images/