# # Allows all user agent robots to spider the entire domain (nothing disallowed). User-agent: * Disallow: