# This file tells all spiders they can crawl all directories and files. User-agent: * Disallow: