User-Agent: * Disallow: /admin.html User-Agent: * Disallow: /*.txt User-Agent: * Disallow: scripts/*.php