User-agent: * Disallow: /php Disallow: /*.pdf$ Disallow: /*.doc$