User-agent: * Disallow: *.doc Disallow: *.pdf Disallow: /send-form.php Disallow: /send-form2.php Disallow: /404.php Allow: /