User-Agent: * Allow: / Disallow: /smarty_dir/ Disallow: /admin/ Disallow: /includes/ Disallow: /ajax/ User-Agent: Buiduspider Disallow: / User-Agent: Sogou web spider Disallow: /