|
楼主 |
发表于 2011-10-4 19:04:00
|
显示全部楼层
IP:重庆
robots.
* \- @# e& e) `( ~& @0 G#Google Search Engine Robot! Z, f# V1 S6 s
User-agent: Googlebot/ f' X6 i1 ?/ R2 P
# Crawl-delay: 10 — Googlebot ignores crawl-delay ftl
% l0 h! y6 f$ Y& L \Allow: /*?*
# Y, ?8 r! @8 o" h5 Z2 sDisallow: /*?
. V: g3 H9 W$ ~* ]- z( iDisallow: /*/ |
|