Robots.txt??浠朵富瑕??????舵?翠釜绔??规??????褰?????绱㈠???璁块?????碉???Robots META??绛惧??涓昏?????瀵逛?涓?涓??蜂???椤甸???????朵???META??绛撅?濡?浣跨?ㄧ??璇?瑷???椤甸?㈢????杩般???抽??璇?绛?锛?涓??凤?Robots META??绛句????惧?ㄩ〉?㈢??<head></head>涓?锛?涓??ㄧ?ㄦ?ュ??璇???绱㈠???ROBOTS濡?浣?????璇ラ〉????瀹广??
?蜂???褰㈠?绫讳技锛?瑙?榛?浣??ㄥ??锛?锛?
<html>
<head>
<title>?朵唬?ラ??--缃?缁??ラ??涓?涓??ㄦ??lt;/title>
<meta name="Robots" content="index,follow">
<meta http-equiv="Content-Type" CONTENT="text/html; charset=gb2312">
<meta name="keywords" content="?ラ????">
<meta name="description" content="?朵唬?ラ??缃?????>
<link rel="stylesheet" href="/public/css.css" target="_blank" rel="external nofollow" type="text/css">
</head>
<body>
??
</body>
</html>
?
2??Robots META??绛剧????娉?锛?
Robots META??绛句腑娌℃??澶у???涔???锛?name=??Robots??琛ㄧず????????绱㈠???锛???浠ラ??瀵规??涓??蜂???绱㈠?????涓?ame=??BaiduSpider????content?ㄥ??????涓???浠ら??椤癸?index??noindex??follow??nofollow锛???浠ら?翠互??,????????
INDEX ??浠ゅ??璇???绱㈡?哄?ㄤ汉????璇ラ〉???
FOLLOW ??浠よ〃绀烘??绱㈡?哄?ㄤ汉??浠ユ部??璇ラ〉??????炬?ョ户缁?????涓??伙?
Robots Meta??绛剧??缂虹???兼??INDEX??FOLLOW锛?????inktomi?ゅ?锛?瀵逛?瀹?锛?缂虹???兼??INDEX,NOFOLLOW??
?
杩??凤?涓??辨????绉?缁???锛?
<META NAME="ROBOTS" CONTENT="INDEX,FOLLOW">
<META NAME="ROBOTS" CONTENT="NOINDEX,FOLLOW">
<META NAME="ROBOTS" CONTENT="INDEX,NOFOLLOW">
<META NAME="ROBOTS" CONTENT="NOINDEX,NOFOLLOW">
?
?朵腑
<META NAME="ROBOTS" CONTENT="INDEX,FOLLOW">??浠ュ????
<META NAME="ROBOTS" CONTENT="ALL">锛?
<META NAME="ROBOTS" CONTENT="NOINDEX,NOFOLLOW">??浠ュ????
<META NAME="ROBOTS" CONTENT="NONE">?
?
??瑕?娉ㄦ??????锛?涓?杩扮??robots.txt??Robots META??绛鹃???舵??绱㈠????哄?ㄤ汉锛?ROBOTS锛?????绔??瑰??瀹圭????娉?????涓?绉?瑙???锛???瑕???绱㈠????哄?ㄤ汉????????琛?锛?骞朵???姣?涓?ROBOTS?介?靛??????
?
???????ワ?缁?澶у??扮????绱㈠????哄?ㄤ汉?介?靛??robots.txt??瑙???锛???瀵逛?Robots META??绛撅???????????骞朵?澶?锛?浣???姝ｅ?ㄩ??娓?澧???锛?濡???????绱㈠???GOOGLE灏卞???ㄦ????锛???涓?GOOGLE杩?澧???浜?涓?涓???浠も??archive??锛???浠ラ????OOGLE???????缃?椤靛揩?с??渚?濡?锛?
<META?NAME="googlebot"?CONTENT="index,follow,noarchive">
琛ㄧず????璇ョ???逛腑椤甸?㈠苟娌跨??椤甸??腑?炬?ユ????锛?浣???涓???OOLGE涓?淇???璇ラ〉?㈢??缃?椤靛揩?? ?
![门户通专访草根站长九天狼：做站贵在坚持[图]](data:image/gif;base64,R0lGODlhAQABAIAAAP///wAAACwAAAAAAQABAAACAkQBADs=)