欢迎您访问程序员文章站本站旨在为大家提供分享程序员计算机编程知识!
您现在的位置是: 首页  >  php教程

缃戠珯鐨剅obots.txt鏂囦欢鎬庝箞鍐欙紵

程序员文章站 2022-05-01 08:49:28
...
robots.txt鏄竴涓崗璁紝鑰屼笉鏄竴涓懡浠ゃ€俽obots.txt鏄悳绱㈠紩鎿庝腑璁块棶缃戠珯鐨勬椂鍊欒鏌ョ湅鐨勭涓€涓枃浠躲€俽obots.txt鏂囦欢鍛婅瘔铚樿洓绋嬪簭鍦ㄦ湇鍔″櫒涓婁粈涔堟枃浠舵槸鍙互琚煡鐪嬬殑銆傚綋涓€涓悳绱㈣湗铔涜闂竴涓珯鐐规椂锛屽畠浼氶鍏堟鏌ヨ绔欑偣鏍圭洰褰曚笅鏄惁瀛樺湪robots.txt锛屽鏋滃瓨鍦紝鎼滅储鏈哄櫒浜哄氨浼氭寜鐓ц鏂囦欢涓殑鍐呭鏉ョ‘瀹氳闂殑鑼冨洿锛涘鏋滆鏂囦欢涓嶅瓨鍦紝鎵€鏈夌殑鎼滅储铚樿洓灏嗚兘澶熻闂綉绔欎笂鎵€鏈夋病鏈夎鍙d护淇濇姢鐨勯〉闈€傜櫨搴﹀畼鏂瑰缓璁紝浠呭綋鎮ㄧ殑缃戠珯鍖呭惈涓嶅笇鏈涜鎼滅储寮曟搸鏀跺綍鐨勫唴瀹规椂锛屾墠闇€瑕佷娇鐢╮obots.txt鏂囦欢銆傚鏋滄偍甯屾湜鎼滅储寮曟搸鏀跺綍缃戠珯涓婃墍鏈夊唴瀹癸紝璇峰嬁寤虹珛robots.txt鏂囦欢銆?鍏充簬robots.txt鏂囦欢鐨勫啓娉?鎴戜滑鏉ョ湅涓€涓媝hpcms鍐呭绠$悊绯荤粺鐨剅obots.txt鏂囦欢:

#
# robots.txt for PHPCMS v9
#
User-agent: * 杩欓噷鐨?浠h〃鐨勬墍鏈夌殑鎼滅储寮曟搸绉嶇被锛?鏄竴涓€氶厤绗?br/>Disallow: /caches/绂佹鐖缂撳瓨鐩綍涓嬬殑鎵€鏈夋枃浠?br/>Disallow: /phpcms/绂佹鐖phpcms鐨勬牳蹇冪洰褰曚笅鐨勭洰褰?br/>Disallow: /install/绂佹璁块棶瀹夎鍖呯洰褰曚笅鐨勭洰褰?br/>Disallow: /phpsso