ONNET.EDU.

VN

Cch to v s dng file robots.txt.

File Robots.txt l g?
File robots.txt l mt dng file rt n gin c th c to bi cng c Notepad.
Bn to 1 file robots.txt vo t vo th mc root ca trang web
File Robots.txt c s dng hng dn cng c tm kim t ng n
nhng trang no m bn mun n tm kim v sau th index trang . Hu ht
trang web no cng c nhng th mc v files khng cn n robot ca cng c
tm kim gh thm. Do vy to ra file robots.txt c th gip bn trong SEO.
Cc User Agent ca Google
Google c vi user-agent chnh. Bn c th ngn chng bng cch thm tn ca
b tm kim tng ng v trong dng User-agent tng ng trong bng ghi
robots.txt. Nu bn chn Googlebot th c ngha l bn chn tt c cc b tm
kim vi t kha Googlebot.
-

Googlebot: nh ch s t cc ch mc c v mi ca Google.
Googlebot-Mobile: nh ch s cho cc thit b cm tay hoc di ng.
Googlebot-Image: nh ch s cc tp tin nh.
Mediapartners-Google: Xut hin trong cc trang dng qung co ca
Google Adsense.
Adsbot-Google: nh ch s cc trang c nh qung co s dng gii
thiu sn phm hay dch v thng qua Google Adwords. N cho php
nh gi cht lng ca trang dng dch v Adwords.

Cch s dng Google boot

Tc gi: Adam Thin - C vn: RichdadLoc Bn quyn 2013 ONNET

ONNET.EDU.VN

Nu bn s dng WordPress mt file robots.txt s c dng nh sau:

User-agent: *
Disallow: /wpDisallow: /feed/
Disallow: /trackback/
Trong :
User-agent:* c ngha l tt c nhng robot tm kim t Google, Yahoo v MSN
nn s dng hng dn ny ca bn tm kim trang web.
Disallow: /wp-: dng code ny bo cho cng c tm kim bit n khng nn lc
li nhng
file ca WordPress bt u bng wp-.
Nu bn khng s dng WordPress, bn ch vic thay th dng Disallow vi files
v folders m bn khng mun n dm ng,
v d:
User-agent: *
Disallow: /images/
Disallow: /cgi-bin/
T ng to robots.txt
Nu bn c s dng Google Webmaster th h cng cho php bn to robots.txt
hoc bn c th s dng Robots.txt Generator t ng to file robots.txt cho
mnh
Sau khi bn to xong file robots.txt ng qun save, bn ch vic upload ln
th mc gc l hon thnh.
Ri vy l bn hiu thm v file robot.txt phi khng no, khng qu kh khn
cng khng h phc tp. Chc bn thnh cng khi thc hnh phn ny.

Tc gi: Adam Thin - C vn: RichdadLoc Bn quyn 2013 ONNET