查看文章 |
Block or remove pages using meta tagsRather than use a robots.txt file to block crawler access to pages, you can add a <META> tag to an HTML page to tell robots not to index the page. This standard is described at http://www.robotstxt.org/wc/exclusion.html#meta. To prevent all robots from indexing a page on your site, you'd place the following meta tag into the <HEAD> section of your page: <META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW"> To allow other robots to index the page on your site, preventing only Google's robots from indexing the page, you'd use the following tag: <META NAME="GOOGLEBOT" CONTENT="NOINDEX, NOFOLLOW"> To allow robots to index the page on your site but instruct them not to follow outgoing links, you'd use the following tag: <META NAME="ROBOTS" CONTENT="NOFOLLOW"> To allow robots to index the page on your site but instruct them not to index images on that page, you'd use the following tag: <META NAME="ROBOTS" CONTENT="NOIMAGEINDEX">
我做SEO有个原则，不写nofollow ，不写robot.txt。 因为很多方式可以达到效果，并且做的很好更安全。
|
