|
SEO Search Engine Optimization, this section lists articles and tutorials on Search Engine Optimization for various Search Engines including Google, Yahoo & MSN. We provide SEO hints, tips and other free goodies to help you optimize your site and to start ranking well in the Search Engines. |
![]() |
|
#1
| |||
| |||
![]()
Hi everybody, tell me about Robots.txt file? Thanks |
![]() Blog Comment Software |
#2
| |||
| |||
![]()
The Robot Exclusion Standard, also known as the Robots Exclusion Protocol or robots.txt protocol, is a convention to prevent cooperating web spiders and other web robots from accessing all or part of a website which is otherwise publicly viewable..
|
#3
| |||
| |||
![]()
robots.txt is a text file which can be used to restrict web robots to accessing your web site only in ways of which you approve. this link will help you http://www.robotstxt.org/ |
![]() Blog Comment Software |
![]() |
Tools | |
Display Modes | |
![]() | ||||
Thread | Thread Starter | Forum | Replies | Last Post |
What is the robots.txt file? | chaynemcgrath | SEO | 5 | 10-12-2009 04:56 AM |
robots.txt | rubsync | SEO | 3 | 10-05-2009 05:59 AM |
Blocking Bad Bots with Robots.txt | Admin | Knowledgebase | 1 | 04-21-2008 02:17 AM |
Robots txt file | Admin | Knowledgebase | 0 | 04-04-2007 12:07 PM |