Web Design & SEO Company

Web Design & SEO Company (http://www.tareeinternet.com/forum/)
-   SEO (http://www.tareeinternet.com/forum/seo/)
-   -   what is the Robots.txt? (http://www.tareeinternet.com/forum/seo/4676-what-robots-txt.html)

Danielnash 11-23-2009 12:56 PM

what is the Robots.txt?
Hi everybody,

tell me about Robots.txt file?


visual 11-23-2009 11:21 PM

The Robot Exclusion Standard, also known as the Robots Exclusion Protocol or robots.txt protocol, is a convention to prevent cooperating web spiders and other web robots from accessing all or part of a website which is otherwise publicly viewable..

newage123 11-24-2009 06:49 AM

robots.txt is a text file which can be used to restrict web robots to accessing your web site only in ways of which you approve.

this link will help you http://www.robotstxt.org/

Forum time zone is GMT. Currently it's 11:15 AM.

Powered by vBulletin® Version 3.8.6
Copyright ©2000 - 2022, Jelsoft Enterprises Ltd.