[stephaniemcgrath]

Please can anyone explain me what is robots.txt file and its correct format?

[manson4ik]

Website owners use the robots.txt file to give instructions about their site to web robots.
It works likes this: a robot wants to visit URL, but before it does so, it first checks for http://www......../robots.txt,

you got it?

I guess it's called The Robots Exclusion Protocol, you can google it)

[Jenie0109]

It is a file you put on your site to tell search robots which pages you would like them not to visit.

[visual]

Robots.txt is a text (not html) file you put on your site to tell search robots which pages you would like them not to visit.

[Benivolent]

robots.txt instruct the crawler not to access the page...... its main tactic like index, follow, no index, nofollow...

[myndconsulting]

regarding its format..

The file itself is a simple text file, which can be created in Notepad. It need to be saved to the root directory of your site, that is the directory where your home page or index page is.