Go Back   Web Design & SEO Company > SEO

SEO Search Engine Optimization, this section lists articles and tutorials on Search Engine Optimization for various Search Engines including Google, Yahoo & MSN. We provide SEO hints, tips and other free goodies to help you optimize your site and to start ranking well in the Search Engines.

Old 11-23-2009, 12:56 PM
Join Date: Sep 2009
Posts: 13
Default what is the Robots.txt?

Hi everybody,

tell me about Robots.txt file?

Reply With Quote
Top SEO Tool
Harvester and Mass Blog Commenter
Blog Comment Software

Old 11-23-2009, 11:21 PM
Senior Member
Join Date: Jun 2009
Posts: 222

The Robot Exclusion Standard, also known as the Robots Exclusion Protocol or robots.txt protocol, is a convention to prevent cooperating web spiders and other web robots from accessing all or part of a website which is otherwise publicly viewable..
Reply With Quote
Old 11-24-2009, 06:49 AM
Junior Member
Join Date: Feb 2009
Posts: 8

robots.txt is a text file which can be used to restrict web robots to accessing your web site only in ways of which you approve.

this link will help you http://www.robotstxt.org/
Reply With Quote
Top SEO Tool
Harvester and Mass Blog Commenter
Blog Comment Software


Display Modes

Similar Threads
Thread Thread Starter Forum Replies Last Post
What is the robots.txt file? chaynemcgrath SEO 5 10-12-2009 04:56 AM
robots.txt rubsync SEO 3 10-05-2009 05:59 AM
Blocking Bad Bots with Robots.txt Admin Knowledgebase 1 04-21-2008 02:17 AM
Robots txt file Admin Knowledgebase 0 04-04-2007 12:07 PM

Knowledgebase | SEO | Free Scripts | Free Wordpress Themes | Free Graphics

eval gzinflate base64 decode | SEO Addons

Forum time zone is GMT. Currently it's 08:44 PM.

SEO - Top

Web Design & SEO Forums