Go Back   Web Design & SEO Company > SEO

SEO Search Engine Optimization, this section lists articles and tutorials on Search Engine Optimization for various Search Engines including Google, Yahoo & MSN. We provide SEO hints, tips and other free goodies to help you optimize your site and to start ranking well in the Search Engines.

Old 11-23-2009, 12:56 PM
Join Date: Sep 2009
Posts: 13
Default what is the Robots.txt?

Hi everybody,

tell me about Robots.txt file?

Reply With Quote
Top SEO Tool
Harvester and Mass Blog Commenter
Blog Comment Software

Old 11-23-2009, 11:21 PM
Senior Member
Join Date: Jun 2009
Posts: 222

The Robot Exclusion Standard, also known as the Robots Exclusion Protocol or robots.txt protocol, is a convention to prevent cooperating web spiders and other web robots from accessing all or part of a website which is otherwise publicly viewable..
Reply With Quote
Old 11-24-2009, 06:49 AM
Junior Member
Join Date: Feb 2009
Posts: 8

robots.txt is a text file which can be used to restrict web robots to accessing your web site only in ways of which you approve.

this link will help you http://www.robotstxt.org/
Reply With Quote

Display Modes

Similar Threads
Thread Thread Starter Forum Replies Last Post
What is the robots.txt file? chaynemcgrath SEO 5 10-12-2009 04:56 AM
robots.txt rubsync SEO 3 10-05-2009 05:59 AM
Blocking Bad Bots with Robots.txt Admin Knowledgebase 1 04-21-2008 02:17 AM
Robots txt file Admin Knowledgebase 0 04-04-2007 12:07 PM

Knowledgebase | SEO | Free Scripts | Free Wordpress Themes | Free Graphics

eval gzinflate base64 decode | SEO Addons

Forum time zone is GMT. Currently it's 12:19 PM.

SEO - Top

Web Design & SEO Forums