Go Back   Web Design & SEO Company > SEO

SEO Search Engine Optimization, this section lists articles and tutorials on Search Engine Optimization for various Search Engines including Google, Yahoo & MSN. We provide SEO hints, tips and other free goodies to help you optimize your site and to start ranking well in the Search Engines.

Reply
 
  #1  
Old 11-23-2009, 12:56 PM
Banned
 
Join Date: Sep 2009
Posts: 13
Default what is the Robots.txt?

Hi everybody,


tell me about Robots.txt file?


Thanks
Reply With Quote
Top SEO Tool
Harvester and Mass Blog Commenter
Blog Comment Software

  #2  
Old 11-23-2009, 11:21 PM
Senior Member
 
Join Date: Jun 2009
Posts: 222
Default

The Robot Exclusion Standard, also known as the Robots Exclusion Protocol or robots.txt protocol, is a convention to prevent cooperating web spiders and other web robots from accessing all or part of a website which is otherwise publicly viewable..
Reply With Quote
  #3  
Old 11-24-2009, 06:49 AM
Junior Member
 
Join Date: Feb 2009
Posts: 8
Default

robots.txt is a text file which can be used to restrict web robots to accessing your web site only in ways of which you approve.


this link will help you http://www.robotstxt.org/
Reply With Quote
Top SEO Tool
Harvester and Mass Blog Commenter
Blog Comment Software

Reply

Tools
Display Modes

Similar Threads
Thread Thread Starter Forum Replies Last Post
What is the robots.txt file? chaynemcgrath SEO 5 10-12-2009 04:56 AM
robots.txt rubsync SEO 3 10-05-2009 05:59 AM
Blocking Bad Bots with Robots.txt Admin Knowledgebase 1 04-21-2008 02:17 AM
Robots txt file Admin Knowledgebase 0 04-04-2007 12:07 PM



Knowledgebase | SEO | Free Scripts | Free Wordpress Themes | Free Graphics

eval gzinflate base64 decode | SEO Addons


Forum time zone is GMT. Currently it's 04:23 AM.

SEO - Top



Web Design & SEO Forums