Go Back   Web Design & SEO Company > SEO

SEO Search Engine Optimization, this section lists articles and tutorials on Search Engine Optimization for various Search Engines including Google, Yahoo & MSN. We provide SEO hints, tips and other free goodies to help you optimize your site and to start ranking well in the Search Engines.

Reply
 
  #1  
Old 11-23-2009, 12:56 PM
Banned
 
Join Date: Sep 2009
Posts: 13
Default what is the Robots.txt?

Hi everybody,


tell me about Robots.txt file?


Thanks
Reply With Quote
Top SEO Tool
Harvester and Mass Blog Commenter
Blog Comment Software

  #2  
Old 11-23-2009, 11:21 PM
Senior Member
 
Join Date: Jun 2009
Posts: 222
Default

The Robot Exclusion Standard, also known as the Robots Exclusion Protocol or robots.txt protocol, is a convention to prevent cooperating web spiders and other web robots from accessing all or part of a website which is otherwise publicly viewable..
Reply With Quote
  #3  
Old 11-24-2009, 06:49 AM
Junior Member
 
Join Date: Feb 2009
Posts: 8
Default

robots.txt is a text file which can be used to restrict web robots to accessing your web site only in ways of which you approve.


this link will help you http://www.robotstxt.org/
Reply With Quote
Reply

Tools
Display Modes

Similar Threads
Thread Thread Starter Forum Replies Last Post
What is the robots.txt file? chaynemcgrath SEO 5 10-12-2009 04:56 AM
robots.txt rubsync SEO 3 10-05-2009 05:59 AM
Blocking Bad Bots with Robots.txt Admin Knowledgebase 1 04-21-2008 02:17 AM
Robots txt file Admin Knowledgebase 0 04-04-2007 12:07 PM



Knowledgebase | SEO | Free Scripts | Free Wordpress Themes | Free Graphics

eval gzinflate base64 decode | SEO Addons


Forum time zone is GMT. Currently it's 12:19 PM.

SEO - Top



Web Design & SEO Forums