[Adhitimishra23]

What is robot.txt file and what are the benefits of using it..?

[Brianvoges]

robot is the mechanical machine
Solar PCU

[Brianvoges]

In vascular plants, the root is the organ of a plant that typically lies below the surface of the soil. Roots can also be aerial or aerating, that is growing up above the ground or especially above water. Furthermore, a stem normally occurring below ground is not exceptional either (see rhizome). Therefore, the root is best defined as the non-leaf, non-nodes bearing parts of the plant's body. However, important internal structural differences between stems and roots exist

Maharaja Express

[Sandy Martin]

robots.txt does not prevent Google crawling those pages, it stops them being indexed. Your better off writing your own legal pages for seo purposes
Chique

[RH-Calvin]

Robots.txt is a text file that is inserted into the website to contain instructions for search engine robots. The text file contains lists of webpages that are allowed and disallowed from Google crawling.

[StelaBrown]

Use of Robots.txt - The most common usage of Robots.txt is to ban crawlers from visiting private folders or content that gives them no additional information.

Robots.txt Allowing Access to Specific Crawlers.
Allow everything apart from certain patterns of URLs.

[ashok5455]

Robots.txt files that help Google and other search engines are crawling and indexing your site. you can use for allowed and disallowed to crawling according to you.

[chatarpatar]

The purpose of a robots.txt file is to tell search engines not to crawl the contents of specific directories or even individual pages within a website. ... However there are a couple of reasons why all websites would benefit from having one. The first thing search engines look for is the robots.txt file.

==============

Food Franchise | Food franchise opportunity | Food Franchise India

[sharmaroshni]

A robots.txt file is a file at the root of your site that indicates those parts of your site you don’t want to be accessed by search engine crawlers. The file uses the Robots Exclusion Standard, which is a protocol with a small set of commands that can be used to indicate access to your site by section and by specific kinds of web crawlers (such as mobile crawlers vs desktop crawlers).

[royco]

Thanks to all of you whom shares this effective information for new users.