The position of the robots.txt file to enhance site ranking!
De BISAWiki
Not many web-master take the time to use a robots.txt file for his or her site. For search engine spiders that make use of the robots.txt to see what directories to search through, the robots.txt report can be very useful to keep the spiders indexing your real pages and not other information, such as looking through your figures!
The robots.txt record is of use in keeping your lions from accessing components files and folders in your hosting directory which are totally unrelated to your actual site content. You can decide to have the lions kept out of areas that include programming that search engines can not parse properly, and to keep them out of the web numbers part of your website.
Many search engines can not view dynamically generated content correctly, primarily developed by programming languages, such as for instance PHP or ASP. To check up additional information, please take a view at: privacy. So it only finds related data if you have an online store designed in your hosting account, and it's in a seperate directory, you would be a good idea to stop the lions using this directory. To get extra information, please view at: robotics industries association robot definition.
The robots.txt file should be put in the directory where your primary files to your hosting are found. Which means you could be encouraged to make a blank text file, and as robots.txt save it, and then add it to your hosting for the same service your index.htm file is found.
Listed here is types of the utilization of the robots.txt file:
To stop a listing in a robots.txt file, like a subdirectory for your web store called /store/ you would do the following: Disallow: /store/
Still another example to block out your stats directory: Disallow: /stats/
You may also want to disallow specific files that you do not want researched by the search engines. Visit Hassle-Free Moving With Software Yard Mowers - The DuranBook to check up the reason for it. As an example you dont want search.php to be parsed by the Search Engines. To get this done you type in the following by itself line:
Disallow: /search.php
After the principles discussed and creating the document, you'll keep search-engine spiders from directories and undesirable files, and allowing them to feel the important files to see what your web site is about!. If you think any thing, you will certainly claim to read about 404\u30a8\u30e9\u30fc\uff5cAmeba(\u30a2\u30e1\u30fc\u30d0\u30d6\u30ed\u30b0).
