KrystaBrody908
Numerous men and women think that by using a robots.txt file on their site they are protecting pages and folders from thieves and hackers. In fact it is absolutely the opposite! robots.txt opens up an enormous security hole that hackers and theives will use to easily acquire access to the parts of your site that you don't want them to.
What is robots.txt?
robots.txt is a file that you produce and up...
robots.txt is possibly the most miss understood file that a website can contain.
Many individuals believe that by making use of a robots.txt file on their site they are defending pages and folders from thieves and hackers. In truth it is entirely the opposite! robots.txt opens up an huge security hole that hackers and theives will use to simply get access to the parts of your internet site that you don't want them to.
What is robots.txt?
robots.txt is a file that you develop and upload to your internet sites root directory that is utilized by search engine spiders to figure out which parts of your web site they should index and which folders/pages that you, the web site owner,
do not want listed in search engine indexes.
Why would not want pages indexed?
There are several factors why you may not want search engines to index pages on your site, such as private membership pages or exclusive instruction pages and such like.
If you are an World wide web Marketer selling your personal ebook or other digital product, you wouldn't want your thank you pages indexed either!
And this is where the misunderstanding comes to the fore, and robots.txt becomes your foe.
Several on the internet marketers who offer ebooks or other digital items for instant download will list their download thank you pages in the robots.txt file since they certainly do not want those pages indexed in search engines.
By using robots.txt this way although, you will be opening up your product to any person who has a slight bit of information about how the file works.
robots.txt is simply readable by any human that opens a browser and types in and if you have listed your thank you pages, all they have to do is go to that url and take your item(s)!
It is that simple!
And I am living proof that this performs, as this is specifically what happened to me. I had listed my thank you pages in robots.txt and believed that they had been safe from hackers and thieves, then one day I was checking my web site stats and BAM, someone had been to each single thank you page, and taken every thing.
The moral is, don't list any URL in robots.txt that you don't want people to have free access to. Use robots.txt with great caution and safe your thank you pages making use of dedicated application. automatic baggers chat
