RankActive LinkBot Description
What exactly does RankActive LinkBot do on my site?
RankActive LinkBot had been designed to analyze all the information on the Internet. We collect information about the popular content on the Internet, data about backlinks and other technical information. Every day we analyze billions of pages on more than 40 parameters. All information is stored on our secure servers.
If you notice that our crawler walks through your site, but you're against it - you can disable the scanning in the robots.txt file
How can I block RankActive LinkBot?
You can edit the robots.txt file and make the following changes:
You can also change the frequency of scanning of your website.
To do this, use the directive Crawl-Delay:
What is robots.txt?
More details about the robots.txt file can be found here: http://www.robotstxt.org/
WHY HASN’T THE ROBOTS.TXT BLOCK STOPPED THE SCANNING OF THE SITE?
The process of reindexing the robots.txt file can last up to 3 days. If you want to stop the scan immediately, just write us: firstname.lastname@example.org