Settings

You can modify the parameters of your website scanning by our crawler in the Settings section.

• Crawl delay in seconds — frequency of your website scanning. You can set a delay in seconds for our crawler. By default, the delay is 6-8 seconds.
• Depth limit — the parameter sets the allowable depth of scanning. Level 1 is all links from the main page; level 2 allows to scan all pages which have links from the first level and so on. By default, the depth is unlimited.
• Scanning start page — here you can specify the page from which our tool will start scanning your site. If the field is empty the scanning process will be started with the homepage.
• Custom Robots.txt — the parameter is added to facilitate your controlling of our crawler. You can allow or restrict a website scanning right in the Site Auditor settings section without setting up separate rules in your robots.txt file. Simply uncomment the necessary string in the area on the right.
• Robots Merge Mode — sets the behavior of our crawler towards your robots.txt file. By Override mode, our crawler ignores your robots.txt file. By Merge mode, our crawler follows both rules of your robots.txt file and the rules set up in the Custom Robots.txt area. In case if some of the rules are in conflict, the highest priority will have those rules which were set up in the Custom Robots.txt area.
• Settings for Spell Checking. In this area, you can manage the Spell Checking settings. To disable the Spell Checking mode simply remove the tick from the corresponding field. You can enable it anytime, just tick the field again. The Spelling Exceptions area displays the words that you’ve set as exceptions (Site Auditor won’t consider them as mistakes anymore). Plus, you can add new exception words in the area or delete any of the existing ones. The changes will be considered while the next scanning. Please note that all the set exceptions are applied only for the current project, not for the whole account.

When you finish setting up your project, click Save to apply changes.