SurfStats web site stats tour - Monitoring site spiders and robots
 
Click here to load the complete tour if you cannot see the menu on the left

If you start out on a web site you have to submit your web site to the search engines and wait...and wait...and wait. How do you know if the search engines are doing something to include your site in their database? The answer is simple: check your spider reports if they are visiting your site. What? No spider reports? Get another statistics package!

Even after being added to the search engines database you should still examine your spider reports periodically to see if the robots are still visiting your site and make sure that your complete site is spidered and not just a small portion (except if you only want them to spider a small portion).


Available spider and robot reports
The following spider reports are available in all versions of SurfStats and SurfStatsLive
Recent Spiders Report

 

Top Spiders Report

 

Top Spider Organizations

 

Top Spiders Countries

 

Top Spider Regions