Tips For Speeding Up SEO SpyGlass Analysis

by Mike on September 13, 2012 · 6 comments

Anytime I’m asked about what my favorite SEO tools are, especially when it pertains to checking backlinks, SEO SpyGlass is always one of the first answers out of my mouth. The amount of data it can provide for you is unequaled among backlink checkers.

The one complaint people have about the tool is it can be slow to analyze a large set of backlinks. Truth be told, it can be a bit slow. It can also be a bit of a resource hog on your system. This can be especially frustrating if it freezes up towards the end of analyzing 10,000+ backlinks after a few hours.

However, one of its biggest assets is the fact that it pulls backlinks from a bunch of different backlink databases (including SpyGlass’s own database), and then it goes out and checks if the links are still present on each of those pages. None of the online backlink data providers do this. OSE, Ahrefs, and Majestic are only updated every few months.

This data is especially important when analyzing a site that has recently lost rankings. One of the biggest causes for a drop in rankings is often link degradation. In other words, a site is losing links faster than it is gaining them. Even though it may be slower to use than some other common backlink tools, this is why I stick by SpyGlass.

While you will never be able to make SpyGlass feel like a Ferrari, you can at least get it to move like a souped up V8 versus it feeling like a vintage Volkswagon Bug. I’ve played around with the settings a lot, and these are what I have found to work for me.

Under the preferences menu, select “Misc. Global Settings”. Your first option is the number of tasks you want SpyGlass to perform at once. It has a max of 25. If I am not doing anything else on my system at the time, I bump it up to 25. If I am working on other projects in the background while SpyGlass is running, I keep it between 15-20. You will need to play around with your system as to what works best for you based on your internet speed, CPU, RAM, etc. This might be the single biggest timesaver on SpyGlass though. If I remember correctly, out of the box it is set at 10. Even just bumping it up to 15 makes a huge difference in how fast SpyGlass completes tasks.

The other thing that I changed on my system is the “Request Timeout”. This was set at 30 or 45 seconds by default. I changed it to 1. This is the delay used if SpyGlass has any issues fetching data from 3rd party providers. That would be stuff like PR, Whois data, etc. I tested this lowering it a few seconds at a time to see if there would be any issues at any point. Got it the whole way down to 1, and have not had any issues. On occasion if I am not using proxies, I’ll see a temporary ban from Google for too many PR checks, but even that has been rare.

The result? Well, here is a sample I just ran while typing this. Full analysis of 1356 links in 5 minutes and 37 seconds. This was on 20 threads, not the max of 25. At 25, it probably would have been around 4 minutes.

One last tip you can use to speed up your use of SEO SpyGlass. Generally, you really do not need to analyze the links that no longer exist, right? So when you pull up the backlink factors to analyze, uncheck everything except the “Page Info” box under the “Internal Factors”.

When this completes, you will know which links are still linking back to the site you are analyzing. Select all of those links, ignoring the ones that no longer link to the site, and run the analysis again, this time including all of the backlink factors. This saves the time of pulling a bunch of unneeded data from pages where the links are no longer present. This is especially useful in the case of sites that have lost a lot of links.

I’m working on an analysis of a site for someone right now that recently lost rankings. SpyGlass pulled over 6200 links from the databases it accesses, but of those links only 1502 still exist. Why waste the time pulling data on the other 4700?

If you have ever been turned off in the past by SpyGlass being too slow, I encourage you to load it up again and try some of these tweaks to speedup its performance.

Share This Post!

{ 6 comments… read them below or add one }

Sean Fullerton September 25, 2012 at 10:29 am

Hi Mike,

I’m a huge SpyGlass fan as well, I can’t believe how rarely it gets mentioned among the backlink analysis tools. Value for money, the whole Powersuite package is the best around in my book. Thanks for the tips on speeding it up a little by the way, I’ll be trying those out in a bit.

Cheers, Sean

Reply

SEO REPUBLIC October 1, 2012 at 7:35 am

Thanks Mike for the useful information. I will try to use your comments to get all backlinks data for my clients, because I could not do it when web site has about 7000 backlinks.

Reply

Christmas Wish List October 15, 2012 at 4:59 pm

Hey Mike!

Reply

SEO Haven November 12, 2012 at 4:52 am

Mine kept getting frozen after analyzing about 4000 links, which is frustrating as hell (I’ve been trying all weekend). I’m going to try the Timeout set to 1 sec settings immediately. Also, thanks for the tip about checking the “Page info” part first, can’t believe I’ve never thought of that.

Anyway, great blog man, this is not the first time Google have sent me your way for some problem I had. Keep it up!

Kind regards,
Adam
SEO Haven Team

Reply

Mike November 12, 2012 at 1:34 pm

SpyGlass can be a bit of resource hog. I used to run it on a system with a lot less RAM than I have now. Two things you can do to try to limit the freezing. First, as I said in the article, find the links that are alive first by just running the ‘Page Info’ part and then delete the dead links. Second, close any other open projects in SpyGlass. And last, if you are still running into issues, run a 1000 or so at a time, save the project, then run the next batch. Then you are not losing any info.

Good luck.

Reply

Peter December 21, 2012 at 5:03 am

Great article says the guy who’s on hour 6 of what’s estimated to be an 18 hour analysis! Keep it up!

Reply

Leave a Comment

*