It has nice new touches such as ignoring SSL errors, and even the ability to check (one at a time) for presence of the URL on Google Search… So basically SEO Spider is now Linkbot Pro, albeit with the regrettable loss of that fab 1996 Windows UI feel. That’s done via Top Menu | Reports | Redirects | All Redirects. CSV out which you can then do what you want with. It appears you can’t make the font a touch bigger, but you can get a. You can also do things like have a Dark UI ( Config | User Interface | Theme | Dark).
Now sort the “Status” column by clicking once on it, so all the various status codes are grouped thus…Īnd save the project file for later reloading, or passing to a colleague for manual checking, as needed. Now, when you switch through to the Response Codes tab in future, you should see the arrangement of columns you just saved.ġ2. Top Menu | File Configuration | Save as Default. Just the one time, then save the current UI configuration as the Default.
Which in this case would be…Īddress | Status Code | Status | Redirect URLġ1. Then adjust the table’s columns so you only see the columns you need. This removes a whole lot of unwanted columns from the results table.ġ0. Now filter the results by the Response Codes tab. Load and then run the list, by pressing the “Start” button.ĩ. In that case it makes an exception for redirects.Ĩ. By default it is set to a zero depth for following links, except when Always Follow Redirects is on. This will enable you to load your list of Web URLs to be checked for viability. On the top menu bar, find the “Mode” item and use this to switch to List mode.
It’s the only link-checking software I found that can do this.ħ. Having this off enables the Chrome browser to still grab the status and redirect URL, even if it can’t otherwise access the website due to a squiffy SSL certificate. While you’re in that panel also ensure HSTS is off (otherwise you may get SSL security certificate errors). Top menu | Configuration | User Agent, as seen here…Ħ. Enable Always Follow Redirects in SEO Spider, so we have the required redirect details in the results.
To a web server, SEO Spider now looks like a normal Chrome browser.ĥ. This is apt as its main internal browser agent is actually Chrome, in the form of a headerless Chrome browser driven by SEO Spider. Top menu: Configuration | User Agent | Chrome. its internal Web browser) to emulate Chrome. Set Screaming Frog SEO Spider user-agent (i.e. Now whitelist SEO Spider in your Firewall, so the new software can access the Web…Ĭ:\Program Files (x86)\Screaming Frog SEO Spider\jre\bin\ javaw.exeĬ:\Program Files (x86)\Screaming Frog SEO Spider\ ScreamingFrogSEOSpider.exeĬ:\Program Files (x86)\Screaming Frog SEO Spider\ ScreamingFrogSEOSpiderCli.exeĤ. Turn off: Top menu | Help | ‘Auto Check for Updates’.ģ. Sobolsoft’s “Extract Data & Text From…” will extract without fuss from a saved HTML page and give you a one-per-line list, but there are also various bits of Windows freeware to do it.Ģ. Extract a plain-text list of Web URLs from your source page of bookmarks, or find the URL list you’ve already prepared and cleaned. Yes, it can be used in this way, and here’s a short tutorial for absolute beginners who wouldn’t know the difference between SEO and a sea-otter.ġ. Are they broken or moved, and if the latter then where are they now?
Can Screaming Frog SEO Spider be used as a Linkbot Pro replacement? SEO Spider is mature desktop PC software meant for SEO-focused webmasters that, in its free form will check 500 Web URLs at a time.