-
Screaming frog?
Does anyone use Screaming frog for site auditing? I really like it because the amount of technical detail about a website.
-
7 Replies
-
I really like the user agent texting which allows you to change the crawler between Google smartphone, desktop and many other options. Good way to check if your website is blocking any crawlers.
-
It also has the feature to see a graph with the internal linking and URL structure of a website. This is a really good feature to analyze the site structure.
-
Took me a long time until I realised it had a graph function but it’s been a game changer ever since!
-
-
-
I love that it can link to so many API’s which enhances the website data we can use for analysis
-
Agreed! This is a very helpful tool!
-
-
Yeah Screaming Frog is a fantastic tool I agree. So many times other programs I use struggle to crawl every page but Screaming Frog is able to do it, no problem!
-
Especially being able to crawl using the sitemap makes it handy to still be able to crawl websites even with nofollow tags or no robots.txt
-
Log in to reply.
