Screaming Frog

yeah so i'll be bringing along some of the tools that I've used for a long time.

So I think things like Screaming Frog, I'll carry on using it.

I know that they've got their CLI and their MCP now, so you can sort of execute things remotely.

So Screaming Frog, other tools I use periodically.

So Ahrefs, less for the technical SEO, but more for the link side of things.

Obviously, SEO stack, because we've built in, we've started to build in the technical aspects of that.

to quickly strip things out like internal link counts and things on pages.

But my core technical SEO tools will stay the same.

So if we're working with somebody and we're just basically doing a one-off project, for example, Maybe like a technical audit or a content audit.

You know, for one-off tasks like that, we can often do the bulk of the work just by using, you know, Screaming Frog with the Search Console MTP and a few other things set up.

And then we can go away and we've got our own process that we go through manually.

If it's a kind of like longer term client engagement, like for us, we've got our own suite of tools.

But before finishing, I want you to tell us about, let's say, testing Google Semantic Dev.

More specific, would you like to talk about the BotLocks content experiment you did, inspired also by Screaming Frog, if I'm not wrong? What this test revealed about Google algorithm and if Google really understand contextual dev or still over index source on surface level kind of home page or classic home page.

So what kind of conclusion, what was the purpose and what was, what were the conclusions you came out with?

Yeah, so the context is as follows.

Usually you have Capterra, G2, comparison websites, or in travel you have lots of them.

affiliates that compare destinations and then rank like hotels.

What Screaming Frog did and I basically copied was like, okay, they wanted to test how well their own website was ranked for alternative related queries.

So alternative to Screaming Frog.

Some of them do, some of them still work, but it's not that relevant anymore.

Then I used Ahrefs and Screaming Frog and some other tools to find... basically any mention of an SEO case study out there on the internet.

And it was like 30,000 documents or so.

After I found them, this is just like a really short overview of how I did it.

I don't know if log files will be any better, but it's worth a shot.

Now, the only tool I could find that had a good graphic user interface, so something that we're used to using and doesn't require command line based stuff and isn't too advanced was the Screaming Frog SEO Log File Analyzer.

So this analyzer is free for up to a thousand lines of data, or if you want to buy it, it's $139 us per year for the unlimited program.

I'm going to buy the program because I think it's going to be really interesting.

So if you want to nerd out a bit, check it out.

It is pretty fascinating.

And something like Scribbing Frog, SEO log file analyzer will make it graphically usable and not too intense.

I've looked at some of the other ones and I was like, ah, no, I don't want to get into that.

And the last video that I wanted to show you is how you can bring it all together in an audit.

So the tool that I use continuously is called Screaming Frog.

You can get a free version of it.

I have the paid version because I use it so much.

It also shows the current meta descriptions and how long they are as well.

I can pull H1s, I can pull H2s, I can pull so many different things.

But specifically, if you want to see your on-page SEO elements at scale, Screaming Frog is really the best tool that I've seen out there that makes it so easy to use.

On-site SEO makes a huge difference to your SEO.

So you really have to work piece by piece and you have to work with the pieces that are going to make the biggest splash first to get buy-in to continue to build trust across the organization before you can go for, I guess, the fruit at the top of the tree.

Have LLM tools, AI tools, Cloud, Cloud Code, ChatGPT being added to your stack given you extra leverage to be able to slice, dice, analyze, and find these technical issues faster? I mean, we've had Screaming Frog for two decades now.

So technically, the information has always been available to us.

kind of mostly analyze a lot of these technical SEO things.

But is there anything that's changed in your tech stack that's made that process, that analysis process, the visualization process of these things much easier?

It has helped a lot with organizing and acting as a second set of eyes.

Parsing through a screaming frog crawl can take some time.

You have to know what you're looking for.

One tool from this chapter's affordable tool stack, 60 seconds, no sponsorships ever.

This week, Screaming Frog.

Yeah, it's an app name.

Screaming Frog is a crawler.

Download and install it, point it at your site, and it follows every link the way a search engine does, and reports back every page it found with titles, links, and errors in a sortable list.

The free tier covers 500 addresses, which is more than most small organization sites will ever have.