You don't want to get rid of it because it may be the place the bots are going.

This is really interesting because we're seeing an influx of traffic now.

These sites are getting more traffic than they have before and more of it's machine traffic.

And that can actually put your system under stress.

And so you might have this reaction of where let's stop the bots and make sure that we can serve the humans.

But it's more nuanced than that.

So you have to understand what are good bots and what are bad bots.

kind of in the second inning compared to the SEO world.