AI Bots — Who is Blocking and Why?

Are you considering blocking AI bots? Perhaps you think it's crazy but want to see who it is. Tom Capper digs into the robots.txt of major sites to reveal who is blocking AI bots.

Comments

Post a Comment

Popular posts from this blog

Enterprise Local SEO is Different: A Checklist, a Mindset

Image
Posted by MiriamEllis Image credit: Abraham Williams If you’re marketing big brands with hundreds or thousands of locations, are you certain you’re getting model-appropriate local SEO information from your favorite industry sources? Is your enterprise checking off not just technical basics, but hyperlocalized research to strengthen its entrance into new markets? Before I started working for Moz in in 2010, the bulk of my local SEO experience had been with small-to-medium business models. Naturally, the advice I was able to offer back then was limited by the scope of my work. But then came Moz Local, and the opportunity to learn more about the more complex needs of valued enterprise customers like Crate & Barrel with more than 170 locations, PAPYRUS with 400, or Bridgestone Corporation with 2000+. Now, when I’m thumbing through industry tips and tactics, I’m better able to identify when a recommended practice is stemming from an SMB mindset and falling short of enterprise rea...
Read more

How Your Local Business Can Be a Helper

Image
Posted by MiriamEllis “When I was a boy and I would see scary things in the news, my mother would say to me, ‘Look for the helpers. You will always find people who are helping.’ To this day, especially in times of disaster, I remember my mother's words, and I am always comforted by realizing that there are still so many helpers — so many caring people in this world.” — Fred Rogers This quote is one I find myself turning to frequently these days as a local SEO. It calls to mind my irreplaceable neighborhood grocer. On my last essential run to their store, they not only shared a stashed 4-pack of bath tissue with me, but also stocked their market with local distillery-produced hand sanitizer which I was warned will reek of bourbon, but will get the job done. When times are hard, finding helpers comes as such a relief. Even the smallest acts that a local business does to support physical and mental health can be events customers remember for years to come. While none of us gets ...
Read more