Bulk-Testing Structured Data Markup Using Screaming Frog

Custom Filters for Screaming Frog

I published a post yesterday on Moz.com about how to use Screaming Frog and Google’s Structured Data Testing Tool together. The concept allows us to test large sets of webpages for structured markup, such as the following:

You can read the full post here: Quick Guide to Scaling Your Authorship Testing with Screaming Frog

Here’s the YouTube video that describes the process:

Kane Jamison

Kane is the founder of Content Harmony, a content marketing platform that helps you build better content briefs. He's also the instructor for Content Marketing at the School of Visual Concepts in Seattle, and an industry speaker at events like Mozcon, EngagePDX, SMX Social, State of Search, LavaCon, Wordcamps, and more. You can find him on Twitter at @KaneJamison.

Comments (3)

  • I’ve set up a similar thing on SF but sadly Google is very good at spotting bot usage and, even when crawling as slowly as possible, is throwing captchas at me after about 7 – 8 URLs.

    The only way around this I can find it to change IP address using a VPN each time the crawler is ‘blocked’, which makes this a manual process that you need to watch over still.. I’m not done yet!

    • You’ll need to use a proxy service to fix this – probably one with built in rotation. It will be much easier than manually switching VPNs. Search “proxies screaming frog” and you should find a few services.

  • Nice article! When auditing websites, I often find improper use of structured markup that’s riddled with warnings and errors. I love using Google’s Structured Data Testing Tool to check and correct these issues, but unfortunately, Google is deprecating their tool in favor of the rich results tester, which isn’t as convenient because it only provides markup suggestions if the schema is eligible for rich results.

    I talk about this in my latest post, but outside of Google’s Structured Data Testing Tool, Merkle’s Schema Tester is my second favorite for making sure my schema markup is set up properly: https://brandonlazovic.com/best-structured-data-testing-tools-for-schema-markup

Leave a Reply

Your email address will not be published. Required fields are marked *

Get new content marketing tips via email:

Content Harmony

Sitemap | Privacy | Terms
© 2011-2019 Content Harmony®.