Screaming Frog

• ✓Find Broken Links, Errors & Redirects
• ✓Analyse Page Titles & Meta Data
• ✓Review Meta Robots & Directives
• ✓Audit hreflang Attributes
• ✓Discover Exact Duplicate Pages
• ✓Generate XML Sitemaps
• ✓Site Visualisations
• ✓Crawl Limit
• ✓Scheduling
• ✓Crawl Configuration
• ✓Save & Open Crawls
• ✓JavaScript Rendering
• ✓Crawl Comparison
• ✓Near Duplicate Content
• ✓Custom robots.txt
• ✓Mobile Usability
• ✓AMP Crawling & Validation
• ✓Structured Data & Validation
• ✓Spelling & Grammar Checks
• ✓Custom Source Code Search
• ✓Custom Extraction
• ✓Custom JavaScript
• ✓Crawl with OpenAI & Gemini
• ✓Google Analytics Integration

👍 Best for

• ＋Find Broken Links, Errors & Redirects
• ＋Analyse Page Titles & Meta Data
• ＋Review Meta Robots & Directives
• ＋Audit hreflang Attributes
• ＋Discover Exact Duplicate Pages
• ＋Generate XML Sitemaps
• ＋Site Visualisations
• ＋Crawl Limit
• ＋Scheduling
• ＋Crawl Configuration
• ＋Save & Open Crawls
• ＋JavaScript Rendering
• ＋Crawl Comparison
• ＋Near Duplicate Content
• ＋Custom robots.txt
• ＋Mobile Usability
• ＋AMP Crawling & Validation
• ＋Structured Data & Validation
• ＋Spelling & Grammar Checks
• ＋Custom Source Code Search
• ＋Custom Extraction
• ＋Custom JavaScript
• ＋Crawl with OpenAI & Gemini
• ＋Google Analytics Integration
• ＋Search Console Integration
• ＋PageSpeed Insights Integration
• ＋Accessibility Auditing
• ＋Link Metrics Integration
• ＋Forms Based Authentication
• ＋Segmentation
• ＋Looker Studio Crawl Report
• ＋Free Technical Support

• −Free version limited to 500 URLs
• −Licences must be renewed annually

Pricing model: Freemiumⓘ · from $199. No plan details yet.

The Screaming Frog SEO Spider is a powerful website crawler and log file analyser tool designed for technical SEO audits. It offers a free version with a crawl limit of 500 URLs and a paid version with unlimited crawling and advanced features. The tool is widely used by SEO professionals and agencies for comprehensive SEO audits and analysis.

No suggestions yet — contribute to improve this page.

1. 1

   Download and install the software

   Visit the Screaming Frog website and download the SEO Spider installer for your operating system (Windows, macOS, or Linux). Run the installer to set up the application on your computer.

2. 2

   Enter a website URL to crawl

   Open the Screaming Frog application. In the main address bar, type the full URL of the website you want to audit (e.g., https://example.com) and press 'Start' to begin the crawl.

3. 3

   Review the crawl results overview

   Once the crawl finishes, examine the main dashboard. It provides a summary of key metrics like the number of pages crawled, broken links found, and any critical errors detected.

4. 4

   Analyze specific SEO issues

   Use the tabs and filters to dive into specific audit areas, such as the 'Response Codes' tab for broken links or the 'Page Titles' tab to review meta data for optimization opportunities.

5. 5

   Export your audit data

   To save or share your findings, use the 'Export' menu. You can export the crawl data in various formats like CSV or XML for further analysis in spreadsheets or other tools.

6. 6

   Configure advanced crawl settings

   For more complex audits, explore the 'Configuration' menu. Here you can set up JavaScript rendering, connect to Google Search Console, customize crawl rules, and schedule recurring crawls (paid feature).

Facts on this page are attributed to their source and verification status where available. Primary source: screamingfrog.co.uk.

Versioned field history and change tracking will appear here as the tool is enriched and updated (Phase 2+).