Family Magazine

Crawling a Specific Folder / Part of Website with Screaming Frog (2024)

By Geoff Griffiths @mmatraining1980

In normal crawl mode – add homepage URL to the main bar

In the top menu:

Click Configuration > Include and add folder with * at the end

E.g. to crawl just the cricket folder on a sports website add:

https://www.example.com/cricket*

Crawling a Specific Folder / Part of Website with Screaming Frog (2024)
Crawling a Specific Folder / Part of Website with Screaming Frog (2024)

Back to Featured Articles on Logo Paperblog