Family Magazine

Excluding URLs in Screaming Frog Crawl [2023]

By Geoff Griffiths @mmatraining1980

To exclude URLs just go to:

Configuration > Exclude (in the very top menu bar)

Excluding URLs in Screaming Frog Crawl [2023]

To exclude URLs within a specific folder, use the following regex:

^https://www.mydomain.com/customer/account/.*
^https://www.mycomain.com/checkout/cart/.*

The above regex, will stop Screaming Frog from Crawling the customer/account folder and the cart folder.


Back to Featured Articles on Logo Paperblog