instal the new version for ios Screaming Frog SEO Spider 19.0

If you have over 49,999 urls the SEO spider will automatically create additional sitemap files and create a sitemap index file referencing the sitemap locations. We conform to the standards outlined in protocol.

Currently this feature is only for HTML pages, so it does not include images, videos etc (which we will be introducing at a later date).

XML Sitemaps – We have included the ability to create XML sitemaps in the SEO spider under the top level menu ‘export’ option.

This feature also allows you to significantly increase the speed of the SEO spider at the same time, which we just ask everyone uses responsibly :-). Hence, we have introduced a ‘speed’ feature which allows you to limit the number of threads or the number of URI requests per second.

We have had some requests for throttle control due to the SEO spider crawling too fast for some older servers. Crawl Speed Control – The ability to control the speed of the crawl is something we have wanted to release for a long time.

The following new features are included in the update – I am excited to announce an update to the Screaming Frog SEO spider, to version 1.80.

Instal the new version for ios Screaming Frog SEO Spider 19.0