Screaming Frog - full logs

Complete saved log across all past runs (newest at the bottom).
storage/logs/www.screamingfrog.co.uk.log
Run13:24:09UTC
60pages audited
538found, not audited
6passed
1failed
2LLM calls · 3,600 tokens
Score71.4/100
Coverage: audited 60 of 598 page(s) discovered — 538 beyond the 60-page limit . Raise the limits on this site to widen coverage. Full URL list is in the log below.
===== audit started 13:24:09 UTC =====
13:24:09  Queued audit for www.screamingfrog.co.uk
13:24:09  Starting audit of https://www.screamingfrog.co.uk (engine: crawl4ai)
13:24:09  robots.txt blocks the site root - auto-proceeding without it (misconfigured or bot-hostile robots.txt)
===== audit started 13:24:09 UTC =====
13:24:09  Queued audit for www.screamingfrog.co.uk
13:24:09  Starting audit of https://www.screamingfrog.co.uk (engine: crawl4ai)
13:24:09  robots.txt blocks the site root - auto-proceeding without it (misconfigured or bot-hostile robots.txt)
13:24:12  Discovery via sitemap (max 60 pages, depth 3)
13:24:12  [1/60] fetching https://www.screamingfrog.co.uk/
13:24:20  [2/60] fetching https://www.screamingfrog.co.uk/about/
13:24:21  Discovery via sitemap (max 60 pages, depth 3)
13:24:21  [1/60] fetching https://www.screamingfrog.co.uk/
13:24:22  [3/60] fetching https://www.screamingfrog.co.uk/search-engine-optimisation/
13:24:35  [2/60] fetching https://www.screamingfrog.co.uk/about/
13:24:36  [3/60] fetching https://www.screamingfrog.co.uk/search-engine-optimisation/
13:24:38  [4/60] fetching https://www.screamingfrog.co.uk/contact-us/
13:24:39  [5/60] fetching https://www.screamingfrog.co.uk/seo-spider/tutorials/
13:24:42  [6/60] fetching https://www.screamingfrog.co.uk/clients/
13:24:44  [7/60] fetching https://www.screamingfrog.co.uk/digital-pr/
13:24:48  [4/60] fetching https://www.screamingfrog.co.uk/contact-us/
13:24:49  [5/60] fetching https://www.screamingfrog.co.uk/seo-spider/tutorials/
13:24:51  [6/60] fetching https://www.screamingfrog.co.uk/clients/
13:24:53  [7/60] fetching https://www.screamingfrog.co.uk/digital-pr/
13:24:56  [8/60] fetching https://www.screamingfrog.co.uk/digital-pr-calm-among-headlines/
13:25:02  [8/60] fetching https://www.screamingfrog.co.uk/digital-pr-calm-among-headlines/
13:25:05  [9/60] fetching https://www.screamingfrog.co.uk/login/
13:25:07  [10/60] fetching https://www.screamingfrog.co.uk/blog/
13:25:09  [11/60] fetching https://www.screamingfrog.co.uk/seo-spider/support/
13:25:10  [12/60] fetching https://www.screamingfrog.co.uk/seo-spider/licence/
13:25:13  [13/60] fetching https://www.screamingfrog.co.uk/copywriting/
13:25:15  [14/60] fetching https://www.screamingfrog.co.uk/log-file-analyser-6-0/
13:25:17  [9/60] fetching https://www.screamingfrog.co.uk/login/
13:25:17  [15/60] fetching https://www.screamingfrog.co.uk/pay-per-click/
13:25:20  [16/60] fetching https://www.screamingfrog.co.uk/search-engine-marketing/
13:25:21  [10/60] fetching https://www.screamingfrog.co.uk/blog/
13:25:22  [17/60] fetching https://www.screamingfrog.co.uk/brightonseo-san-diego-23/
13:25:24  [11/60] fetching https://www.screamingfrog.co.uk/seo-spider/support/
13:25:26  [18/60] fetching https://www.screamingfrog.co.uk/seo-spider/tutorials/broken-link-checker/
13:25:28  [12/60] fetching https://www.screamingfrog.co.uk/seo-spider/licence/
13:25:30  [19/60] fetching https://www.screamingfrog.co.uk/maintaining-productivity/
13:25:31  [13/60] fetching https://www.screamingfrog.co.uk/copywriting/
13:25:33  [20/60] fetching https://www.screamingfrog.co.uk/privacy/
13:25:34  [14/60] fetching https://www.screamingfrog.co.uk/log-file-analyser-6-0/
13:25:34  [21/60] fetching https://www.screamingfrog.co.uk/seo-spider/tutorials/xml-sitemap-generator/
13:25:37  [15/60] fetching https://www.screamingfrog.co.uk/pay-per-click/
13:25:38  [22/60] fetching https://www.screamingfrog.co.uk/log-file-analyser/faq/
13:25:39  [16/60] fetching https://www.screamingfrog.co.uk/search-engine-marketing/
13:25:41  [23/60] fetching https://www.screamingfrog.co.uk/content-marketing/
13:25:42  [17/60] fetching https://www.screamingfrog.co.uk/brightonseo-san-diego-23/
13:25:44  [24/60] fetching https://www.screamingfrog.co.uk/seo-spider/tutorials/web-scraping/
13:25:45  [18/60] fetching https://www.screamingfrog.co.uk/seo-spider/tutorials/broken-link-checker/
13:25:46  [25/60] fetching https://www.screamingfrog.co.uk/learn-seo/
13:25:47  [19/60] fetching https://www.screamingfrog.co.uk/maintaining-productivity/
13:25:50  [26/60] fetching https://www.screamingfrog.co.uk/services/
13:25:51  [20/60] fetching https://www.screamingfrog.co.uk/privacy/
13:25:52  [27/60] fetching https://www.screamingfrog.co.uk/log-file-analyser/
13:25:53  [21/60] fetching https://www.screamingfrog.co.uk/seo-spider/tutorials/xml-sitemap-generator/
13:25:55  [28/60] fetching https://www.screamingfrog.co.uk/seo-spider/user-guide/
13:25:55  [22/60] fetching https://www.screamingfrog.co.uk/log-file-analyser/faq/
13:25:58  [29/60] fetching https://www.screamingfrog.co.uk/how-to-use-screaming-frog-visualisations/
13:26:00  [23/60] fetching https://www.screamingfrog.co.uk/content-marketing/
13:26:00  [30/60] fetching https://www.screamingfrog.co.uk/log-file-analyser/licence/
13:26:03  [24/60] fetching https://www.screamingfrog.co.uk/seo-spider/tutorials/web-scraping/
13:26:03  [31/60] fetching https://www.screamingfrog.co.uk/conversion-rate-optimisation/
13:26:05  [25/60] fetching https://www.screamingfrog.co.uk/learn-seo/
13:26:06  [32/60] fetching https://www.screamingfrog.co.uk/design-feedback-loop/
13:26:08  [26/60] fetching https://www.screamingfrog.co.uk/services/
13:26:08  [33/60] fetching https://www.screamingfrog.co.uk/seo-spider/issues/
13:26:11  [27/60] fetching https://www.screamingfrog.co.uk/log-file-analyser/
13:26:12  [34/60] fetching https://www.screamingfrog.co.uk/careers/
13:26:13  [28/60] fetching https://www.screamingfrog.co.uk/seo-spider/user-guide/
13:26:15  [35/60] fetching https://www.screamingfrog.co.uk/social-media/
13:26:17  [36/60] fetching https://www.screamingfrog.co.uk/seo-spider/
13:26:17  [29/60] fetching https://www.screamingfrog.co.uk/how-to-use-screaming-frog-visualisations/
13:26:19  [37/60] fetching https://www.screamingfrog.co.uk/reactive-pr/
13:26:20  [30/60] fetching https://www.screamingfrog.co.uk/log-file-analyser/licence/
13:26:23  [38/60] fetching https://www.screamingfrog.co.uk/adwords-history/
13:26:23  [31/60] fetching https://www.screamingfrog.co.uk/conversion-rate-optimisation/
13:26:26  [39/60] fetching https://www.screamingfrog.co.uk/link-building/
13:26:26  [32/60] fetching https://www.screamingfrog.co.uk/design-feedback-loop/
13:26:28  [40/60] fetching https://www.screamingfrog.co.uk/seo-spider/faq/
13:26:29  [33/60] fetching https://www.screamingfrog.co.uk/seo-spider/issues/
13:26:32  [41/60] fetching https://www.screamingfrog.co.uk/meet-the-team/
13:26:33  [34/60] fetching https://www.screamingfrog.co.uk/careers/
13:26:36  [42/60] fetching https://www.screamingfrog.co.uk/analytics-consultancy/
13:26:36  [35/60] fetching https://www.screamingfrog.co.uk/social-media/
13:26:37  [43/60] fetching https://www.screamingfrog.co.uk/technical-seo/
13:26:37  [36/60] fetching https://www.screamingfrog.co.uk/seo-spider/
13:26:41  [44/60] fetching https://www.screamingfrog.co.uk/seo-spider/pricing/
13:26:42  [37/60] fetching https://www.screamingfrog.co.uk/reactive-pr/
13:26:44  [45/60] fetching https://www.screamingfrog.co.uk/log-file-analyser/support/
13:26:45  [38/60] fetching https://www.screamingfrog.co.uk/adwords-history/
13:26:47  [46/60] fetching https://www.screamingfrog.co.uk/copywriting-chatgpt-prompts/
13:26:48  [39/60] fetching https://www.screamingfrog.co.uk/link-building/
13:26:51  [47/60] fetching https://www.screamingfrog.co.uk/screaming-frog-scores-two-uk-search-awards/
13:26:51  [40/60] fetching https://www.screamingfrog.co.uk/seo-spider/faq/
13:26:55  [41/60] fetching https://www.screamingfrog.co.uk/meet-the-team/
13:26:55  [48/60] fetching https://www.screamingfrog.co.uk/our-work/
13:26:56  [42/60] fetching https://www.screamingfrog.co.uk/analytics-consultancy/
13:26:57  [49/60] fetching https://www.screamingfrog.co.uk/brighton-seo-san-diego/
13:26:58  [43/60] fetching https://www.screamingfrog.co.uk/technical-seo/
13:26:59  [50/60] fetching https://www.screamingfrog.co.uk/log-file-analyser/pricing/
13:27:00  [44/60] fetching https://www.screamingfrog.co.uk/seo-spider/pricing/
13:27:02  [51/60] fetching https://www.screamingfrog.co.uk/mastering-seo-audits/
13:27:04  [45/60] fetching https://www.screamingfrog.co.uk/log-file-analyser/support/
13:27:06  [52/60] fetching https://www.screamingfrog.co.uk/our-story/
13:27:08  [53/60] fetching https://www.screamingfrog.co.uk/log-file-analyser/tutorials/
13:27:08  [46/60] fetching https://www.screamingfrog.co.uk/copywriting-chatgpt-prompts/
13:27:12  [54/60] fetching https://www.screamingfrog.co.uk/log-file-analyser/user-guide/
13:27:12  [47/60] fetching https://www.screamingfrog.co.uk/screaming-frog-scores-two-uk-search-awards/
13:27:13  [55/60] fetching https://www.screamingfrog.co.uk/our-work/insuremytrip/
13:27:16  [56/60] fetching https://www.screamingfrog.co.uk/our-work/moneybarn/
13:27:16  [48/60] fetching https://www.screamingfrog.co.uk/our-work/
13:27:18  [57/60] fetching https://www.screamingfrog.co.uk/our-work/stasher/
13:27:19  [49/60] fetching https://www.screamingfrog.co.uk/brighton-seo-san-diego/
13:27:22  [58/60] fetching https://www.screamingfrog.co.uk/seo-spider/tutorials/how-to-audit-core-web-vitals/
13:27:22  [50/60] fetching https://www.screamingfrog.co.uk/log-file-analyser/pricing/
13:27:24  [59/60] fetching https://www.screamingfrog.co.uk/seo-spider/tutorials/how-to-audit-validate-amp/
13:27:25  [51/60] fetching https://www.screamingfrog.co.uk/mastering-seo-audits/
13:27:27  [52/60] fetching https://www.screamingfrog.co.uk/our-story/
13:27:27  [60/60] fetching https://www.screamingfrog.co.uk/ai-search-optimisation
13:27:30  [53/60] fetching https://www.screamingfrog.co.uk/log-file-analyser/tutorials/
13:27:30  Crawl finished: 60 pages (60 ok)
13:27:30  Reached the 60-page limit — 538 discovered page(s) NOT validated (raise max pages to include them): https://www.screamingfrog.co.uk/blog/22-ways-to-analyse-log-files, https://www.screamingfrog.co.uk/blog/author/aaron-rackham, https://www.screamingfrog.co.uk/blog/author/danny-sturrock, https://www.screamingfrog.co.uk/blog/author/emina-demiri-watson, https://www.screamingfrog.co.uk/blog/author/georgina-radford, https://www.screamingfrog.co.uk/blog/author/jack-e-prouse, https://www.screamingfrog.co.uk/blog/author/lydia-essex, https://www.screamingfrog.co.uk/blog/author/markporter, https://www.screamingfrog.co.uk/blog/author/nikki-halliwell, https://www.screamingfrog.co.uk/blog/author/oliver-m-holmes, https://www.screamingfrog.co.uk/blog/author/screamingfrog, https://www.screamingfrog.co.uk/blog/author/steph-hugman, https://www.screamingfrog.co.uk/blog/automating-xml-sitemaps, https://www.screamingfrog.co.uk/blog/best-practices-for-on-site-campaign-content, https://www.screamingfrog.co.uk/blog/brighton-seo-san-diego, https://www.screamingfrog.co.uk/blog/brightonseo-san-diego-23, https://www.screamingfrog.co.uk/blog/category/ai, https://www.screamingfrog.co.uk/blog/category/blog, https://www.screamingfrog.co.uk/blog/category/business, https://www.screamingfrog.co.uk/blog/category/content (+518 more)
13:27:30  Running 11 rules through the deterministic gate
13:27:30  Deterministic checks: 6 passed, 1 failed, 4 deferred to LLM
13:27:30  Evaluating interpretive rules via Groq...
13:27:32  [54/60] fetching https://www.screamingfrog.co.uk/log-file-analyser/user-guide/
13:27:34  [55/60] fetching https://www.screamingfrog.co.uk/our-work/insuremytrip/
13:27:37  [56/60] fetching https://www.screamingfrog.co.uk/our-work/moneybarn/
13:27:39  [57/60] fetching https://www.screamingfrog.co.uk/our-work/stasher/
13:27:41  [58/60] fetching https://www.screamingfrog.co.uk/seo-spider/tutorials/how-to-audit-core-web-vitals/
13:27:43  [59/60] fetching https://www.screamingfrog.co.uk/seo-spider/tutorials/how-to-audit-validate-amp/
13:27:45  [60/60] fetching https://www.screamingfrog.co.uk/ai-search-optimisation
13:27:47  Crawl finished: 60 pages (60 ok)
13:27:47  Reached the 60-page limit — 538 discovered page(s) NOT validated (raise max pages to include them): https://www.screamingfrog.co.uk/blog/22-ways-to-analyse-log-files, https://www.screamingfrog.co.uk/blog/author/aaron-rackham, https://www.screamingfrog.co.uk/blog/author/danny-sturrock, https://www.screamingfrog.co.uk/blog/author/emina-demiri-watson, https://www.screamingfrog.co.uk/blog/author/georgina-radford, https://www.screamingfrog.co.uk/blog/author/jack-e-prouse, https://www.screamingfrog.co.uk/blog/author/lydia-essex, https://www.screamingfrog.co.uk/blog/author/markporter, https://www.screamingfrog.co.uk/blog/author/nikki-halliwell, https://www.screamingfrog.co.uk/blog/author/oliver-m-holmes, https://www.screamingfrog.co.uk/blog/author/screamingfrog, https://www.screamingfrog.co.uk/blog/author/steph-hugman, https://www.screamingfrog.co.uk/blog/automating-xml-sitemaps, https://www.screamingfrog.co.uk/blog/best-practices-for-on-site-campaign-content, https://www.screamingfrog.co.uk/blog/brighton-seo-san-diego, https://www.screamingfrog.co.uk/blog/brightonseo-san-diego-23, https://www.screamingfrog.co.uk/blog/category/ai, https://www.screamingfrog.co.uk/blog/category/blog, https://www.screamingfrog.co.uk/blog/category/business, https://www.screamingfrog.co.uk/blog/category/content (+518 more)
13:27:47  Running 11 rules through the deterministic gate
13:27:47  Deterministic checks: 6 passed, 1 failed, 4 deferred to LLM
13:27:47  Evaluating interpretive rules via Groq...
13:28:09  Groq: 2 call(s), 3600 token(s)
13:28:09  Compliance score: 71.4/100
13:28:09  Audit complete
13:28:23  Groq: 2 call(s), 3595 token(s)
13:28:23  Compliance score: 85.7/100
13:28:23  Audit complete