We’re delighted to announce that Screaming Frog SEO Spider version 20.0 is now available 🐸 Buckle up, it's a big one! https://lnkd.in/eYBZrZJE 🧙♂️ Custom JavaScript You’re now able to execute custom JavaScript while crawling. This means you’re able to manipulate pages or extract data, as well as communicate with APIs such as OpenAI’s ChatGPT, local LLMs, or other libraries. You can do things like: - Use AI to generate alt text for images. - Trigger mouseover events. - Scroll a page (to crawl some infinite scroll set ups). - Download and save various content locally (like images, or PDFs etc). - Sentiment, intent or language analysis of page content. - Connect to SEO tool APIs that are not already integrated, such as Sistrix. - And more! 🤖 Crawl with ChatGPT You can select the ‘(ChatGPT) Template’ snippet, open it up in the JavaScript editor, add your OpenAI API key, and adjust the prompt to query anything you like against a page while crawling! The possibilities are endless. Setup your own snippets, which will be saved in your own user library, and then export/import the library as JSON to share with colleagues and friends. 📱 Mobile Usability You are now able to audit mobile usability at scale via the Lighthouse integration. There’s a new Mobile tab with filters for common mobile usability issues such as viewport not set, tap target size, content not sized correctly, illegible font sizes and more. 🔑 N-grams Analysis You can now analyse phrase frequency using n-gram analysis across pages of a crawl, or aggregated across a selection of pages of a website. This analysis can help improve on-page alignment, identify gaps in keywords and also provide a new way to identify internal link opportunities. Using n-grams you’re able to highlight a section of a website and filter for keywords in ‘Body Text (Unlinked)’ to identify link opportunities. 🌳 Carbon Footprint The SEO Spider will now automatically calculate carbon emissions for each page using CO2.js library. Alongside the CO2 calculation there is a carbon rating for each URL, and new ‘High Carbon Rating’ opportunity under the ‘Validation’ tab. And lots more. Take a look at our release notes for a full list. Enjoy! #seo #technicalseo #seocrawler #ai #chatgpt #screamingfrog
May i ask, why my website unreadable with Screaming Frog tools? Please help, thank you
Hi, is your website under maintenance? It has not been accessed since 06 August. I just updated to the 20.0 version but it always failed when validating the license, then I see your web is down.
This is fantastic! I have always been a fan of Screaming Frog. I'm curious about using AI for alt text. Are you feeding reach image into GPTs API and if so is the token cost passed down to the user? I imagine for larger enterprise sites you could easily end up with thousands of images being sent for alt text. I can't wait to dive in and test these new features myself soon!
Custom JS, nice. I'll have to have a play with the SISTRIX API to see what can be combined in the crawl.
Hitting it out the park once again Screaming Frog - we're a big fan of this update! 🐸
I’ve been saying it for years, Screaming Frog is awesome, everything from the software to the support. Kudos again for this release!
Wow what an update 🤯 Can't wait to start testing it out. Feel like a kid in a candy store 🍫🍬🍭 Thank you SF team ♥️
Enterprise SEO Manager at Studiohawk | APAC Search Awards Finalist 2024
7moCan you please make it so we can update in app instead of redownloading - otherwise we need admin to install 😅