On the recordRead 12 Oct 202617 facts
Crawly
Crawly · Chester, England
Plans and prices
Free
Free
Unlimited URLs per crawl
Read 22 Sep 2026 · getcrawly.com
Free forever
Free
Unlimited URLs · all features included · no trial period
Read 12 Oct 2026 · getcrawly.com
On the record
- API access
- Yesgetcrawly.com · read 22 Sep 2026
- Backlink analysis
- Yesgetcrawly.com · read 22 Sep 2026
- Company and location
- Crawly is built by Limely Ltd, a UK web agency, and the site says it was built in Chester, England.getcrawly.com · read 12 Oct 2026
- Crawl comparison
- It can compare two crawls and show added, removed and changed URLs, including changes to titles, H1s, status codes and indexability.getcrawly.com · read 12 Oct 2026
- Crawl controls
- The crawler supports configurable depth and page limits, robots.txt settings, user agent selection, list mode and up to 10 concurrent pages by default.getcrawly.com · read 12 Oct 2026
- Custom extraction
- Users can extract page text or attributes with CSS selectors and search raw HTML with regular expressions.getcrawly.com · read 12 Oct 2026
- Integrations
- Crawly includes an MCP server for Claude Code and the maker says it connects with Claude Code, Cursor and Codex via MCP.getcrawly.com · read 12 Oct 2026
- Intended users
- The maker describes Crawly as a free alternative for Mac teams and says it is built for professionals who need control over how their sites are crawled.getcrawly.com · read 12 Oct 2026
- Issue detection
- It automatically detects 19 SEO issue types, including broken pages, redirect chains, missing titles, duplicate H1s and mixed content.getcrawly.com · read 12 Oct 2026
- Local data
- Crawl data is stored locally in a SQLite database on the user's Mac; the about page says data never leaves the Mac.getcrawly.com · read 12 Oct 2026
- Platform requirements
- Crawly is a native Mac app for Apple Silicon and Intel and requires macOS 12 Monterey or later.getcrawly.com · read 12 Oct 2026
- Product
- Crawly is a native macOS SEO crawler for crawling and auditing websites.getcrawly.com · read 12 Oct 2026
- Security auditing
- Crawly audits pages for HSTS, Content-Security-Policy, X-Frame-Options, Referrer-Policy and X-Content-Type-Options headers.getcrawly.com · read 12 Oct 2026
- Site audit
- Yesgetcrawly.com · read 22 Sep 2026
- Support
- The maker directs users to its support page or GitHub issues for questions and feedback.getcrawly.com · read 12 Oct 2026