- Home
- SEO Log File Analysis Tools
- Patrick Stox Log File Analyzer
Patrick Stox Log File Analyzer
What it is
Patrick Stox Log File Analyzer is a free web tool for examining server access logs and crawler activity. It can report crawl-budget use and waste, compare AI and search crawler traffic, and help investigate possible bot impersonation. The tool recognizes nginx, Apache, IIS/W3C Extended, and JSON logs, including Cloudflare Logpush. Parsing takes place in the browser, and pasted or uploaded logs are not sent to the server. Reports break down crawl budget by bot and section, show crawler activity by page type, identify wasted URLs, and provide daily trends when timestamps are present. Users can supply a sitemap or expected URL list for comparison with crawler requests. Ranked recommendations, copy-ready robots.txt lines, and CSV exports for bots and wasted URLs are also available. Crawler checks compare request IPs with operators’ published ranges; those without checkable ranges are marked unverifiable. An optional suspicious-IP check sends one IP to a verifier API for reverse-DNS and ASN lookup. The tool analyzes only requests found in the logs; it does not report indexing outcomes or explain why a crawler selected a URL.
For and against
For
- Recognizes nginx, Apache, IIS, and JSON logs.
- Log parsing runs in the browser.
- Reports wasted URLs and crawler activity by page type.
- Exports bot and wasted-URL data as CSV.
Against
- Only analyzes requests present in the logs.
- Does not report indexing outcomes.
- IP-range matching can miss impostors using genuine crawler IPs.
- Some crawlers cannot be verified by published ranges.
The verdict
The analyzer turns access logs into crawler and crawl-budget reports, with exports and recommendations. Its findings are limited to logged requests, and range-based verification cannot resolve every crawler identity.
Who it suits
This tool suits people measuring crawler activity, finding crawl-budget waste, comparing crawler traffic, or investigating possible bot spoofing. It is useful when the relevant requests appear in server logs.
Plans and prices
Free
No signup · multiple files · large logs stream in chunks
Read 4 Oct 2026 · patrickstox.com
On the record
- Audience and use cases
- The maker describes use cases including measuring crawler activity, finding crawl-budget waste, comparing AI and search crawlers, and investigating possible bot spoofing.patrickstox.com · read 4 Oct 2026
- Crawler verification
- It compares request IPs with crawler operators’ published ranges and marks crawlers without checkable ranges as unverifiable.patrickstox.com · read 4 Oct 2026
- Expected URL comparison
- Users can supply a sitemap or expected URL list to compare against crawler requests.patrickstox.com · read 4 Oct 2026
- Limits
- It can only analyze requests present in the log and does not report indexing outcomes or explain why a crawler selected a URL.patrickstox.com · read 4 Oct 2026
- Local processing
- Log parsing runs in the browser, and pasted or uploaded logs are not sent to the server.patrickstox.com · read 4 Oct 2026
- Log formats
- It auto-detects nginx, Apache, IIS/W3C Extended, and JSON logs including Cloudflare Logpush.patrickstox.com · read 4 Oct 2026
- Optional network check
- The optional suspicious-IP spot-check sends a single IP to the verifier API for reverse-DNS and ASN lookup.patrickstox.com · read 4 Oct 2026
- Privacy detail
- Anonymous run-level outcome counters may be used for aggregate research, with no URLs, domains, IPs, or identifiers included and no statistic released below 100 runs.patrickstox.com · read 4 Oct 2026
- Purpose
- Analyzes server access logs to show crawler activity, crawl-budget waste, AI crawler traffic, and likely crawler impersonators.patrickstox.com · read 4 Oct 2026
- Recommendations and export
- It provides ranked recommendations with copy-paste robots.txt lines and CSV exports for bots and wasted URLs.patrickstox.com · read 4 Oct 2026
- Reports
- Reports include crawl budget by bot and section, crawler-by-page-type matrix, wasted URLs, and daily trends when logs contain timestamps.patrickstox.com · read 4 Oct 2026
- Support
- The page offers bug reports through a private triage queue and feature requests that are reviewed before appearing publicly.patrickstox.com · read 4 Oct 2026
- Verification limit
- IP-range matching may miss an impostor using a genuine crawler IP, and crawlers without published ranges cannot be distinguished by range matching alone.patrickstox.com · read 4 Oct 2026
