- Home
- SEO Log File Analysis Tools
- Spider-Lens
On the recordRead 8 Oct 202615 facts
Spider-Lens
Caen, France
Plans and prices
Open-source self-hosted
Free
No paid plans or usage limits stated
Read 8 Oct 2026 · github.com
On the record
- AI assistant
- Nova uses Google Gemini and requires a Gemini API key; without one, the rest of the application works normally while Nova and AI Analysis show a configuration prompt.github.com · read 8 Oct 2026
- AI data handling
- The README says Nova does not send raw log data to Google and transmits only a compact JSON summary of about 500 tokens per request.github.com · read 8 Oct 2026
- Alerts
- Configurable SMTP email alerts and webhook notifications cover 404 spikes, server errors, missing Googlebot, and weekly reports.github.com · read 8 Oct 2026
- Crawler monitoring
- It detects 16 or more bots and visualizes crawl budget and crawler volume.github.com · read 8 Oct 2026
- Deployment
- It is available as a standalone Node.js application and as a native WordPress plugin; the plugin does not require Node.js on the server.github.com · read 8 Oct 2026
- Integrations
- The project documents Discord and Slack webhooks and an MCP server for Claude Code or other MCP-compatible clients.github.com · read 8 Oct 2026
- Languages
- The interface supports 16 listed languages and can detect the browser language automatically.github.com · read 8 Oct 2026
- Maker
- The repository identifies the maker as GDM-Pixel and lists Caen, France.github.com · read 8 Oct 2026
- Performance analysis
- It reports Time to First Byte per URL and supports configurable slow thresholds plus CSV and Excel exports.github.com · read 8 Oct 2026
- Purpose
- Spider-Lens analyzes Apache and Nginx server logs to monitor traffic, HTTP errors, crawler bots, and server performance.github.com · read 8 Oct 2026
- Requirements
- The Node.js application requires Node.js 18 or later, npm 9 or later, and access to Apache or Nginx log files.github.com · read 8 Oct 2026
- Security
- Spider-Lens uses JWT authentication with a seven-day token and advises changing the default JWT secret and admin password before deployment.github.com · read 8 Oct 2026
- SEO dashboard
- The dashboard summarizes requests, human visits, bots, error rates, HTTP status trends, bot distribution, and 12-week trends.github.com · read 8 Oct 2026
- Site crawler
- The sitemap crawler follows internal links and extracts page titles, H1 headings, word counts, canonicals, robots directives, and crawl depth.github.com · read 8 Oct 2026
