Bot Tracker classifies every crawler that touches your site into three states — cite-worthy, neutral, or hostile — so you can welcome the ones that drive AI referrals and block the ones that just harvest your content.
Every request is categorised as citation-driving (Perplexity, ChatGPT), neutral (Common Crawl, research), or hostile (undisclosed scrapers). Backed by our open Bot Database of 200+ named bots.
From bot → citation → referral
The only tracker that links crawl activity to actual citation events and downstream referral traffic. Prove which bot visits produce business impact — and which are pure cost.
Real-time signals feed
Live stream of bot activity with severity flags and PTR-verified fingerprints. See a suspicious spike the moment it happens, not the next morning.
One-click AI-aware robots.txt
Generate a `robots.txt` that allows beneficial citation bots and blocks the hostile ones. Deploy it in seconds, revisit it as the landscape shifts.
Screenshots
Three-state classification: cite-worthy · neutral · hostileReal-time signals feed — every hit, severity-scoredFull bot → citation → referral chain in one place
How it works
01
Connect logs or install pixel
Upload Apache / Nginx / Cloudflare logs, or drop our lightweight edge pixel for real-time streaming — whichever fits your stack.
02
We classify every hit
User-agent + reverse-DNS + behavioural fingerprint check every request against the 3LA Bot Database. Three-state verdict in under 100 ms.
03
Watch the citation chain
When a crawl leads to a citation and a citation leads to a click, we chain them so you see the full funnel in one place.
04
Act on the signal
Auto-generated robots.txt, Slack alerts for hostile bots, weekly digest for the CMO. No SQL required.
Who uses it
SEO leads proving AI-referral ROI to a skeptical CMO
Security teams stopping content theft before it hurts server load
Content strategists identifying pages AI *actually* crawls (vs. ignores)
Publishers negotiating with AI vendors on data-licensing terms
Frequently asked
Is this different from Log Analyzer?
Log Analyzer is the raw log-parsing engine underneath. Bot Tracker adds the classification layer + citation-chain linking + real-time alerting. If you already use Log Analyzer, Bot Tracker turns those raw hits into decisions.
Do I have to give you my logs?
No. You can stream events through our edge pixel instead, keeping raw logs on your side. Both paths feed the same classifier.
How do you verify a bot is real?
User-agent match, reverse-DNS PTR check, IP-range verification, and behavioural fingerprint. A crawler that claims to be Googlebot but fails PTR is flagged as impersonating.
Which bots are covered?
The 3LA Bot Database ships with 200+ named crawlers including GPTBot, ClaudeBot, PerplexityBot, Google-Extended, Bytespider, CCBot and dozens of undisclosed scrapers. New bots are added weekly.
TRUSTED BY
Built by practitioners, used in the wild.
Not just theory. 3LA was forged in the agency trenches and is now used by brands and agencies across the Nordics to track what AI says about them.
The Three-Layer Approach (3LA) is a groundbreaking service! In the report, you don't just learn what is wrong with your site, but also what you should do to improve it – specifically tailored to you.
Nina Furu
Textbook author and course instructor · Lærebokforfatter og kursleder - ninafuru.no
I highly recommend the 3LA platform! It only took a short time from when I joined the waiting list until I was approved and could receive three free analyses. My first impression was brilliant – I found myself saying 'Wow!' and 'You guys have to see this!' The platform provides genuinely valuable insight. A major plus is that the report is clear and accessible from anywhere, and the fact that it can be used on both Shopify and WordPress is truly seamless.
Marianne Vikne
Web Editor, former Head of SEO at Komplett Group and SEO Advisor at Try · Rolfsenshop.no
I was lucky enough to test 3LA in the beta version and found it to be a very useful and user-friendly tool – regardless of technical expertise. The analysis you receive provides concrete, actionable suggestions for website improvements and makes it easy to take steps that actually yield results. Additionally, the tool is cost-effective, both in terms of licensing and time spent. Highly recommended! )
The Three-Layer Approach finally separates AI visibility from generic SEO advice. Sharp, somewhat brutal and opinionated, but practically and actually actionable.
Jørgen Simensen
Founder · Synaro Agency
A critical gap has emerged between the information we publish and how modern systems actually retrieve it. Our industry colleague, Nickolass at Nettpilot, has addressed this gap by developing The Three-Layer Approach™ (3LA). This is not just another "trend," but a necessary upgrade of digital infrastructure for anyone who wishes to remain relevant in an ecosystem now governed by machine understanding.
The five AI models that already answer for your brand.
Every audit runs against ChatGPT, Claude, Gemini, Perplexity and Mistral — the engines where your customers ask questions before Google.
ChatGPT
OpenAI
Claude
Anthropic
Gemini
Google
Perplexity
Perplexity
Mistral
Mistral AI
ECOSYSTEM · INTEGRATIONS
One platform. The whole AI stack.
3LA plugs into the tools your team already uses – from LLM APIs and search consoles to the delivery surfaces where reports land.
Search & webmaster tools
L2 data pulled straight from source.
Ahrefs
Bing Webmaster
Google Search Console
Analytics & privacy
L1 engagement + consent, done right.
GA4
Microsoft Clarity
Plausible
GetCookie
AI infrastructure
Scraping, structured registries, ML backends.
Vertex AI
SocialCrawl
Beautiful Soup
Brønnøysund Registeret
Workspace & delivery
Where the audit output actually lands.
WordPress
Google Docs
Slack
Notion
Jira
NotebookLM
AI USAGE · NOW
How people use AI right now.
More than 2 billion people encounter AI‑generated answers every month – across chatbots, search, and agents.
1B+” (for monthly active users)
Chat LLM Users
ChatGPT alone has reached about 1 billion monthly active users in 2026, with around 900 million weekly users, while other chatbots like Gemini and Claude are growing triple‑digits year over year. (Source: https://www.omnibound.ai/blog/chatgpt-user-statistics)
Your opportunity:Structured, citable content gets reused across all major chat‑LLMs – from ChatGPT to Gemini and Claude.
2B+
AI in Search
Google’s AI Overviews already appear in roughly 15–25% of searches, depending on study and market, and now reach around 2–2.5 billion people per month across 200+ countries and 40 languages.
Key insight:AI answers in search now reach more people than all major chat apps combined – and 37% of consumers already start their search journey with an AI tool.
20-40%
Agentic AI
Analyst syntheses of 2025–26 surveys suggest that roughly 20–40% of knowledge workers now use AI assistants or task‑specific agents at least weekly in their workflows
Critical shift:If AI agents cannot understand, structure, and trust your content, they will route tasks – and value – to competitors who are agent‑ready.
The Zero‑Click AI Economy ChatGPT now has around 1 billion monthly users, Google’s Gemini app reaches hundreds of millions, and AI Overviews surface answers directly in search for billions of people every month. (https://www.cnbc.com/2026/06/12/chatgpt-a-billion-monthly-app-users-despite-souring-public-ai-sentiment.html)
If your content is not optimized for AI citations, you are invisible to the fastest‑growing discovery layer on the web.
Bot Tracker groups crawler activity so you can investigate useful discovery, routine collection and suspicious requests separately. Review the paths and request patterns behind a classification before blocking an entire crawler family. A policy change can affect legitimate access as well as unwanted scraping.
Keep the crawl-to-referral chain honest
A visit, a citation and a referral are different events. Relate them when supporting data exists, but do not treat every bot request as a generated answer or every citation as a click. Use this distinction to explain the difference between technical reach and measurable audience traffic.
Frequently Asked Questions
What is the three-state classification?
Cite-worthy (leads to citations), neutral (search crawlers) or hostile (scrapers). Based on PTR + IP verification.
How does it link crawl to citation?
Connects bot visit → page cited in AI answer → user clicked through. Proves which visits produce business impact.