AI BOT INTELLIGENCE

Not every AI bot is worth letting in

Bot Tracker classifies every crawler that touches your site into three states — cite-worthy, neutral, or hostile — so you can welcome the ones that drive AI referrals and block the ones that just harvest your content.

Powered by the open 3LA AI Bot Database.

Three-state classification

Every request is categorised as citation-driving (Perplexity, ChatGPT), neutral (Common Crawl, research), or hostile (undisclosed scrapers). Backed by our open Bot Database of 200+ named bots.

From bot → citation → referral

The only tracker that links crawl activity to actual citation events and downstream referral traffic. Prove which bot visits produce business impact — and which are pure cost.

Real-time signals feed

Live stream of bot activity with severity flags and PTR-verified fingerprints. See a suspicious spike the moment it happens, not the next morning.

One-click AI-aware robots.txt

Generate a `robots.txt` that allows beneficial citation bots and blocks the hostile ones. Deploy it in seconds, revisit it as the landscape shifts.

Screenshots

Bot Tracker three-state classification dashboard
Three-state classification: cite-worthy · neutral · hostile
Live signals feed with severity flags
Real-time signals feed — every hit, severity-scored
Bot → citation → referral chain view
Full bot → citation → referral chain in one place

How it works

  1. 01

    Connect logs or install pixel

    Upload Apache / Nginx / Cloudflare logs, or drop our lightweight edge pixel for real-time streaming — whichever fits your stack.

  2. 02

    We classify every hit

    User-agent + reverse-DNS + behavioural fingerprint check every request against the 3LA Bot Database. Three-state verdict in under 100 ms.

  3. 03

    Watch the citation chain

    When a crawl leads to a citation and a citation leads to a click, we chain them so you see the full funnel in one place.

  4. 04

    Act on the signal

    Auto-generated robots.txt, Slack alerts for hostile bots, weekly digest for the CMO. No SQL required.

Who uses it

  • SEO leads proving AI-referral ROI to a skeptical CMO
  • Security teams stopping content theft before it hurts server load
  • Content strategists identifying pages AI *actually* crawls (vs. ignores)
  • Publishers negotiating with AI vendors on data-licensing terms

Frequently asked

Is this different from Log Analyzer?

Log Analyzer is the raw log-parsing engine underneath. Bot Tracker adds the classification layer + citation-chain linking + real-time alerting. If you already use Log Analyzer, Bot Tracker turns those raw hits into decisions.

Do I have to give you my logs?

No. You can stream events through our edge pixel instead, keeping raw logs on your side. Both paths feed the same classifier.

How do you verify a bot is real?

User-agent match, reverse-DNS PTR check, IP-range verification, and behavioural fingerprint. A crawler that claims to be Googlebot but fails PTR is flagged as impersonating.

Which bots are covered?

The 3LA Bot Database ships with 200+ named crawlers including GPTBot, ClaudeBot, PerplexityBot, Google-Extended, Bytespider, CCBot and dozens of undisclosed scrapers. New bots are added weekly.

TRUSTED BY

Built by practitioners, used in the wild.

Not just theory. 3LA was forged in the agency trenches and is now used by brands and agencies across the Nordics to track what AI says about them.

  • The Three-Layer Approach (3LA) is a groundbreaking service! In the report, you don't just learn what is wrong with your site, but also what you should do to improve it – specifically tailored to you.
    Nina Furu

    Nina Furu

    Textbook author and course instructor · Lærebokforfatter og kursleder - ninafuru.no

  • I highly recommend the 3LA platform! It only took a short time from when I joined the waiting list until I was approved and could receive three free analyses. My first impression was brilliant – I found myself saying 'Wow!' and 'You guys have to see this!' The platform provides genuinely valuable insight. A major plus is that the report is clear and accessible from anywhere, and the fact that it can be used on both Shopify and WordPress is truly seamless.
    Marianne Vikne

    Marianne Vikne

    Web Editor, former Head of SEO at Komplett Group and SEO Advisor at Try · Rolfsenshop.no

  • I was lucky enough to test 3LA in the beta version and found it to be a very useful and user-friendly tool – regardless of technical expertise. The analysis you receive provides concrete, actionable suggestions for website improvements and makes it easy to take steps that actually yield results. Additionally, the tool is cost-effective, both in terms of licensing and time spent. Highly recommended! )
    Karianne Berg

    Karianne Berg

    Senior Communications Manager · Martinsen & Duvholdt | Skanska

  • The Three-Layer Approach finally separates AI visibility from generic SEO advice. Sharp, somewhat brutal and opinionated, but practically and actually actionable.
    Jørgen Simensen

    Jørgen Simensen

    Founder · Synaro Agency

  • A critical gap has emerged between the information we publish and how modern systems actually retrieve it. Our industry colleague, Nickolass at Nettpilot, has addressed this gap by developing The Three-Layer Approach™ (3LA). This is not just another "trend," but a necessary upgrade of digital infrastructure for anyone who wishes to remain relevant in an ecosystem now governed by machine understanding.
    Andreas Hatlem

    Andreas Hatlem

    Founder, Growth manager · Admirate

BUILT WITH PARTNERS

Backed by Nordic AI-native operators.

3LA is co-developed with agencies that live and breathe AI-readiness — not detached from the market that has to sell it.

ENGINES WE TRACK

The five AI models that already answer for your brand.

Every audit runs against ChatGPT, Claude, Gemini, Perplexity and Mistral — the engines where your customers ask questions before Google.

  • ChatGPT

    OpenAI

  • Claude logo

    Claude

    Anthropic

  • Gemini logo

    Gemini

    Google

  • Perplexity logo

    Perplexity

    Perplexity

  • Mistral logo

    Mistral

    Mistral AI

ECOSYSTEM · INTEGRATIONS

One platform. The whole AI stack.

3LA plugs into the tools your team already uses – from LLM APIs and search consoles to the delivery surfaces where reports land.

Search & webmaster tools

Ahrefs

Bing Webmaster

Google Search Console logo

Google Search Console

Analytics & privacy

GA4 logo

GA4

Microsoft Clarity

Plausible logo

Plausible

GetCookie

AI infrastructure

Vertex AI logo

Vertex AI

SocialCrawl

Beautiful Soup logo

Beautiful Soup

Brønnøysund Registeret

Workspace & delivery

WordPress logo

WordPress

Google Docs logo

Google Docs

Slack

Notion logo

Notion

Jira logo

Jira

NotebookLM logo

NotebookLM

AI USAGE · NOW

How people use AI right now.

More than 2 billion people encounter AI‑generated answers every month – across chatbots, search, and agents.

1B+” (for monthly active users)

Chat LLM Users

ChatGPT alone has reached about 1 billion monthly active users in 2026, with around 900 million weekly users, while other chatbots like Gemini and Claude are growing triple‑digits year over year. (Source: https://www.omnibound.ai/blog/chatgpt-user-statistics)

Your opportunity:Structured, citable content gets reused across all major chat‑LLMs – from ChatGPT to Gemini and Claude.
2B+

AI in Search

Google’s AI Overviews already appear in roughly 15–25% of searches, depending on study and market, and now reach around 2–2.5 billion people per month across 200+ countries and 40 languages.

Key insight:AI answers in search now reach more people than all major chat apps combined – and 37% of consumers already start their search journey with an AI tool.
20-40%

Agentic AI

Analyst syntheses of 2025–26 surveys suggest that roughly 20–40% of knowledge workers now use AI assistants or task‑specific agents at least weekly in their workflows

Critical shift:If AI agents cannot understand, structure, and trust your content, they will route tasks – and value – to competitors who are agent‑ready.

The Zero‑Click AI Economy ChatGPT now has around 1 billion monthly users, Google’s Gemini app reaches hundreds of millions, and AI Overviews surface answers directly in search for billions of people every month. (https://www.cnbc.com/2026/06/12/chatgpt-a-billion-monthly-app-users-despite-souring-public-ai-sentiment.html)

If your content is not optimized for AI citations, you are invisible to the fastest‑growing discovery layer on the web.

See the full AI usage breakdown and platform scorecard →

Data last updated: October 2026

Stop guessing which bots earn their keep.

Start seeing the full crawl-to-citation-to-referral chain in under 10 minutes.

Try Bot Tracker free

Make access decisions from observed behaviour

Bot Tracker groups crawler activity so you can investigate useful discovery, routine collection and suspicious requests separately. Review the paths and request patterns behind a classification before blocking an entire crawler family. A policy change can affect legitimate access as well as unwanted scraping.

Keep the crawl-to-referral chain honest

A visit, a citation and a referral are different events. Relate them when supporting data exists, but do not treat every bot request as a generated answer or every citation as a click. Use this distinction to explain the difference between technical reach and measurable audience traffic.

Frequently Asked Questions

What is the three-state classification?

Cite-worthy (leads to citations), neutral (search crawlers) or hostile (scrapers). Based on PTR + IP verification.

How does it link crawl to citation?

Connects bot visit → page cited in AI answer → user clicked through. Proves which visits produce business impact.

What is the AI Bot Database?

200+ named crawlers: GPTBot, ClaudeBot, PerplexityBot, Google-Extended, Bytespider, CCBot. Continuously updated.

How does PTR verification work?

Reverse DNS lookup + IP range check for each hit. Prevents spoofed user-agent strings from polluting data.

Can I generate a robots.txt?

Yes. One-click generator based on observed crawlers — allow cite-worthy, block hostile.

What is the difference from Log Analyzer?

Bot Tracker: real-time + citation linking. Log Analyzer: historical report from uploaded logs.