Search DevTools

Jump to any tool or page

ActableSite AI Crawler Monitor

Check AI crawler robots.txt policy and monitor public-site policy, sitemap, and llms.txt changes.

unitedideas0 stars0 forksBrowser & Web
View source

Install

mcp_config.json

{
  "mcpServers": {
    "com-actablesite-readiness": {
      "url": "https://actablesite.com/mcp",
      "type": "streamable-http"
    }
  }
}

Documentation

ActableSite MCP

A remote, read-only MCP server for public website evidence, AI crawler policy, and explicit Crawler Watch, report, and Practice Radar offer metadata.

Tools

It exposes five tools over Streamable HTTP:

  • audit_public_website checks public identity, offer evidence, action paths, discovery files, metadata, and structured data.
  • check_ai_crawler_policy evaluates eight OpenAI, Anthropic, Perplexity, and Google crawler tokens.
  • get_crawler_watch_offer returns the $9 monthly price, one-site scope, 15-minute cadence, confirmation rule, delivery, cancellation, and synthetic-check limitations. It cannot open checkout or purchase anything.
  • get_full_report_offer returns explicit metadata for an optional $19 one-time report. It cannot open checkout or purchase anything.
  • get_practice_radar_offer returns the current weekly-edition receipt, public sample, $39 monthly price, delivery, cancellation, and material NPI limitations. It cannot open checkout or purchase anything.

Connect

Claude Code:

claude mcp add --transport http actablesite https://actablesite.com/mcp/

For another MCP client, add a remote server named actablesite with:

  • URL: https://actablesite.com/mcp/
  • Transport: Streamable HTTP
  • Authentication: none

For clients that require a local stdio command, clone this repository and run the dependency-free bridge:

git clone https://github.com/unitedideas/actablesite-mcp.git
cd actablesite-mcp
npm run start:stdio

The bridge contains the visible MCP implementation source in src/stdio.mjs. Distribution version 1.4.2 exposes the same five read-only tools and sends requests only to ActableSite's bounded public JSON APIs. It has no file, shell, browser, account, or write capability.

The same stdio process is available as a public, non-root container:

docker run --rm -i ghcr.io/unitedideas/actablesite-mcp:1.4.2

The hosted server implements MCP protocol version 2025-06-18 and is published in the official registry as com.actablesite/ai-crawler-robots-monitor version 1.4.2.

Discovery metadata

Directory scanners can read either machine-readable discovery surface:

  • /.well-known/mcp.json identifies the official registry name, repository, remote endpoint, transport, authentication mode, and tool names.
  • /.well-known/mcp/server-card.json provides static tool descriptions and JSON input schemas for scanners that cannot complete a live MCP handshake.

Both files describe the same unauthenticated endpoint and five-tool inventory verified by this repository.

Ongoing crawler monitoring

The MCP tools report current public evidence and do not create background jobs. Crawler Watch is the separate $9/month service for one public website: it checks crawler policy, synthetic homepage responses, sitemap.xml, and llms.txt every 15 minutes and emails after a changed state appears twice.

Its synthetic requests do not authenticate provider IP ranges or prove crawling, indexing, citation, ranking, or traffic.

Safety contract

  • Public HTTP and HTTPS websites only; private, local, loopback, and reserved network destinations are rejected.
  • No browser control, file access, account access, write, or mutation tools.
  • No authentication header or API key is requested.
  • Tool calls are limited to 60 per caller per hour.
  • All three offer tools are informational and require explicit user confirmation before any separate checkout or purchase action.
  • Practice Radar records do not prove licensure, active operation, demand, or buying intent and must be verified before contact.
  • Results do not guarantee crawling, indexing, citation, ranking, recommendation, traffic, legal compliance, or revenue.

Verify the live server

Node.js 20 or newer is required.

npm test
npm run verify:live

The verifier initializes the live server, checks its protocol and version, and confirms the exact read-only tool inventory. It does not call an audit tool or create a funnel event.

Repository scope

This repository contains a runnable stdio implementation, public registry manifest, connection contract, live verifier, and security policy for the hosted ActableSite MCP server. The production runtime is operated at https://actablesite.com/mcp/.

License

MIT

Sourced from the repository README.

More in Browser & Web