crawlwise-mcp
Advanced tools
MCP (Model Context Protocol) stdio server for Crawlwise Data: techstack, feed, sitemap, monitors, account balance. Auth via CRAWLWISE_API_KEY.
crawlwise-mcp)Official local (stdio) MCP server for Crawlwise Data.
Crawlwise Data watches the public URLs you choose and sends an HMAC-signed JSON webhook when something changes:
Scheduled checks, usually within an hour, plus check-now on demand. The minimum monitor interval is 15 minutes on every plan.
It works per URL you supply. It is not web-wide discovery, it does not diff page text or prices, and it does not render JavaScript.
It uses your Crawlwise API key and credits; no AI runs on our side.
Node 18 or later. No runtime dependencies.
npx crawlwise-mcp
Or install globally with npm install -g crawlwise-mcp and run crawlwise-mcp.
| Variable | Required | Default | Notes |
|---|---|---|---|
CRAWLWISE_API_KEY | For monitors and account tools | none | Your Crawlwise Data API key (cw_test_... or cw_live_...). Keep it secret. CRAWLWISE_KEY also works. |
CRAWLWISE_BASE_URL | No | https://crawlwisedata.com | API base URL. |
Without a key, techstack, feed and sitemap run in the free keyless demo (10 calls/day per IP, smaller results, no monitors).
claude_desktop_config.json (macOS: ~/Library/Application Support/Claude/claude_desktop_config.json):
{
"mcpServers": {
"crawlwise-data": {
"command": "npx",
"args": ["-y", "crawlwise-mcp"],
"env": { "CRAWLWISE_API_KEY": "cw_test_YOUR_KEY" }
}
}
}
.cursor/mcp.json (or Cursor Settings → MCP): same block as above.
| Tool | What it does | Key |
|---|---|---|
techstack | Detect the tech stack (CMS, frameworks, analytics, CDN, DNS) of a public URL. 30 credits with a key. | Optional (demo without) |
feed | Read an RSS/Atom/RDF/JSON Feed, or autodiscover it from a site URL. Optional monitor returns new items only. 10 credits. | Optional |
sitemap | Extract URLs from a site's sitemaps (robots.txt discovery). Optional monitor reports changes since the last check. 10 credits + 1 per URL. | Optional |
list_monitors | List your monitors (schedule, webhook, last and next run). | Required |
create_monitor | Create or update a monitor. With schedule: true and an https webhookUrl, Crawlwise runs the checks and POSTs signed change events. | Required |
test_monitor_webhook | Send a free HMAC-signed sample event (monitor.test) to the monitor's webhook, signed like real events. | Required |
run_monitor | Check a monitor now. If it changed and has a webhook, a signed monitor.change event is POSTed. | Required |
get_account | Credit balance, plan limits and key metadata. | Required |
Full parameters and prices: https://crawlwisedata.com/docs.html#agents
Every delivery carries X-Crawlwise-Signature: t=<unix>,v1=<HMAC-SHA256 hex of "t.rawBody">. Failed deliveries are retried with backoff, and a retry resends the same event (same X-Crawlwise-Event and X-Crawlwise-Delivery ids), so deduplicate on X-Crawlwise-Delivery or the event id.
Free trial: 1,000 credits, one time, no card. Sign up at https://crawlwisedata.com/signup.html (the account starts at 0 credits; after you accept the Terms, the free trial key is a separate step), or request a trial key directly:
curl -X POST https://crawlwisedata.com/v1/trial \
-H "Content-Type: application/json" \
-d '{"email":"you@company.com","acceptTerms":true}'
export CRAWLWISE_API_KEY=cw_test_...
Getting terms_required? Accept the Terms, then retry.
Paid credits: https://crawlwisedata.com/pricing.html
techstackcreate_monitor. The demo target changes every 5 minutes; test_monitor_webhook sends a free signed sample, and run_monitor checks now.npm test
node index.js
com.crawlwisedata/crawlwise-mcpGPL-3.0-only. See LICENSE.
Copyright (C) 2026 Crawlwise. Licensed under GPL-3.0-only (see LICENSE).
FAQs
MCP (Model Context Protocol) stdio server for Crawlwise Data: techstack, feed, sitemap, monitors, account balance. Auth via CRAWLWISE_API_KEY.
We found that crawlwise-mcp demonstrated a healthy version release cadence and project activity because the last version was released less than a year ago. It has 1 open source maintainer collaborating on the project.
Security News
The PHP Foundation says Chainguard broke a security embargo ahead of critical RCE patches, as leaks disrupted the coordinated release.
Security News
PHP releases emergency patches for two critical RCE vulnerabilities as agencies urge organizations to take unpatched sites offline.
Threat Research
/Security News
A supply chain attack compromised LiteLLM 1.107.0 on PyPI and Docker, spreading malware that steals cloud credentials, developer secrets, and AI provider keys.