New:Microsoft Teams Notifications Are Now Available in Socket.Learn more →
Get Started

@astermind/astermind-mcp

Package Overview
Dependencies
Maintainers
2
Versions
1
Alerts
File Explorer

Advanced tools

Socket logo

Install Socket

Detect and block malicious and high-risk dependencies

Install

@astermind/astermind-mcp

MCP server that cuts LLM token usage with on-device reranking, context filtering, and classification (AsterMind ELM). Nothing leaves the machine.

latest
Source
npmnpm
Version
0.1.0
Version published
Maintainers
2
Created
Source

AsterMind MCP

Cut the tokens you send to an LLM — on your own machine, before the call goes out.

AsterMind MCP is a Model Context Protocol server that ranks and filters your retrieved context locally, so you send the model the few passages that actually answer the question instead of everything your retriever returned. It runs on the AsterMind Community Edition ELM engine. No network calls, no API keys, no data leaves the machine.

What it actually does (measured, not promised)

On a 6-scenario RAG benchmark (support KB, API docs, HR policy, e-commerce FAQ, DevOps runbook, fintech help), filtering 10 retrieved candidates down to the top 3 by rerank score:

MetricResult
Average context-token saving66.9% (66.8% overall by tokens)
Answer-present hit rate100% (a passage that answers the query survived filtering in every scenario)
Total tokens926 → 307
Strict "all relevant passages kept" recall55.6%
Precision50%

Tokens counted with gpt-tokenizer (o200k/cl100k BPE, OpenAI-compatible). Reproduce it yourself: npm run benchmark. Full methodology and per-scenario results are in BENCHMARK.md.

The honest tradeoff

Savings and recall move in opposite directions — keep fewer chunks, save more tokens, risk dropping a relevant one. You choose the point on the curve:

Keep top-K of 10Token savingAnswer-present hit rateAll-relevant recall
1~87.9%100%38.9%
3 (default)66.8%100%~55–75%
6~46%100%75%

Rank-1 surfaced a relevant passage in 100% of scenarios at every K we tested. That is the strong, defensible result. For single-hop questions (FAQ, support, one-fact lookups) keep top 1–3 and cut ~67–88% of context. For multi-hop questions that need several passages, keep top 5–6 — don't over-filter, or you'll drop a needed passage.

Install

npx @astermind/astermind-mcp

Or add it to your MCP client config (Claude Desktop, Cursor, VS Code, Cline):

{
  "mcpServers": {
    "astermind": {
      "command": "npx",
      "args": ["-y", "@astermind/astermind-mcp"]
    }
  }
}

Runs on Node 18+. No GPU, no build step, no configuration.

Tools (10)

ToolWhat it doesStrength
rerank_documentsScore & order candidates against a queryStrong — the core value
filter_contextKeep the top-K / above-threshold passagesStrong
compress_contextRerank + trim a context block to a token budgetStrong
count_tokensExact BPE token count for any textExact
estimate_savingsBefore/after token delta for a filtering choiceExact
semantic_searchRank a corpus against a queryGood (lexical)
detect_languageIdentify text languageGood, confidence-flagged
classify_textLabel text into supplied categoriesWeak — low-confidence flagged
generate_embeddingsCharacter-level vector for textNear-duplicate use only
compare_textsSimilarity between two textsNear-duplicate use only

Every tool returns a confidence signal. Where the engine is weak, the tool says so rather than guessing silently.

Known limitations (stated on purpose)

  • The reranker is lexical (TF-IDF). It matches on shared terms, so pure synonym gaps can be missed — a query for "payment methods" won't strongly rank a passage that only says "Visa/Mastercard." It excels when the query and the answer share vocabulary, which is the common RAG case.
  • Classification is weak out of the box and only fair after training — use it as a low-confidence hint, not a decision-maker. It flags low confidence.
  • Embeddings are character-level, useful for near-duplicate detection, not deep semantic similarity.

The token savings above are real only because a relevant passage is preserved. Cutting tokens by dropping the answer is not a saving, and this benchmark measures both.

When this saves you money

The server does not shrink an LLM's vocabulary or compress prompts magically. It saves tokens one specific way: you retrieve broadly, then send the model only the passages that matter. If your RAG pipeline currently stuffs 8–12 retrieved chunks into every prompt, reranking locally and sending 3 is a direct, repeatable cut to your per-call input tokens — and it runs on your machine for free.

Develop & verify

npm install
npm test              # engine + MCP client round-trip tests
npm run benchmark     # regenerates benchmark/results.json
npm run benchmark:sweep   # top-K policy sweep

License

MIT © AsterMind AI. Built on @astermind/astermind-community.

Keywords

mcp

FAQs

Package last updated on 25 Sep 2026

Related posts