New Research: Supply Chain Attack on Axios Pulls Malicious Dependency from npm.Details →
Socket
Book a DemoSign in
Socket

lynkr

Package Overview
Dependencies
Maintainers
1
Versions
30
Alerts
File Explorer

Advanced tools

Socket logo

Install Socket

Detect and block malicious and high-risk dependencies

Install

lynkr

Self-hosted Claude Code & Cursor proxy with Databricks,AWS BedRock,Azure adapters, openrouter, Ollama,llamacpp,LM Studio, workspace tooling, and MCP integration.

latest
Source
npmnpm
Version
8.0.1
Version published
Maintainers
1
Created
Source

Lynkr - Run Cursor, Cline, Continue, OpenAi Compatible Tools and Claude Code on any model.

One universal LLM proxy for AI coding tools.

npm version Homebrew Tap License: Apache 2.0 Ask DeepWiki Databricks Supported AWS Bedrock OpenAI Compatible Ollama Compatible llama.cpp Compatible

Use Case

        Cursor / Cline / Continue / Claude Code / Clawdbot / Codex/ KiloCode
                        ↓
                       Lynkr
                        ↓
        Local LLMs | OpenRouter | Azure | Databricks | AWS BedRock | Ollama | LMStudio | Gemini

Overview

Lynkr is a self-hosted proxy server that unlocks Claude Code CLI , Cursor IDE and Codex Cli by enabling:

  • 🚀 Any LLM Provider - Databricks, AWS Bedrock (100+ models), OpenRouter (100+ models), Ollama (local), llama.cpp, Azure OpenAI, Azure Anthropic, OpenAI, LM Studio
  • 💰 60-80% Cost Reduction - Built-in token optimization with smart tool selection, prompt caching, and memory deduplication
  • 🔒 100% Local/Private - Run completely offline with Ollama or llama.cpp
  • 🌐 Remote or Local - Connect to providers on any IP/hostname (not limited to localhost)
  • 🎯 Zero Code Changes - Drop-in replacement for Anthropic's backend
  • 🏢 Enterprise-Ready - Circuit breakers, load shedding, Prometheus metrics, health checks

Perfect for:

  • Developers who want provider flexibility and cost control
  • Enterprises needing self-hosted AI with observability
  • Privacy-focused teams requiring local model execution
  • Teams seeking 60-80% cost reduction through optimization

Quick Start

Installation

Option 1: NPM Package (Recommended)

# Install globally
npm install -g pino-pretty 
npm install -g lynkr

lynkr start

Option 2: Git Clone

# Clone repository
git clone https://github.com/vishalveerareddy123/Lynkr.git
cd Lynkr

# Install dependencies
npm install

# Create .env from example
cp .env.example .env

# Edit .env with your provider credentials
nano .env

# Start server
npm start

Node.js Compatibility:

  • Node 20-24: Full support with all features
  • Node 25+: Full support (native modules auto-rebuild, babel fallback for code parsing)

Option 3: Docker

docker-compose up -d

Supported Providers

Lynkr supports 10+ LLM providers:

ProviderTypeModelsCostPrivacy
AWS BedrockCloud100+ (Claude, Titan, Llama, Mistral, etc.)$$-$$$Cloud
DatabricksCloudClaude Sonnet 4.5, Opus 4.5$$$Cloud
OpenRouterCloud100+ (GPT, Claude, Llama, Gemini, etc.)$-$$Cloud
OllamaLocalUnlimited (free, offline)FREE🔒 100% Local
llama.cppLocalGGUF modelsFREE🔒 100% Local
Azure OpenAICloudGPT-4o, GPT-5, o1, o3$$$Cloud
Azure AnthropicCloudClaude models$$$Cloud
OpenAICloudGPT-4o, o1, o3$$$Cloud
LM StudioLocalLocal models with GUIFREE🔒 100% Local
MLX OpenAI ServerLocalApple Silicon (M1/M2/M3/M4)FREE🔒 100% Local

📖 Full Provider Configuration Guide

Claude Code Integration

Configure Claude Code CLI to use Lynkr:

# Set Lynkr as backend
export ANTHROPIC_BASE_URL=http://localhost:8081
export ANTHROPIC_API_KEY=dummy

# Run Claude Code
claude "Your prompt here"

That's it! Claude Code now uses your configured provider.

📖 Detailed Claude Code Setup

Cursor Integration

Configure Cursor IDE to use Lynkr:

  • Open Cursor Settings

    • Mac: Cmd+, | Windows/Linux: Ctrl+,
    • Navigate to: FeaturesModels
  • Configure OpenAI API Settings

    • API Key: sk-lynkr (any non-empty value)
    • Base URL: http://localhost:8081/v1
    • Model: claude-3.5-sonnet (or your provider's model)
  • Test It

    • Chat: Cmd+L / Ctrl+L
    • Inline edits: Cmd+K / Ctrl+K
    • @Codebase search: Requires embeddings setup

📖 Full Cursor Setup Guide | Embeddings Configuration

Codex CLI Integration

Configure OpenAI Codex CLI to use Lynkr as its backend.

Option 1: Environment Variables (Quick Start)

export OPENAI_BASE_URL=http://localhost:8081/v1
export OPENAI_API_KEY=dummy

codex

Edit ~/.codex/config.toml:

# Set Lynkr as the default provider
model_provider = "lynkr"
model = "gpt-4o"

# Define the Lynkr provider
[model_providers.lynkr]
name = "Lynkr Proxy"
base_url = "http://localhost:8081/v1"
wire_api = "responses"

# Optional: Trust your project directories
[projects."/path/to/your/project"]
trust_level = "trusted"

Configuration Options

OptionDescriptionExample
model_providerActive provider name"lynkr"
modelModel to request (mapped by Lynkr)"gpt-4o", "claude-sonnet-4-5"
base_urlLynkr endpoint"http://localhost:8081/v1"
wire_apiAPI format (responses or chat)"responses"
trust_levelProject trust (trusted, sandboxed)"trusted"

Remote Lynkr Server

To connect Codex to a remote Lynkr instance:

[model_providers.lynkr-remote]
name = "Remote Lynkr"
base_url = "http://192.168.1.100:8081/v1"
wire_api = "responses"

Troubleshooting

IssueSolution
Same response for all queriesDisable semantic cache: SEMANTIC_CACHE_ENABLED=false
Tool calls not executingIncrease threshold: POLICY_TOOL_LOOP_THRESHOLD=15
Slow first requestKeep Ollama loaded: OLLAMA_KEEP_ALIVE=24h
Connection refusedEnsure Lynkr is running: npm start

Note: Codex uses the OpenAI Responses API format. Lynkr automatically converts this to your configured provider's format.

ClawdBot Integration

Lynkr supports ClawdBot via its OpenAI-compatible API. ClawdBot users can route requests through Lynkr to access any supported provider.

Configuration in ClawdBot:

SettingValue
Model/auth providerCopilot
Copilot auth methodCopilot Proxy (local)
Copilot Proxy base URLhttp://localhost:8081/v1
Model IDsAny model your Lynkr provider supports

Available models (depending on your Lynkr provider): gpt-5.2, gpt-5.1-codex, claude-opus-4.5, claude-sonnet-4.5, claude-haiku-4.5, gemini-3-pro, gemini-3-flash, and more.

🌐 Remote Support: ClawdBot can connect to Lynkr on any machine - use any IP/hostname in the Proxy base URL (e.g., http://192.168.1.100:8081/v1 or http://gpu-server:8081/v1).

Lynkr also supports Cline, Continue.dev and other OpenAI compatible tools.

Documentation

Getting Started

IDE & CLI Integration

Features & Capabilities

Deployment & Operations

Support

External Resources

Key Features Highlights

  • Multi-Provider Support - 12+ providers including local (Ollama, llama.cpp) and cloud (Bedrock, Databricks, OpenRouter, Moonshot AI)
  • 60-80% Cost Reduction - Token optimization with smart tool selection, prompt caching, memory deduplication
  • 100% Local Option - Run completely offline with Ollama/llama.cpp (zero cloud dependencies)
  • OpenAI Compatible - Works with Cursor IDE, Continue.dev, and any OpenAI-compatible client
  • Embeddings Support - 4 options for @Codebase search: Ollama (local), llama.cpp (local), OpenRouter, OpenAI
  • MCP Integration - Automatic Model Context Protocol server discovery and orchestration
  • Enterprise Features - Circuit breakers, load shedding, Prometheus metrics, K8s health checks
  • Streaming Support - Real-time token streaming for all providers
  • Memory System - Titans-inspired long-term memory with surprise-based filtering
  • Tool Calling - Full tool support with server and passthrough execution modes
  • Production Ready - Battle-tested with 400+ tests, observability, and error resilience
  • Node 20-25 Support - Works with latest Node.js versions including v25
  • Semantic Caching - Cache responses for similar prompts (requires embeddings)

Semantic Cache

Lynkr includes an optional semantic response cache that returns cached responses for semantically similar prompts, reducing latency and costs.

Enable Semantic Cache:

# Requires an embeddings provider (Ollama recommended)
ollama pull nomic-embed-text

# Add to .env
SEMANTIC_CACHE_ENABLED=true
SEMANTIC_CACHE_THRESHOLD=0.95
OLLAMA_EMBEDDINGS_MODEL=nomic-embed-text
OLLAMA_EMBEDDINGS_ENDPOINT=http://localhost:11434/api/embeddings
SettingDefaultDescription
SEMANTIC_CACHE_ENABLEDfalseEnable/disable semantic caching
SEMANTIC_CACHE_THRESHOLD0.95Similarity threshold (0.0-1.0)

Note: Without a proper embeddings provider, the cache uses hash-based fallback which may cause false matches. Use Ollama with nomic-embed-text for best results.

Architecture

┌─────────────────┐
│    AI Tools     │  
└────────┬────────┘
         │ Anthropic/OpenAI Format
         ↓
┌─────────────────┐
│  Lynkr Proxy    │
│  Port: 8081     │
│                 │
│ • Format Conv.  │
│ • Token Optim.  │
│ • Provider Route│
│ • Tool Calling  │
│ • Caching       │
└────────┬────────┘
         │
         ├──→ Databricks (Claude 4.5)
         ├──→ AWS Bedrock (100+ models)
         ├──→ OpenRouter (100+ models)
         ├──→ Ollama (local, free)
         ├──→ llama.cpp (local, free)
         ├──→ Azure OpenAI (GPT-4o, o1)
         ├──→ OpenAI (GPT-4o, o3)
         └──→ Azure Anthropic (Claude)

📖 Detailed Architecture

Quick Configuration Examples

100% Local (FREE)

export MODEL_PROVIDER=ollama
export OLLAMA_MODEL=qwen2.5-coder:latest
export OLLAMA_EMBEDDINGS_MODEL=nomic-embed-text
npm start

💡 Tip: Prevent slow cold starts by keeping Ollama models loaded: launchctl setenv OLLAMA_KEEP_ALIVE "24h" (macOS) or set OLLAMA_KEEP_ALIVE=24h env var. See troubleshooting.

Remote Ollama (GPU Server)

export MODEL_PROVIDER=ollama
export OLLAMA_ENDPOINT=http://192.168.1.100:11434  # Any IP or hostname
export OLLAMA_MODEL=llama3.1:70b
npm start

🌐 Note: All provider endpoints support remote addresses - not limited to localhost. Use any IP, hostname, or domain.

MLX OpenAI Server (Apple Silicon)

# Terminal 1: Start MLX server
mlx-openai-server launch --model-path mlx-community/Qwen2.5-Coder-7B-Instruct-4bit --model-type lm

# Terminal 2: Start Lynkr
export MODEL_PROVIDER=openai
export OPENAI_ENDPOINT=http://localhost:8000/v1/chat/completions
export OPENAI_API_KEY=not-needed
npm start

🍎 Apple Silicon optimized - Native MLX performance on M1/M2/M3/M4 Macs. See MLX setup guide.

AWS Bedrock (100+ models)

export MODEL_PROVIDER=bedrock
export AWS_BEDROCK_API_KEY=your-key
export AWS_BEDROCK_MODEL_ID=anthropic.claude-3-5-sonnet-20241022-v2:0
npm start

OpenRouter (simplest cloud)

export MODEL_PROVIDER=openrouter
export OPENROUTER_API_KEY=sk-or-v1-your-key
npm start

** You can setup multiple models like local models 📖 More Examples

Contributing

We welcome contributions! Please see:

License

Apache 2.0 - See LICENSE file for details.

Community & Support

Made with ❤️ by developers, for developers.

Keywords

claude

FAQs

Package last updated on 21 Mar 2026

Did you know?

Socket

Socket for GitHub automatically highlights issues in each pull request and monitors the health of all your open source dependencies. Discover the contents of your packages and block harmful activity before you install or update your dependencies.

Install

Related posts