@memberjunction/ai-lmstudio

@memberjunction/ai-lm-studio

MemberJunction AI provider for LM Studio, enabling integration with locally-hosted models through LM Studio's OpenAI-compatible API. This package extends the OpenAI provider to connect to LM Studio's local inference server.

Architecture

graph TD
    A["LMStudioLLM<br/>(Provider)"] -->|extends| B["OpenAILLM<br/>(@memberjunction/ai-openai)"]
    B -->|extends| C["BaseLLM<br/>(@memberjunction/ai)"]
    A -->|connects to| D["LM Studio Server<br/>(localhost:1234/v1)"]
    D -->|runs| E["Local Models<br/>(GGUF, GGML)"]
    C -->|registered via| F["@RegisterClass"]

    style A fill:#7c5295,stroke:#563a6b,color:#fff
    style B fill:#2d6a9f,stroke:#1a4971,color:#fff
    style C fill:#2d6a9f,stroke:#1a4971,color:#fff
    style D fill:#2d8659,stroke:#1a5c3a,color:#fff
    style E fill:#b8762f,stroke:#8a5722,color:#fff
    style F fill:#b8762f,stroke:#8a5722,color:#fff

Features

• Local Model Hosting: Run AI models locally without cloud dependencies
• OpenAI Compatible: Inherits all features from the OpenAI provider
• Streaming: Full streaming support for real-time responses
• No API Key Required: Connects to local server (API key parameter ignored)
• Model Flexibility: Use any model loaded in LM Studio (GGUF, GGML formats)
• Privacy: All data stays on your local machine
• Configurable Endpoint: Support for custom host and port settings

Installation

npm install @memberjunction/ai-lm-studio

Usage

import { LMStudioLLM } from '@memberjunction/ai-lm-studio';

// API key is not used but required by the interface
const llm = new LMStudioLLM('not-used');

const result = await llm.ChatCompletion({
    model: 'local-model', // Model loaded in LM Studio
    messages: [
        { role: 'system', content: 'You are a helpful assistant.' },
        { role: 'user', content: 'Explain how local inference works.' }
    ],
    temperature: 0.7
});

if (result.success) {
    console.log(result.data.choices[0].message.content);
}

Configuration

The default endpoint is http://localhost:1234/v1. Configure via SetAdditionalSettings if using a different host/port.

How It Works

LMStudioLLM is a thin subclass of OpenAILLM that redirects API calls to LM Studio's local server endpoint. LM Studio provides an OpenAI-compatible API, so all chat, streaming, and parameter handling is inherited from the OpenAI provider.

Prerequisites

• Install LM Studio
• Download and load a model in LM Studio
• Start the local server (default: port 1234)
• Configure the provider in your MemberJunction application

Class Registration

Registered as LMStudioLLM via @RegisterClass(BaseLLM, 'LMStudioLLM').

Dependencies

• @memberjunction/ai - Core AI abstractions
• @memberjunction/ai-openai - OpenAI provider (parent class)
• @memberjunction/global - Class registration