@nestjs-ai/observation

NestJS AI

A TypeScript/NestJS port of Spring AI — bringing the same powerful AI abstraction layer to the Node.js ecosystem.

Last synced Spring AI commit: da8db657 (Remove Anthropic IT that no longer makes sense)

Overview

NestJS AI is a comprehensive TypeScript port of the Spring AI project, reimagined for the NestJS/Node.js ecosystem. It provides a unified abstraction layer for integrating Large Language Models (LLMs), vector stores, document readers, and RAG pipelines into NestJS applications.

The project faithfully mirrors Spring AI's module structure and API design while leveraging TypeScript idioms, RxJS reactive streams, and NestJS dependency injection.

Key Features

• Model Abstraction — Unified ChatModel and EmbeddingModel interfaces across providers
• Multi-Provider Support — OpenAI, Google GenAI (Gemini), Hugging Face Transformers
• Tool Calling — Structured function/tool calling orchestration
• RAG Pipeline — End-to-end Retrieval Augmented Generation with vector stores
• Chat Memory — In-memory and Redis-backed conversation history
• Document Readers — PDF, Markdown, HTML (Cheerio), Apache Tika
• Vector Stores — Abstract interface with Redis implementation
• Observability — OpenTelemetry tracing and metrics
• Prompt Templating — StringTemplate-based prompt rendering
• NestJS Integration — Modules, decorators, and DI support

Tech Stack

Category	Technology
Language	TypeScript 6.x (strict mode)
Runtime	Node.js >= 20
Framework	NestJS 11.x
Package Manager	pnpm 10.x
Build	Turborepo + tsc
Test	Vitest 4.x + TestContainers
Lint/Format	Biomejs 2.x
Reactive	RxJS 7.x
Validation	Zod 4.x

Porting Progress

Spring AI module porting status to NestJS AI. (~520 source files, ~180 test files ported across 22 packages)

Category	Spring AI Module	nestjs-ai Package	Progress
Core	spring-ai-model	@nestjs-ai/model	100%
	spring-ai-client-chat	@nestjs-ai/client-chat	100%
	spring-ai-commons	@nestjs-ai/commons	100%
	spring-ai-retry	@nestjs-ai/retry	100%
	spring-ai-template-st	@nestjs-ai/template-st	100%
	spring-ai-observation	@nestjs-ai/observation	100%
	spring-ai-test	@nestjs-ai/testing	100%
Model Providers	spring-ai-openai	@nestjs-ai/model-openai	100%
	spring-ai-openai-sdk	@nestjs-ai/model-openai-sdk	100%
	spring-ai-google-genai	@nestjs-ai/model-google-genai	100%
	spring-ai-transformers	@nestjs-ai/model-transformers	100%
	spring-ai-anthropic	—	0%
	spring-ai-azure-openai	—	0%
	spring-ai-bedrock	—	0%
	spring-ai-mistral-ai	—	0%
	spring-ai-ollama	—	0%
RAG & Vector Stores	spring-ai-rag	@nestjs-ai/rag	100%
	spring-ai-vector-store	@nestjs-ai/vector-store	100%
	spring-ai-redis-store	@nestjs-ai/vector-store-redis	100%
	spring-ai-advisors-vector-store	@nestjs-ai/advisors-vector-store	100%
	spring-ai-pgvector-store	—	0%
	spring-ai-chroma-store	—	0%
	spring-ai-pinecone-store	—	0%
	spring-ai-milvus-store	—	0%
Document Readers	spring-ai-pdf-document-reader	@nestjs-ai/document-reader-pdf	100%
	spring-ai-markdown-document-reader	@nestjs-ai/document-reader-markdown	100%
	spring-ai-tika-document-reader	@nestjs-ai/document-reader-tika	100%
	(cheerio - NestJS specific)	@nestjs-ai/document-reader-cheerio	100%
Memory	spring-ai-model-chat-memory-redis	@nestjs-ai/model-chat-memory-repository-redis	100%
	spring-ai-model-chat-memory-jdbc	—	0%
	spring-ai-model-chat-memory-cassandra	—	0%
Platform	spring-ai-autoconfigure	@nestjs-ai/platform	100%
	spring-ai-mcp	@nestjs-ai/mcp-common	10%
	spring-ai-jsdbc	@nestjs-ai/jsdbc	30%

Project Structure

nestjs-ai/
├── packages/
│   ├── model/                    # Core chat/embedding abstractions
│   ├── client-chat/              # High-level client API & advisors
│   ├── commons/                  # Shared utilities & tokens
│   ├── platform/                 # NestJS module integration
│   ├── rag/                      # RAG pipeline
│   ├── vector-store/             # Vector store abstractions
│   ├── observation/              # OpenTelemetry integration
│   ├── retry/                    # Retry utilities
│   ├── template-st/             # Prompt templating
│   ├── testing/                  # Test utilities
│   ├── jsdbc/                    # JDBC integration layer
│   ├── models/
│   │   ├── openai/               # OpenAI provider
│   │   ├── google-genai/         # Google GenAI provider
│   │   └── transformers/         # Hugging Face local embeddings
│   ├── mcp/
│   │   └── common/               # Model Context Protocol
│   ├── vector-stores/
│   │   └── redis-store/          # Redis vector store
│   ├── memory/
│   │   └── repository/
│   │       └── model-chat-memory-repository-redis/
│   ├── document-readers/
│   │   ├── pdf-reader/           # PDF.js reader
│   │   ├── markdown-reader/      # Markdown reader
│   │   ├── cheerio-reader/       # HTML/web scraping
│   │   └── tika-reader/          # Apache Tika reader
│   └── advisors/
│       └── advisors-vector-store/
├── docs/                         # Antora documentation site
└── turbo.json                    # Turborepo configuration

Getting Started

Prerequisites

• Node.js >= 20.0.0
• pnpm >= 10.0.0

Installation

pnpm install

Build

pnpm build

Test

pnpm test

Lint & Format

pnpm lint
pnpm format