🚀 Big News: Socket Acquires Coana to Bring Reachability Analysis to Every Appsec Team.Learn more
Socket
Sign inDemoInstall
Socket

ai-bridge

Package Overview
Dependencies
Maintainers
1
Versions
16
Alerts
File Explorer

Advanced tools

Socket logo

Install Socket

Detect and block malicious and high-risk dependencies

Install

ai-bridge

AI connector library, which helps simplify API usage, and provide out of the box caching.

1.2.8
latest
Source
npm
Version published
Weekly downloads
11
-47.62%
Maintainers
1
Weekly downloads
 
Created
Source

ai-bridge

Thin wrapper over openAI api, and potentially other AI provider alternatives. It helps handle out of the box caching of request.

It also provide some very minor QOL enhancments to the API

Cache Options

  • Local jsonl cache dir
  • MongoDB connection

Provider support

  • openAI

Future provider support?

  • claude ?
  • forefront (embedding not supported)

Why should you be caching your AI response?

In general running LLM, is an expensive process. Caching however helps offset the cost involved for frequent and common query. The downside is, this is not appropriate for all use cases.

Keywords

AI

FAQs

Package last updated on 29 Nov 2023

Did you know?

Socket

Socket for GitHub automatically highlights issues in each pull request and monitors the health of all your open source dependencies. Discover the contents of your packages and block harmful activity before you install or update your dependencies.

Install

Related posts