Socket
Socket
Sign inDemoInstall

@tgpt/open-api

Package Overview
Dependencies
174
Maintainers
1
Versions
1
Alerts
File Explorer

Advanced tools

Install Socket

Detect and block malicious and high-risk dependencies

Install

    @tgpt/open-api

AI connector library, which helps simplify API usage, and provide out of the box caching.


Version published
Weekly downloads
2
increased by100%
Maintainers
1
Created
Weekly downloads
 

Readme

Source

ai-bridge

Thin wrapper over openAI api, and potentially other AI provider alternatives. It helps handle out of the box caching of request.

It also provide some very minor QOL enhancments to the API

Cache Options

  • Local jsonl cache dir
  • MongoDB connection

Provider support

  • openAI

Future provider support?

  • claude ?
  • forefront (embedding not supported)

Why should you be caching your AI response?

In general running LLM, is an expensive process. Caching however helps offset the cost involved for frequent and common query. The downside is, this is not appropriate for all use cases.

Keywords

FAQs

Last updated on 28 Jun 2023

Did you know?

Socket for GitHub automatically highlights issues in each pull request and monitors the health of all your open source dependencies. Discover the contents of your packages and block harmful activity before you install or update your dependencies.

Install

Related posts

SocketSocket SOC 2 Logo

Product

  • Package Alerts
  • Integrations
  • Docs
  • Pricing
  • FAQ
  • Roadmap

Stay in touch

Get open source security insights delivered straight into your inbox.


  • Terms
  • Privacy
  • Security

Made with ⚡️ by Socket Inc