🚀 Big News: Socket Acquires Coana to Bring Reachability Analysis to Every Appsec Team.Learn more
Socket
Book a DemoInstallSign in
Socket

github.com/aldarisbm/ltmllm

Package Overview
Dependencies
Alerts
File Explorer
Socket logo

Install Socket

Detect and block malicious and high-risk dependencies

Install

github.com/aldarisbm/ltmllm

v0.0.2-0.20240616032255-f94be55295eb
Source
Go
Version published
Created
Source

LTMLLM

ltmllm is a simple backend to create a long term memory large language model

Disclaimer

This is a work in progress and is not ready for use. I will only support OpenAI GPT streaming models.

Details:

The way this work is as follows:

  • We create a llm chatbot.
  • We will create a local k/v database(bolt) to save full messages and conversations
  • We will use an embedding API to create embeddings for each prompt and response
  • We will store the embeddings in a vector db (pinecone) and metadata pointing to bolt
  • Every time we interact with our chatbot, it will embed our question and query the vector db for the most similar messages
  • We will then retrieve the full message to give the chatbot context

FAQs

Package last updated on 16 Jun 2024

Did you know?

Socket

Socket for GitHub automatically highlights issues in each pull request and monitors the health of all your open source dependencies. Discover the contents of your packages and block harmful activity before you install or update your dependencies.

Install

Related posts