@isdk/ai-tool-prompt

ai-tool-prompt

• Management of various prompts
• System template format prompts (guessing corresponding system templates based on the model)
• Recommendation of parameters for LLM models

Installation

npm install @isdk/ai-tool @isdk/ai-tool-prompt

Prompt Structure

• _id: string (unique) - id of the prompt
• templateFormat: 'hf'|'ollama'|'langchain' - template format of the prompt, defaults to 'hf'
• template: string - template of the prompt, eg, '{{messages[0].content}}'
• type: 'system'|'tool'|'char' - type of the prompt
• prompt: object - default prompt data
• modelPattern: string|RegExpr|(string|RegExpr)[]|{[version:string]: string|RegExpr} - pattern(s) to match the LLM model name
• parameters: {[ruleMatched: string]: object]} - the default parameters of LLM models
  • the key is the matched rule named group: id or group[1], it is lowercase always.
  • the value is parameters of the LLM model
• extends: string - the id of the parent prompt
• version: {[name: string]: object} - the version/feature info of the prompt
  • the key is the name of the version/feature
  • the value is the prompt to overwrite.

Changelog

0.1.0 (2024-08-11)

⚠ BREAKING CHANGES

• rename option rule to modelPattern

Features

• add tag option for prompt settings (a012089)
• prompt: add phi-3.1 support (605d5bb)
• prompt: blilibili index 1.9B model system prompt template added (9c32316)
• prompt: Gemma system prompt template added (2ae3786)

Refactor

• rename option rule to modelPattern (1f19bd2)
• update to latest sqlite (cc3d3fb)