together-ai
Advanced tools
Comparing version 0.5.0 to 0.5.1
{ | ||
"name": "together-ai", | ||
"version": "0.5.0", | ||
"version": "0.5.1", | ||
"description": "Node.js SDK for Together.ai.", | ||
@@ -5,0 +5,0 @@ "author": "Hassan El Mghari (@nutlope)", |
@@ -41,5 +41,3 @@ <div align="center"> | ||
```js | ||
const model = 'togethercomputer/llama-2-70b-chat'; | ||
const result = await together.inference(model, { | ||
const result = await together.inference('togethercomputer/llama-2-70b-chat', { | ||
prompt: 'Tell me about the history of the United States', | ||
@@ -51,2 +49,8 @@ max_tokens: 1000, | ||
### Example Chat App | ||
You can see an example of this library being used in a chat app here: https://simple-ai-chat.vercel.app. | ||
The code for the example is also available. This includes code on how to stream the results of the LLM directly to the frontend: https://github.com/Nutlope/chat | ||
## Popular Supported Models | ||
@@ -53,0 +57,0 @@ |
7178
68