@evertech/chatgpt-api-patched
Advanced tools
A ChatGPT implementation using the official ChatGPT model via OpenAI's API.
The method we were using to access the ChatGPT raw models has been patched, unfortunately. Your options right now are to either use the official OpenAI API with the text-davinci-003 model (which costs money), or use a browser-based solution to interface with ChatGPT's backend (which is less powerful, more rate-limited and is not supported by this library at this time).
With the help of @PawanOsman, we've figured out a way to continue using the ChatGPT raw models. To hopefully prevent losing access again, we've decided to provide reverse proxy servers compatible with the OpenAI API. I've updated ChatGPTClient to support using a reverse proxy server instead of the OpenAI API server. See Using a Reverse Proxy for more information on available proxy servers and how they work.
Please note that if you choose to go this route, you are exposing your access token to a closed-source third-party server. If you are concerned about this, you may choose to either use a free ChatGPT account to minimize risks, or continue using the official OpenAI API instead with the text-davinci-003 model.
I've found a new working model for text-chat-davinci-002, text-chat-davinci-002-sh-alpha-aoruigiofdj83. This is the raw model that the ChatGPT Plus "Turbo" version uses. Responses are blazing fast. I've updated the library to use this model.
Bad timing; text-chat-davinci-002-sh-alpha-aoruigiofdj83 was removed shortly after, possibly due to a new model somewhere out there?
Experience the power of Bing's GPT-4 version of ChatGPT with BingAIClient (experimental).
The API server and CLI still need to be updated to support this, but you can use the client directly right now.
Please note that if your account is still wait-listed, you will not be able to use this client.
Even though text-chat-davinci-002-20221122 is back up again, it seems like it's constantly overloaded and returns a 429 error. It's likely that OpenAI only dedicated a small amount of resources to this model to prevent it being widely used by the public. Additionally, I've heard that newer versions are now access-locked to OpenAI employees and partners, so it's unlikely that we'll be able to find any workarounds until the model is officially released.
You may use the text-davinci-003 model instead as a drop-in replacement. Keep in mind that text-davinci-003 is not as good as text-chat-davinci-002 (which is trained via RHLF and fine-tuned to be a conversational AI), though results are still pretty good in most cases. Please note that using text-davinci-003 will cost you credits ($).
I will be re-adding support for the browser-based ChatGPT for the API server and CLI. Please star and watch this repository for updates.
The roller coaster has reached the next stop. text-chat-davinci-002-20221122 is back up again.
Trying to use text-chat-davinci-002-20221122 with the OpenAI API now returns a 404 error.
You may use the text-davinci-003 model instead as a drop-in replacement. Keep in mind that text-davinci-003 is not as good as text-chat-davinci-002 (which is trained via RHLF and fine-tuned to be a conversational AI), though results are still very good. Please note that using text-davinci-003 will cost you credits ($).
Please hold for further updates as we investigate further workarounds.
Trying to use text-chat-davinci-002-20230126 with the OpenAI API now returns a 404 error. Someone has already found the new model name, but they are unwilling to share at this time. I will update this repository once I find the new model. If you have any leads, please open an issue or a pull request.
In the meantime, I've added support for models like text-davinci-003, which you can use as a drop-in replacement. Keep in mind that text-davinci-003 is not as good as text-chat-davinci-002 (which is trained via RHLF and fine-tuned to be a conversational AI), though results are still very good. Please note that using text-davinci-003 will cost you credits ($).
Discord user @pig#8932 has found a working text-chat-davinci-002 model, text-chat-davinci-002-20221122. I've updated the library to use this model.
A ChatGPT implementation with support for Bing's GPT-4 version of ChatGPT, plus the official ChatGPT model via OpenAI's API. Available as a Node.js module, REST API server, and CLI app.
This is an implementation of ChatGPT, with support for Bing's GPT-4 version of ChatGPT, plus the official ChatGPT raw model, text-chat-davinci-002.
An experimental client for Bing's GPT-4 version of ChatGPT is available in BingAIClient. It works much like ChatGPT, but it's powered by GPT-4 instead of GPT-3. For more information on its capabilities and limitations, see this Reddit comment.
text-chat-davinci-002The model name text-chat-davinci-002-20230126 was briefly leaked while I was inspecting the network requests made by the official ChatGPT website, and I discovered that it works with the OpenAI API. Since then, that model and others have been disabled, but I'm keeping this repo updated with the newer versions of text-chat-davinci-002 as we find them. Usage of this model currently does not cost any credits.
As far as I'm aware, I was the first one who discovered this, and usage of the model has since been implemented in libraries like acheong08/ChatGPT and transitive-bullshit/chatgpt-api as we collaborated and shared knowledge.
By itself, the model does not have any conversational support, so ChatGPTClient uses a cache to store conversations and pass them to the model as context. This allows you to have persistent conversations with ChatGPT in a nearly identical way to the official website.
text-chat-davinci-002, via OpenAI's API.ChatGPTClient and BingAIClient class that you can use in your own Node.js applications.ChatGPTClient) Replicates chat threads from the official ChatGPT website (with conversation IDs and message IDs), with persistent conversations using Keyv.
keyv-file adapter is also included in this package, and can be used to store conversations in a JSON file if you're using the API server or CLI (see settings.example.js).ChatGPTClient) Supports configurable prompt prefixes, and custom names for the user and ChatGPT.
npm i @waylaidwanderer/chatgpt-api
import { BingAIClient } from '@waylaidwanderer/chatgpt-api';
const bingAIClient = new BingAIClient({
// Necessary for some people in different countries, e.g. China (https://cn.bing.com)
host: '',
// "_U" cookie from bing.com
userToken: '',
// If the above doesn't work, provide all your cookies as a string instead
cookies: '',
debug: false,
});
let response = await bingAIClient.sendMessage('Write a short poem about cats', {
onProgress: (token) => {
process.stdout.write(token);
},
});
console.log(response);
response = await bingAIClient.sendMessage('Now write it in French', {
conversationSignature: response.conversationSignature,
conversationId: response.conversationId,
clientId: response.clientId,
invocationId: response.invocationId,
onProgress: (token) => {
process.stdout.write(token);
},
});
console.log(response);
import { ChatGPTClient } from '@waylaidwanderer/chatgpt-api';
const clientOptions = {
// (Optional) Support for a reverse proxy for the completions endpoint (private API server).
// Warning: This will expose your `openaiApiKey` to a third-party. Consider the risks before using this.
// reverseProxyUrl: 'https://chatgpt.hato.ai/completions',
// (Optional) Parameters as described in https://platform.openai.com/docs/api-reference/completions
modelOptions: {
// You can override the model name and any other parameters here.
// model: 'text-chat-davinci-002-20221122',
},
// (Optional) Set custom instructions instead of "You are ChatGPT...".
// promptPrefix: 'You are Bob, a cowboy in Western times...',
// (Optional) Set a custom name for the user
// userLabel: 'User',
// (Optional) Set a custom name for ChatGPT
// chatGptLabel: 'ChatGPT',
// (Optional) Set to true to enable `console.debug()` logging
debug: false,
};
const cacheOptions = {
// Options for the Keyv cache, see https://www.npmjs.com/package/keyv
// This is used for storing conversations, and supports additional drivers (conversations are stored in memory by default)
// For example, to use a JSON file (`npm i keyv-file`) as a database:
// store: new KeyvFile({ filename: 'cache.json' }),
};
const chatGptClient = new ChatGPTClient('OPENAI_API_KEY', clientOptions, cacheOptions);
const response = await chatGptClient.sendMessage('Hello!');
console.log(response); // { response: 'Hi! How can I help you today?', conversationId: '...', messageId: '...' }
const response2 = await chatGptClient.sendMessage('Write a poem about cats.', { conversationId: response.conversationId, parentMessageId: response.messageId });
console.log(response2.response); // Cats are the best pets in the world.
const response3 = await chatGptClient.sendMessage('Now write it in French.', {
conversationId: response2.conversationId,
parentMessageId: response2.messageId,
// If you want streamed responses, you can set the `onProgress` callback to receive the response as it's generated.
// You will receive one token at a time, so you will need to concatenate them yourself.
onProgress: (token) => console.log(token),
});
console.log(response3.response); // Les chats sont les meilleurs animaux de compagnie du monde.
You can install the package using
npm i -g @waylaidwanderer/chatgpt-api
then run it using
chatgpt-api.
This takes an optional --settings=<path_to_settings.js> parameter, or looks for settings.js in the current directory if not set, with the following contents:
module.exports = {
// Your OpenAI API key (for `ChatGPTClient`)
openaiApiKey: process.env.OPENAI_API_KEY || '',
chatGptClient: {
// (Optional) Support for a reverse proxy for the completions endpoint (private API server).
// Warning: This will expose your `openaiApiKey` to a third-party. Consider the risks before using this.
// reverseProxyUrl: 'https://chatgpt.hato.ai/completions',
// (Optional) Parameters as described in https://platform.openai.com/docs/api-reference/completions
modelOptions: {
// You can override the model name and any other parameters here.
// model: 'text-chat-davinci-002-20221122',
},
// (Optional) Set custom instructions instead of "You are ChatGPT...".
// promptPrefix: 'You are Bob, a cowboy in Western times...',
// (Optional) Set a custom name for the user
// userLabel: 'User',
// (Optional) Set a custom name for ChatGPT
// chatGptLabel: 'ChatGPT',
// (Optional) Set to true to enable `console.debug()` logging
debug: false,
},
// Options for the Keyv cache, see https://www.npmjs.com/package/keyv.
// This is used for storing conversations, and supports additional drivers (conversations are stored in memory by default).
// Does not apply when using `BingAIClient`.
cacheOptions: {},
// Options for the Bing client
bingAiClient: {
// Necessary for some people in different countries, e.g. China (https://cn.bing.com)
host: '',
// The "_U" cookie value from bing.com
userToken: '',
// If the above doesn't work, provide all your cookies as a string instead
cookies: '',
// (Optional) Set to true to enable `console.debug()` logging
debug: false,
},
// Options for the API server
apiOptions: {
port: process.env.API_PORT || 3000,
host: process.env.API_HOST || 'localhost',
// (Optional) Set to true to enable `console.debug()` logging
debug: false,
// (Optional) Set to "bing" to use `BingAIClient` instead of `ChatGPTClient`.
// clientToUse: 'bing',
},
// Options for the CLI app
cliOptions: {
// (Optional) Set to "bing" to use `BingAIClient` instead of `ChatGPTClient`.
// clientToUse: 'bing',
},
// If set, `ChatGPTClient` will use `keyv-file` to store conversations to this JSON file instead of in memory.
// However, `cacheOptions.store` will override this if set
storageFilePath: process.env.STORAGE_FILE_PATH || './cache.json',
};
Alternatively, you can install and run the package directly.
git clone https://github.com/waylaidwanderer/node-chatgpt-apinpm install (if not using Docker)settings.example.js to settings.js in the root directory and change the settings where required.npm start or npm run server (if not using Docker)docker-compose up (requires Docker)To start a conversation with ChatGPT, send a POST request to the server's /conversation endpoint with a JSON body in the following format.
Optional parameters are only necessary for conversations that span multiple requests:
{
"message": "Hello, how are you today?",
"conversationId": "your-conversation-id (optional)",
"parentMessageId": "your-parent-message-id (optional, for `ChatGPTClient` only)",
"conversationSignature": "your-conversation-signature (optional, for `BingAIClient` only)",
"clientId": "your-client-id (optional, for `BingAIClient` only)",
"invocationId": "your-invocation-id (optional, for `BingAIClient` only)",
}
The server will return a JSON object containing ChatGPT's response:
// HTTP/1.1 200 OK
{
"response": "I'm doing well, thank you! How are you?",
"conversationId": "your-conversation-id",
"messageId": "response-message-id (for `ChatGPTClient` only)",
"conversationSignature": "your-conversation-signature (for `BingAIClient` only)",
"clientId": "your-client-id (for `BingAIClient` only)",
"invocationId": "your-invocation-id (for `BingAIClient` only - pass this new value back into subsequent requests as-is)",
"details": "additional details about the AI's response (for `BingAIClient` only)"
}
If the request is unsuccessful, the server will return a JSON object with an error message.
If the request object is missing a required property (e.g. message):
// HTTP/1.1 400 Bad Request
{
"error": "The message parameter is required."
}
If there was an error sending the message to ChatGPT:
// HTTP/1.1 503 Service Unavailable
{
"error": "There was an error communicating with ChatGPT."
}
You can set "stream": true in the request body to receive a stream of tokens as they are generated.
{
"message": "Write a poem about cats.",
"conversationId": "your-conversation-id (optional)",
"parentMessageId": "your-parent-message-id (optional)",
"stream": true
}
See demos/use-api-server-streaming.js for an example of how to receive the response as it's generated. You will receive one token at a time, so you will need to concatenate them yourself.
Successful output:
{ data: '', event: '', id: '', retry: 3000 }
{ data: 'Hello', event: '', id: '', retry: undefined }
{ data: '!', event: '', id: '', retry: undefined }
{ data: ' How', event: '', id: '', retry: undefined }
{ data: ' can', event: '', id: '', retry: undefined }
{ data: ' I', event: '', id: '', retry: undefined }
{ data: ' help', event: '', id: '', retry: undefined }
{ data: ' you', event: '', id: '', retry: undefined }
{ data: ' today', event: '', id: '', retry: undefined }
{ data: '?', event: '', id: '', retry: undefined }
{ data: '[DONE]', event: '', id: '', retry: undefined }
// Hello! How can I help you today?
Error output:
const message = {
data: '{"code":503,"error":"There was an error communicating with ChatGPT."}',
event: 'error',
id: '',
retry: undefined
};
if (message.event === 'error') {
console.error(JSON.parse(message.data).error); // There was an error communicating with ChatGPT.
}
Follow the same setup instructions for the API server, creating settings.js.
If installed globally:
chatgpt-cli
If installed locally:
npm run cli
ChatGPT's responses are automatically copied to your clipboard, so you can paste them into other applications.
As shown in the examples above, you can set reverseProxyUrl in ChatGPTClient's options to use a reverse proxy server instead of the official ChatGPT API.
For now, this is the only way to use the ChatGPT raw models. This method has been patched, but you may still want to use a reverse proxy for other reasons.
How does it work? Simple answer: ChatGPTClient > reverse proxy > OpenAI server. The reverse proxy server does some magic under the hood to access the raw model directly via OpenAI's server and then returns the response to ChatGPTClient.
Instructions are provided below.
accessToken property).
reverseProxyUrl to https://chatgpt.hato.ai/completions in settings.js > chatGptClient or ChatGPTClient's options.settings.openaiApiKey) to the ChatGPT access token you got in step 1.model to text-davinci-002-render, text-davinci-002-render-paid, or text-davinci-002-render-sha depending on which ChatGPT models that your account has access to. Models must be a ChatGPT model name, not the raw model name, and you cannot use a model that your account does not have access to.
stream: true (API) or onProgress (client) as a workaround.accessToken property).
reverseProxyUrl to https://chatgpt.pawan.krd/api/completions in settings.js > chatGptClient or ChatGPTClient's options.settings.openaiApiKey) to the ChatGPT access token you got in step 1.model to text-davinci-002-render, text-davinci-002-render-paid, or text-davinci-002-render-sha depending on which ChatGPT models that your account has access to. Models must be a ChatGPT model name, not the raw model name, and you cannot use a model that your account does not have access to.
stream: true (API) or onProgress (client) as a workaround.Since text-chat-davinci-002 is ChatGPT's raw model, I had to do my best to replicate the way the official ChatGPT website uses it. After extensive testing and comparing responses, I believe that the model used by ChatGPT has some additional fine-tuning.
This means my implementation or the raw model may not behave exactly the same in some ways:
Conversations are not tied to any user IDs, so if that's important to you, you should implement your own user ID system.
ChatGPT's model parameters (temperature, frequency penalty, etc.) are unknown, so I set some defaults that I thought would be reasonable.
Conversations are limited to roughly the last 3000 tokens, so earlier messages may be forgotten during longer conversations.
It is well known that, as part of the fine-tuning, ChatGPT had the following preamble:
"You are ChatGPT, a large language model trained by OpenAI. You answer as concisely as possible for each response (e.g. don’t be verbose). It is very important that you answer as concisely as possible, so please remember this. If you are generating a list, do not have too many items. Keep the number of items short. Knowledge cutoff: 2021-09 Current date: 2023-01-31"
As OpenAI updates ChatGPT, this preamble may also change. The default prompt prefix in my implementation attempts to replicate a similar behavior to the current ChatGPT model.
If you'd like to contribute to this project, please create a pull request with a detailed description of your changes.
This project is licensed under the MIT License.
FAQs
A ChatGPT implementation using the official ChatGPT model via OpenAI's API.
We found that @evertech/chatgpt-api-patched demonstrated a not healthy version release cadence and project activity because the last version was released a year ago. It has 1 open source maintainer collaborating on the project.
Did you know?
Socket for GitHub automatically highlights issues in each pull request and monitors the health of all your open source dependencies. Discover the contents of your packages and block harmful activity before you install or update your dependencies.
Security News
In this segment of the Risky Business podcast, Feross Aboukhadijeh and Patrick Gray discuss the challenges of tracking malware discovered in open source softare.
Research
Security News
A threat actor's playbook for exploiting the npm ecosystem was exposed on the dark web, detailing how to build a blockchain-powered botnet.
Security News
NVD’s backlog surpasses 20,000 CVEs as analysis slows and NIST announces new system updates to address ongoing delays.