genkitx-anthropic

Firebase Genkit <> Anthropic AI Plugin

Anthropic AI Community Plugin for Google Firebase Genkit

genkitx-anthropic is a community plugin for using Anthropic AI and all its supported models with Firebase Genkit.

This Genkit plugin allows to use Anthropic AI models through their official APIs.

If you want to use Anthropic AI models through Google Vertex AI, please refer to the official Vertex AI plugin.

Supported models

The plugin supports the most recent Anthropic models: Claude 3.5 Sonnet, Claude 3 Opus, Claude 3 Sonnet, and Claude 3 Haiku.

Installation

Install the plugin in your project with your favorite package manager:

• npm install genkitx-anthropic
• yarn add genkitx-anthropic

Usage

Initialize

import { genkit } from 'genkit';
import { anthropic, claude35Sonnet } from 'genkitx-anthropic';

const ai = genkit({
  plugins: [anthropic({ apiKey: process.env.ANTHROPIC_API_KEY })],
  // specify a default model for generate here if you wish:
  model: claude35Sonnet,
});

Basic examples

The simplest way to generate text is by using the generate method:

const response = await ai.generate({
  model: claude3Haiku, // model imported from genkitx-anthropic
  prompt: 'Tell me a joke.',
});

console.log(response.text);

Multi-modal prompt

// ...intialize Genkit instance (as shown above)...

const response = await ai.generate({
  prompt: [
    { text: 'What animal is in the photo?' },
    { media: { url: imageUrl } },
  ],
  config: {
    // control of the level of visual detail when processing image embeddings
    // Low detail level also decreases the token usage
    visualDetailLevel: 'low',
  },
});
console.log(response.text);

Within a flow

import { z } from 'genkit';

// ...initialize Genkit instance (as shown above)...

export const jokeFlow = ai.defineFlow(
  {
    name: 'jokeFlow',
    inputSchema: z.string(),
    outputSchema: z.string(),
  },
  async (subject) => {
    const llmResponse = await ai.generate({
      prompt: `tell me a joke about ${subject}`,
    });
    return llmResponse.text;
  }
);

Contributing

Want to contribute to the project? That's awesome! Head over to our Contribution Guidelines.

Need support?

[!NOTE]
This repository depends on Google's Firebase Genkit. For issues and questions related to Genkit, please refer to instructions available in Genkit's repository.

Reach out by opening a discussion on Github Discussions.

Credits

This plugin is proudly maintained by the team at The Fire Company. 🔥

License

This project is licensed under the Apache 2.0 License.