@jupyterlite/ai

jupyterlite-ai

AI code completions and chat for JupyterLab, Notebook 7 and JupyterLite ✨

a screencast showing the Jupyterlite AI extension in JupyterLite

Requirements

[!NOTE] This extension is meant to be used in JupyterLite to enable AI code completions and chat in the browser, with a specific provider. To enable more AI providers in JupyterLab and Jupyter Notebook, we recommend using the Jupyter AI extension directly. At the moment Jupyter AI is not compatible with JupyterLite, but might be to some extent in the future.

• JupyterLab >= 4.4.0a0 or Notebook >= 7.4.0a0

✨ Try it in your browser ✨

You can try the extension in your browser using JupyterLite:

See the Usage section below for more information on how to provide your API key.

Install

To install the extension, execute:

pip install jupyterlite-ai

To install requirements (jupyterlab, jupyterlite and notebook), there is an optional dependencies argument:

pip install jupyterlite-ai[jupyter]

Usage

AI providers typically require using an API key to access their models.

The process is different for each provider, so you may refer to their documentation to learn how to generate new API keys, if they are not covered in the sections below.

Using MistralAI

[!WARNING] This extension is still very much experimental. It is not an official MistralAI extension.

• Go to https://console.mistral.ai/api-keys/ and create an API key.

• Open the JupyterLab settings and go to the Ai providers section to select the MistralAI provider and the API key (required).

• Open the chat, or use the inline completer

Using ChromeAI

[!WARNING] Support for ChromeAI is still experimental and only available in Google Chrome.

You can test ChromeAI is enabled in your browser by going to the following URL: https://chromeai.org/

Enable the proper flags in Google Chrome.

• chrome://flags/#prompt-api-for-gemini-nano
  • Select: Enabled
• chrome://flags/#optimization-guide-on-device-model
  • Select: Enabled BypassPrefRequirement
• chrome://components
  • Click Check for Update on Optimization Guide On Device Model to download the model
• [Optional] chrome://flags/#text-safety-classifier

Then restart Chrome for these changes to take effect.

[!WARNING] On first use, Chrome will download the on-device model, which can be as large as 22GB (according to their docs and at the time of writing). During the download, ChromeAI may not be available via the extension.

[!NOTE] For more information about Chrome Built-in AI: https://developer.chrome.com/docs/ai/get-started

Uninstall

To remove the extension, execute:

pip uninstall jupyterlite-ai

Contributing

Development install

Note: You will need NodeJS to build the extension package.

The jlpm command is JupyterLab's pinned version of yarn that is installed with JupyterLab. You may use yarn or npm in lieu of jlpm below.

# Clone the repo to your local environment
# Change directory to the jupyterlite_ai directory
# Install package in development mode
pip install -e "."
# Link your development version of the extension with JupyterLab
jupyter labextension develop . --overwrite
# Rebuild extension Typescript source after making changes
jlpm build

You can watch the source directory and run JupyterLab at the same time in different terminals to watch for changes in the extension's source and automatically rebuild the extension.

# Watch the source directory in one terminal, automatically rebuilding when needed
jlpm watch
# Run JupyterLab in another terminal
jupyter lab

With the watch command running, every saved change will immediately be built locally and available in your running JupyterLab. Refresh JupyterLab to load the change in your browser (you may need to wait several seconds for the extension to be rebuilt).

By default, the jlpm build command generates the source maps for this extension to make it easier to debug using the browser dev tools. To also generate source maps for the JupyterLab core extensions, you can run the following command:

jupyter lab build --minimize=False

Development uninstall

pip uninstall jupyterlite-ai

In development mode, you will also need to remove the symlink created by jupyter labextension develop command. To find its location, you can run jupyter labextension list to figure out where the labextensions folder is located. Then you can remove the symlink named @jupyterlite/ai within that folder.

Packaging the extension

See RELEASE