Kepler.gl AI Assistant Module
The AI Assistant is a module that adds an AI chatbot to Kepler.gl. This module aims to integrates Kepler.gl with AI-powered capabilities, enabling it to interact with multiple AI models seamlessly.
Overview
The AI Assistant Module facilitates communication, processes prompts, and optionally calls back into the main application to deliver results. This setup supports advanced functionalities like tool-based function calling for enhanced interactivity.
The system is designed to enable Kepler.gl, a React-based single-page application, to integrate an AI Assistant Module for performing tasks with large language models (LLMs) like OpenAI GPT models, Google Gemini models, and Ollama models.
An example of how the AI Assistant Module can be used to update a basemap in Kepler.gl:
This flow enables a seamless interaction where a user can update a basemap in Kepler.gl through a simple AI-driven prompt, showcasing the integration of LLMs with application actions and rendering.
The AI Assistant Module OpenAssistant
(Github: https://github.com/geodacenter/openassistant) is a open-source project that helps adding AI capabilities to your React SPA applications while keeping your data secure and private.
Key features:
- Built-in chat UI.
- Built-in "Screenshot to Ask" feature.
- Built-in "Talk to Ask" feature.
- Support OpenAI, Google Gemini, Ollama models.
- Support function calling with type hint.
- Support custom message UI for function calling.
- Addons:
- query your dataset using duckdb
- map your data
- analyze and visualize your data
...
Proposal
From the previous PRs, we have a working prototype of the AI Assistant Module with the following features:
- Show dataset/layer/variable info.
- Change the basemap style.
- Load data from url.
- Create a map layer using variable.
- Create a histogram.
- Create a scatter plot with regression line.
- Classify the data of a variable.
- Spatial join two datasets.
The next step is to integrate more kepler.gl features into the AI Assistant Module.
P0
Support more kepler.gl map layers
Support color palette
Support custom map styles
Support map settings
Support time playback