@theia/ai-llamafile

AI Llamafile Integration

The AI Llamafile package provides an integration that allows users to manage and interact with Llamafile language models within Theia IDE.

Features

• Start and stop Llamafile language servers.

Commands

Start Llamafile

• Command ID: llamafile.start
• Label: Start Llamafile
• Functionality: Allows you to start a Llamafile language server by selecting from a list of configured Llamafiles.

Stop Llamafile

• Command ID: llamafile.stop
• Label: Stop Llamafile
• Functionality: Allows you to stop a running Llamafile language server by selecting from a list of currently running Llamafiles.

Usage

• Starting a Llamafile Language Server:

  • Use the command palette to invoke Start Llamafile.
  • A quick pick menu will appear with a list of configured Llamafiles.
  • Select a Llamafile to start its language server.

• Stopping a Llamafile Language Server:

  • Use the command palette to invoke Stop Llamafile.
  • A quick pick menu will display a list of currently running Llamafiles.
  • Select a Llamafile to stop its language server.

Dependencies

This extension depends on the @theia/ai-core package for AI-related services and functionalities.

Configuration

Make sure to configure your Llamafiles properly within the preference settings. This setting is an array of objects, where each object defines a llamafile with a user-friendly name, the file uri, and the port to start the server on.

Example Configuration:

{
    "ai-features.llamafile.llamafiles": [
        {
            "name": "MyLlamaFile",
            "uri": "file:///path/to/my.llamafile",
            "port": 30000
        }
    ]
}

Changelog

1.65.0 - 9/26/2025

• [ai-chat] cancelled incomplete requests on new request #16179
• [ai-chat] deduplicated tools before sending llm request #16229
• [ai-chat] enabled specifying original state in change sets #16067
• [ai-chat] unified tool call result handling #16106
• [ai-chat-ui] added chat input history with arrow key navigation #16174 - Contributed on behalf of STMicroelectronics
• [ai-chat-ui] cancelled tool execution confirm dialogs when request was cancelled #16221
• [ai-chat-ui] fix(chat): prevent prompt navigation when suggestion widget is visible #16224
• [ai-chat-ui] fixed #16129 #16185
• [ai-chat-ui] fixed arrow up/down only triggering prompt history if visual top/bottom line #16265
• [ai-claude-code] initial Claude Code agent integration #16273
• [ai-core] Also watch non-existent template directories #16251
• [ai-google] improved error reporting for Google GenAI connector #16228
• [ai-ide] added "find files" tool function #16250
• [ai-ide] collapsed prompt fragment list 1st level by default #16202
• [ai-ide] fixed show variables and functions only from selected prompt variants #15519
• [ai-ide] improved getWorkspaceList to mark sub directories #16170
• [ai-ide] refined app tester prompt #16147
• [ai-ide] removed workspace directory structure function from default prompts #16171
• [ai-mcp-server] added model context protocol server integration for theia #15832
• [ai-openai] added info on bearer token #16307
• [ai-openai] correctly handled reasoning output of openai/gpt-oss-120b #16282
• [ai-openai] deployment configuration for Azure hosted models was added #16324
• [ai-openai] updated OpenAI models, added gpt-5 #16169
• [changelog] fixed changelog for 1.64.0 #16103
• [changelog] updated changelog.md #16217
• [core] added coding guidelines to project info #16318
• [core] cleaned up emitters and dangling references when Theia DockPanel disposed #16317
• [core] ended support for Node 18 and upgraded to node-gyp 11.x #16218 - Contributed on behalf of STMicroelectronics
• [core] fixed api tests on windows #16050
• [core] fixed missing filters in save as dialog #16247 - Contributed on behalf of MVTec Software GmbH
• [core] fixed react warning for duplicate createroot calls on singleton reactdialogs #16306
• [core] fixed test failures on Ubuntu with Node 22 #16272
• [core] fixed: correctly handle plugin-icons during menu creation and use tooltip #16181
• [core] localized property tooltips for tasks.json #16300
• [core] new contribution point to modify the shell layout data #16242
• [core] npm upgrade #16264
• [core] Passed correct "effectiveMenuPath" to menu actions #16148 - Contributed on behalf of STMicroelectronics
• [core] ran npm upgrade #15688
• [core] replaced links in status bar items which provide markdown with safe commands #16182
• [core] restored extracted widget to main window #15871 - contributed on behalf of STMicroelectronics
• [core] Reverted "Ensure context menu arguments are propagated to submenus" #16139
• [core] theia v1.64.0 released #16100
• [core] translation update for version 1.65.0 #16329
• [core] updated colors for editor gutter #16096
• [debug] added evaluate in debug console command #16289
• [debug] added Run to Cursor and Run to Line commands #16219
• [debug] don't accept/cancel breakpoint editor while its suggest widget is visible #16285
• [debug] Don't show inline stackframe pointer when line is empty #16308 - Contributed on behalf of MVTec Software GmbH
• [debug] enhanced localization of the debug package #16305
• [debug] fixed breakpoints being lost when editing source #16154
• [debug] fixed enabling continue command if the debugger is active for pressing F5 #14641 - Contributed by MVTec Software GmbH
• [debug] fixed line breakpoints not shifting if lines are inserted above #16183
• [debug] fixed text misalignment caused by inline breakpoint decoration #16160
• [debug] removed excessive spacing in breakpoint list #16173 - Contributed on behalf of STMicroelectronics
• [debug] showed the error message when setting a variable fails #16235
• [debug] supported copy value/copy as expression in debug console #16310
• [editor] stored/restored navigation locations without warning #16207 - Contributed on behalf of STMicroelectronics
• [ffmpeg] fixed ffmpeg cache write promise #16297
• [getting-started] added a link to usage data & telemetry info #16184
• [github] added sbom generation and upload workflow #16290
• [monaco] fixed two dots in save as dialog #16299
• [notebook] added support for vscode-notebook-cell uri's #16276
• [plugin] added argument processor for plugin toolbar command arguments #16230
• [plugin] new jupyter support and non chromium rendering fix #16243
• [plugin-ext] added automatic ${viewId}.open command #16239
• [plugin-ext] correctly supported shadow dom when forwarding links from webviews #16213
• [plugin-ext] fixed error in previous PR #16178
• [plugin-ext] fixed leak in status bar registry that caused memory leaks on item updates #16168
• [plugin-ext] fixed missing new file entries from vscode extensions #16241 - Contributed on behalf of MVTec Software GmbH
• [preferences] improved preferenceWidget state restoration on start and scope change #16078
• [scripts] updated translation workflow to include common dirs #16328
• [search-in-workspace] search in workspace / find in files functionality fixed in browser-only environment #16231
• [task] enhanced localization of the task package #16286
• [vscode] API evolution (public and proposed) to 1.104.0 #16281 - Contributed on behalf of STMicroelectronics

<a name="breaking_changes_1.65.0">Breaking Changes:</a>

• [ai-ide]TaskContextFileStorageService.getStorageLocation and TaskContextFileStorageService.watchStorage modified to run synchronously, with corresponding change of signature. #16063
• [core] Make Preferences available in the back end #16017 - Contributed on behalf of STMicroelectronics
  This PR allows to user default and user preferences in the back-end process. See Migration.md for breaking API changes
• [workspace] WorkspaceService.reloadWindow now requires the workspace path string parameter #16238
• [filesystem] browser-only: fixed Safari compatibility issues, refactored implementation to use OPFS API with web workers, implemented file watching, folder copying, file/folder download and upload capabilities with streaming support. OPFSFileSystemProvider rewritten, OPFSInitialization.getRootDirectory() signature changed. FileUploadService/FileDownloadService moved/renamed. See Migration.md for migration steps. #16187