@theia/ai-llamafile

AI Llamafile Integration

The AI Llamafile package provides an integration that allows users to manage and interact with Llamafile language models within Theia IDE.

Features

• Start and stop Llamafile language servers.

Commands

Start Llamafile

• Command ID: llamafile.start
• Label: Start Llamafile
• Functionality: Allows you to start a Llamafile language server by selecting from a list of configured Llamafiles.

Stop Llamafile

• Command ID: llamafile.stop
• Label: Stop Llamafile
• Functionality: Allows you to stop a running Llamafile language server by selecting from a list of currently running Llamafiles.

Usage

• Starting a Llamafile Language Server:

  • Use the command palette to invoke Start Llamafile.
  • A quick pick menu will appear with a list of configured Llamafiles.
  • Select a Llamafile to start its language server.

• Stopping a Llamafile Language Server:

  • Use the command palette to invoke Stop Llamafile.
  • A quick pick menu will display a list of currently running Llamafiles.
  • Select a Llamafile to stop its language server.

Dependencies

This extension depends on the @theia/ai-core package for AI-related services and functionalities.

Configuration

Make sure to configure your Llamafiles properly within the preference settings. This setting is an array of objects, where each object defines a llamafile with a user-friendly name, the file uri, and the port to start the server on.

Example Configuration:

{
    "ai-features.llamafile.llamafiles": [
        {
            "name": "MyLlamaFile",
            "uri": "file:///path/to/my.llamafile",
            "port": 30000
        }
    ]
}

Changelog

1.64.0 - 7/31/2025

• [ai-chat] adapted the default of the summary agent to gtp-4o #16042
• [ai-chat] added session cleanup to AgentDelegationTool #15996
• [ai-chat] correctly handled stream responses #15942
• [ai-chat] preserved delegation content #16066
• [ai-chat] reduced formatter selection prompts for changeset elements #16094
• [ai-chat-ui] fixed cancel on escape in chat input #16068
• [ai-chat-ui] improved chatUI auto-scroll / scroll-lock consistency #15936
• [ai-chat-ui] improved delegated content part styling #15956
• [ai-chat-ui] renamed 'pin agent' to 'agent' to avoid confusion #16072
• [ai-core] added AI model aliases and default models #15782
• [ai-core] displayed warning when selected variant does not exist #15974
• [ai-core] fixed startup crash when 'ai-chat' was not included #15902
• [ai-ide] added functions for launch configuration #15941
• [ai-ide] introduced puppeteer to manage the browser instance #15734
• [ai-ide] put new prompt templates under MIT #16051
• [ai-ide] promoted AI IDE features to beta #16058
• [ai-ide] refined architect task context creation prompt #16059
• [ai-ide] showed selected prompted variant if configured, showed default otherwise #15907
• [ai-ide] updated toolProvider to handle cancellation #15951
• [ai-ide] used the agent name that requested the tool call in the change set title #15952 - Contributed on behalf of Lonti.com Pty Lt
• [ai-ollama] fixed crash in ollama language model #16091
• [ai-ollama] used available parameter information from the provided tool description #15575
• [application-package] bumped vscode API compatibility to 1.102.3 #16081 - Contributed on behalf of STMicroelectronics
• [core] bumped cookie to 1.0.2 #16041 - contributed by STMicroelectronics
• [core] bumped nyc to 17.1.0 #15989 - contributed by STMicroelectronics
• [core] correctly detached from DOM in DynamicMenuWidget #16019
• [core] enabled clicks inside interactive hover tooltips and opened tooltip on status-bar click #15971
• [core] ensured double click on tab maximizes area #16079
• [core] fix cannot drop explorer view files on AI chat input on Windows #15979 - contributed on behalf of Lonti.com Pty Ltd.
• [core] fix: dynamicMenuWidget memory leak #15982 - contributed by Hbb
• [core] fixed default locale issue #16093
• [core] fixed memory leak in RenderedToolbarItemImpl #15949 - contributed on behalf of Lonti.com Pty Ltd
• [core] fixed stale tree selection #15928
• [core] fixed typeError in updateAutoSaveMode #15991
• [core] reenabled deprecated paste command in electron #15918 - contributed on behalf of STMicroelectronics
• [core] setting service gracefully handled ENOENT #15803
• [core] translation update for version 1.64.0 #16099
• [core] ui fixes (squashed) #15953
• [doc] updated publishing guide documentation #15939
• [editor] removed now unneeded EditorManager override #15934
• [electron] updated to Electron 37.2.1 #15999
• [monaco] ide cannot fully restore to the previous state after restarting #15898
• [navigator] removed double-click handler that caused folders to auto-open #15869
• [notebook] fixed usage of lodash debounce #16045
• [playwright] exported terminal, monaco and welcome-view playwright utilities #16013
• [playwright] made expectation independent from execution order #16047
• [plugin-ext] implemented support for remote MCP server #16002
• [remote] improved type safety of remote ssh config #15671
• [remote] used environment variable instead of wmic to get remote architecture #16004
• [remote] used node 22 for remote containers #15937
• [scm] added the 3-way merge editor #15701
• [scm] fixed minor issues with scroll sync #16038
• [scm] set relative sizes for horizontal split panel #16036
• [toolbar] fixed styling of main toolbar items so enabled items have a pointer cursor #15948 - contributed on behalf of Lonti.com Pty Ltd
• [vsx-registry] disabled extension recommendations #15830
• [vsx-registry] restored location for the clear all actions in vsx extension view #15923 - contributed on behalf of STMicroelectronics
• [workflows] published next version once a week #15965

<a name="breaking_changes_1.64.0">Breaking Changes:</a>

• [ai-core] extracts UI from @theia/ai-core and @theia/ai-mcp to @theia/ai-core-ui and @theia/ai-mcp-ui #16075.
  Include these new packages to restore the old behavior. Also moves the AI Enable preference to @theia/ai-ide and enables the AI features by default if @theia/ai-ide is not included.