Framework designed to simplify and accelerate the development of LLM-based applications.
🏎️ Fast-track your LLM-based apps with an accessible, production-ready library. 🏎️
Are you looking for maximum flexibility and efficiency in your next Python library? Tired of unnecessary complexities and inefficient token usage?
👉 Introducing draive - an open-source Python library under the Miquido AI Kickstarter framework, designed to simplify and accelerate the development of LLM-based applications. Get started with draive to streamline your workflow and build powerful, efficient apps with ease.
Dive straight into the code and learn how to use draive with our interactive guides. Check out Draive AI Course on YouTube to understand our unique architecture and see real-world applications of Draive in action. For quick solutions to common problems, explore our cookbooks.
Great, but how it looks like?
from draive import ctx, generate_text, LMM, tool, Toolbox
from draive.openai import OpenAIClient, openai_lmm_invocation
@tool # simply annotate a function as a tool
async def current_time(location: str) -> str:
return f"Time in {location} is 9:53:22"
async with ctx.new( # create execution context
dependencies=[OpenAIClient], # define client for llm provider
state=[LMM(invocation=openai_lmm_invocation)], # and use it for this scope
):
result: str = await generate_text( # choose the right abstraction, like simple `generate_text`
instruction="You are a helpful assistant", # provide clear instructions
input="What is the time in Kraków?", # give it some input (including multimodal)
tools=Toolbox(current_time), # and select any tools you like
)
print(result) # to finally get the result!
# output: The current time in Kraków is 9:53:22.
Fully functional examples of using the Draive library are also available in Draive Examples repository.
draive is an open-source Python library for developing apps powered by large language models. It stands out for its simplicity, consistent behavior, and transparency.
RAG enhances model capabilities and personalizes the outputs.
Simplified data extraction and structuring.
Sophisticated conversational agents.
… and much more!
With pip:
pip install draive
Draive library comes with optional integrations to 3rd party services:
Use OpenAI services client, including GPT, dall-e and embedding. Allows to use Azure services as well.
pip install draive[openai]
Use Anthropic services client, including Claude.
pip install draive[anthropic]
Use Google AIStudio services client, including Gemini.
pip install draive[gemini]
Use Mistral services client. Allows to use Azure services as well.
pip install draive[mistral]
Use Ollama services client.
pip install draive[ollama]
User Fastembed services client.
pip install draive[fastembed]
User SentencePiece model runner. It is used by Gemini and Mistral.
pip install draive[sentencepiece]
Beginning with version 0.29.0, Draive will initiate the migration to haiway for state and dependency management. Interfaces will be gradually updated to the new system, with a complete transition planned. Interfaces subject to change will be marked as deprecated and maintained for as long as feasible, though no later than the end of the migration period. Once the transition is complete, all deprecated interfaces will be fully removed.
Direct support for mistralrs library will be also removed during the process.
As an open-source project in a rapidly evolving field, we welcome all contributions. Whether you can add a new feature, enhance our infrastructure, or improve our documentation, your input is valuable to us.
We welcome any feedback and suggestions! Feel free to open an issue or pull request.
MIT License
Copyright (c) 2024 Miquido
Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions:
The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software.
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.
FAQs
Framework designed to simplify and accelerate the development of LLM-based applications.
We found that draive demonstrated a healthy version release cadence and project activity because the last version was released less than a year ago. It has 3 open source maintainers collaborating on the project.
Did you know?
Socket for GitHub automatically highlights issues in each pull request and monitors the health of all your open source dependencies. Discover the contents of your packages and block harmful activity before you install or update your dependencies.
Security News
Research
An advanced npm supply chain attack is leveraging Ethereum smart contracts for decentralized, persistent malware control, evading traditional defenses.
Security News
Research
Attackers are impersonating Sindre Sorhus on npm with a fake 'chalk-node' package containing a malicious backdoor to compromise developers' projects.
Security News
The npm package for the LottieFiles Player web component was hit with a supply chain attack after a software engineer's npmjs credentials were compromised.