
Security News
vlt Launches "reproduce": A New Tool Challenging the Limits of Package Provenance
vlt's new "reproduce" tool verifies npm packages against their source code, outperforming traditional provenance adoption in the JavaScript ecosystem.
Phospho is an open source platform to help you monitor LLM apps.
With phospho, monitor every user interaction with your LLM app to identify issues and improve performance. Understand how users use your app and which versions of your product are the most successful.
Read the docs at docs.phospho.ai.
Warning : This project is still under active development!
You need Python >=3.9
pip install --upgrade phospho
Create an account on phospho. Create an API key and note down the project id. Set them as environment variables:
export PHOSPHO_API_KEY="your-api-key"
export PHOSPHO_PROJECT_ID="project-id"
In the code of your LLM app, log interactions with your agent using phospho.log()
.
import phospho
phospho.init()
# This is how you log interactions to phospho as strings
phospho.log(input="The user input", output="Your LLM app output")
You can also directly pass OpenAI API query and responses (or any object with same format) to phospho :
import phospho
import openai
phospho.init()
openai_client = openai.OpenAI()
# This is your agent code
query = {
"messages": [{"role": "user", "content": "The user input"}],
"model": "gpt-3.5-turbo",
}
response = openai_client.chat.completions.create(**query)
# Log the interactions to phospho
phospho.log(input=query, output=response)
Monitor and visualize your agent on the phospho dashboard.
You can also use phospho locally to run evaluations and event detection on your text messages.
See the phospho lab documentation for more information or the notebook quicksart.ipynb
in the notebooks
folder.
Read the docs at docs.phospho.ai for more information. Use your phospho dashboard to monitor your agent, score interactions and detect events.
FAQs
Text Analytics for LLM apps
We found that phospho demonstrated a healthy version release cadence and project activity because the last version was released less than a year ago. It has 1 open source maintainer collaborating on the project.
Did you know?
Socket for GitHub automatically highlights issues in each pull request and monitors the health of all your open source dependencies. Discover the contents of your packages and block harmful activity before you install or update your dependencies.
Security News
vlt's new "reproduce" tool verifies npm packages against their source code, outperforming traditional provenance adoption in the JavaScript ecosystem.
Research
Security News
Socket researchers uncovered a malicious PyPI package exploiting Deezer’s API to enable coordinated music piracy through API abuse and C2 server control.
Research
The Socket Research Team discovered a malicious npm package, '@ton-wallet/create', stealing cryptocurrency wallet keys from developers and users in the TON ecosystem.