nbox provides first class API support for all NimbleBox.ai infrastructure (NBX-Build, Jobs, Deploy) and services (NBX-Workspaces) components. Write jobs using nbox.Operators
# on macos find the correct wheel file based on python version: https://github.com/pietrodn/grpcio-mac-arm-build/releases/tag/1.51.1
pip install <wheel_url>
pip install nbox
# on linux
pip install nbox
Install the package from pypi:
When loading nbox for the first time, it will prompt you the username and password and create a secrets file at ~/.nbx/secrets.json. This file then contains all the information that you don’t have to fetch manually again.
Our APIs are deep, user functions are kept to minimum and most relavant. This documentation contains the full spec of everything, but here’s all the APIs you need to know:
nbox
├── Model # Framework agnostic Model
│ ├── __call__
│ ├── deploy
│ ├── train_on_instance (WIP)
│ └── train_on_jobs (WIP)
├── Operators # How jobs are combinations of operators
│ ├── __call__
│ └── deploy
├── Jobs # For controlling all your jobs
│ ├── logs # stream logs right on your terminal
│ └── trigger # manually trigger a job
└── Instance
├── __call__ # Run any command on the instance
└── mv (WIP) # Move files to and from NBX-Build
Let's take this script as an example
from nbox import operator, Operator
from nbox.lib.shell import ShellCommand
# define your function and wrap it as an operator
@operator()
def foo(x: Dict):
return "bar"
# or use OO to deploy an API
@operator()
class Baz():
def __init__(self, power: int = 2):
# load any model that you want
self.model = load_tf_pt_model()
self.power = power
def forward(self, x: float = 1.0):
return {"pred": x ** self.power}
Through your CLI:
# to deploy a job
nbx jobs upload file:foo 'my_first_job'
# to deploy an API
nbx serve upload file:Baz 'my_first_api'
Join our discord and someone from our community or engineering team will respond!
The code in thist repo is licensed as Apache License 2.0. Please check for individual repositories for licenses.
FAQs
ML Inference 🥶
We found that nbox demonstrated a healthy version release cadence and project activity because the last version was released less than a year ago. It has 1 open source maintainer collaborating on the project.
Did you know?
Socket for GitHub automatically highlights issues in each pull request and monitors the health of all your open source dependencies. Discover the contents of your packages and block harmful activity before you install or update your dependencies.
Security News
Research
The Socket Research Team breaks down a malicious wrapper package that uses obfuscation to harvest credentials and exfiltrate sensitive data.
Research
Security News
Attackers used a malicious npm package typosquatting a popular ESLint plugin to steal sensitive data, execute commands, and exploit developer systems.
Security News
The Ultralytics' PyPI Package was compromised four times in one weekend through GitHub Actions cache poisoning and failure to rotate previously compromised API tokens.