evalai

EvalAI-CLI

Official Command Line utility to use EvalAI in your terminal.

EvalAI-CLI is designed to extend the functionality of the EvalAI web application to command line to make the platform more accessible and terminal-friendly to its users.

Installation

EvalAI-CLI and its required dependencies can be installed using pip:

pip install evalai

Once EvalAI-CLI is installed, check out the usage documentation.

Contributing Guidelines

If you are interested in contributing to EvalAI-CLI, follow our contribution guidelines.

Development Setup

• Setup the development environment for EvalAI and make sure that it is running perfectly.

• Clone the evalai-cli repository to your machine via git

  git clone https://github.com/Cloud-CV/evalai-cli.git evalai-cli
  

• Create a virtual environment

  cd evalai-cli
  virtualenv -p python3 venv
  source venv/bin/activate
  

• Install the package locally

  pip install -e .
  

• Change the evalai-cli host to make request to local EvalAI server running on http://localhost:8000 by running:

  evalai host -sh http://localhost:8000
  

• Login to cli using the command evalai login Two users will be created by default which are listed below -

  Host User - username: host, password: password
  Participant User - username: participant, password: password