Official Command Line utility to use EvalAI in your terminal.

EvalAI-CLI is designed to extend the functionality of the EvalAI web application to command line to make the platform more accessible and terminal-friendly to its users.

EvalAI-CLI and its required dependencies can be installed using pip:

pip install evalai

Once EvalAI-CLI is installed, check out the usage documentation.

If you are interested in contributing to EvalAI-CLI, follow our contribution guidelines.

1. Setup the development environment for EvalAI and make sure that it is running perfectly.

2. Clone the evalai-cli repository to your machine via git

   git clone https://github.com/Cloud-CV/evalai-cli.git evalai-cli

3. Create a virtual environment

   cd evalai-cli
   virtualenv -p python3 venv
   source venv/bin/activate

4. Install the package locally

   pip install -e .

5. Change the evalai-cli host to make request to local EvalAI server running on http://localhost:8000 by running:

   evalai host -sh http://localhost:8000

6. Login to cli using the command evalai login Two users will be created by default which are listed below -

   Host User - username: host, password: password
   Participant User - username: participant, password: password