django_docker_engine
This Django app manages and proxies requests to Docker containers.
The primary goal has been to provide a visualization framework for the
Refinery Project,
but nothing should prevent its use in other contexts, as well.
In order for a Docker container to work with this package it must at a minimum:
- listen on some port for HTTP connections, and
- accept a single JSON file as input.
Quick Demo
Install Docker
if you haven't already, then download the project, install dependencies, and
run the demo server:
$ git clone https://github.com/refinery-platform/django_docker_engine.git
$ cd django_docker_engine
$ pip install -r requirements-dev.txt
$ pip install -r requirements.txt
$ ./manage.py runserver
Visit the demo server: From there you can pick a visualization
tool and a data file to launch a container, see the requests made against
each container, and kill the containers you've launched.
Motivation
Visualization tools have been built with a range of languages and they may have numerous, and possibly conflicting, dependencies. For the Refinery Platform, a data management, analysis, and visualization system for bioinformatics and computational biology applications, we have tried to accommodate the widest range of tools by creating django_docker_engine
, a Python package, available on PyPI, which launches Docker containers, proxies requests from Django to the containers, and records each request.
For each tool the wrapping Docker container will parse the input data provided on launch and start listening for requests. Currently, wrappers are in use for pure JavaScript applications, and for client-server applications, such as HiGlass for exploring genomic contact matrices, and a Plotly Dash tool for gene expression data. The containers themselves may run on the same host as Django, or on separate instances.
In the Refinery Platform, interactive visualizations managed by django_docker_engine
complement workflows managed by Galaxy: Both tools lower barriers to entry and make it possible for end users to run sophisticated analyses on their own data. Refinery adds user management, access control, and provenance tracking facilities to make research more reproducible.
django_docker_engine
will be useful in any environment which needs to provide access to pre-existing or independently developed tools from within a Django application with responsibility for user authentication, access control, and data management.
More information
For the demo server, tools.py
defines the tools
which are available and specifies default inputs. Analogously,
the visualization-tools
repo
defines the tools which can be loaded into Refinery.
More information:
Release process
In your branch update VERSION.txt, using semantic versioning:
When the PR is merged, the successful Travis build will push a new version to pypi.