Installing Apache Distill¶
The first step is to install Apache Distill. First, checkout the latest version of Apache Distill.
$ git clone https://git-wip-us.apache.org/repos/asf/incubator-senssoft-distill.git
Apache Distill is a python project, so it can be installed like any other python library. Several operating systems (Mac OS X, Major Versions of Linux/BSD) have Python pre-installed, so you should just have to run
$ easy_install distill
$ pip install distill
Users are strongly recommended to install Apache Distill in a virtualenv. Instructions to setup an virtual environment will be explained below.
When the package is installed via
pip this function will be bound to the
distill executable in the Python installation’s
bin directory (on Windows - the
Installing Apache Distill in an Virtual Environment¶
virtualenv is a tool to create isolated Python environments. virtualenv creates a folder which contains all the necessary executables to use the packages that the Apache Distill project would need.
Install virtualenv via pip:
$ sudo env/bin/pip install virtualenv
Start by changing directory into the root of Apache Distill’s project directory, and then use the virtualenv command-line tool to create a new environment:
$ mkdir env $ virtualenv env
$ source env/bin/activate
Install Apache Distill requirements:
$ env/bin/pip -r requirements.txt
To build the source code and run all unit tests.
$ env/bin/python setup.py develop test
Launch local Apache Distill server, running on localhost:8090:
Running Apache Distill on Docker Compose¶
From the project directory, start up Apache Distill in the background.
$ docker-compose up -d Starting elastic Starting logstash Starting kibana Starting distill $ docker-compose ps Name Command State Ports -------------------------------------------------------------------------------------------------- distill /bin/sh -c python distill/ ... Up 0.0.0.0:8090->8090/tcp elastic elasticsearch Up 0.0.0.0:9200->9200/tcp, 0.0.0.0:9300->9300/tcp kibana /tmp/entrypoint.sh Up 0.0.0.0:5601->5601/tcp logstash logstash -f /etc/logstash/ ... Up
To stop services once you’ve finished with them:
$ docker-compose stop
Deployment with Nginx and Gunicorn¶
I will describe a setup with nginx as a web server on Ubuntu. A web server cannot communicate directly with a Flask application such as Apache Distill. Thus gunicorn will be used to act as a medium between the web server and Apache Distill. Gunicorn is like an application web server that will be running behind nginx, and it is WSGI compatible. It can communicate with applications that support WSGI – Flask, Django, etc.
$ sudo apt-get update $ sudo apt-get install -y python python-pip nginx gunicorn
Create a directory to store the project.
$ sudo mkdir /home/pubic_html && cd /home/public_html
Download the project from the GitHub repository and copy the application to the
$ git clone https://git-wip-us.apache.org/repos/asf/incubator-senssoft-distill.git /home/public_html
Install Apache Distill’s requirements either globally or in a virutal environment:
$ env/bin/pip install -r requirements.txt
Apache Distill has provided an nginx configuration file located in
Gunicorn will use port 8000 and handle the incoming HTTP requests.
Restart nginx to load the configuration changes.
$ sudo /etc/init.d/nginx restart
Run gunicorn on port 8000.
$ gunicorn --workers 4 --bind unix:distill.sock -m 007 deploy/run_server:app
Start a new browser instance and navigate to http://localhost.
To save yourself the trouble, all up to date documentation is available at https://draperlaboratory.github.io/distill/.
However, if you want to manully build the documentation, the instructions are below.
First, install the documentation dependencies:
$ env/bin/pip install -r doc_requirements.txt
To build Apache Distill’s documentation, create a directory at the root level of
/distill called distill-docs.
$ mkdir distill-docs & cd distill-docs
Execute build command:
# Inside top-level docs/ directory. $ make html
This should build the documentation in your shell, and output HTML. At then end, it should say something about documents being ready in
You can now open them in your browser by typing
$ open distill-docs/html/index.html