big-crossfilter

big-crossfilter

Crossfilter millions of records without latencies. This project is work in progress and not documented yet. Please get in touch if you have questions.

The largest experiments we have done so far is 10M flights in the browser and ~180M flights when connected to MapD.

Demos

• 1M flights in the browser: https://uwdata.github.io/big-crossfilter/flights/
• 7M flights in MapD: https://uwdata.github.io/big-crossfilter/flights-mapd/
• 500k weather records: https://uwdata.github.io/big-crossfilter/weather/

Big Crossfilter uses Apache Arrow and ndarray.

Experiments

First version that turned out to be too complicated is at https://github.com/uwdata/big-crossfilter/tree/complex and the client-server version is at https://github.com/uwdata/big-crossfilter/tree/client-server.