MicroGesture SensorFusion (mGesf)
Check out our video
This repo extends the work in this paper: ThuMouse: A Micro-gesture Cursor Input through mmWave Radar-based Interaction
.
This application supports a variety of sensors, including:
- Texas Instrument mmWave Sensors: IWR6843ISK, IWR6843AoP
- LeapMotion (coming soon)
- DecaWave UWB sensors (coming soon)
To run this application, first make sure you have the GUI backend PyQT5 installed. Depending on your O.S., use the following commands:
ubuntu: sudo apt-get install python3-pyqt5
MacOs: brew install pyqt
Then install the package in your python interpreter:
pip install pyqt5
first run this command to install the prerequisites.
python setup.py install
Now run this app with this command
python main.py
Make sure you have the audio library installed:
Mac:
brew install ffmpeg
Ubuntu:
sudo apt-get install ffmpeg
For Windows, it's a bit more involved as the downloaded library needs to be added to the environment variables.
This is a good tuorial.
If you are getting 'permission denied' errors (likely to occur on Windows), install the simpleaudio package by running:
pip install simpleaudio