BeamNGpy
BeamNGpy is an official library providing a Python API to BeamNG.tech,
the academia- and industry-oriented fork of the video game BeamNG.drive.
BeamNGpy and BeamNG.tech are designed to go hand in hand, both being kept up
to date to support each other's functions, meaning using the latest versions
of both is recommended.
It allows remote control of the simulation, including vehicles contained in it.
See Features or go through the Feature Overview Jupyter notebook.
Table of Contents
Features
BeamNGpy comes with a wide range of low-level functions to interact with the
simulation and a few higher-level interfaces that make more complex actions
easier. Some features to highlight are:
Remote Control of Vehicles
Each vehicle can be controlled individually and independently during the
simulation. This includes basic steering inputs, but also controls over
various lights (headlights, indicators, etc.) or gear shifting.
Throttle Control.webm
Steering Control.webm
AI-controlled Vehicles
Besides manual control, BeamNG.tech ships with its own AI to control vehicles.
This AI can be configured and controlled from BeamNGpy. It can be used to
make a vehicle drive to a certain waypoint, make it follow another vehicle,
span the map, or follow a user-defined trajectory:
Dynamic Sensor Models
Vehicles and the environment can be equipped with various sensors that provide
simulated sensor data. These sensors include:
- Cameras
- Color camera
- Depth camera
- Semantic and Instance annotations
- Lidars
- Inertial Measurement Units (IMU)
- Ultrasonic Distance Measurements
These sensors give perfect data from the simulation by default. Therefore, some
of them, like the camera and lidar sensor, can be equipped to also simulate
noisy data.
Access to Road Network & Scenario Objects
Geometry of roads in the currently-loaded level/scenario are made available
via BeamNGpy. Objects and vehicles that are currently active in the scene
are also exposed, allowing for analysis of the current simulation state.
Multiple Clients
BeamNGpy interacts with BeamNG.tech as the client, with BeamNG.tech acting
as the server. This allows for multiple BeamNGpy processes to connect to a
running simulation and have each control the simulator, making it possible
to, for example, run a scenario in which each vehicle is controlled by
a separate client.
More
There is a healthy collection of usage examples in the examples/
folder of this repository. These highlight more features, but also serve
as documentation, so be sure to check them out.
Prerequisites
Usage of BeamNGpy requires BeamNG.tech to be installed. For commercial use,
contact us at licensing@beamng.gmbh. Builds of BeamNG.tech are made
available for research and academic use upon request using this form.
Once downloaded, you can use the environment variable BNG_HOME
to where
BeamNG.tech can be run from, or provide a path to the BeamNGpy library
during initialization.
Installation
The library itself is available on PyPI and can therefore be installed
using common methods like pip
:
pip install beamngpy
If you use Anaconda, you can
install BeamNGpy from the conda-forge
channel by:
conda install beamngpy -c conda-forge
To upgrade, use
pip install --upgrade beamngpy
if you installed BeamNGpy using pip
or
conda update beamngpy -c conda-forge --no-pin
if you installed it using conda
.
Usage
DISCLAIMER: If you are using an older version of beamngpy
and BeamNG.tech, please follow the
instructions of the corresponding README
file (for example, 1.27.1 instructions). If you are using the latest version of BeamNGpy, continue following the instructions located in this README file.
The library can be imported using import beamngpy
. A short
usage example setting up a scenario with one vehicle in the West Coast USA map
that spans the area is:
from beamngpy import BeamNGpy, Scenario, Vehicle
bng = BeamNGpy('localhost', 25252, home='/path/to/bng/tech', user='/path/to/bng/tech/userfolder')
bng.open()
scenario = Scenario('west_coast_usa', 'example')
vehicle = Vehicle('ego_vehicle', model='etk800', license='PYTHON')
scenario.add_vehicle(vehicle, pos=(-717, 101, 118), rot_quat=(0, 0, 0.3826834, 0.9238795))
scenario.make(bng)
bng.scenario.load(scenario)
bng.scenario.start()
vehicle.ai.set_mode('traffic')
input('Hit Enter when done...')
bng.disconnect()
We have a guide helping you to get started and navigating our collection of examples and
the documentation of the library is available here.
BeamNG.tech is also customizable with various command-line arguments. Check the documentation for reference.
Compatibility
BeamNG.tech is not a finished product but is still under development.
Thus frequent changes on the simulation side are to be expected.
While the BeamNGpy library maintains compatibility between minor versions for the user, this doesn't extend to the BeamNG.tech side. Not all BeamNGpy versions are compatible with all BeamNG.tech versions.
Below is a list of compatible BeamNG.tech and BeamNGpy versions.
However, we do not maintain minor versions: bug fixes and new features will only be available for the newest BeamNG.tech and BeamNGpy releases.
Troubleshooting
This section lists common issues with BeamNGpy in particular. Since this
library is closely tied to BeamNG.tech and thus BeamNG.drive, it is also
recommended to consult the documentation on BeamNG.drive here:
https://documentation.beamng.com/
BeamNGpy cannot establish a connection
- Be sure to complete the initial set-up step described in the Usage section and to repeat it with every newly released BeamNG.tech version.
- Make sure BeamNG.tech and Python are allowed to connect to your current
network in Windows Firewall.
BeamNG.tech quietly fails to launch
- There is a known issue where BeamNG.tech quietly crashes when there is a
space in the configured userpath. Until this issue is fixed, it is
recommended to either switch to a path that does not contain a space or
change the userpath directly in the "startup.ini" file located in the
directory of your BeamNG.tech installation.
Contributions
We always welcome user contributions, be sure to check out our contribution guidelines first, before starting your work.
The Python code is formatted using Black, please use it to
format the code you want to contribute.