singlestoredb

SingleStoreDB Python SDK

This project contains a DB-API 2.0 compatible Python interface to the SingleStore database and workspace management API.

Install

This package can be install from PyPI using pip:

pip install singlestoredb

Documentation

https://singlestore-labs.github.io/singlestoredb-python

Usage

Connections to the SingleStore database are made using the DB-API parameters host, port, user, password, etc, but they may also be done using URLs that specify these parameters as well (much like the SQLAlchemy package).

import singlestoredb as s2

# Connect using the default connector
conn = s2.connect('user:password@host:3306/db_name')

# Create a cursor
cur = conn.cursor()

# Execute SQL
cur.execute('select * from foo')

# Fetch the results
print(cur.description)
for item in cur:
    print(item)

# Close the connection
conn.close()

Connecting to the HTTP API is done as follows:

# Use the HTTP API connector
conn = s2.connect('https://user:password@host:8080/db_name')

Performance

While this package is based on PyMySQL which is a pure Python-based MySQL connector, it adds various performance enhancements that make it faster than most other connectors. The performance improvements come from changes to the data conversion functions, cursor implementations, and a C extension that is highly optimized to improve row data reading.

The package can be used both in a pure Python mode and as well as a C accelerated mode. Generally speaking, the C accelerated version of the client can read data 10X faster than PyMySQL, 2X faster than MySQLdb, and 1.5X faster than mysql.connector. All of this is done without having to install any 3rd party MySQL libraries!

Benchmarking was done with a table of 3,533,286 rows each containing a datetime, a float, and eight character columns. The data is the same data set used in this article. The client and server were running on the same machine and queries were made using fetchone, fetchall, fetchmany(1000), and an iterator over the cursor object (e.g., iter(cur)). The results are shown below.

Buffered

	PyMySQL	MySQLdb	mysql.connector	SingleStore (pure Python)	SingleStore
fetchall	37.0s	8.7s	5.6s	29.0s	3.7s
fetchmany(1000)	37.4s	9.2s	6.2s	29.6s	3.6s
fetchone	38.2s	10.1s	10.2s	30.9s	4.8s
iter(cur)	38.3s	9.1s	10.2s	30.4s	4.4s

Unbuffered

	PyMySQL	MySQLdb	mysql.connector	SingleStore (pure Python)	SingleStore
fetchall	39.0s	6.5s	5.5s	30.3s	5.5s
fetchmany(1000)	39.4s	7.0s	6.0s	30.4s	4.1s
fetchone	34.5s	8.9s	10.1s	30.8s	6.6s
iter(cur)	39.0s	9.0s	10.2s	31.4s	6.0s

License

This library is licensed under the Apache 2.0 License.

Resources

• SingleStore
• Python