sqlitely

SQLitely

SQLitely is an SQLite database tool, written in Python.

It can:

• detect and manage SQLite databases in bulk
• create new or temporary databases
• create and alter tables, indexes, triggers and views
• modify table data
• free-form search over all database data and metadata
• export data and metadata in various formats (text, HTML, spreadsheet, JSON, YAML, SQL)
• import data to tables from spreadsheet or JSON/YAML
• view database table and index size statistics
• copy tables from one database to another
• execute direct SQL queries
• manage database PRAGMA directives
• fix database corruption

Also, a command line interface is available, offering functions like exporting, importing, querying, searching, and statistics. The graphical version includes a Python console window.

Downloads, help texts, and more screenshots at http://suurjaak.github.io/SQLitely.

Using The Program

SQLitely can search over all columns of all tables with a simple query syntax. Keywords can search from specific tables and columns only (table:foo, column:bar), or from certain dates only (date:2012, date:2010..2013-06). Search supports wildcards, exact phrases, grouping, excluding, and either-or queries.

SQLitely can show disk space usage for each table and index, in bytes and overall percentage. (Depending on the size of the database, this analysis can take a while.)

SQLitely offers a convenient way for complex ALTER TABLE operations. Columns and constraints can be changed, reordered, added, dropped; the program automatically performs the multiple steps required for SQLite table modifications while retaining existing data (creating a temporary table, copying data, dropping old table, and renaming temporary table as old). Additionally, when renaming tables or columns, all related tables, indexes, triggers and views are altered automatically.

SQLitely can check database integrity for corruption, and copy as much data as possible over into a new database.

SQLitely offers a number of options from the command line:

  gui                 launch SQLitely graphical program (default option)
  execute             run SQL statements in SQLite database
  export              export SQLite database in various output formats
  import              import data from file to database
  parse               search in SQLite database schema
  pragma              output SQLite database PRAGMAs
  search              search in SQLite database data
  stats               print or save database statistics
  -h [option]         show command line help, for option if specified

SQLitely has been tested under Windows 10, Windows 7 and Ubuntu Linux. In source code form, it should run wherever Python and the required Python packages are installed.

If running from pip installation, run sqlitely from the command-line. If running straight from source code, launch sqlitely.sh where shell scripts are supported, or sqlitely.bat under Windows, or open a terminal and run python -m sqlitely in SQLitely/src directory.

Installation

Windows: download and launch the latest setup from https://suurjaak.github.io/SQLitely/downloads.html.

Linux Snap Store: install SQLitely, or run snap install sqlitely.

Mac/Linux/other: install Python and pip, run pip install sqlitely.

The pip installation will add the sqlitely command to path.

Installing the required wxPython on Linux can be faster via one of their prepared Python wheels. Example for Ubuntu 20:

• run sudo apt-get install libgtk-3-0 libsdl2-2.0 libwebkit2gtk-4.0
• run pip install wxPython --find-links \ https://extras.wxpython.org/wxPython4/extras/linux/gtk3/ubuntu-20.04

SQLitely has a Dockerfile, see build/README for Docker.md.

Windows installers have been provided for convenience. The program itself is stand-alone, can work from any directory, and does not need additional installation. The installed program can be copied to a USB stick and used elsewhere, same goes for the source code.

Source Dependencies

If running from source code, SQLitely needs Python 3.5+ or Python 2.7, and the following 3rd-party Python packages:

• ANTLR Python runtime (https://antlr.org)
• appdirs (https://pypi.org/project/appdirs)
• chardet (https://pypi.org/project/chardet)
• openpyxl (https://pypi.org/project/openpyxl)
• Pillow (https://pypi.org/project/Pillow)
• pyparsing (https://pypi.org/project/pyparsing)
• pytz (https://pythonhosted.org/pytz/)
• PyYAML (https://pypi.org/project/PyYAML/)
• six (https://pypi.org/project/six/)
• step (https://pypi.org/project/step-template/)
• wxPython 4.0+ (https://wxpython.org)
• xlrd (https://pypi.org/project/xlrd)
• XlsxWriter (https://pypi.org/project/XlsxWriter)

All dependencies can be installed by running pip install -r requirements.txt in SQLitely source distribution folder.

If chardet or openpyxl or pyparsing or PyYAML or xlrd or XlsxWriter are not available, the program will function regardless, only with lesser service - like lacking Excel import-export or full search syntax.

Attribution

Includes sqlite_analyzer, a command-line utility for table space analysis, (c) 2000, D. Richard Hipp, https://www.sqlite.org.

Includes a modified version of SQLite.g4 from sqlite-parser, (c) 2013, Bart Kiers, https://github.com/bkiers/sqlite-parser.

SQL lexer and parser generated with ANTLR, (c) 2012 The ANTLR Project, https://github.com/antlr/antlr4.

Includes several icons from Fugue Icons, (c) 2010 Yusuke Kamiyamane, https://p.yusukekamiyamane.com.

Includes fonts Carlito Regular and Carlito Bold, https://fedoraproject.org/wiki/Google_Crosextra_Carlito_fonts.

Includes fonts Open Sans Regular and Open Sans Bold, https://fonts.google.com/specimen/Open+Sans.

Binaries compiled with PyInstaller, https://www.pyinstaller.org.

Installers created with Nullsoft Scriptable Install System, https://nsis.sourceforge.io.

License

Copyright (c) 2019 by Erki Suurjaak. Released as free open source software under the MIT License, see LICENSE.md for full license text.