node-sqlite3

SQLite3 bindings for Node.js

README

⚙️ node-sqlite3


Asynchronous, non-blocking SQLite3 bindings for Node.js.

Latest release
Build Status
FOSSA Status
N-API v3 Badge
N-API v6 Badge

Features


- Straightforward query and parameter binding interface
- Full Buffer/Blob support
- Extensive debugging support
- Extension support, including bundled support for the json1 extension
- Big test suite
- Written in modern C++ and tested for memory leaks
- Bundles SQLite v3.39.4, or you can build using a local SQLite

Installing


You can use [npm](https://github.com/npm/cli) or [yarn](https://github.com/yarnpkg/yarn) to install sqlite3:

(recommended) Latest published package:
  1. ```bash
  2. npm install sqlite3
  3. # or
  4. yarn add sqlite3
  5. ```
GitHub's master branch: npm install https://github.com/tryghost/node-sqlite3/tarball/master

Prebuilt binaries


sqlite3 v5+ was rewritten to use Node-API so prebuilt binaries do not need to be built for specific Node versions.sqlite3 currently builds for both Node-API v3 and v6. Check the Node-API version matrix to ensure your Node version supports one of these. The prebuilt binaries should be supported on Node v10+.

The module uses node-pre-gyp to download the prebuilt binary for your platform, if it exists. These binaries are hosted on GitHub Releases forsqlite3 versions above 5.0.2, and they are hosted on S3 otherwise. The following targets are currently provided:

Format: napi-v{napi_build_version}-{platform}-{libc}-{arch}

napi-v3-darwin-unknown-arm64
napi-v3-darwin-unknown-x64
napi-v3-linux-glibc-arm64
napi-v3-linux-glibc-x64
napi-v3-linux-musl-arm64
napi-v3-linux-musl-x64
napi-v3-win32-unknown-ia32
napi-v3-win32-unknown-x64
napi-v6-darwin-unknown-arm64
napi-v6-darwin-unknown-x64
napi-v6-linux-glibc-arm64
napi-v6-linux-glibc-x64
napi-v6-linux-musl-arm64
napi-v6-linux-musl-x64
napi-v6-win32-unknown-ia32
napi-v6-win32-unknown-x64

Unfortunately, node-pre-gyp cannot differentiate betweenarmv6 and armv7, and instead uses arm as the {arch}. Until that is fixed, you will still need to install sqlite3 from source.

Support for other platforms and architectures may be added in the future if CI supports building on them.

If your environment isn't supported, it'll use node-gyp to build SQLite but you will need to install a C++ compiler and linker.

Other ways to install


It is also possible to make your own build of sqlite3 from its source instead of its npm package (See below.).

The sqlite3 module also works with node-webkit if node-webkit contains a supported version of Node.js engine. (See below.)

SQLite's SQLCipher extension is also supported. (See below.)

API


See the API documentation in the wiki.

Usage


Note: the module must be installed before use.

  1. ``` js
  2. const sqlite3 = require('sqlite3').verbose();
  3. const db = new sqlite3.Database(':memory:');

  4. db.serialize(() => {
  5.     db.run("CREATE TABLE lorem (info TEXT)");

  6.     const stmt = db.prepare("INSERT INTO lorem VALUES (?)");
  7.     for (let i = 0; i < 10; i++) {
  8.         stmt.run("Ipsum " + i);
  9.     }
  10.     stmt.finalize();

  11.     db.each("SELECT rowid AS id, info FROM lorem", (err, row) => {
  12.         console.log(row.id + ": " + row.info);
  13.     });
  14. });

  15. db.close();
  16. ```

Source install


To skip searching for pre-compiled binaries, and force a build from source, use

  1. ```bash
  2. npm install --build-from-source
  3. ```

The sqlite3 module depends only on libsqlite3. However, by default, an internal/bundled copy of sqlite will be built and statically linked, so an externally installed sqlite3 is not required.

If you wish to install against an external sqlite then you need to pass the --sqlite argument to npm wrapper:

  1. ```bash
  2. npm install --build-from-source --sqlite=/usr/local
  3. ```

If building against an external sqlite3 make sure to have the development headers available. Mac OS X ships with these by default. If you don't have them installed, install the -dev package with your package manager, e.g. apt-get install libsqlite3-dev for Debian/Ubuntu. Make sure that you have at least libsqlite3 >= 3.6.

Note, if building against homebrew-installed sqlite on OS X you can do:

  1. ```bash
  2. npm install --build-from-source --sqlite=/usr/local/opt/sqlite/
  3. ```

Custom file header (magic)


The default sqlite file header is "SQLite format 3". You can specify a different magic, though this will make standard tools and libraries unable to work with your files.

  1. ```bash
  2. npm install --build-from-source --sqlite_magic="MyCustomMagic15"
  3. ```

Note that the magic must be exactly 15 characters long (16 bytes including null terminator).

Building for node-webkit


Because of ABI differences, sqlite3 must be built in a custom to be used with node-webkit.

To build sqlite3 for node-webkit:

1. Install [nw-gyp](https://github.com/rogerwang/nw-gyp) globally: npm install nw-gyp -g (unless already installed)

2. Build the module with the custom flags of --runtime, --target_arch, and --target:

  1. ```bash
  2. NODE_WEBKIT_VERSION="0.8.6" # see latest version at https://github.com/rogerwang/node-webkit#downloads
  3. npm install sqlite3 --build-from-source --runtime=node-webkit --target_arch=ia32 --target=$(NODE_WEBKIT_VERSION)
  4. ```

This command internally calls out to [node-pre-gyp](https://github.com/mapbox/node-pre-gyp) which itself calls out to [nw-gyp](https://github.com/rogerwang/nw-gyp) when the --runtime=node-webkit option is passed.

You can also run this command from within a sqlite3 checkout:

  1. ```bash
  2. npm install --build-from-source --runtime=node-webkit --target_arch=ia32 --target=$(NODE_WEBKIT_VERSION)
  3. ```

Remember the following:

You must provide the right --target_arch flag. ia32 is needed to target 32bit node-webkit builds, while x64 will target 64bit node-webkit builds (if available for your platform).

After the sqlite3 package is built for node-webkit it cannot run in the vanilla Node.js (and vice versa).
   For example, npm test of the node-webkit's package would fail.

Visit the “Using Node modules” article in the node-webkit's wiki for more details.

Building for SQLCipher


For instructions on building SQLCipher, see Building SQLCipher for Node.js. Alternatively, you can install it with your local package manager.

To run against SQLCipher, you need to compile sqlite3 from source by passing build options like:

  1. ```bash
  2. npm install sqlite3 --build-from-source --sqlite_libname=sqlcipher --sqlite=/usr/

  3. node -e 'require("sqlite3")'
  4. ```

If your SQLCipher is installed in a custom location (if you compiled and installed it yourself), you'll need to set some environment variables:

On OS X with Homebrew


Set the location where brew installed it:

  1. ```bash
  2. export LDFLAGS="-L`brew --prefix`/opt/sqlcipher/lib"
  3. export CPPFLAGS="-I`brew --prefix`/opt/sqlcipher/include/sqlcipher"
  4. npm install sqlite3 --build-from-source --sqlite_libname=sqlcipher --sqlite=`brew --prefix`

  5. node -e 'require("sqlite3")'
  6. ```

On most Linuxes (including Raspberry Pi)


Set the location where make installed it:

  1. ```bash
  2. export LDFLAGS="-L/usr/local/lib"
  3. export CPPFLAGS="-I/usr/local/include -I/usr/local/include/sqlcipher"
  4. export CXXFLAGS="$CPPFLAGS"
  5. npm install sqlite3 --build-from-source --sqlite_libname=sqlcipher --sqlite=/usr/local --verbose

  6. node -e 'require("sqlite3")'
  7. ```

Custom builds and Electron


Running sqlite3 through electron-rebuild does not preserve the SQLCipher extension, so some additional flags are needed to make this build Electron compatible. Yournpm install sqlite3 --build-from-source command needs these additional flags (be sure to replace the target version with the current Electron version you are working with):

  1. ```bash
  2. --runtime=electron --target=18.2.1 --dist-url=https://electronjs.org/headers
  3. ```

In the case of MacOS with Homebrew, the command should look like the following:

  1. ```bash
  2. npm install sqlite3 --build-from-source --sqlite_libname=sqlcipher --sqlite=`brew --prefix` --runtime=electron --target=18.2.1 --dist-url=https://electronjs.org/headers
  3. ```

Testing


  1. ```bash
  2. npm test
  3. ```

Contributors



Acknowledgments


Thanks to Orlando Vazquez,
Ryan Dahl for their SQLite bindings for node, and to mraleph on Freenode's #v8 for answering questions.

This module was originally created by Mapbox & is now maintained by Ghost.

Changelog


We use GitHub releases for notes on the latest versions. See CHANGELOG.md in git history for details on older versions.

License


node-sqlite3 is BSD licensed.

FOSSA Status