Skip to main content
Version: Preview

SQLite

Experimental
Creates:
AssetsLineage

Configure in the UI

This plugin can be configured directly in the Marmot UI with a step-by-step wizard.

View Guide

The SQLite plugin discovers tables, views and foreign key relationships from SQLite database files. It opens the file read-only with the pure-Go modernc.org/sqlite driver, so it needs no cgo. Turso and libSQL databases use the SQLite on-disk format, so a local copy of one is discovered the same way as any other SQLite file.

File Sources

The path field accepts local paths, S3 URIs (s3://bucket/key) or Git URIs (git::https://...). For S3 and Git sources, the file is downloaded to a temporary directory before discovery and cleaned up afterwards.

See File Sources for the full list of supported backends, authentication options and configuration examples.

Example Configuration


path: "/data/app.db"
include_columns: true
enable_metrics: true
discover_foreign_keys: true
exclude_system_tables: true
filter:
include:
- "^user.*"
exclude:
- ".*_tmp$"
tags:
- "sqlite"
- "app"

Configuration

The following configuration options are available:

PropertyTypeRequiredDescription
discover_foreign_keysboolfalseWhether to discover foreign key relationships
enable_metricsboolfalseWhether to include table metrics (row and column counts)
exclude_system_tablesboolfalseWhether to exclude SQLite internal tables (sqlite_*)
external_links[]ExternalLinkfalseExternal links to show on all assets
filterFilterfalseFilter discovered assets by name (regex)
git_sourceGitSourceConfigfalseGit repository file source configuration
include_columnsboolfalseWhether to include column information in table metadata
pathstringfalsePath to the SQLite database file (local path, s3://bucket/key or git::url)
s3_sourceS3SourceConfigfalseS3 file source configuration
source_typestringfalseFile source backend (auto-detected from path when empty)
tagsTagsConfigfalseTags to apply to discovered assets

Available Metadata

The following metadata fields are available:

FieldTypeDescription
column_defaultstringDefault value expression
column_namestringColumn name
data_typestringDeclared column data type
is_nullableboolWhether null values are allowed
is_primary_keyboolWhether the column is part of the primary key
object_typestringObject type (table, view)
pathstringPath to the SQLite database file
source_columnstringColumn in the referencing table
source_tablestringName of the referencing table
table_namestringTable or view name
target_columnstringColumn in the referenced table
target_tablestringName of the referenced table