DuckDB

Experimental

Creates:

AssetsLineage

Configure in the UI

This plugin can be configured directly in the Marmot UI with a step-by-step wizard.

View Guide

The DuckDB plugin discovers schemas, tables, views and foreign key relationships from DuckDB database files.

File Sources

The path field accepts local paths, S3 URIs (s3://bucket/key) or Git URIs (git::https://...). For S3 and Git sources, the file is downloaded to a temporary directory before discovery and cleaned up afterwards.

See File Sources for the full list of supported backends, authentication options and configuration examples.

Example Configuration

path: "/data/analytics.duckdb"
include_columns: true
enable_metrics: true
discover_foreign_keys: true
exclude_system_schemas: true
filter:
  include:
    - "^main\\..*"
  exclude:
    - ".*_temp$"
tags:
  - "duckdb"
  - "analytics"

Configuration

The following configuration options are available:

Property	Type	Required	Description
discover_foreign_keys	bool	false	Whether to discover foreign key relationships
enable_metrics	bool	false	Whether to include table metrics (row counts and sizes)
exclude_system_schemas	bool	false	Whether to exclude system schemas (information_schema, pg_catalog)
external_links	[]ExternalLink	false	External links to show on all assets
filter	Filter	false	Filter discovered assets by name (regex)
git_source	GitSourceConfig	false	Git repository file source configuration
include_columns	bool	false	Whether to include column information in table metadata
path	string	false	Path to the DuckDB database file (local path, s3://bucket/key or git::url)
s3_source	S3SourceConfig	false	S3 file source configuration
source_type	string	false	File source backend (auto-detected from path when empty)
tags	TagsConfig	false	Tags to apply to discovered assets

Available Metadata

The following metadata fields are available:

Field	Type	Description
column_default	string	Default value expression
column_name	string	Column name
comment	string	Object comment/description
constraint_name	string	Foreign key constraint name
data_type	string	Column data type
is_nullable	bool	Whether null values are allowed
object_type	string	Object type (BASE TABLE, VIEW)
path	string	Path to the DuckDB database file
row_count	int64	Estimated row count
schema	string	Schema name
size	int64	Estimated size in bytes
source_column	string	Column in the referencing table
source_schema	string	Schema of the referencing table
source_table	string	Name of the referencing table
table_name	string	Table or view name
target_column	string	Column in the referenced table
target_schema	string	Schema of the referenced table
target_table	string	Name of the referenced table