Skip to main content
Version: 0.10

Plugins

Plugins automatically discover and catalog your data assets in Marmot. They connect to external systems, extract metadata and lineage, and create asset entries with minimal effort.

Marmot isn't limited to plugin-based ingestion. You can also use:

Infrastructure as Code

These approaches enable version-controlled asset definitions and integration with existing infrastructure workflows.

API

The Marmot API lets you programmatically create, update, and manage assets.

Available Plugins

Airflow

Ingest DAGs, tasks, and dataset lineage from Apache Airflow

Amundsen

Import an Amundsen graph, cataloguing every table as the technology it belongs to

AsyncAPI icon

AsyncAPI

Discover services, topics, and queues from AsyncAPI specifications

Athena

Discover databases, tables, workgroups, and saved queries from Amazon Athena

Azure Blob Storage

Discover containers from Azure Blob Storage accounts

BigQuery

Catalog datasets, tables, and views from Google BigQuery projects

Cassandra

Discover keyspaces, tables, and materialized views from Apache Cassandra clusters

Bigtable

Discover instances, tables, and column families from Google Cloud Bigtable

ClickHouse

Discover databases, tables, and views from ClickHouse instances

Cloud Run

Discover services and jobs from Google Cloud Run, with lineage to the buckets they mount

CockroachDB

Discover databases, tables, views and foreign keys from CockroachDB clusters

Confluent Cloud icon

Confluent Cloud

Discover Kafka topics from Confluent Cloud clusters

Dagster icon

Dagster

Discover jobs, ops, and software-defined assets from Dagster

Couchbase

Discover buckets, scopes and collections from Couchbase clusters

DBT

Ingest models, sources, seeds, and lineage from dbt projects

Delta Lake icon

Delta Lake

Discover tables from Delta Lake transaction logs on local filesystems

Doris

Discover databases, tables, views, and materialized views from Apache Doris clusters

DuckDB

Discover schemas, tables, views, and relationships from DuckDB database files

DynamoDB

Discover tables from Amazon DynamoDB

Elasticsearch

Discover indices, data streams, and aliases from Elasticsearch clusters

Firebase

Discover Firestore collections and Realtime Database instances from Firebase projects

Firehose

Discover delivery streams and their lineage from Amazon Data Firehose

Flink

Discover jobs, vertices and run history from Apache Flink JobManagers

Google Cloud Storage

Discover buckets from Google Cloud Storage

Glue

Discover jobs, databases, tables and crawlers from AWS Glue

Hive

Discover databases, tables and views from Apache Hive through HiveServer2

Glue Pipelines

Discover workflows, tasks and run history from AWS Glue

Google Pub/Sub

Discover topics and subscriptions from Google Cloud Pub/Sub

Grafana

Discover dashboards, panels and data sources from Grafana

Iceberg icon

Iceberg

Discover namespaces, tables and views from Iceberg catalogs (REST and AWS Glue)

Lambda

Discover functions from AWS Lambda

Kafka

Catalog topics from Apache Kafka clusters with Schema Registry integration

Kinesis

Discover Kinesis Data Streams from AWS accounts

Kafka Connect

Discover connectors, tasks and topics from Kafka Connect with lineage to the systems they move data between

Kubernetes

Discover namespaces, services, workloads, and cron jobs from self-managed Kubernetes clusters

Amazon EKS

Discover namespaces, services, workloads, and cron jobs from Amazon EKS clusters

Google GKE

Discover namespaces, services, workloads, and cron jobs from Google GKE clusters

MariaDB

Discover databases, tables, views and sequences from MariaDB servers

Metabase

Discover dashboards, charts and models from Metabase, with lineage from the tables they read

MLflow icon

MLflow

Discover registered models, experiments and training datasets from MLflow

MongoDB

Discover databases and collections from MongoDB instances

MySQL

Discover databases and tables from MySQL instances

NATS

Discover JetStream streams from NATS servers

NiFi

Discover process groups, processors and data flow lineage from Apache NiFi

OpenSearch

Discover indices, data streams, and aliases from OpenSearch clusters

OpenAPI

Discover services and endpoints from OpenAPI v3 specifications

Google Drive

Discover folders, files and spreadsheets from Google Drive

OpenMetadata

Import an OpenMetadata instance, cataloguing every entity as the technology it belongs to

Oracle

Discover schemas, tables, views, materialized views and stored procedures from Oracle databases

Pinot icon

Pinot

Discover tables, schemas and stream lineage from Apache Pinot clusters

PostgreSQL

Discover tables, views, and relationships from PostgreSQL databases

Redash

Discover dashboards, charts, queries and data sources from Redash

Presto

Discover catalogs, schemas, tables and views from Presto clusters

Prefect

Discover flows, tasks and run history from Prefect Cloud or a self-hosted Prefect server

QuestDB icon

QuestDB

Discover tables, views and materialized views from QuestDB instances

Redis

Discover databases from Redis instances

Redpanda icon

Redpanda

Discover topics from Redpanda clusters

S3

Catalog buckets from Amazon S3

SFTP

Discover directories and files from an SFTP server

SageMaker

Discover models, endpoints, feature groups and training jobs from Amazon SageMaker

SNS

Catalog topics from Amazon SNS

Spline

Discover Spark applications and their lineage from a Spline server

SQL Server

Discover databases, tables, views and routines from Microsoft SQL Server instances

SQLite icon

SQLite

Discover tables, views, and relationships from SQLite database files

SQS

Discover queues from Amazon SQS

TimescaleDB

Discover hypertables, continuous aggregates and policies from TimescaleDB instances

Superset

Discover dashboards, charts, datasets and database connections from Apache Superset

StarRocks

Discover databases, tables, views, and materialized views from StarRocks clusters

Trino

Discover catalogs, schemas, tables and views from Trino clusters

Unity Catalog

Discover catalogs, tables, views, volumes, functions and models from Unity Catalog servers

Vertex AI

Discover models, endpoints, datasets, feature groups and pipeline jobs from Google Vertex AI

Don't see your data source?

Learn how to build a custom plugin to connect Marmot to any data source.

Create a Plugin