Skip to main content
Version: 0.12

Create a pipeline in the UI

The Plugins page creates and runs pipelines from a form, which is the quickest way to try a plugin. Every pipeline is listed there with its last run, recent runs, schedule and the assets it catalogs:

The Plugins page listing pipelines with their last run, recent runs, schedule and asset count, and Run now on each rowThe Plugins page listing pipelines with their last run, recent runs, schedule and asset count, and Run now on each row

Create a pipeline​

  1. On Plugins, select Add plugin, or pick a plugin under Add a source.
  2. Under Choose plugin, search for your source, select it and select Continue.
  3. Under Basic info, enter a Pipeline name, such as marketplace-postgres, and select Continue.
  4. Under Configure, fill in the connection details. Test connection lists what the plugin can see without changing the catalog. For a plugin marked Supports querying, turn on Let agents and people query this source if it should answer read-only queries. Select Check and continue.
  5. Under Schedule and filters, turn on Run on a schedule if it should run by itself, choose when the First run happens and select Create pipeline.

The plugin chosen:

The Choose plugin step of New pipeline, filtered to PostgreSQLThe Choose plugin step of New pipeline, filtered to PostgreSQL

The Configure step for a PostgreSQL source:

The Configure step for a PostgreSQL pipeline named marketplace-postgres, with host db.internal, user marmot_reader and the discovery switchesThe Configure step for a PostgreSQL pipeline named marketplace-postgres, with host db.internal, user marmot_reader and the discovery switches

Options differ by plugin. Each plugin's page in the plugin registry lists them.

Run and edit pipelines​

Run now on a pipeline's row starts it straight away. The menu on the row has View runs, for its run history and the log of each run, Edit pipeline and delete.

Next steps​

  • Pipelines: how pipelines run and how to declare them in Terraform.
  • From the CLI: run a plugin from your own machine or CI and push the results.
Last updated on