- Home
- Data Lineage Tools
- Marquez
On the recordRead 11 Oct 202617 facts
Marquez
On the record
- Architecture
- The documented system includes a metadata repository, RESTful metadata API, and metadata UI.marquezproject.ai · read 11 Oct 2026
- Audience
- Marquez is designed for data teams managing metadata and lineage across data processing applications and pipelines.marquezproject.ai · read 11 Oct 2026
- Authentication
- Clients can send an API key using Bearer Auth when configured, while the Marquez HTTP API does not require authentication or authorization by default.marquezproject.ai · read 11 Oct 2026
- Column lineage limit
- The site says column lineage support is limited to the Spark integration.marquezproject.ai · read 11 Oct 2026
- Deployment
- The deployment guide describes Docker and Kubernetes deployments and says the HTTP API server uses PostgreSQL to store dataset, job, and run metadata.marquezproject.ai · read 11 Oct 2026
- Getting started
- The quickstart documents MacOS/Linux and Windows prerequisites and runs the Marquez HTTP server using Docker.marquezproject.ai · read 11 Oct 2026
- Integrations
- The site names Apache Airflow, Apache Spark, Apache Flink, dbt, and Dagster as integrations supported through the OpenLineage community.marquezproject.ai · read 11 Oct 2026
- Lineage API
- The Lineage API supports dependency traversal and metadata queries for tasks such as backfills and root cause analysis.marquezproject.ai · read 11 Oct 2026
- Lineage visualization
- The web UI maps dependencies across a data ecosystem and lets users inspect job inputs and outputs, dataset lineage, performance metrics, and execution details.marquezproject.ai · read 11 Oct 2026
- Metadata collection
- Its metadata server provides an OpenLineage-compatible endpoint for real-time collection from running jobs and applications.marquezproject.ai · read 11 Oct 2026
- Metadata history
- Marquez records job run history, job statistics, and immutable versioned dataset metadata.marquezproject.ai · read 11 Oct 2026
- Open source
- The site says Marquez was released and open sourced by WeWork.marquezproject.ai · read 11 Oct 2026
- Purpose
- Marquez consumes, stores, and visualizes OpenLineage metadata for use cases including data governance, data quality monitoring, and performance analytics.marquezproject.ai · read 11 Oct 2026
- Real-time collection
- Its metadata server provides an OpenLineage-compatible endpoint to collect information from running jobs and applications.marquezproject.ai · read 11 Oct 2026
- Security limitation
- The deployment documentation states that authentication and authorization are not enabled on the API by default.marquezproject.ai · read 11 Oct 2026
- Support
- The site directs users to its Slack channel for help and feedback and encourages newcomers to join monthly community meetings.marquezproject.ai · read 11 Oct 2026
- Visual lineage
- The web UI maps dependencies in a data ecosystem and lets users inspect job inputs and outputs, dataset lineage, performance metrics, and execution details.marquezproject.ai · read 11 Oct 2026
