yujunjun/OpenMetadata
1
0
Fork 0
mirror of https://github.com/open-metadata/OpenMetadata.git synced 2025-08-06 16:18:05 +00:00
Code Issues Packages Projects Releases Wiki Activity
OpenMetadata/openmetadata-docs/content/v1.9.x-SNAPSHOT/how-to-guides/data-quality-observability/profiler/spark-engine/configuration.md
IceS2 5adf32b731
Add Spark Engine docs (#22739) 
* Add Spark Engine docs

* Update structure
2025-08-04 16:28:46 +00:00

1.3 KiB
Raw Blame History

title description slug collate
Spark Engine Configuration | OpenMetadata Spark Profiling Setup Learn how to configure your profiler pipeline to use Spark Engine for distributed data profiling. /how-to-guides/data-quality-observability/profiler/spark-engine/configuration true

Spark Engine Configuration

Overview

There are two ways to configure Spark Engine in OpenMetadata:

{% inlineCalloutContainer %} {% inlineCallout color="violet-70" bold="UI Configuration" icon="MdAnalytics" href="/how-to-guides/data-quality-observability/profiler/spark-engine/ui-configuration" %} Configure Spark Engine through the OpenMetadata UI. {% /inlineCallout %} {% inlineCallout icon="MdOutlineSchema" bold="External Configuration" href="/how-to-guides/data-quality-observability/profiler/spark-engine/external-configuration" %} Configure Spark Engine using YAML files for external workflows. {% /inlineCallout %} {% /inlineCalloutContainer %}

{% note %} Before configuring, ensure you have completed the Spark Engine Prerequisites and understand the Partitioning Requirements. {% /note %}