Spark Connection | Collate Apache Spark Connection

Define Spark pipeline connection to track job metadata, task lineage, and performance metrics across executions.

SparkConnection

Spark Metadata Pipeline Connection Config

Properties

• type: Service Type. Refer to #/definitions/SparkType. Default: "Spark".

Definitions

• SparkType (string): Service type. Must be one of: ["Spark"]. Default: "Spark".

Documentation file automatically generated at 2025-01-15 09:05:41.923720+00:00.