Databrickspipelineconnection | Official Documentation

Set up connection to Databricks pipelines for ingesting task, run metadata, and lineage using this configuration schema.

DatabricksPipelineConnection

Databricks Connection Config

Properties

• type: Service Type. Refer to #/definitions/databricksType. Default: "DatabricksPipeline".
• hostPort (string): Host and port of the Databricks service.
• token (string, format: password): Generated Token to connect to Databricks.
• httpPath (string): Databricks compute resources URL.
• connectionArguments: Refer to ../connectionBasicType.json#/definitions/connectionArguments.
• supportsMetadataExtraction: Refer to ../connectionBasicType.json#/definitions/supportsMetadataExtraction.

Definitions

• databricksType (string): Service type. Must be one of: ["DatabricksPipeline"]. Default: "DatabricksPipeline".

Documentation file automatically generated at 2025-01-15 09:05:41.923720+00:00.