CreateIngestionPipelineRequest
Ingestion Pipeline Config is used to set up an Airflow DAG.
Properties
name
: Name that identifies this pipeline instance uniquely. Refer to ../../../type/basic.json#/definitions/entityName.displayName
(string): Display Name that identifies this ingestion pipeline.description
: Description of the pipeline. Refer to ../../../type/basic.json#/definitions/markdown.pipelineType
: Refer to ../../../entity/services/ingestionPipelines/ingestionPipeline.json#/definitions/pipelineType.sourceConfig
: Refer to ../../../metadataIngestion/workflow.json#/definitions/sourceConfig.airflowConfig
: Refer to ../../../entity/services/ingestionPipelines/ingestionPipeline.json#/definitions/airflowConfig.loggerLevel
: Set the logging level for the workflow. Refer to ../../../metadataIngestion/workflow.json#/definitions/logLevels.raiseOnError
(boolean): Control if we want to flag the workflow as failed if we encounter any processing errors. Default:True
.service
: Link to the service for which ingestion pipeline is ingesting the metadata. Refer to ../../../type/entityReference.json.owners
: Owner of this Ingestion Pipeline. Refer to ../../../type/entityReferenceList.json. Default:None
.provider
: Refer to ../../../type/basic.json#/definitions/providerType.domains
(array): Fully qualified names of the domains the Ingestion Pipeline belongs to.- Items (string)
processingEngine
: The processing engine responsible for executing the ingestion pipeline logic. Refer to ../../../type/entityReference.json.
Documentation file automatically generated at 2025-08-12 05:39:47.683420+00:00.