CreateIngestionPipelineRequest
Ingestion Pipeline Config is used to set up an Airflow DAG.
Properties
- name: Name that identifies this pipeline instance uniquely. Refer to ../../../type/basic.json#/definitions/entityName.
- displayName(string): Display Name that identifies this ingestion pipeline.
- description: Description of the pipeline. Refer to ../../../type/basic.json#/definitions/markdown.
- pipelineType: Refer to ../../../entity/services/ingestionPipelines/ingestionPipeline.json#/definitions/pipelineType.
- sourceConfig: Refer to ../../../metadataIngestion/workflow.json#/definitions/sourceConfig.
- airflowConfig: Refer to ../../../entity/services/ingestionPipelines/ingestionPipeline.json#/definitions/airflowConfig.
- loggerLevel: Set the logging level for the workflow. Refer to ../../../metadataIngestion/workflow.json#/definitions/logLevels.
- raiseOnError(boolean): Control if we want to flag the workflow as failed if we encounter any processing errors. Default:- True.
- service: Link to the service for which ingestion pipeline is ingesting the metadata. Refer to ../../../type/entityReference.json.
- owners: Owner of this Ingestion Pipeline. Refer to ../../../type/entityReferenceList.json. Default:- None.
- provider: Refer to ../../../type/basic.json#/definitions/providerType.
- domains(array): Fully qualified names of the domains the Ingestion Pipeline belongs to.- Items (string)
 
- processingEngine: The processing engine responsible for executing the ingestion pipeline logic. Refer to ../../../type/entityReference.json.
Documentation file automatically generated at 2025-08-12 05:39:47.683420+00:00.