Exam DP203 Synapse Data Pipelines: Difference between revisions
No edit summary |
|||
| Line 16: | Line 16: | ||
'''Triggers''' to run the pipeline. Immediate, Scheduled, In response to an event | '''Triggers''' to run the pipeline. Immediate, Scheduled, In response to an event | ||
The '''Monitor''' tab of Synapse Studio shows the run progress of a pipeline. | The '''Monitor''' tab of Synapse Studio shows the run progress of a pipeline. This progress information is used by [[Exam_DP203_front-end_services_Microsoft_Purview|Microsoft Purview]] to inform it about data lineage. | ||
Revision as of 22:37, 17 November 2024
Data Pipelines in Synapse Studio
In the Synapse Studio Integrate tab.
integration runtime
For pipelines to be able to do anything, you have to define Linked Services to the resources they will need to access.
To create a pipeline, click the + button and select "Pipeline"
When you create a pipeline in Synapse Studio, like in SSIS the Control Flow items are shown graphically when they are created, with green and red arrows stating where to go next on success, failure, or completion.
Once the pipeline has been created, click the curly brackets on the top right {} to display the JSON code for it. The template can also be generated from supplied JSON code (this is done by clicking the + button and selecting "Import from Pipeline Template" (it needs the JSON file as a .zip).
Source, Transformation, Sink
Triggers to run the pipeline. Immediate, Scheduled, In response to an event
The Monitor tab of Synapse Studio shows the run progress of a pipeline. This progress information is used by Microsoft Purview to inform it about data lineage.