Exam DP203 Synapse Data Pipelines

Data Pipelines in Synapse Studio

In the Synapse Studio Integrate tab.

integration runtime

For pipelines to be able to do anything, you have to define Linked Services to the resources they will need to access.

To create a pipeline, click the + button and select "Pipeline"

When you create a pipeline in Synapse Studio, like in SSIS the Control Flow items are shown graphically when they are created, with green and red arrows stating where to go next on success, failure, or completion.

Once the pipeline has been created, click the curly brackets on the top right {} to display the JSON code for it. The template can also be generated from supplied JSON code (this is done by clicking the + button and selecting "Import from Pipeline Template" (it needs the JSON file as a .zip).

Source, Transformation, Sink

Triggers to run the pipeline. Immediate, Scheduled, In response to an event

The Monitor tab of Synapse Studio shows the run progress of a pipeline. This progress information is used by Microsoft Purview to inform it about data lineage.

Create Pipeline

Under Activities - Move and Transform, select Copy Data or Data Flow.

For Data Flow items, you create a new source object. The "Projection" tab has the list of columns to map.