Exam DP203 Path 1: Difference between revisions
No edit summary |
Tag: Manual revert |
||
| (11 intermediate revisions by the same user not shown) | |||
| Line 1: | Line 1: | ||
== Path 1 == | == Path 1 == | ||
Streaming data. Stream Analytics. Azure Event Hubs | Streaming data. Stream Analytics. Azure Event Hubs. Streaming vs Batch processing | ||
Structured, semi-structured, and unstructured data. | Structured, semi-structured, and unstructured data. | ||
Azure Data Lake Storage Gen2 | Azure Data Lake Storage Gen2 | ||
Operational data (OLTP) vs Analytical data | |||
Source to Sink | |||
== Azure Portal == | |||
In the portal, open a script window. This can run Bash or Powershell (.ps1 files). | |||
== Resource Groups and resources == | |||
Create a Resource Group. | |||
In this, create Resources. | |||
An example of a Resource is a Synapse Analytics "Workspace". You click on this to go into its properties, and in here is a button to click to open [[Exam_DP203_front-end_services_Azure_Synapse_Analytics_Studio|Azure Synapse Analytics Studio]]. | |||
== SQL Pools == | |||
Two types of SQL Pool: | |||
# Serverless - These query file-based data in a data lake. | |||
# Dedicated - These query relational data in a data warehouse. | |||
Dedicated pools cost money to run, and need to be started up before they can be used. I think they are probably implemented as a virtual Windows machine that is run in the background, with the startup time being required for the reboot to take place. | |||
Note I think these are distinct from Azure SQL Database. | |||
== Azure Synapse Link == | |||
Azure Synapse Link. Allows data to be moved between the various services. | |||
Latest revision as of 17:04, 15 November 2024
Path 1
Streaming data. Stream Analytics. Azure Event Hubs. Streaming vs Batch processing
Structured, semi-structured, and unstructured data.
Azure Data Lake Storage Gen2
Operational data (OLTP) vs Analytical data
Source to Sink
Azure Portal
In the portal, open a script window. This can run Bash or Powershell (.ps1 files).
Resource Groups and resources
Create a Resource Group.
In this, create Resources.
An example of a Resource is a Synapse Analytics "Workspace". You click on this to go into its properties, and in here is a button to click to open Azure Synapse Analytics Studio.
SQL Pools
Two types of SQL Pool:
- Serverless - These query file-based data in a data lake.
- Dedicated - These query relational data in a data warehouse.
Dedicated pools cost money to run, and need to be started up before they can be used. I think they are probably implemented as a virtual Windows machine that is run in the background, with the startup time being required for the reboot to take place.
Note I think these are distinct from Azure SQL Database.
Azure Synapse Link
Azure Synapse Link. Allows data to be moved between the various services.