Exam 203 back-end services Spark

The second back-end service is: Spark

Languages supported in Spark include Python, Scala, Java, SQL, and C#.

Example Spark Python script in a Notebook:

%%pyspark
df = spark.read.load('abfss://files@datalakexxxxxxx.dfs.core.windows.net/product_data/products.csv', format='csv'
## If header exists uncomment line below
##, header=True
)
display(df.limit(10))