Skills Spark SQL: Difference between revisions

From MillerSql.com
NeilM (talk | contribs)
NeilM (talk | contribs)
Line 28: Line 28:


Backup tables (job)
Backup tables (job)
Databricks notebooks
SQL MERGE


== Python ==
== Python ==

Revision as of 20:43, 1 October 2024

Spark SQL

Used at:...
  Used at: 
  Ovo Energy

Spark SQL

input_file_name()

Refresh Table

Databricks

Used at:...
  Used at: 
  Ovo Energy

data migration

Databricks Compute (clusters)

Widgets (variables)

Backup tables (job)

Databricks notebooks

SQL MERGE

Python

Streamsets

Used at:...
  Used at: 
  Ovo Energy

Azure

Used at:...
  Used at: 
  Ovo Energy

Azure Blob Storage

Used at:...
  Used at: 
  Ovo Energy

Azure Delta Lake

Used at:...
  Used at: 
  Ovo Energy