Skills Spark SQL: Difference between revisions
| (8 intermediate revisions by the same user not shown) | |||
| Line 5: | Line 5: | ||
''Used at: '' | ''Used at: '' | ||
''[[Role_Ovo_Energy|Ovo Energy]]'' | ''[[Role_Ovo_Energy|Ovo Energy]]'' | ||
''[[Role_SSE_Energy_smart_meter|SSE Energy smart meter]]'' | |||
</div> | </div> | ||
</div> | </div> | ||
| Line 12: | Line 13: | ||
Refresh Table | Refresh Table | ||
current_timestamp() | |||
ifnull(a, b) | |||
reverse(a) | |||
Datatypes: timestamp, string, int, bigint, date | |||
== Databricks == | == Databricks == | ||
| Line 19: | Line 28: | ||
''Used at: '' | ''Used at: '' | ||
''[[Role_Ovo_Energy|Ovo Energy]]'' | ''[[Role_Ovo_Energy|Ovo Energy]]'' | ||
''[[Role_SSE_Energy_smart_meter|SSE Energy smart meter]]'' | |||
</div> | </div> | ||
</div> | </div> | ||
| Line 48: | Line 58: | ||
''Used at: '' | ''Used at: '' | ||
''[[Role_Ovo_Energy|Ovo Energy]]'' | ''[[Role_Ovo_Energy|Ovo Energy]]'' | ||
''[[Role_SSE_Energy_smart_meter|SSE Energy smart meter]]'' | |||
</div> | </div> | ||
</div> | </div> | ||
| Line 75: | Line 86: | ||
''Used at: '' | ''Used at: '' | ||
''[[Role_Ovo_Energy|Ovo Energy]]'' | ''[[Role_Ovo_Energy|Ovo Energy]]'' | ||
''[[Role_SSE_Energy_smart_meter|SSE Energy smart meter]]'' | |||
</div> | </div> | ||
</div> | </div> | ||
Latest revision as of 18:46, 2 October 2024
Spark SQL
Used at:...
Used at: Ovo Energy SSE Energy smart meter
Spark SQL
input_file_name()
Refresh Table
current_timestamp()
ifnull(a, b)
reverse(a)
Datatypes: timestamp, string, int, bigint, date
Databricks
Used at:...
Used at: Ovo Energy SSE Energy smart meter
data migration
Databricks Compute (clusters)
Widgets (variables)
Backup tables (job)
Databricks notebooks
SQL MERGE
Python
Used at:...
Used at: Ovo Energy
Streamsets
Used at:...
Used at: Ovo Energy SSE Energy smart meter
Azure
Used at:...
Used at: Ovo Energy
Azure Blob Storage
Used at:...
Used at: Ovo Energy
Azure Delta Lake
Used at:...
Used at: Ovo Energy SSE Energy smart meter