Spark SQL, Git, Pyspark, Databricks, Python, Sql, Delta Lake

Pyspark, Apache Spark, Kafka, ELT, Git, Azure Data Factory, Databricks, Azure, Azure DevOps, Etl, Databricks Structured Streaming, Spark performance tuning, Parquet format, Great Expectations, Azure Key Vault, MLflow, Unity Catalog, Data Lakehouse, Delta Lake, Azure Event Hubs