Senior/Lead Azure Data Engineer

Required Skills and Qualifications:

Experience with Azure Ecosystem (Preferably Synapse): 5+ years of hands-on experience with Azure Ecosystem, including Synapse, Spark, OneLake, and other Fabric tools. Expertise in optimising Fabric notebooks and efficiently managing large-scale data workloads.

Proficiency in Azure Data Factory: Strong experience with designing and orchestrating complex data pipelines using Azure Data Factory, with an emphasis on seamless data flow integration across various Azure services.

Familiarity with Microsoft Fabric: A working knowledge or eagerness to learn Azure Data Fabric, focusing on cross-platform data orchestration, governance, and security.

Advanced Data Engineering Skills: Extensive experience in data engineering, including the design and implementation of ETL processes and working with large datasets. Proven expertise in data quality, monitoring, and testing practices.

Cloud Architecture Design Expertise: Experience designing and implementing data architectures in the Azure ecosystem, including tools such as Data Lake, Synapse, and Azure Storage.

SQL and Data Modelling Expertise: Strong skills in SQL and data modelling, with the ability to design optimised data structures, tables, and views. Knowledge of both transactional and analytical data modelling.

Collaboration and Communication Skills: Strong ability to work cross-functionally with teams from various domains. Ability to communicate complex technical concepts to both technical and non-technical stakeholders.

Cost Optimisation: Proven experience optimising data engineering processes and Azure resources for both performance and cost, particularly in large-scale cloud environments.

Preferred Skills:Data Lakehouse Experience: Familiarity with Data Lakehouse architectures, particularly with tools like Delta Lake, OneLake, etc.

Azure Ecosystem Familiarity: Knowledge of Azures full ecosystem for end-to-end data integration and ETL processes.

Proficiency in PySpark and Python: Expertise in PySpark for data processing tasks, with a solid foundation in Python.

Fabric Integration: Familiarity with Fabric and how it integrates with other services within the Azure ecosystem.

•Databricks Experience: Experience with Databricks is a plus.

If interested, share your resume at [Confidential Information] with CTC, notice period and location details.