Senior Data Engineer
Search Jobs
Search by job, company or skills
Search by job, company or skills
Role Summary
The Senior Data Engineer builds and integrates the core Azure Synapse and ADF data pipelines that underpin the modernized data platform, working closely onshore with the Data Delivery Lead and ETL Lead while guiding the offshore ETL Engineer(s).
Key Responsibilities
• Design and build Azure Synapse and ADF pipelines for core data integration workloads
• Implement data models and integration patterns feeding the ADLS Gen2 data lake
• Write and optimize SQL for data transformation and validation across source and target systems
• Partner with the ETL Lead on migration logic from IBM DataStage into Synapse/ADF
• Support solution design discussions on data integration architecture with the Data Delivery Lead
• Mentor and review the output of the offshore ETL Engineer(s)
Required Skills
• Azure Synapse Analytics
• Azure Data Factory (ADF)
• Azure Data Lake Storage (ADLS) Gen2
• PySpark
• SQL Development
• Delta Lake
• Data Modeling
• Azure DevOps / CI-CD
• ETL Modernization
• IBM DataStage Migration experience (preferred)
Experience
6-8 years as a data engineer, with hands-on Azure Synapse and ADF delivery experience; DataStage migration
exposure is a strong plus.
Common Candidate Expectations
• Insurance / Banking / Financial Services domain exposure preferred
• Strong English communication proficiency (written and verbal)
• Comfortable working in a hybrid/remote-led delivery model with onshore architecture and governance oversight
Job ID: 152484701
Skills:
Data Modeling, Dashboarding, Sql, ELT, Data Quality, Data Visualization, Python, Etl, SaaS Enterprise business models, Data processing performance tuning, Logging specifications, Product analytics, Anomaly detection solutions
Skills:
Github, Pyspark, Data Lineage, Data Warehouse, ELT, Data Lake, Databricks, Star Schema, Etl, Slowly Changing Dimensions, Role-Based Access Control, Attribute-Based Access Control, Snowflake Schema, Unity Catalog, Delta Tables, Fact and Dimension tables, GitHub Actions, Lakehouse, CI CD pipelines
Skills:
Devops, Pyspark, Databricks, Azure, Python, Sql, AWS, Infrastructure as Code, DataOps, SRE, CI CD
Skills:
Advanced Analytics, Machine Learning, Data Warehousing, Data Modeling, Google Cloud, ELT, Data Quality, Data Governance, Azure, AWS, Etl, data engineering best practices, cloud platforms, big data tools, data lakehouse
Skills:
Pyspark, Sql, databricks, Data Engineer
