Search by job, company or skills

8-10 Years
Not Disclosed
Early Applicant
  • Posted 5 days ago
  • Be among the first 10 applicants

Job Description

Position: Data Engineer – Azure Data Factory & Synapse

Location: Bangalore

Experience: 8+ Years

About the Role

Latinum is hiring for a client seeking an experienced Data Engineer with strong hands-on expertise in Azure Data Factory (ADF), Azure Synapse Analytics, SQL, and Power BI.

The ideal candidate will have extensive experience designing, developing, and maintaining scalable ETL/ELT pipelines across multiple enterprise data sources. Strong expertise in ADF pipeline orchestration, Azure DevOps-based CI/CD, and Power BI semantic modelling is essential.

The role involves building data solutions from the ground up, with a strong focus on clean architecture, scalability, maintainability, and performance. Familiarity with AI-assisted development tools such as ChatGPT and Claude will be valuable, as the team is progressively adopting AI-augmented and agent-assisted engineering workflows.

Key Responsibilities

  • Design, develop, and maintain end-to-end ETL/ELT pipelines using Azure Data Factory and Azure Synapse Analytics.
  • Manage pipeline orchestration, scheduling, dependency management, error handling, monitoring, and performance optimisation.
  • Integrate data from multiple enterprise sources, including Oracle, Salesforce, and other business applications.
  • Develop and manage ADF pipelines using Git-based version control and Azure DevOps.
  • Implement CI/CD practices, including repository management, branching strategies, pull requests, and code reviews.
  • Onboard new source systems by defining extraction strategies, incremental and daily loading mechanisms, and connectivity standards.
  • Build and maintain Power BI semantic models, datasets, reports, and dashboards.
  • Develop and support data transformations using Databricks wherever required.
  • Create and maintain technical documentation, including data mapping documents, pipeline specifications, and data model documentation.
  • Collaborate with business analysts and stakeholders to understand requirements, identify gaps, and translate business needs into technical solutions.
  • Participate in testing, deployment, troubleshooting, and post-deployment validation.
  • Leverage AI coding assistants such as ChatGPT and Claude for development support, documentation, and initial code reviews.
  • Review and validate AI-assisted or agent-generated code and pull requests, ensuring adherence to engineering standards and production quality.

Required Skills & Experience

  • 8+ years of hands-on Data Engineering experience.
  • Strong, hands-on expertise in Azure Data Factory (ADF) and Azure Synapse Analytics.
  • Excellent SQL skills and experience working with complex data transformations.
  • Strong understanding of ADF pipeline architecture, orchestration, scheduling, monitoring, error handling, and performance optimisation.
  • Practical experience with Azure DevOps and Git-based CI/CD, including repositories, branching, pull requests, and code management.
  • Hands-on experience with Power BI, particularly semantic modelling, datasets, and DAX.
  • Experience integrating Salesforce data through REST/Bulk APIs, SOQL, or connector-based approaches.
  • Experience integrating data across multiple enterprise source systems, including Oracle and other business applications.
  • Strong understanding of ETL/ELT patterns, data warehousing concepts, and enterprise data architecture.
  • Ability to independently develop scalable, maintainable data pipelines and solutions from scratch.
  • Experience using AI-assisted coding tools as part of a professional software development workflow.
  • Strong technical documentation, analytical, troubleshooting, and problem-solving skills.

Good to Have

  • Working knowledge of Azure Databricks, including PySpark or Scala.
  • Experience integrating additional enterprise platforms such as SAP, ServiceNow, Workday, or similar systems.
  • Exposure to AI-assisted development tools, coding agents, and automated code review workflows.
  • Experience working in engineering teams transitioning towards automated and agent-driven pipeline development.

More Info

Job Type:
Industry:
Employment Type:

Key Skills

AI-assisted coding tools

Azure Data Factory (ADF)

ETL/ELT patterns

Git-based CI/CD

Similar Jobs

10-12 yrs
Bengaluru, India
Skills:
Data Lineage, Alteryx, Machine Learning, Data Quality, Tableau, Data Modelling, Sql, AI tools, Data Analysis
4-10 yrs
Bengaluru, India
Skills:
snowflake , Github, PostgreSQL, Data Warehousing, Sql, Git, DB2, Bitbucket, MySQL, Oracle, Etl, Teradata
7-9 yrs
Bengaluru, India
Skills:
Java, S3, Scala, Emr, Redshift, Sql, Lambda, Kinesis, Spark, Python, AWS, Step Functions, Lake Formation, Glue, Athena
6-8 yrs
Bengaluru, India
Skills:
Elk, Pyspark, PostgreSQL, Prometheus, Kafka, Grafana, Terraform, Oracle, Python, AWS, Workflows, SQL Server, Sql, Git, Gcp, Spark, Databricks, Azure, GenAI, Infrastructure as Code, MLflow, CI CD, Unity Catalog, Delta Lake, Databricks Genie
6-8 yrs
Bengaluru, India
Skills:
snowflake , Git, Power Bi, Sql, dbt, CI/CD