Search by job, company or skills

6-8 Years
Not Disclosed
Early Applicant
  • Posted 13 days ago
  • Be among the first 30 applicants

Job Description

Job Description: Senior / Lead Azure Data Engineer (6+ Years)

Job Description

**mandatory

SN

Required Information

Details

Role**

Azure Data Engineer

Required Technical Skill Set**

Azure DataBricks, Pyspark. ADLS, Synapse

Desired Experience Range**

6+ Yrs Exp

Location of Requirement

Bangalore , Chennai

Desired Competencies (Technical/Behavioral Competency)

Must-Have**

(Ideally should not be more than 3-5)

  • 3+ years of relevant experience in Pyspark and Azure Databricks.
  • 1+ year of exp in Synapse Analytics
  • Proficiency in integrating, transforming and consolidating data from various structured and unstructured data sources.
  • Good experience in SQL or native SQL query languages.
  • Strong experience in implementing Databricks notebooks using Python.
  • Good experience in Azure Data Factory, ADLS, Storage Services, Synapse, Serverless architecture, Azure functions.

Good-to-Have

  • Strong knowledge of Data management principles.
  • Good experience in SSIS/ETL transformation processes.
  • Experience in Azure DevOps and CI/CD deployments
  • Strong problem solving and analytical skills.
  • Experience with Agile development methodologies.

Microsoft Azure certifications (such as DP203) are preferred.

SN

Responsibility of / Expectations from the Role

1

This role will provide an opportunity for the candidate to work with a team of developers and designers that are responsible for developing applications on Azure Data tech stack

2

Ideal candidates need to be creative problem solvers, self-motivated and tenacious when tackling tough issues and will have to contribute to process improvements by bringing in new ideas and techniques to enhance the design and development process.

3

Collaboratively working with the project data team members on projects and tasks. Self-driven learning of technologies

More Info

Job Type:
Industry:
Employment Type:

Key Skills

Similar Jobs

6-8 yrs
Bengaluru, India
Skills:
RAG (Retrieval-Augmented Generation), Azure Data Factory (ADF), Pyspark, Azure Sql, Sql, ELT, Devops, Azure Synapse Analytics, Azure Data Lake, Spark, Cosmos DB, Python, Etl, Fabric Lakehouse architectures, Infrastructure as Code, vector databases, CI/CD pipelines, Microsoft Fabric, Azure AI Search
6-8 yrs
Bengaluru, India
Skills:
Aws Redshift, Data Modeling, Automated Testing, Scala, Apache Spark, ELT, Azure Synapse, Gcp, Databricks, Data Warehousing, Azure, Python, AWS, Etl, Lakehouse Architecture, Google BigQuery, Unity Catalog, Delta Lake, CI/CD, Infrastructure-as-Code, Observability, Databricks Workflows
5-7 yrs
Bengaluru, India
Skills:
snowflake , Java, BigQuery, Scala, Kafka, Redshift, Sql, Git, Gcp, Kinesis, Spark, Azure, Python, AWS, Airflow, Alation, Flink, Atlan, Prefect, dbt, Dagster, CI/CD
10-12 yrs
Bengaluru, India
Skills:
Large Language Models (LLM), Pyspark, Azure Databricks, Sql, Rest Apis, Visual Studio Code, Python, Azure DevOps, Generative AI, Cloud-based data platforms, Scalable data architectures, ETL processes, Monitoring and alerting systems
8-12 yrs
Bengaluru, India
Skills:
Pyspark, Azure Databricks, Data Modeling, Sql, ELT, Databricks, Etl, GenAI frameworks and platforms, Databricks Mosaic AI, Lakehouse Architecture, Medallion Architecture, Transformation Notebooks, Batch and real-time streaming data processing frameworks, Cloud-based data storage solutions