Search by job, company or skills

Lead Data Engineer

Lead Data Engineer

Exl
5-7 Years
Not Disclosed
Early Applicant
  • Posted 2 months ago
  • Be among the first 20 applicants

Job Description

In-depth working experience of distributed systems Hadoop, Spark, Hive, DBT and Airflow/Dagster

At least 5 years of solid production quality coding experience in data pipeline implementation in Python

Experience working with public cloud platforms, preferably AWS

Experience working with Databricks and/or Snowflake

Experience in Git, JIRA, Jenkins, shell scripting

Familiarity with Agile methodology, test-driven development, source control management and test automation

Experience supporting and working with cross-functional teams in a dynamic environment

You have excellent collaborative problem solving and communication skills and are empathetic to others

You have a track record of building fast, reliable, and high-quality data pipelines

More Info

Job Type:
Industry:
Employment Type:

About Company

Similar Jobs

8-10 yrs
Pune, India
Skills:
snowflake , Pyspark, Scala, Redshift, Sql, Gcp, Spark, Databricks, Azure, Python, AWS, Etl
8-10 yrs
Pune, India
Skills:
Java, Metadata Management, Scala, Sql, Apache Airflow, Kinesis, Gcp, MLops, Spark, Apache Kafka, Data Governance, Azure, Python, AWS, data quality frameworks, Flink, Prefect, dbt
8-10 yrs
Pune, India
Skills:
Java, Metadata Management, Scala, Sql, Apache Airflow, Kinesis, MLops, Gcp, Apache Kafka, Spark, Data Governance, Azure, Python, AWS, data quality frameworks, Flink, Prefect, dbt
5-12 yrs
Pune, India
Skills:
Python, Databricks, AWS, Java, Pyspark
9-12 yrs
Pune, India
Skills:
Spark SQL, S3, RDS, Aws Services, Pyspark, Emr, Jenkins, Git, Devops Tools, Python, Big Data concepts, AWS architecture, AWS cloud microservices, cloud implementation projects, Aurora, Snowflake SQL, Glue, Data Vault 2.0