Python Databricks Developer

Role Overview

We are looking for a Python Databricks Developer with strong experience in data engineering, ETL development, and cloud-based data platforms. The candidate will be responsible for developing and optimizing data pipelines using Python, Databricks, and Apache Spark.

Key Responsibilities

• Develop and maintain scalable data pipelines using Python, Databricks, and PySpark.
• Design and implement ETL/ELT workflows for large-scale data processing.
• Develop and optimize Databricks notebooks, jobs, and workflows.
• Work with Apache Spark for distributed data processing.
• Integrate data from multiple sources and build reliable data solutions.
• Perform data transformation, cleansing, validation, and optimization.
• Troubleshoot pipeline failures and performance issues.
• Collaborate with data engineers, analysts, and business stakeholders.
• Follow data quality, security, and development best practices.
  
  

Required Skills

• Strong experience with Python and PySpark.
• Hands-on experience with Databricks.
• Good understanding of Apache Spark and distributed data processing.
• Strong SQL skills and experience with relational databases.
• Experience in ETL/ELT and data pipeline development.
• Knowledge of cloud platforms such as Azure, AWS, or GCP.
• Experience with Delta Lake and Databricks Workflows is preferred.
• Good problem-solving and communication skills.
  
  

Experience: 4–8 years

Role: Python Databricks Developer

Python,

SQL, Databricks, Apache Spark, REST APIs, Data Modeling, Git, Cache

development

Good to have – LLM Integration,