Data Engineering Lead

Join Verdantas – A Top #ENR 73 Firm

We at Verdantas seeking for a Data Engineering Lead to design and deliver scalable, secure, and modern data solutions that support AI/ML, reporting, analytics, and web applications. The ideal candidate will have strong expertise in Microsoft Azure, Microsoft Fabric, data platform architecture, and team leadership.

Key Responsibilities

Architecture & Strategy

• Design and implement batch and real-time data architectures using modern cloud platforms.
• Define data engineering standards, governance, and best practices.
• Evaluate and recommend technologies for data ingestion, processing, storage, and reporting.

Development & Operations

• Lead development of ETL/ELT pipelines using Spark, Airflow, dbt, Azure Data Factory, and Microsoft Fabric.
• Build and manage data lakes, lakehouses, data warehouses, and data marts.
• Ensure data quality, lineage, observability, and governance.
• Develop scalable data solutions supporting enterprise reporting, dashboards, and web applications.

Leadership & Collaboration

• Mentor data engineers and drive technical excellence.
• Collaborate with business stakeholders, analysts, data scientists, and application teams.
• Manage project delivery, timelines, and resource allocation.

Cloud & DevOps

• Build and manage cloud-based data platforms on Azure and Microsoft Fabric.
• Implement CI/CD pipelines and Infrastructure as Code (IaC).
• Optimize performance, scalability, and cost efficiency.

Skills & Qualifications

• Bachelor's or master's degree in computer science or related field.
• 8+ years of Data Engineering experience with 2+ years in a leadership role.
• Strong SQL and Python skills.
• Experience with Spark, Flink, ETL/ELT frameworks, and modern data architectures.
• Hands-on experience with Microsoft Azure services such as Azure Data Factory, Synapse, Data Lake, and Databricks.
• Experience with Microsoft Fabric (OneLake, Lakehouse, Warehouse, Data Factory, Power BI integration).
• Experience building data solutions for reporting, analytics, dashboards, and web applications.
• Strong understanding of data modeling, governance, metadata management, and cloud-native architectures.
• Excellent communication and stakeholder management skills.

Preferred Certifications

• Microsoft Certified: Azure Data Engineer Associate
• Microsoft Fabric Analytics Engineer Associate
• Google Professional Data Engineer
• AWS Certified Data Analytics – Specialty

Location and Work Set-up

Pune, Maharashtra, India

Work Mode: In Office