Job Summary:
We are looking for an experienced Data Architect with strong expertise in
Databricks, cloud platforms (AWS & Azure), and AI/ML technologies. The candidate will design scalable data architectures, build modern data platforms, and support machine learning and AI-driven analytics solutions across enterprise environments.
Key Responsibilities
- Design enterprise-scale data architectures using Databricks on AWS and Azure
- Build scalable ETL/ELT pipelines for large-scale structured and unstructured data
- Develop and maintain Data Lake / Lakehouse architectures
- Implement AI/ML data pipelines and model integration workflows
- Work with Apache Spark / PySpark for distributed data processing
- Collaborate with Data Scientists and ML Engineers to deploy AI/ML solutions
- Enable real-time analytics and predictive modeling platforms
- Ensure data governance, security, compliance, and cloud optimization
- Support cloud migration and modernization initiatives
- Lead architecture discussions and define best practices
Equired Skills
- Strong hands-on experience with Databricks (AWS & Azure)
- Expertise in cloud services:
- AWS (S3, Glue, Redshift, Lambda, EC2, IAM)
- Azure (ADF, ADLS, Synapse, Azure SQL)
- Strong experience in Apache Spark / PySpark
- Experience in ML model deployment and MLOps concepts
- Strong SQL, Python, and data modeling skills
- Understanding of data governance and security practices