pipeline management , Spark SQL, Data Modelling, Etl Testing, Data Pipeline, Data Governance, Enterprise Integration, Data Intelligence, Extensive Work Experience, data integration projects, Computer Science, Data Quality Management, Enterprise Database System Administration, Agile Delivery, Data Migration Services, Content Ingest Operations

Orchestration, Cloud Security, Pyspark, Apache Spark, Kafka, Sql, Databricks, Data Governance, Python, Platform Operations, Retrieval mechanisms, Performance optimisation, Knowledge Base and RAG solutions, Batch and streaming pipelines, Access Management, Troubleshooting, Embeddings, Vectorisation, GenAI applications, Delta Lake, CI/CD, Microsoft Fabric, Monitoring

Pyspark, Apache Spark, Kafka, Sql, Git, Databricks, Python, RAG solution stacks, embeddings, CI CD workflows, vector databases, cloud-native observability, Delta Lake

Data Governance, Data Lineage, Python, Metadata Management, Pandas, Data Transformation, Distributed Systems, FastAPI, Rest Apis, Apache Iceberg, LangGraph, Pydantic, Trino, Observability, Monitoring, LangChain, Parquet, DuckDB, Microservices patterns, Data ingestion, dbt, CI/CD, tracing, SDKs, Event-driven architectures

Pyspark, Sql, Databricks, Kafka, Microsoft Fabric, Delta Lake

Apache Airflow, Hadoop, Pyspark, Apache Spark, Cloudera, Advanced Sql, Python

operational support , Orchestration, release management, cloud security, Data Transformation, Performance Tuning, Pyspark, Apache Spark, Sql, Python, enterprise data architecture, CI CD, agentic AI use cases, Production Operations, RAG solutions, Access Control, streaming data pipelines, error handling, observability

Pyspark, Apache Spark, Kafka, Sql, Databricks, Python, RAG solution stacks, enterprise data governance, embeddings, CI CD workflows, vector databases, Git version control, cloud-native observability, Delta Lake