Senior Data Engineer

Senior Data Engineer

Role Summary

We are looking for a Senior Data Engineer with strong experience in Azure Databricks, SQL, Kafka, NiFi, and CDC technologies, capable of building and supporting enterprise‑scale data pipelines (batch and real‑time).

Mandatory Skills (Must Be Visible in Resume)

✅ SQL (Mandatory) 

· Strong SQL skills

• Stored procedures
• Query / performance tuning experience

✅ Azure Databricks (Very Important)

· Hands‑on experience with Azure Databricks

• Experience building data pipelines using Databricks
• Exposure to Spark / PySpark / Spark SQL
• Experience with Delta Lake is an advantage

✅ Kafka & Streaming

· Experience working with Kafka

• Real‑time or near real‑time data ingestion experience

✅ NiFi 

· Experience using Apache NiFi for data ingestion

• Experience building and managing data flows in NiFi
• Experience integrating NiFi with databases, Kafka, or cloud storage

✅ CDC (Change Data Capture)

· Experience with CDC concepts or tools

• Handling incremental / real‑time data changes

✅ Data Engineering & Architecture

· Experience designing data pipelines (batch and/or streaming)

• Basic understanding of data architecture concepts

✅ Industry experience

• Malaysian Banking/Financial/Payments experience is an added advantages

Experience Requirements

· At least have 6–10+ years total IT experience

· 3–5+ years in Data Engineering roles

· 2+ years working with Azure Databricks

· Hands‑on experience with NiFi and Kafka