The Data Engineer to design, develop, and maintain scalable data pipelines and architectures. The candidate will play a critical role in enabling data-driven decision-making across the organization by ensuring the availability, reliability, and quality of data. This role includes working with structured and unstructured data, integrating data from multiple sources, and ensuring compliance with regulatory requirements, including BNM RMiT, PDPA, and internal data governance frameworks.
Job Description
- Design, build, and maintain scalable ETL/ELT pipelines to ingest, transform, and process large volumes of data.
- Collaborate with data analysts business stakeholders to understand data needs and deliver high-quality datasets.
- Integrate data from internal systems, third-party APIs, and public datasets into the enterprise data platform.
- Implement data quality checks, metadata management, and data lineage tracking.
- Ensure compliance with regulatory and security standards (e.g., BNM RMiT, PDPA, PCI-DSS).
- Optimize data workflows for performance and cost-efficiency in cloud/on-premises environments.
- Develop and maintain documentation on data architecture, processes, and standards.
- Automate recurring data workflows and implement monitoring tools to ensure high availability.
- Support data platform migration, including cloud-based data solutions (e.g., AWS, Azure, GCP).
Qualification / Requirement
- Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field.
- Experience with cloud platforms (AWS, Azure, or GCP) and services like S3, Lambda, Glue, or Data Factory
- Hands-on experience with ETL/ELT tools
- Understanding of data governance principles and frameworks.
- Minimum 3 years of experience in data engineering, data integration, or related roles..
- Experience in regulated industries such as banking, insurance, or Takaful (preferred).
