Search by job, company or skills

paynet (payments network malaysia)

Data Platform Engineer

Save
new job description bg glownew job description bg glow
  • Posted 8 days ago
  • Be among the first 10 applicants
Early Applicant

Job Description

Why PayNet / Why Now

  • Build the data platform that underpins analytics, products, and decision‑making across national payment systems
  • Shape how data is ingested, processed, and operated as PayNet scales volume and complexity
  • Influence platform standards early, before one‑off solutions become systemic debt
  • Work on infrastructure where reliability and cost efficiency directly affect enterprise outcomes
  • Step into a role with clear ownership, your platform decisions compound across teams

TL;DR

  • Build and own the core data platform that other engineers rely on daily
  • Decide how data ingestion, pipelines, and tooling scale across teams and use cases
  • Optimise for reliability, cost, and developer experience, not one‑off solutions
  • Work hands‑on with Python, Kubernetes (container orchestration platform), and cloud‑native data infrastructure
  • Be accountable for platform outcomes, not just code delivery

Why This Role Matters

  • Enables data engineers to ship pipelines faster with fewer operational failures
  • Reduces duplicated effort through standardised ingestion and pipeline frameworks
  • Improves platform reliability that downstream analytics and products depend on
  • Shapes how data services are built, deployed, and operated across PayNet
  • Directly impacts cost efficiency and scalability of the data lake

What You Will Actually Do

  • Own and evolve reusable ingestion and CDC (Change Data Capture) frameworks used across teams
  • Build standard pipeline SDKs (Software Development Kits) that make onboarding new data sources predictable
  • Decide platform patterns that balance flexibility, simplicity, and scale
  • Engineer monitoring, alerting, and debugging tools that prevent silent failures
  • Run platform deployments using GitOps (Git‑based Operations) with strong operational discipline

Examples of This Role in Practice

  • Designing a CDC framework that becomes the default for all new data sources
  • Eliminating repeated pipeline failures by standardising retries and observability
  • Challenging a complex design in favour of a simpler, more robust platform API (Application Programming Interface)
  • Improving developer velocity by replacing bespoke scripts with shared tooling
  • Catching platform instability early through proactive monitoring improvements

What Will Help You Succeed

  • Strong Python engineering skills building libraries, SDKs, or internal frameworks
  • Sound judgment in API design and managing long‑term platform complexity
  • Hands‑on experience operating Kubernetes workloads with a GitOps mindset
  • Understanding trade‑offs of running stateful data workloads at scale
  • Ability to prioritise reliability, cost, and usability over theoretical perfection

More Info

Job Type:
Industry:
Employment Type:

Job ID: 148492505

Similar Jobs

Malaysia, Kuala Lumpur

Skills:

snowflake BigQueryHadoopScalaApache SparkKafkaRedshiftSqlDevopsGcpDatabricksAzurePythonAWSAWS CDKFlinkAzure BicepInfrastructure-as-Code