Principal Data Platform Engineer

Job Title:Principal Data Platform Engineer

Location: Malaysia

Job Description

Role Mission: To lead and scale theData Platform Engineering and Operationsfunction within StarHubs Digital Experience Platform (DXP) Data organization. This role ensures the continuousreliability, scalability, and securityof StarHubs C360 cloud data platform built on AWS, Snowflake, SageMaker, and Datapipe. The incumbent drivesoperational excellence, automation, and engineering maturityacross the platform,while prototyping and rolling outnew platform capabilitiesthat enable agility, innovation, and performance for data and AI workloads across the enterprise.

Accountabilities:

1. Own end-to-endinfrastructure and platform operationsof the DXP Data Platform across AWS, Snowflake, and SageMaker environments (DEV, SIT, PROD).

1. Lead thedesign, build, and automation ofdataplatform engineering and DevOps practices, ensuring continuous improvement and zero-downtime operations.

1. Lead the prototyping, implementation, and rollout ofnew platform capabilities and servicesacross AWS, Snowflake, and SageMaker.

1. Implement governance,security, and compliance standards& improvementsfor cloud infrastructure, data access, and network controls.

1. Drive operational excellence throughmonitoring, alerting, cost optimization, and performance tuning.

1. Manage a hybrid teamof internal platform engineers and vendor-augmented resources supporting Day 2 operations and enhancements.

1. Partnerwith Data Engineering, Architecture, Security, Infrastructure& Toolingteams to ensure aligned technical roadmaps, compliance readiness, and audit traceability.

Responsibilities:

1. Platform Engineering & Operations:

• Own AWS infrastructure for DXP Data Platform (multi-AZ, multi-VPC setup).

• Administer Snowflake environments, including user roles, RBAC, performance optimization, warehouse lifecycle, and cost controls.

• Manage SageMaker environments (Studio, Canvas, Notebooks) forenablingmulti-domain ML use cases.

• Operate DataPipes (EKS + Airflow) for ingestion orchestration, ensuring high availability and version-controlled configurations via IaC (CloudFormation/CDK).

• Maintain& enhancelogging, monitoring, observability& DevOps automationviamoderntoolssuch asCloudWatch,Splunk, PagerDuty, Slack, ServiceNow,Snowflakeobservability features.

1. Platform Prototyping & Enhancement:

• Design, prototype, and implement new platform features across AWS, Snowflake, and SageMaker to support innovation in data processing, analytics, and ML operations.

• Lead rollout and production hardening of new platform components (e.g., new Snowflake Cortex AI features, SageMaker pipelines, AWS-native services).

• Evaluate and integrate new services or capabilities aligned to StarHubs data platform roadmap.

• Develop technical design standards and documentation for new features and automation processes.

1. Automation & Continuous Improvement:

• Implement Day 2 platform enhancements including auto-scaling, self-healing workflows, and CI/CD automation.

• Enhance EKS cluster performance, pipeline automation, and integration efficiency across cloud and on-prem data sources.

• Drive infrastructure-as-code (IaC) adoption for all environments and standardize rollout strategies (blue-green/canary).

1. Governance, Security & Compliance:

• Enforce enterprise security policies for IAM, VPC isolation, PrivateLink, and encryption (KMS, Secrets Manager).

• Coordinate vulnerability remediation (EKS upgrades, CVE patching, EC2 AMI refresh, Docker image hardening).

• Ensure infrastructure audit readiness in partnership with Information Security (ITSec) and Compliance teams.

1. Operations & Cost Management:

1. Monitor and optimize Snowflake warehouse utilization, compute spend, and S3 data lifecycle management.

1. Maintain tagging, dashboards, and cost visibility frameworks across AWS and Snowflake.

1. Implement cost governance guardrails and usage quotas across platform components.

1. Team & Vendor Leadership:

• Lead a blended team of StarHub engineers and partner vendors responsible for platform sustainment and evolution.

• Manage augmented vendor teams, ensuring consistent delivery quality and knowledge transfer to internal engineers.

• Build in-house capability in platform engineering, IaC, and automation disciplines.

Areas of Impact:

1. Scope: DXP Data Platform infrastructure (AWS, Snowflake, SageMaker, Datapipe) supporting C360, AI/ML, and analytics workloads enterprise-wide.

1. Decision Rights: Platform design approval, selection of new AWS/Snowflake/SageMaker capabilities, DevOps tooling and IaC framework choices, and vendor performance oversight.

1. Stakeholders: Platform Engineering, Data Engineering, Data Science, Architecture & Governance, Information Security, and Infrastructure teams.

1. Resources: Hybrid team of 2-4engineers (StarHub and partner resources) managing infrastructure, platform automation, enhancements, and operations.

Ideal Track Record:

1. 8-10yearsofexperience in cloud and platform engineering, with extensive experience on AWS-based data platforms.

1. Proven leadership of cross-functional engineering teams managing production-grade, multi-environment platforms.

1. Hands-on expertise in:

• AWS Services: VPC, EC2, S3, RDS, Lambda, KMS, CloudFormation/CDK, Transfer Family, CloudWatch, CloudTrail.

• Snowflake: administration, RBAC, warehouse optimization, DevOps automation, Cortex AI, and Streamlit integration.

• EKS / Airflow/ Airbyte(Datapipe):container orchestration, CI/CD pipelines, and deployment automation.

• SageMaker: multi-domain setup, pipeline management, Studio/Canvas lifecycle, and MLOps enablement.

• Monitoring & Observability: CloudWatch, Splunk, Snowflake Account Usage, cost dashboards, PagerDuty, Slack, ServiceNow.

1. Demonstrated success in prototyping, implementing, and scaling new cloud and data platform features into production.

1. Experience managing Day 2 operations, incident response, and SRE-driven performance stabilization.

1. Familiarity with machine learning integration and model lifecycle management.

1. Experience enforcing ITSec and compliance standards (IAM, KMS, PDPA/GDPR).

1. Proven success in transitioning platform operations from vendor-managed to in-house ownership.