Location: KL, Malaysia
Title: Senior Manager, Data Platforms
About the Role
We are seeking a senior technical leader to own the strategy, architecture, and performance of our client's mission-critical Trading Data Platform. You will lead the end-to-end data pipeline on Databricks, ingesting 30+ external market data feeds and 12+ internal sources to deliver high-performance, low-latency analytics to our trading ecosystem. You will also own the development of internal reporting solutions using Power BI.
Key Responsibilities
- Platform Leadership: Define and execute the roadmap for our Unified Trading Data Platform (UTDP) on Databricks, ensuring alignment with trading business objectives.
- Data Engineering: Own the design and optimization of real-time and batch data pipelines using Apache Spark, Delta Lake, and Delta Live Tables. Manage sub-second latency requirements for tick data and market events.
- Analytics & Reporting: Deliver high-performance analytics services to trading tools. Lead the development of interactive dashboards in Power BI (including data models, DAX, and governance) for trading, risk, and executive management.
- Governance & Reliability: Implement data governance (Unity Catalog), enforce SLAs for data availability, and ensure platform resilience with fault-tolerant architecture and performance tuning.
- Team Leadership: Lead, mentor, and grow a high-performing team of data engineers and BI developers, fostering a culture of innovation and operational excellence.
- Stakeholder Management: Partner with Front Office trading desks, Quantitative Research, and senior leadership to translate complex business needs into technical solutions.
Required Qualifications
- 17+ years of experience in data engineering, with 8+ years in technical leadership.
- Deep financial services experience, specifically in trading, capital markets, and market data (Bloomberg, Reuters, exchanges).
- Expert-level Databricks proficiency: 5+ years hands-on with Delta Lake, Spark (PySpark/Scala), and Unity Catalog.
- Strong expertise in Power BI, Python, and cloud platforms (AWS/Azure).
- Proven track record of building large-scale, low-latency data platforms.
Preferred Qualifications
- Databricks, Power BI, or Cloud (AWS/Azure) certifications.
- Experience with streaming technologies (Kafka), ML frameworks (MLflow), and infrastructure-as-code (Terraform).
