Software Engineer

Job Title: Data Engineer

Location: Malaysia

Engagement Type: Contract

Role Overview

We are seeking an experienced Data Engineer with strong expertise in PySpark, AWS Glue, and Data bricks to design, build, and maintain scalable data pipelines and analytics solutions. The ideal candidate should be comfortable working independently, deploying changes directly to production, and collaborating with cross-functional teams to deliver data-driven solutions.

Required Experience

Minimum 4+ years of experience as a Data Engineer or in a similar role.

Technical Skills (Mandatory)

Expert proficiency in PySpark

Strong hands-on experience with AWS Glue

Expertise in SQL and SQL-based databases

Hands-on experience with AWS services

Experience with Databricks Platform

Ability to push changes to production without prior review

Preferred / Recommended Skills

Advanced working knowledge of:

Amazon Athena

Grafana

Databricks

Experience building and optimizing data pipelines

Familiarity with data warehousing concepts and ETL/ELT processes

Key Responsibilities :

Design, develop, and maintain scalable data pipelines using PySpark and AWS Glue

Build and optimize data processing workflows in Databricks

Query and analyze large datasets using SQL and Athena

Create and maintain dashboards/visualizations using Grafana

Work closely with data scientists, analysts, and engineering teams

Troubleshoot data issues and ensure data quality and reliability

Deploy and monitor data solutions in production environments

Proactively improve performance, cost efficiency, and reliability of data systems