Data Engineer (AWS Experience)

Role Summary

Our client is looking for a skilled Data Engineer with expertise in data modelling and data pipeline development.

As a Data Engineer/Analyst, you will work with the big data team, adopting best practices to develop and optimize

data pipelines, reporting and dashboarding to meet business requirements. Proficiency in serverless cloud services

like AWS Glue, Aurora, Lambda, RDS and Redshift. Handle Management Information Systems (MIS) to generate

reports and develop dashboards using business intelligence tools.

Main Responsibilities

Data Pipeline Development

Discuss with Solution Architect on designing data pipelines.

Develop data pipelines with proposed solution.

Manage and maintain data pipelines.

Design and optimize of the ETL/ELT architectures and performances.

Develop efficient and scalable data processing workflows.

Monitor data pipelines, detect issue and fix.

Data Modelling

Create and maintain data models, including entity-relationship diagrams, to represent data structures and

relationships.

Design database schemas that optimize data storage, retrieval and query performance.

Improve query performances.

Optimize on database storage.

Reporting and Visualization

Effective Communication, Stakeholder Engagement and Timely Reporting.

Develop reports, dashboards and visualizations that effectively communicate data-driven insights.

Ensure the reports are delivered on schedule and in a timely manner.

BAU Tasks

Understanding and translating business requirements into technical requirements.

Develop/Enhance SAP reports based on business requirements.

Develop/Enhance Dashboards based on business requirements.

Fix bug whenever detected and Deploy changes into GitHub.

Deliver reports to business team.

Ensure data accuracy and consistency.