
Search by job, company or skills

Role Description
The Data Engineer is responsible for designing, building, and maintaining scalable data pipelines and analytics-ready data assets. This role focuses on Databricks-based data engineering, API-driven data ingestion, and enabling downstream analytics and reporting through well-modeled datasets consumed by Power BI.
Key Responsibilities
• Design, develop, and maintain data pipelines using Databricks (Spark / SQL / PySpark)
• Build scalable ETL / ELT processes to support enterprise analytics and reporting
• Ingest and integrate data from internal and external systems using REST APIs
• Transform raw data into curated, analytics-ready datasets and data marts
• Optimize data processing performance, reliability, and cost efficiency
• Partner with BI and analytics teams to enable Power BI reporting and semantic models
• Ensure data quality, governance compliance, and documentation standards
• Support testing, deployment, and monitoring of data solutions
Required Skills & Experience
• Strong hands-on experience with Databricks development
• Solid knowledge of Spark, SQL, and Python
• Experience working with APIs for data ingestion and system integration
• Exposure to Power BI (data modeling, performance optimization, analytics consumption)
• Strong understanding of data modeling concepts (fact/dimension, star schema)
• Experience with cloud data platforms and modern data architectures
Laurelsoft is a leading IT consulting Malaysian company focused on providing business relevant solutions to its customers. We offer the entire range of enterprise IT services – package implementation, web ennoblement, application integration and application management to customers in the BFSI, Manufacturing and Retail verticals.We Offer - Software Development, IT Staffing - Providing IT Talent, Corporate Trainings, Outsourced Testing Services.
http://www.laurelsoft.com.my/
Job ID: 147026207
Skills:
data engineering , Azure Data Lake, Kafka, Postgresql, FastAPI, Apache Kafka, PostgreSQL, Python, Angular, Typescript, Rest API Development, API security, Azure Synapse, Azure Storage, Sql, Database Design, Devops, Kubernetes, Authentication, Identity Management, solution architecture, Web Application Development, TimescaleDB, asynchronous processing, data pipeline development, real-time data streaming, Batch Processing, cloud data platforms, CI/CD pipelines, container orchestration, microservices architecture, observability, Microsoft Entra ID, consumer groups, Problem Solving
Skills:
Alteryx, MySQL, PostgreSQL, Tableau, Informatica, Sql, Etl, Dataiku, Tableau Prep
Skills:
Data Modelling, Apis, Sql, ELT, Databases, Spark, Databricks, Python, Aws S3, Etl, Data Lakes, Documentation, Files, Access Control, Monitoring
Skills:
Data Modeling, Dimensional Modeling, Data Warehousing, Sql, Star Schema, ELT, Etl, Cloud Data Platforms
Skills:
Java, Spark Streaming, Scala, Kafka, Python, Sql, Doris, Clickhouse, Starrocks, Flink
We don’t charge any money for job offers