Search by job, company or skills

Infinite Computer Solutions Pte Ltd

Data Engineer

Infinite Computer Solutions Pte Ltd
Kuala Lumpur
3-12 Years
Save
  • Posted 6 hours ago
  • Be among the first 10 applicants
Early Applicant
Quick Apply

Job Description

  • Design, develop, test, deploy and maintain ETL/ELT pipelines using Azure Data Factory (ADF) and Databricks.
  • Implement scalable data processing and transformation logic in PySpark and SQL on Databricks (Delta Lake / lakehouse patterns).
  • Ingest and integrate data from diverse batch and streaming sources into ADLS Gen2 and Delta Lake.
  • Build curated, documented datasets for analytics and ML (support dimensional models where appropriate).
  • Implement automated data quality checks, unit/integration tests, and validation gates.
  • Monitor pipeline health, implement logging, alerting and dashboards; perform RCA and production incident remediation.
  • Optimize pipeline performance and cost: cluster sizing, job scheduling, partitioning, caching and query tuning.
  • Implement and maintain CI/CD for data jobs and infrastructure (Terraform/ARM/Bicep, Azure DevOps or GitHub Actions).
  • Ensure data governance, lineage and security best practices; register assets in a data catalog (e.g., Microsoft Purview or equivalent).
  • Collaborate with cross-functional teams to collect requirements, define SLAs/SLOs and deliver production-ready solutions.
  • Contribute to runbooks, documentation, coding standards and data platform roadmap.

More Info

Job Type:
Contract Job
Role:
Other Roles
Function:
Others

Job ID: 150833489

Jobs by Skill - IT
Jobs by Skill - Non IT
International Jobs
Jobs in Top Cities
Popular Jobs
Last Updated: 06-07-2026 08:09:45 AM
Homejobs in Kuala LumpurData Engineer

Similar Jobs

Azure Data Engineer

amIT Global Solutions Sdn Bhd
Kuala Lumpur

Skills:

data engineering , Azure Data Lake, Kafka, Postgresql, FastAPI, Apache Kafka, PostgreSQL, Python, Angular, Typescript, Rest API Development, API security, Azure Synapse, Azure Storage, Sql, Database Design, Devops, Kubernetes, Authentication, Identity Management, solution architecture, Web Application Development, TimescaleDB, asynchronous processing, data pipeline development, real-time data streaming, Batch Processing, cloud data platforms, CI/CD pipelines, container orchestration, microservices architecture, observability, Microsoft Entra ID, consumer groups, Problem Solving

Data Engineer

Bipi
Malaysia, Kuala Lumpur

Skills:

Power Bi, Kafka, Tableau, Sql, Azure Synapse, Git, Spark Streaming, Gcp, Spark, Databricks, Azure, Python, AWS, Big Data Processing, Delta Lakehouse, Cloud-based Storage, ETL Pipelines, DLT, Schema Validation, Data Quality Systems, Apache Superset

Senior Data Engineer - Market #3

NTT Data
India, Remote

Skills:

Github, Sql, Azure Synapse, Apache Spark, Scala

Data Engineer

Agensi Pekerjaan Shivz Solution Sdn. Bhd
Kuala Lumpur

Skills:

data engineering , Python, Sql, Pyspark, AWS, Aws Rds, S3, Apache Airflow, Kafka, Etl, ELT, Data Modeling, Data Lake, Docker, Cloud Infrastructure, Nosql, Data Quality, Scalability, dbt, Debezium, CDC Frameworks, Data Pipelines, Real-Time Processing, Batch Processing, Apache Iceberg, Delta Lake, ClickHouse, Workflow Orchestration, Relational Databases, ERP Data Integration, Construction Data, Manufacturing Data, Logistics Data, Pipeline Monitoring, Troubleshooting, Performance Optimization

Data Engineer (Python, R, Cloud)

OxyData Software Sdn Bhd
Kuala Lumpur

Skills:

Data Engineer, Python, Cloud, Google Cloud Platform, Sql, Etl, ELT, Apache Airflow, Gitlab, Github, Kubernets, Confluence, R, G Suite