Data Engineer/Senior Data Engineer
Search Jobs
Search by job, company or skills
Search by job, company or skills
Role: Data Engineer/Senior Data Engineer
Location: Kuala Lumpur(Onsite)
Duration: 12 Months (Renewable) Contract
Databricks.
Implement scalable data processing and transformation logic in PySpark and SQL on Databricks (Delta
Lake / lakehouse patterns). Ingest and integrate data from diverse batch and streaming sources into
ADLS Gen2 and Delta Lake.
Build curated, documented datasets for analytics and ML (support dimensional models where
appropriate).
Implement automated data quality checks, unit/integration tests, and validation gates. Monitor pipeline
health, implement logging, alerting and dashboards; perform RCA and production incident remediation.
Optimize pipeline performance and cost: cluster sizing, job scheduling, partitioning, caching and query
tuning.
Implement and maintain CI/CD for data jobs and infrastructure (Terraform/ARM/Bicep, Azure DevOps or
GitHub Actions). Candidate knows Cantonese .
Interested candidates can connect on +6586533349 (WhatsApp chat only)
Job ID: 151799695
Skills:
Pyspark, Sql, databricks, Data Engineer
Skills:
data warehouses , Java, Cloud Services, Golang, Scala, Data Modeling, Sql, ELT, Apache Airflow, Linux Shell Scripting, Python, Etl, datamarts, NoSQL systems, streaming event-based data pipelines, data management technologies, real-time data processing
Skills:
Java, Data Cleaning, Power Bi, Scala, Tableau, Data Warehouse, Sql, ELT, Data Lake, Data Governance, Python, Etl, Looker
Skills:
Node.js, Cube, Python, knowledge engineering, Analytical modeling on OLAP warehouse systems, Semantic or metrics-layer experience, dbt, MetricFlow, Strong SQL, Open-source semantic layer engines, API service mindset, LookML
Skills:
Git, Databricks, FastAPI, Azure, Python, Sql, Etl, ELT
