Search Jobs
Search by job, company or skills
Search by job, company or skills
Role Description
The Data Engineer is responsible for designing, building, and maintaining scalable data pipelines and analytics-ready data assets. This role focuses on Databricks-based data engineering, API-driven data ingestion, and enabling downstream analytics and reporting through well-modeled datasets consumed by Power BI.
Key Responsibilities
• Design, develop, and maintain data pipelines using Databricks (Spark / SQL / PySpark)
• Build scalable ETL / ELT processes to support enterprise analytics and reporting
• Ingest and integrate data from internal and external systems using REST APIs
• Transform raw data into curated, analytics-ready datasets and data marts
• Optimize data processing performance, reliability, and cost efficiency
• Partner with BI and analytics teams to enable Power BI reporting and semantic models
• Ensure data quality, governance compliance, and documentation standards
• Support testing, deployment, and monitoring of data solutions
Required Skills & Experience
• Strong hands-on experience with Databricks development
• Solid knowledge of Spark, SQL, and Python
• Experience working with APIs for data ingestion and system integration
• Exposure to Power BI (data modeling, performance optimization, analytics consumption)
• Strong understanding of data modeling concepts (fact/dimension, star schema)
• Experience with cloud data platforms and modern data architectures
Laurelsoft is a leading IT consulting Malaysian company focused on providing business relevant solutions to its customers. We offer the entire range of enterprise IT services – package implementation, web ennoblement, application integration and application management to customers in the BFSI, Manufacturing and Retail verticals.We Offer - Software Development, IT Staffing - Providing IT Talent, Corporate Trainings, Outsourced Testing Services.
http://www.laurelsoft.com.my/
Job ID: 147026207
Skills:
End-to-End API Design & Implementation, Python, FastAPI, Api Development, Data Engineer, Azure, AWS, test Automation, Javascript, PowerShell, Shell Scripting, React.js with TypeScript, AI/ML application development, Data Validation expertise, Regex knowledge
Skills:
data engineering , Azure Data Lake, Kafka, Postgresql, FastAPI, Apache Kafka, PostgreSQL, Python, Angular, Typescript, Rest API Development, API security, Azure Synapse, Azure Storage, Sql, Database Design, Devops, Kubernetes, Authentication, Identity Management, solution architecture, Web Application Development, TimescaleDB, asynchronous processing, data pipeline development, real-time data streaming, Batch Processing, cloud data platforms, CI/CD pipelines, container orchestration, microservices architecture, observability, Microsoft Entra ID, consumer groups, Problem Solving
Skills:
S3, BigQuery, AWS Glue, Redshift, Sql, Apache Airflow, Git, Gcp, Talend, Azure, Python, AWS, ETL frameworks
Skills:
snowflake , Json, Sql, Git, Gcp, Xml, Azure, Python, AWS, dbt, API integrations, Fivetran
Skills:
data engineering , Python, Sql, Pyspark, AWS, Aws Rds, S3, Apache Airflow, Kafka, Etl, ELT, Data Modeling, Data Lake, Docker, Cloud Infrastructure, Nosql, Data Quality, Scalability, dbt, Debezium, CDC Frameworks, Data Pipelines, Real-Time Processing, Batch Processing, Apache Iceberg, Delta Lake, ClickHouse, Workflow Orchestration, Relational Databases, ERP Data Integration, Construction Data, Manufacturing Data, Logistics Data, Pipeline Monitoring, Troubleshooting, Performance Optimization
We don’t charge any money for job offers
