Search by job, company or skills

Hastraa Consulting Services

Data Engineer

Save
  • Posted 18 hours ago
  • Be among the first 10 applicants
Early Applicant

Job Description

Duration : 1 year Extendable contract Job Location : Kuala Lumpur
Job Description
  • Bachelor's Degree in Computer Science, Information Technology, Engineering, or related discipline.
  • Minimum 3 years of experience in Data Engineering, Big Data Support, or Application Support.
  • Strong programming experience in Python.
  • Hands-on experience with Apache Spark / PySpark development and troubleshooting.
  • Strong understanding of distributed data processing concepts.
  • Experience analyzing and troubleshooting Spark and YARN logs.
  • Strong SQL knowledge with experience in complex joins, aggregations, and data transformations.
  • Experience working with Data Lake platforms such as HDFS, Hive, Iceberg, or equivalent technologies.
  • Hands-on experience with MongoDB development and support.
  • Strong understanding of data modeling concepts, including normalization and denormalization techniques.
  • Experience designing and maintaining data structures for both relational and NoSQL databases.
  • Experience with Apache NiFi for workflow automation and data ingestion.
  • Experience using Bitbucket or Git-based version control systems.
  • Familiarity with Linux/Unix operating systems and command-line troubleshooting.
Functional Skills
  • Strong analytical and problem-solving skills.
  • Ability to troubleshoot complex production issues independently.
  • Experience performing root cause analysis and implementing preventive measures.
  • Strong communication and stakeholder management skills.
Preferred Skills
  • Experience with Hadoop ecosystem technologies.
  • Experience with Apache Hive and Iceberg tables.
  • Knowledge of Spark performance tuning and optimization.
  • Experience with CI/CD pipelines and deployment automation.
  • Experience supporting enterprise-scale data platforms.
  • Exposure to banking, financial services, or telecommunications environments.
  • Knowledge of data governance and data quality frameworks.
  • Familiarity with Agile and Scrum methodologies.
Personal Attributes
  • Strong sense of ownership and accountability.
  • Self-motivated and capable of working independently.
  • Detail-oriented with strong troubleshooting capabilities.
  • Team player with excellent collaboration skills.
  • Able to work under pressure and manage multiple priorities.
  • Proactive in identifying opportunities for process improvement.
  • Willing to provide after-hours support when required.

More Info

Job Type:
Industry:
Employment Type:

Job ID: 149138553

Similar Jobs

Kuala Lumpur

Skills:

data engineering PythonSqlPysparkAWSAws RdsS3Apache AirflowKafkaEtlELTData ModelingData LakeDockerCloud InfrastructureNosqlData QualityScalabilitydbtDebeziumCDC FrameworksData PipelinesReal-Time ProcessingBatch ProcessingApache IcebergDelta LakeClickHouseWorkflow OrchestrationRelational DatabasesERP Data IntegrationConstruction DataManufacturing DataLogistics DataPipeline MonitoringTroubleshootingPerformance Optimization

Malaysia, Kuala Lumpur

Skills:

Data ModellingApisSqlELTDatabasesSparkDatabricksPythonAws S3EtlData LakesDocumentationFilesAccess ControlMonitoring

Malaysia, Kuala Lumpur

Skills:

Data ModelingDimensional ModelingData WarehousingSqlStar SchemaELTEtlCloud Data Platforms

Malaysia, Kuala Lumpur

Skills:

AlteryxMySQLPostgreSQLTableauInformaticaSqlEtlDataikuTableau Prep

Remote

Skills:

AwsEtlSql