Data Engineer

Description

We are seeking a skilled Data Engineer to join our team in Southeast Asia. The ideal candidate will be responsible for designing and implementing scalable data architectures, developing data pipelines, and ensuring the integrity and availability of data. This role requires a blend of technical expertise and analytical skills to support our data-driven decision-making processes.

Responsibilities

• Design, construct, install, and maintain large-scale processing systems and data pipelines.
• Ensure systems meet business requirements and industry practices.
• Develop data set processes for data modeling, mining, and production.
• Integrate new data management technologies and software engineering tools into existing structures.
• Analyze and organize raw data and build data systems and pipelines to optimize data flow.
• Collaborate with data scientists and other stakeholders to understand data needs and deliver solutions.

Skills and Qualifications

• 6-12 years of experience in data engineering or a related field.
• Proficiency in programming languages such as Python, Java, or Scala.
• Experience with big data technologies such as Hadoop, Spark, or Kafka.
• Strong knowledge of SQL and NoSQL databases (e.g., PostgreSQL, MongoDB).
• Familiarity with data warehousing solutions (e.g., Amazon Redshift, Google BigQuery).
• Experience with cloud platforms such as AWS, Azure, or Google Cloud.
• Understanding of ETL processes and data integration techniques.
• Strong analytical and problem-solving skills, with attention to detail.