Description and Requirements
- Design, develop, test, and maintain efficient data integration pipelines to connect various data sources (databases, APIs, flat files, etc.) and ensure data accuracy, completeness, and timeliness.
- Collaborate with cross-functional teams (data analysts, AI engineers, product managers) to understand data requirements and deliver integrated data solutions that support business and AI initiatives.
- Apply basic AI/ML knowledge (e.g., data preprocessing, feature engineering, simple model application) to optimize data integration processes and improve data quality for AI model training.
- Monitor data integration workflows, troubleshoot issues, and continuously optimize pipeline performance to meet business SLAs.
- Document data integration processes, technical specifications, and AI-related data handling procedures.
- Stay updated with the latest trends in data integration technologies and basic AI applications, and proactively propose process improvements.
- Fresh graduate (Bachelor's/Master's degree) in Computer Science, Information Technology, Data Science, Electrical Engineering, or related fields from Malaysian universities.
- Solid understanding of data integration concepts, ETL processes, and data modeling fundamentals.
- Basic knowledge of AI/ML principles (e.g., supervised/unsupervised learning, data preprocessing, feature selection) is mandatory hands-on experience with simple AI tools or frameworks (e.g., Python, scikit-learn, TensorFlow/PyTorch basics) is a plus.
- Proficient in at least one programming language (Python&Java is preferred) familiarity with SQL, data warehouses, ETL tools (Talend), and Kafka is a plus. Knowledge of or hands-on experience with Databricks is highly preferred.
- Good understanding of database systems (relational databases like MySQL, PostgreSQL NoSQL databases is a plus).
- Strong problem-solving skills, attention to detail, and the ability to work independently and in a team.
- Excellent communication skills in English and Mandarin (both written and verbal), as frequent communication with colleagues in China is required proficiency in Bahasa Malaysia is a plus.
- Passionate about data and AI, with a willingness to learn new technologies and take on challenges.
