Roles and Responsibilities
1. ETL / Data Pipeline Development
- Assist in building and enhancing ETL/ELT pipelines for ingesting data from various insurance systems (policy, claims, agent management, etc.).
- Develop and maintain data transformation logic using SQL/PySpark under supervision.
- Participate in creating data mappings, transformation rules, and workflow documentation.
2. Data Quality & Validation Perform data profiling, identify data anomalies, and support root-cause analysis.
- Implement and test basic data quality checks (e.g., completeness, consistency, integrity).
- Assist data engineers in validating data output across staging, refined, and consumption layers.
3. Testing & Deployment Support Assist in preparing test cases, sample datasets, and expected results for ETL pipeline testing.
- Support UAT activities, including executing test scripts and recording results.
- Help with deployment activities using the team's CI/CD framework.
4. Collaboration & CrossTeam Support Work closely with data engineers, business analysts, and data consumers to understand requirements.
- Participate in team meetings, sprint reviews, and technical discussions.
- Seek feedback proactively and continuously develop technical and analytical skills.
5. Learning & Development
Learn modern data engineering tools and concepts, such as:
- Cloud data platforms (e.g., Azure Databricks / Data Factory / Delta Lake)
- SQL, Python, PySpark Data modeling fundamentals ETL/ELT design patterns
- Demonstrate curiosity and willingness to explore new tools and technologies relevant to the data platform
6. Other duties as assigned by superior
Job Requirements
1. Education: Bachelor's degree in computer science, IT, or related field (or equivalent coursework).
2. Technical Skills:
- SQL/Python: Expertise in SQL script and Python.
- Databases: Familiarity with relational databases (SQL Server, Oracle or PostgreSQL, etc.).
3. Soft Skills:
- Strong problem-solving mindset and eagerness to learn.
- Good communication skills to collaborate with cross-functional teams.
- Good at English reading and writing
4. Work Approach & Attitude
- Curiosity and growth mindset; comfortable learning new tools quickly.
- Ownership of tasks from assignment, then delivery to validation.
- Reliable, organized, and able to manage time across multiple small tasks.
5. Experience for ETL tools (e.g. Databricks, Informatica) and cloud platforms (Azure etc.) is added advantage.
