Summary
We are seeking a highly skilled Data Engineer with strong experience in data warehousing and big data technologies. The ideal candidate will be responsible for designing, developing, and maintaining data pipelines and solutions that enable efficient data processing and analytics.
Responsibilities
- Design, develop, and maintain data pipelines and ETL processes for data warehouse environments.
- Write and optimize PySpark and SparkSQL programs on Databricks platform.
- Collaborate closely with technical teams to deliver high-quality solutions.
- Ensure timely and independent delivery of development tasks.
- Work on multiple projects simultaneously while meeting deadlines.
- Maintain data integrity and optimize performance for large-scale datasets.
Requirements
- Bachelor's degree in Information Technology, Computer Science or any related fields.
- 3+ years of experience in the IT industry.
- 3+ years of experience as a Data Engineer in a data warehouse environment.
- Strong proficiency in Python programming.
- Solid experience in SQL development for relational databases.
- Familiarity with big data frameworks such as Apache Spark (PySpark, SparkSQL) and Databricks.
- Ability to work independently and efficiently under tight deadlines.
- Excellent teamwork and communication skills.
- Strong multitasking and problem-solving abilities.
- Experience with cloud platforms (AWS, Azure, or GCP) is nice to have.
- Knowledge of data modeling and performance tuning is a plus.
- Exposure to CI/CD and DevOps practices for data engineering is a plus.
- Proficiency in Mandarin to effectively support Mandarin-speaking stakeholders.
