Team: DE
About Setel:
The Future of Mobility
Introduced in July 2018, Setel is a mobile platform that aims to delight customers by innovating for better, inclusive mobility. Setel serves customers across Malaysia by powering one app as the constant companion to ease motorists journey across fueling, parking, EV charging, motor insurance, road tax, auto assistance, general purchases, and more across an ecosystem of PETRONAS petrol stations, retail partners, and online merchants.
Role Purpose:
The Data Engineer provides the technical expertise to scale our data infrastructure using the right tools and frameworks, enabling access to high-quality data for Setel and our stakeholders. The responsibilities include performance tuning and monitoring of our data warehouse, developing
best-in-class extract, transform, and load (ETL) job architecture, and building batch or streaming data pipelines for analytics and ML use cases. This role will require someone with hands-on exposure developing and implementing data engineering solutions in a cloud environment,
experience with data warehouse technologies and data processing frameworks as well as proficient in Spark/Python/Java and SQL.
In this role you will:
- Collaborate with the data team to define key data quality and timeliness SLAs for all datasets.
- Integrate all key data sources in the Redshift data warehouse for a single source of truth and own the performance tuning and monitoring of the data warehouse.
- Develop and implement best-in-class extract, transform, and load (ETL) architecture and processes to enhance the productivity of data consumers.
- Implement good engineering practices of version control (Git) and quality testing into our data development processes in collaboration with data team members.
- Implement and maintain data orchestration tools e.g. Airflow, DBT which help efficiently automate, schedule and manage dependencies in our daily data jobs.
- Design, build and maintain batch and/or streaming data pipelines in the cloud for analytics, ML or external data transfer use cases.
- Collaboratively work with data analysts and scientists to develop tooling and platforms that help them work more effectively.
- Work closely where necessary with the broader engineering team on company-wide projects like data lake / central data platform to centralize our customer data.
- Mentor and guide fellow data team members on good data engineering and coding best practices.
- Implement reasonable data governance e.g. prevent exposure of personally identifiable information data to users without proper access rights.
- Assist with any related tasks, projects, and other assigned duties as and when deemed necessary.
- Ensure adherence to the compliance of company policies, industry regulations and legal requirements.
You're a great fit if you have:
Qualifications:
- Minimum B.S. Degree in Computer Science or a related quantitative/technical field.
- Experience working in a consumer product company with large amounts of data.
- 1-3 years of data engineering experience
Technical & Functional Skills:
- Strong working experience with one or more general-purpose programming languages such as Java, Scala, Python.
- Ability to write optimized and efficient SQL queries.
- Familiar with data warehouses and data lakes such as Redshift, Athena, and BigQuery.
- Familiar with distributed data processing frameworks such as Hadoop, Spark, and Flink.
- Familiar with data warehouse modeling concepts e.g. dimensional data modeling and schema design.
- Familiar with data orchestration frameworks e.g. Airflow to schedule and manage ETL jobs.
- Experience with cloud computing technologies and environments e.g. AWS, GCP, Azure.
- Experience in developing and managing large-scale TB-level data processing pipelines is preferred.
- Experience with managing application and infrastructure dependencies using containers e.g. Docker is a plus.
- Experience with event sourcing and stream processing frameworks e.g. Kafka is a plus.
- Experience developing backend APIs or deploying Machine Learning/Data Mining applications is a plus.
Soft Skills:
- Ability to work independently and collaboratively with others in the data team and different functional teams e.g. product and engineering.
- Positive team player with strong collaboration skills.
- Able to take ownership and drive initiatives.
- High energy, self-motivated, and able to thrive in a fast-paced environment.
- Humble and customer-centric.
- Ability to handle sensitive information with confidentiality.
- Excellent communication and interpersonal skills.
What Makes Working With Us Awesome
- Our people and culture: You will get to work with awesome and friendly colleagues to whom you can expect to collaborate well to deliver your work. Empowerment is given and you will get a lot of opportunities for peer-learning.
- Availability of tools and applications: You will be provided with different tools to facilitate your work. Automate your work whenever possible so that you can focus on delivering impact for your role.
- Development focused: Your learning and growth matters most for us. We are people centric and always ready to help our people to define what they want to make an impact on and craft their learning plan accordingly.
Cool Perks/Benefits
- Hybrid working arrangement; Flexible working hours.
- Relax and unwind at the leisure area with video games, board games, books, and more.
- Wear your favourite jeans, or any cool OOTD so that you can work comfortably (in style).
- Coffee, tea, or snacks are available for consumption at the pantry. Because you'll be happier with a full tummy.
- A healthy body leads to a brilliant mind. Let's get moving with the inter-company sports team.
- There will be workshops, talent shows, sport activities, and other events for sharing and bonding.
Personal Data Protection
Setel Ventures Sdn Bhd (Setel, we, our us) is committed to protecting and respecting your privacy. This Setel privacy statement (Privacy Statement) explains what personal data we collect about you, when and why we collect it, how we use it, the conditions under which we may disclose it to others, your rights to your personal data and how we keep it secure. This Privacy Statement covers both our online and offline collection activities, including personal data that we collect through online platforms such as websites, applications, third party social networks or our online and physical events, or through other third parties that we work with. Please read this carefully to understand our views and practices regarding your personal data.
