Job Summary
You are responsible for the design, development, and maintenance of a cutting edge data
infrastructure that empower the digital bank's vision in offering innovative financial products with frictionless customer experience that is realized through large-scale data federation, predictive and prescriptive analytics, state-of-the-art machine/deep learning, and rapid experimentation. You and your team will take full ownership of the data infrastructure under your care.
Technology stack we use
Python, MySQL, PostgreSQL, MongoDB, Redshift, Airflow, Kafka, Spark
Job Responsibilities
- Actively contribute towards all data engineering best practices across the Engineering function
- Collaborate with Product and Engineering teams to construct data pipelines for business reporting and application monitoring
- Collaborate with analysts and data scientists to build analytical tools based on data pipelines
- Write the best code in terms of scalability and performance of the data infrastructure
- Participate in the data solutions development process from definition to deployment
- Provide consultation to Product and Engineering teams in data processing and storage best practices
- Responsible for supporting production code to produce comprehensive and accurate data artifacts
- Senior data engineers will mentor other data engineers for both personal and professional growth
- Design, evaluate, and communicate solutions to both technical and non-technical stakeholders
Job Requirements
- Bachelor Degree in Computer Science, IT or similar field
- Proficient with data development standards and ETL processes
- Proficient with with RDBMS (MySQL, Postgres), NoSQL (MongoDB), and data warehouses (Redshift)
- Experience in building processes that support data transformation and data delivery
- Proficient with programming and scripting languages (e.g. Java and Python
- Excellent problem solving and troubleshooting skills
- Process oriented with great documentation skills
- Familiarity with microservice architecture and domain-driven design is a plus
- Familiarity with data science techniques and frameworks is a plus
- Familiarity with Docker/Container, Container Orchestration (Kubernetes)
- Familiarity with CI/CD platforms (Jenkins, Bitbucket, Github Actions, Gitlab CI)
- Familiarity with modern cloud service provider such as AWS, Azure, and GCP
