We are seeking a Data Platforms Engineer for our client, a top service provider renowned for trading and refurbishing used technology, such as cellphones and laptops. This company is dedicated to assisting manufacturers with sustainable practices and plays a significant role in reducing new tech expenses on a global scale.
In this role, you'll design and build the data pipelines and platforms that turn raw data from multiple sources into reliable, usable information. You'll work mainly in AWS, building and maintaining ETL pipelines, data lakes and warehouses, and a fit-for-purpose reporting layer the business and its partners can depend on. You'll also drive data quality and help make data accessible across the organisation.
What you'll
- doBuild and maintain ETL pipelines in AWS, feeding data from core transactional systems into a reliable reporting lay
- erDesign, build and maintain large-scale data solutions using AWS analytics services (EMR, Glue, Redshift, Kinesis, Lambda, DynamoD
- B)Build and maintain data lakes, warehouses and data mar
- tsImprove data quality across core reporting syste
- msApply data modelling to design models across multiple subject are
- asDeliver automated, reliable and secure data servic
- esSet up monitoring and alerting for data environmen
- tsCreate and maintain clear documentation
What we're looking
- forExperience designing and deploying production data pipelines in AWS, from ingestion to consumption, within a big data architect
- ureReal-time data experience with Kafka or Apache Sp
- arkStrong SQL, plus scripting and extracting data via A
- PIsHands-on with large-scale databases and storage (Redshift, Hive, Parquet, Hado
- op)Data modelling and building data ma
- rtsData cleansing, wrangling, visualisation and report
- ingExperience delivering automated, reliable and secure services, with monitoring and alert
- ingComfortable working in Agile teams (Scrum/Kanban) across time zones, using Jira and Confluence
Nice to
- haveProgramming in SQL plus one of Python, R or S
- calaAWS certificat
- ionsDashboard visualisa
- tionOpen source contribut
- ionsExperience in a DevOps culture
