Data Engineer (AWS, Central Location)
Data Engineer (AWS, Central Location)
optimum solutions pte ltdEarly Applicant
- Posted a month ago
- Be among the first 10 applicants
Job Description
Our client is looking for a Senior Data Engineer to design, build and operate enterprise-grade data platforms supporting analytics, data science and digital products. The role will contribute to data architecture, engineering standards and technical decision-making in a complex enterprise environment.
Responsibilities
- Design, build and maintain scalable data architectures and pipelines for data ingestion, transformation and delivery.
- Develop robust data models and reusable data capabilities for analysts, data scientists and applications.
- Improve the reliability, security, performance, observability and maintainability of data platforms.
- Evaluate technologies and architectural approaches, making sound technical trade-offs and contributing to engineering standards.
- Champion modern engineering practices including automated testing, code reviews, CI/CD and Infrastructure-as-Code.
- Collaborate with engineers, Product Managers, Data Scientists and analysts, while providing technical leadership, mentoring and knowledge sharing.
Requirements
- 7+ years of experience in software/data engineering with strong Python and SQL skills.
- Experience with AWS and modern data platforms such as Redshift, Snowflake, Databricks or BigQuery.
- Strong experience in enterprise data architecture and engineering, including production data systems.
- Hands-on experience designing data pipelines, data models, data warehouses, data lakes or lakehouse architectures.
- Experience with data orchestration, transformation and modelling.
- Strong understanding of production engineering practices including testing, CI/CD, monitoring, troubleshooting and data quality.
Good to Have
- Experience with Apache Airflow, dbt and/or Apache Spark.
- Strong knowledge of AWS data services and cloud infrastructure.
- Experience with Tableau, Power BI or similar BI tools.
- Knowledge of Infrastructure-as-Code, data observability, metadata, data catalogues or data lineage.
- Experience working with sensitive or regulated data.
More Info
Key Skills
Infrastructure-as-Code
data lakes
data pipelines
data orchestration
CI CD
lakehouse architectures
About Company
Skills:
data warehouses , snowflake , BigQuery, Automated Testing, Redshift, Sql, Databricks, Python, AWS, data pipelines, code reviews, CI CD, data lakes, Infrastructure-as-Code, data orchestration, lakehouse architectures
Skills:
Spark SQL, Apache Spark, Data Warehouse Concepts, Tableau, Oracle Database Management, Incident Management, Data Profiling, Databricks, AWS, Advanced Analytics Techniques, RDDs, Cloud Cost Control, Amazon SageMaker, DataFrames, DataRobot, ML Ops, IDMC Informatica Data Management Cloud, Data Verification, Monitoring
Skills:
Cloudformation, AWS Glue, Terraform, Apache Iceberg
Skills:
Spark SQL, Pyspark, Data Modeling, Sql, Terraform, Databricks, Python, AWS, Databricks SQL, CI CD, Infrastructure-as-code, Unity Catalog, Delta Lake, Lakeflow Delta Live Tables
Skills:
Spark SQL, Pyspark, Data Modeling, Sql, Google Cloud, Terraform, Databricks, Azure, Python, AWS, Databricks SQL, Infrastructure-as-code, Unity Catalog, CI CD pipelines, Lakeflow Delta Live Tables