Senior Data Engineer
- Posted 20 hours ago
- Be among the first 20 applicants
Job Description
Job Description
6+ years in data engineering. Strong data architecture and system design skills to make sound tradeoffs on modeling, partitioning, and scalability, not just write queries. Demonstrated end-to-end production ownership of data pipelines from design through deployment, monitoring, and operational support. Expert-level Python + SQL as the primary toolset. Hive/Hadoop is a nice-to-have only. Robust data quality and auditability practices - validation, reconciliation, anomaly detection, audit trails. Experience working with finance, risk, or compliance data - comfort with the heightened accuracy, auditability, and data-lineage requirements typical of these domains
Required Skills
Primary Skills
11pythonairflowCICDHiveHadoop
Secondary Skills
AzureAws
6+ years in data engineering. Strong data architecture and system design skills to make sound tradeoffs on modeling, partitioning, and scalability, not just write queries. Demonstrated end-to-end production ownership of data pipelines from design through deployment, monitoring, and operational support. Expert-level Python + SQL as the primary toolset. Hive/Hadoop is a nice-to-have only. Robust data quality and auditability practices - validation, reconciliation, anomaly detection, audit trails. Experience working with finance, risk, or compliance data - comfort with the heightened accuracy, auditability, and data-lineage requirements typical of these domains
Required Skills
Primary Skills
11pythonairflowCICDHiveHadoop
Secondary Skills
AzureAws
More Info
About Company
Skills:
snowflake , Apache Airflow, Data Modelling, Python, Sql, AWS – Glue, dbt, CI CD
Skills:
snowflake , Git, Data Modeling, Etl Tools, Data Warehousing, Python, Sql, AWS, Matillion, CI CD
Skills:
Spark SQL, Sftp, Pyspark, Amazon S3, Databricks, Rest Apis, Sql, Python, Delta Lake
Skills:
Azure Data Factory, Power Bi, Spark, Python, Sql, Synapse, DevOps practices, MS Fabric, Microsoft Azure Data Lake
Skills:
Apache Airflow, Scala, Amazon S3, Apache Spark, Python, Sql, AWS, Distributed data processing, ETL pipelines