Search Jobs

Search by job, company or skills

Data Engineering

Data Engineering

ETeam
8-12 Years
  • Posted 7 hours ago
  • Be among the first 10 applicants

Job Description

The consultant needs to be strong in bringing data together from multiple enterprise systems, cleaning/reconciling it, and creating a reliabledata pipeline/model that supports OTIF calculations

.

The profile I would look for is someone with:

Core

* 8–12+ years of experience in Data Engineering, with 3+ years in a technical lead role.

* Strong hands-on experience building enterprise-scale data pipelines.

* Strong expertise in Python and SQL.

* Strong experience with Apache Spark/PySpark.

* Deep AWS experience with services such as S3, Glue, Redshift, Athena, EMR, Lambda, Kinesis/MSK, Step Functions and LakeFormation.

* Experience designing and implementing Data Lake/Lakehouse architectures.

* Strong understanding of ETL/ELT, CDC, batch and streaming architectures.

* Experience with relational and NoSQL databases.

* Strong understanding of data modeling, dimensional modeling, and data warehouse concepts.

More Info

Job Type:
Industry:
Employment Type:

Key Skills

About Company

Similar Jobs

8-10 yrs
Malaysia, Kuala Lumpur
Skills:
snowflake JavaMs ExcelJsonApi IntegrationSqlPowerbiXmlDatabricksSplunkPythonAzure DevOpsSalesforceGCP BigQuery
6-8 yrs
Malaysia, Kuala Lumpur
Skills:
data engineering data warehouses Metadata ManagementMachine LearningData ModelingData IntegrationGoogle CloudELTCloud TechnologiesData QualityData ArchitectureData GovernanceAzureAWSEtlData LakesComplianceAiLakehouse ArchitecturesData Platform DevelopmentSecurityAnalytics
8-10 yrs
Malaysia, Kuala Lumpur
Skills:
SqlStreamingPysparkProgrammingDatabricks PlatformCloud KnowledgeDevOps DataOpsGovernance SecurityLakehouse ArchitectureDelta Lake
6-8 yrs
Bengaluru, India, Remote
Skills:
graph databases SparkDatabricksSqlAWSS3PythonTableauSpark Streamingdbt
7-9 yrs
Malaysia, Kuala Lumpur
Skills:
snowflake Apache AirflowSQL ServerData WarehousingSSISAzurePythonEtlcloud data technologiesMicrosoft Fabric