Search by job, company or skills

  • Posted 9 hours ago
  • Over 50 applicants have applied

Job Description

 Roles and Responsibilities

  • Design, develop, and maintain large-scale data pipelines using Azure Data Factory (ADF) to extract, transform, and load data from various sources into Azure Databricks.
  • Develop complex ETL processes using Python scripts and SQL queries to process large datasets stored in Azure Data Lake Storage.
  • Collaborate with cross-functional teams to gather requirements for new data warehousing solutions and implement scalable architectures on Azure Data Warehouse.
  • Troubleshoot issues related to ADF pipeline failures, Azure Synapse connections, and SQL queries.

More Info

Job ID: 114471677

Similar Jobs

Chennai, India

Skills:

.NETPowerShellAzure DatabricksBashSqlJenkinsAzure Data FactoryJavascriptTerraformAzure Synapse AnalyticsAzure Data LakeAzure DevOpsAirflow

Noida, India

Skills:

composer PysparkBigQueryDataprocSqlGcpDataFlowAzurePythonAWSData Modelling ConceptsdbtGCS

Bengaluru, India

Skills:

GithubUnixGitLinux Shell ScriptingPl SqlPythonSqlAws S3ETL processesOracle databasesControl-M

Bengaluru, India

Skills:

JavaData SecurityPostgreSQLSQL ServerApache SparkData GovernanceSqlDatabricksData ModellingTesting FrameworksPythonAWSAirflowBatch and streaming data pipelinesMonitoring and observability toolsData quality and validationdbtCI CD pipelines

Bengaluru, India

Skills:

PysparkUnix ScriptingSqlDevopsDockerTerraformShell scriptingPythonKubernetesEtlAirflowControl-M

Beware of Scammers

We don’t charge money for job offers