Azure Data Engineer

Description

We are seeking an experienced Azure Data Engineer. The ideal candidate will have a strong background in designing and implementing data solutions on Microsoft Azure, with a focus on data storage, processing, and analytics.

Core Competencies

-      Tertiary qualifications in a relevant discipline with relevant certifications in Microsoft Azure.

-      Worked as pyspark Data engineer on Azure Cloud.

-      Good knowledge of pyspark, databricks and SQL.

-      Comprehensive knowledge of public cloud environments and industry trends.

-      ‎Significant experience supporting, designing, and developing public cloud solutions via Infrastructure as Code, including Terraform and ARM.

-      Extensive DevOps experience.

-      The ability to communicate effectively and work collaboratively with diverse team members.

-      Demonstrated experience in security hardening and testing.

-      Proven ability in creating and updating accurate documentation.

-      ‎Excellent verbal and written communication skills.

Responsibilities

-      Lead the implementation of infrastructure via code and provide strategic advice/recommendations for the development and advancement of Microsoft Azure technologies based on previous research on trends in public cloud environments.

-      Integrate and automate the delivery of standardised Azure deployments, in conjunction with orchestration products such as Azure DevOps with Terraform, Azure ARM templates and other modern deployment technologies.

-      Act as the escalation point for level three Azure related issues, providing technical support and fault resolution, as well as guidance and mentoring of operational run teams, both locally and remotely throughout the organization.

-      Ensure the appropriate gathering of business requirements and their translation into appropriate solutions.

-      Maintain and deliver all related documentation for the design, development, build, and ‎deployment methods used, ensuring the source of control of all applicable code is stored and managed properly.

-      Provide guidance and assistance to al support teams.

-      Provide complimentary support and leadership in hardening and security testing.