Data Engineer

Handshakes is an award-winning DataTech company. We enable our clients to make safer, more informed decisions by delivering meaningful insights, harnessed from reliable data

We are looking for a Data Engineer to join our Data & AI Engineering team. In this role, you will be responsible for developing, maintaining, and supporting data ingestion and processing pipelines for large-scale news and company data.

You will work closely with Product Managers, Solution Architects, AI Engineers, and other stakeholders to deliver reliable data solutions that support business and product requirements.

Key Responsibilities

• Develop, maintain, and enhance ETL and data processing pipelines.
• Support and monitor production data pipelines to ensure data quality, reliability, and operational stability.
• Develop and optimize data workflows for ingesting, transforming, and storing structured and unstructured data.
• Troubleshoot and resolve data pipeline, database, and infrastructure-related issues.
• Work with stakeholders to understand business and product requirements and translate them into technical solutions.
• Manage and optimize data storage solutions across relational and NoSQL databases.
• Collaborate with cross-functional teams to support any product enhancements and operational improvements.
• Participate in code reviews, testing, deployment, and documentation activities.

** Work Arrangement - 3 days work in office on hybrid working as per company policy.

Must-Have Skills & Experience

• Diploma or Bachelor's degree in Computer Science, Software Engineering, Data Engineering, or a related field.
• 2–5 years of experience in Data Engineering or a related role.
• Strong SQL skills and experience writing complex queries for data processing and analysis.
• Hands-on experience designing and maintaining ETL/data pipelines.
• Experience with Apache Spark for large-scale data processing.
• Experience working with relational databases such as Microsoft SQL Server or MySQL.
• Experience working with NoSQL databases such as Azure Cosmos DB or MongoDB.
• Experience working with cloud platforms and cloud-based services, preferably Microsoft Azure. Familiarity with Azure services such as Cosmos DB, Service Bus, Blob Storage, Function Apps, and Virtual Machines is an advantage.
• Strong problem-solving skills and the ability to troubleshoot production issues.

Good-to-Have Skills

• Programming experience in Python, Scala, or C#.
• Experience working in Linux environments and familiarity with Bash scripting.
• Experience developing or integrating RESTful APIs.
• Knowledge of distributed systems and scalable data processing architectures

What You'll Work With

• Data ingestion and processing pipelines.
• Cloud-native services and infrastructure.
• Relational and NoSQL databases.
• Cross-functional teams including Product Managers, Solution Architects, AI Engineers, and other stakeholders.

Personal Attributes

• Strong analytical and problem-solving mindset.
• Ability to work independently while collaborating effectively within a team.
• Good communication skills and the ability to understand and clarify business requirements.
• Detail-oriented with a focus on reliability, maintainability, and quality.
• Eagerness to learn and adapt to new technologies and business domains.