Senior Data Engineer

Job Responsibilities:

• Design and implement robust data pipelines to ensure data quality and scalability.
• Manage data storage using modern tools and frameworks, including MongoDB, Redis, Kafka, and PostgreSQL.
• Develop interactive dashboards using tools like Streamlit to deliver real-time insights and enable data-driven decisions.
• Partner with cross-functional teams to integrate advanced analytics into business processes, improving decision-making and outcomes.
• Stay at the forefront of data engineering innovations, leveraging cloud-native deployments, Kubernetes, and state-of-the-art data processing tools.
• Apply user-centric design principles to drive innovation and solve complex data challenges effectively.
• Utilize modern streaming platforms such as Apache Kafka or AWS MSK to enable real-time data ingestion and processing.
• Design and deploy high-performance batch and stream processing workflows using frameworks like Apache Flink or Apache Spark.
• Implement and manage databases and pipelines on cloud platforms like AWS, Google Cloud, or Azure to ensure scalability, resilience, and efficiency.
• Work with MongoDB for document-based storage, PostgreSQL for relational data, and explore distributed databases to future-proof the architecture.
• Build and maintain advanced analytical solutions using platforms such as Amazon Redshift or Snowflake, enabling actionable insights.

Job Requirements:

• Bachelor's or Master's degree in Computer Science, Engineering, Mathematics, or a related field.
• 3+ years of experience working on innovative R&D projects or deploying solutions for enterprise-scale challenges.
• Familiarity with design thinking methodologies and a track record of driving innovation in team environments.
• Hands-on experience with real-time data streaming tools such as Kafka, Flink, or Spark Streaming.
• Familiarity with modern data warehousing technologies, including Redshift, BigQuery, or Snowflake.
• Proficiency in cloud-native databases and ecosystems like DynamoDB, AWS RDS, Google Spanner).
• Knowledge of containerized environments like Docker and orchestration tools like Kubernetes for managing scalable applications.