
Search by job, company or skills

Role Overview
We are seeking experienced platform and data engineers to support the migration of key security and analytics tools, including Splunk, Apache ecosystem, and NiFi, to a new datacenter environment.
This role requires hands-on expertise across data pipelines, platform engineering, and infrastructure automation. The successful candidates will ensure a smooth transition of systems, including reconfiguration, validation, and optimization of existing solutions.
Key Responsibilities
Migration and Platform Engineering
• Support migration of Splunk, Apache-based platforms such as Kafka, and NiFi pipelines to a new datacenter
• Perform system reconfiguration, validation, and performance optimization
• Ensure minimal disruption and maintain data integrity throughout migration
• Troubleshoot issues during migration and perform post-migration validation
Data Engineering and Integration
• Design, maintain, and enhance data ingestion pipelines using NiFi, Kafka, and Splunk
• Integrate data pipelines with analytics platforms such as Databricks
• Manage data ingestion, transformation, enrichment, and routing processes
DevOps and Automation
• Develop and maintain CI/CD pipelines using Azure DevOps
• Implement infrastructure provisioning using Terraform
• Automate deployments and configuration management across environments
• Maintain version control for infrastructure and pipeline configurations
Security and Monitoring
• Support security monitoring pipelines and SIEM capabilities using Splunk
• Ensure compliance with enterprise logging and monitoring standards
• Collaborate with cybersecurity and infrastructure teams to maintain operational resilience
Required Skills and Experience
Must-have
• Hands-on experience with at least one of the following technologies:
• Splunk
• Apache NiFi
• Apache Kafka or Confluent ecosystem
• Strong experience in building and maintaining data pipelines
• Experience with Azure DevOps and CI/CD processes
• Experience with Terraform and infrastructure as code
• Proven experience in migration projects, including datacenter or platform migrations
Nice-to-have
• Experience with Databricks or other big data platforms
• Knowledge of Azure or other cloud platforms
• Understanding of SIEM and security monitoring architecture
• Experience working in cybersecurity or financial services environments
Job ID: 151259843