Senior Engineer - AI Platform

Job Description

Role Overview :

We are looking for a Senior Engineer AI Platform to design, develop, and improve enterprise-scale AI infrastructure and platform capabilities. The role combines platform engineering, distributed systems, cloud infrastructure, and Generative AI/Agentic AI, with a focus on building highly scalable, secure, resilient, and high-performance AI platforms.

Key Responsibilities

• Design and develop enterprise-scale AI platform and infrastructure solutions.
• Build highly available distributed systems using active-active and failover architectures.
• Develop high-throughput, low-latency production services and APIs.
• Design and manage cloud-native AI infrastructure across AWS and Kubernetes.
• Build infrastructure supporting LLM and Agentic AI workloads.
• Implement and optimise AI model serving and inference infrastructure.
• Integrate AI platforms with enterprise applications and services.
• Collaborate with architects, product managers, engineers, and business stakeholders.
• Participate in code reviews and promote engineering best practices.
• Implement secure coding, testing, monitoring, and reliability practices.
• Contribute to technology strategy, platform standards, and continuous improvement.
  
  

Technical Requirements

• 7+ years of software/platform engineering experience, including 5+ years working with enterprise-scale platform or infrastructure architecture.
• Strong experience with distributed systems, high availability, active-active architecture, and failover patterns.
• Expert-level proficiency in Python, particularly FastAPI and asynchronous programming; Go or Java experience is also valuable.
• Strong AWS experience, including :
• EKS
• Bedrock
• IAM
• Aurora
• CloudFormation
• GPU scheduling
• Multi-tenancy
• Strong knowledge of Kubernetes and containerised infrastructure.
• Experience with service mesh technologies, particularly Istio and Envoy.
• Hands-on experience with Generative AI and Agentic AI, including :
• LangGraph / LangChain
• Google ADK
• MCP
• A2A protocols
• Prompt engineering
• RAG
• vLLM
• Experience building high-performance AI/ML platform infrastructure.
  
  

Preferred / Additional Skills

• Experience implementing AI safety and guardrails, including :
• Prompt injection detection
• PII redaction
• Content filtering
• Knowledge of AI security frameworks such as :
• NIST AI RMF
• MITRE ATLAS
• OWASP LLM Top 10
• Strong experience with Envoy Proxy, including xDS API, WASM filters, and AI Gateway extensions.
• Experience with GPU infrastructure and AI inference optimisation.
• Financial services or banking experience, particularly around regulatory requirements, data residency, and compliance.
  
  

Leadership & Stakeholder Skills

• Strong analytical and problem-solving capabilities.
• Ability to influence technical direction and architectural decisions.
• Strong communication and stakeholder management skills.
• Ability to collaborate across engineering, product, architecture, and business teams.
• Experience mentoring and guiding less experienced engineers.
• Ability to manage technical risks and strengthen platform controls.
• Strong understanding of enterprise technology strategy and cloud architecture.
  
  

Education

• Bachelor's degree in Computer Science, Engineering, Information Technology, or a related technical discipline.
  
  

(ref:hirist.tech)