Agentic AI Engineer Azure | LLM | RAG | LangGraph

Job Title :- Agentic AI Engineer – Azure | LLM | RAG | LangGraph

Work Location:- Pune/Bengaluru/Bhopal

Job Type:- FTE

Job Summary:

We are seeking an experienced, handson AI (3+ years) to lead technical delivery and client engagement for Agentic AI platforms. The role owns endtoend design, productionisation and operationalisation of LLMbased solutions (RAG, finetuning, model serving) on Azure, and will act as the technical face to the client while leading a crossfunctional delivery team.

What Success Looks like:

· Deliver production Agentic AI features that meet SLA targets for latency, throughput and reliability.

· Reduce timetovalue for LLM integrations via repeatable patterns, MLOps pipelines and reusable components.

· Maintain model governance, explainability and security posture appropriate for sensitive data domains.

Key Responsibilities:

· Architect and build Agentic AI systems: orchestrate agents, action executors, retrieval layers, and feedback loops.

· Design and implement LLM solutions (RAG, retrieval chains, prompt engineering, finetuning/LoRA/P-tuning) for production use.

· Own model deployment, serving and scaling on Azure (Azure AI, Azure ML, AKS, container registries) and hybrid setups.

· Build MLOps & ModelOps pipelines: CI/CD for models and services, automated testing, monitoring, drift detection and rollbacks.

· Lead data pipelines for retrieval: vector stores, semantic search, indexing, embeddings, data privacy & access controls.

· Implement model explainability, confidence scoring, adversarial protections and prompt security (prompt injection mitigation).

· Define and enforce model governance: versioning, reproducibility, lineage, audit trails and compliance.

· Collaborate with product, data engineering, security, DevOps and UX to ensure integrated delivery and acceptance.

· Mentor and upskill engineers; conduct technical reviews and pair programming; recruit when required.

· Act as primary technical contact for clients: present designs, lead architecture reviews, and support RFP/interview processes.

Required Skills & Experience:

· 6 + years in software engineering/AI with demonstrable, handson production experience.

· Deep experience with LLMs and RAG architectures: retrieval design, vector DBs (Pinecone/Weaviate/Milvus), embeddings.

· Proven track record in finetuning/customising LLMs (LoRA, fullfine tune, instruction tuning) and prompt engineering.

· Strong Azure AI stack experience: Azure OpenAI/GPT, Azure ML, AKS, Azure Functions, KeyVault, Data Factory/Synapse.

· Expertise in Agentic frameworks and orchestration (LangChain, LangGraph, custom agent frameworks).

· Production MLOps/ModelOps: CI/CD for models, model registry, automated testing, monitoring (Prometheus/Grafana/ELK), drift detection.

· Backend engineering: Python, FastAPI, microservices, Docker, Kubernetes, gRPC/REST, event-driven architectures.

· Data engineering basics: SQL/NoSQL, ETL, schema design, data lineage and data privacy controls.

· Security & compliance: secrets management