Software Engineer (AI Chatbot)

Key Responsibilities

• Develop AI-powered chatbots, product recommendation systems, and GenAI applications using LLMs and RAG.
• Build and integrate LLM serving/inference solutions, APIs, databases, and SQL-based data pipelines.
• Develop frontend and backend components for AI applications.
• Design and execute AI workload benchmarks and analyze GPU/system performance, including latency, throughput, utilization, and memory.
• Develop Python-based automation and testing frameworks using Docker/containerization.
• Create data visualizations and performance reports to identify bottlenecks and optimization opportunities.
• Collaborate with AI/ML, software, hardware, and performance engineering teams to deliver scalable and optimized AI solutions.

Required Qualifications

• 4+ years of software development experience with strong Python and/or C++ skills.
• Experience in AI/ML, LLMs, Generative AI, RAG, and chatbot development.
• Experience with LLM serving/inference frameworks.
• Experience with databases and SQL.
• Experience with AI workload benchmarking and GPU performance analysis.
• Experience with Docker, automated testing, and performance analysis.
• Strong data analysis, visualization, debugging, and problem-solving skills.