Role Value Proposition
MetLife is offering an exciting opportunity to contribute to our digital and AI transformation journey. We are seeking experienced SDET's who can also operate as AI Engineers to drive the transformation that will enable business results.
The AI Engineer (Test Engineering) has the responsibility of delivering high-quality software in an Agile environment. This includes the adoption of test automation within the Agile sprint, and the leverage of Gen-AI toolset to achieve high velocity of releases without compromising delivery quality. In this role, the SDET also operates as an AI Engineer – using GitHub Copilot and Copilot Agent Mode on our GitHub Enterprise platform, together with the Microsoft AI Foundry stack, to build AI agents that automate testing, and to design and run AI evaluations (AI evals) that measure the performance and reliability of those agents.
Key Responsibilities
- Design, build and scale testing capabilities using AI agents – using GitHub Copilot Agent Mode on the GitHub Enterprise platform and the Microsoft AI Foundry stack – to automate testing tasks such as test case generation, test data creation, defect triage, and regression analysis.
- Develop and run AI evaluation (AI eval) frameworks and metrics to measure the accuracy, reliability, and performance of AI agents and Gen-AI-assisted testing workflows and iterate on prompts and agent design based on eval results.
- Write efficient test automation code using coding standards and best practices.
- Validate application functionality through the implementation of test strategies, automation frameworks, tools, and dashboard
- Participate in planning and documentation of test strategies and acceptance criteria based on customer needs.
- Participate in test execution (automated and manual) (new builds and regression), analyze the reports, troubleshoot & investigate the failure.
- Maintain automation scripts and perform peer reviews of the automation codebase.
- Analyze and repair broken test cases and failures.
- Investigate, diagnose, and repair complex problems, test, and manage bug reports.
- Adoption of the Agile ways of working in the software delivery lifecycle.
Education
Candidate Qualifications:
- Bachelor in Computer Science or Equivalent
Experience
- At least 3+ years in automation testing preferably using AI in high tech and/or highly regulated industries
- Hands-on experience with AI-assisted engineering tools such as GitHub Copilot (including Agent Mode) on GitHub Enterprise, and the Microsoft AI Foundry stack, including building AI agents and running AI evaluations to validate agent performance.
- Developing and implementing automation testing practices using modern technology stack and patterns.
- Strong scripting and programming skills in languages such as Java, Python, Bash, or PowerShell.
- AI Engineering: Ability to design agent instructions/prompts, build and orchestrate AI agents (e.g. via GitHub Copilot Agent Mode and the Microsoft AI Foundry stack), and apply AI evaluation techniques to validate agent accuracy and performance within the test lifecycle
- Hands-on in test automation using scripting and programming skills
- Exposure to Behavior Driven Development (BDD)
- Continuous learning mindset, ability to acquire new skills and competencies independently and proactively
Tech Stack
Development & Delivery Methods:
Agile (Scaled Agile Framework)
Mobile
Appium
Automated Testing Framework + UI:
Selenium, TOSCA, BDD-Cucumber, Playwright
UI: Java, JavaScript, Python, GitHub, DS-Algo
API:
RestAssured, Postman,KarateDSL
Cloud Platform
Azure DevOps - Test Plan, Perfecto, SauceLabs, BrowserStack
Performance Testing:
Jmeter, Blazemeter
AI Engineering / GenAI Tools
GitHub Enterprise – GitHub Copilot, Copilot Agent Mode
Microsoft AI Foundry Stack
AI Foundry, Prompt Engineering, AI Agent Evaluation (AI Evals)
