Quality Assurance Specialist - Agentic AI
Vi
Software Engineering, Data Science, Quality Assurance
Remote
Posted on Feb 26, 2026
Quality Assurance Specialist - Agentic AI
- Remote (EST/PST/CT)
Description
Role Summary
We’re seeking a detail-oriented QA Specialist to test and validate AI-powered voice agents across phone calls, SMS, and webchat. This role is highly hands-on and involves actively interacting with agents in real-world scenarios to ensure accuracy, reliability, and conversational quality.
Key Responsibilities
- Conduct manual testing through live calls, SMS conversations, and webchat sessions
- Evaluate conversational flow, tone, intent recognition, and response accuracy
- Identify bugs, logic gaps, edge cases, and failure patterns
- Document issues clearly and collaborate with engineering on fixes
- Create and maintain test scenarios for new features and agent launches
- Validate improvements and prevent regressions before release
Qualifications
- 2+ years of QA or testing experience
- Strong written and verbal communication skills
- Highly detail-oriented with strong analytical thinking
- Comfortable making frequent test calls and simulating customer interactions
- Experience working with product and engineering teams
Preferred
- Experience with conversational AI, chatbots, voice systems, or contact center technology.