Alpha invests in incredible companies.

We are always searching for talented people who want to make a difference. Join our extended team.

Quality Assurance Specialist - Agentic AI

Vi

Vi

Software Engineering, Data Science, Quality Assurance
Remote
Posted on Feb 26, 2026

Quality Assurance Specialist - Agentic AI

  • Remote (EST/PST/CT)

Description

Role Summary

We’re seeking a detail-oriented QA Specialist to test and validate AI-powered voice agents across phone calls, SMS, and webchat. This role is highly hands-on and involves actively interacting with agents in real-world scenarios to ensure accuracy, reliability, and conversational quality.

Key Responsibilities

  • Conduct manual testing through live calls, SMS conversations, and webchat sessions
  • Evaluate conversational flow, tone, intent recognition, and response accuracy
  • Identify bugs, logic gaps, edge cases, and failure patterns
  • Document issues clearly and collaborate with engineering on fixes
  • Create and maintain test scenarios for new features and agent launches
  • Validate improvements and prevent regressions before release

Qualifications

  • 2+ years of QA or testing experience
  • Strong written and verbal communication skills
  • Highly detail-oriented with strong analytical thinking
  • Comfortable making frequent test calls and simulating customer interactions
  • Experience working with product and engineering teams

Preferred

  • Experience with conversational AI, chatbots, voice systems, or contact center technology.