Find your dream job faster with JobLogr
AI-powered job search, resume help, and more.
Try for Free
Motion Recruitment

Motion Recruitment

via LinkedIn

All our jobs are verified from trusted employers and sources. We connect to legitimate platforms only.

Senior QA Engineer (AI Agent Quality & Evaluation)

Anywhere
Full-time
Posted 2/17/2026
Verified Source
Key Skills:
Python
AI evaluation and testing
Automation and tooling

Compensation

Salary Range

$120K - 200K a year

Responsibilities

Develop and maintain automated evaluation systems for probabilistic AI outputs, collaborating with engineering and product teams.

Requirements

Experience in automation, data pipelines, and AI system evaluation, with strong Python skills and familiarity with AI developer tools.

Full Description

As a Senior QA Engineer, you’ll own quality strategy for AI-powered systems where correctness is probabilistic, outputs are structured (JSON), and evaluation requires real measurement (accuracy, cost, latency, edge-case handling, regression detection). You’ll build automated evaluation harnesses, and partner closely with Engineering and Product to prevent silent quality regressions as the system evolves. High autonomy, high leverage, and direct impact on the core product. Ideal Profile • Senior QA engineer who has moved beyond manual testing into automation, tooling, and quality systems. • Comfortable testing systems where “expected output” is not always deterministic — and knows how to create evaluation strategies anyway. • Strong Python + data mindset: can build repeatable harnesses, metrics pipelines, and regression suites. • Product-minded and skeptical in the best way: notices failure modes, ambiguous cases, and risks early. • Comfortable collaborating with engineers and shipping quality gates, not just filing bugs. • Hands-on experience with AI developer / agent tooling (e.g., Claude Code, GitHub Copilot or similar) and building agents that amplify inputs and orchestrate multi-step workflows (prompt engineering, tool integration).

This job posting was last updated on 2/19/2026

Ready to have AI work for you in your job search?

Sign-up for free and start using JobLogr today!

Get Started »
JobLogr badgeTinyLaunch BadgeJobLogr - AI Job Search Tools to Land Your Next Job Faster than Ever | Product Hunt