via Indeed
$12K - 24K a year
Develop and maintain automated test suites for AI-enabled marketplace workflows, validate AI model integration, and ensure release readiness through comprehensive testing and reporting.
3+ years QA automation experience with familiarity in testing tools and AI-specific testing collaboration.
Role summary You will ensure the AI embedded marketplace works correctly end to end and stays stable under automation. You will build test plans covering classic software behavior plus AI specific risks such as drift, false positives, and edge case failures. What you will do • Create a full test strategy for AI enabled marketplace flows. • Write test cases that cover normal operations, failures, and manual override paths. • Build and maintain automation suites for APIs and UI. • Validate model integration behavior, latency, and correct fallback logic. • Test data pipelines and confirm training and inference inputs are correct. • Set up regression testing for every release. • Report defects with clear reproduction steps and severity. What you should have • 3+ years in QA with strong automation experience. • Familiarity with tools like Playwright, Cypress, Selenium, Postman, JMeter, or equivalents. • Understanding of API testing, CI/CD quality gates, and release validation. • Comfort working with data and ML teams on AI specific testing. Deliverables in 3 months • Automated regression suite covering AI workflows. • Release readiness criteria and signoff reports. • AI risk tests for drift and bad outcome detection. • Final quality handover docs. Job Types: Full-time, Part-time Pay: $1,000.00 - $2,000.00 per month Work Location: Remote
This job posting was last updated on 12/9/2025