Custom Business Solutions, Inc.

Compensation

Full Description

Test Lead - Data & AI Products We are seeking an experienced Test Lead to support a suite of data-driven analytics and AI-enabled products. This role will lead functional, data, API, and AI prompt-based testing efforts across dashboards and cloud-based data platforms. The ideal candidate is passionate about data, comfortable working hands-on with SQL and Python, and experienced validating complex business rules within modern data environments. This is a highly collaborative role working closely with engineering, product, business stakeholders, and offshore QA teams.Key Responsibilities Test Leadership & Coordination • Lead end-to-end testing activities including requirement review, test case design, execution, defect tracking, and retesting. • Coordinate with developers, product owners, and offshore teams to ensure high-quality releases. • Participate in Agile ceremonies and manage work in Jira. • Create and maintain test cases within TestRail. Data & Dashboard Validation • Validate dashboard metrics by comparing UI values with backend data sources. • Verify data accuracy after transformations and business rule application. • Write and execute SQL queries to validate data across multiple databases. • Understand and validate end-to-end data flows from ingestion to reporting layers. AI & API Testing • Test prompt-based AI tools to ensure accurate outputs are rendered in the UI. • Validate AI-generated responses against expected business logic. • Execute API test scenarios, analyze JSON/XML responses, and validate payload structures. ETL & Cloud Data Testing • Validate data ingestion from multiple source systems. • Test transformation and aggregation logic within Azure-based data platforms. • Perform source-to-target validation across data pipelines and ETL workflows. Automation & Continuous Improvement • Contribute to test automation using Python or PySpark. • Develop and maintain automated data validation scripts. • Support development of automation frameworks using PyTest (enhancements vs. building from scratch). • Work within code repositories (branching, pull requests, code reviews). • Follow clean code practices and maintain code quality standards. Minimum Qualifications • 3+ years of strong SQL experience (complex queries required). • 3+ years of experience testing data-intensive applications. • 2-3+ years of Python or PySpark experience for data validation. • Experience working in Databricks or Azure-based data environments. • Experience testing AI chat or prompt-based tools. • Experience validating APIs and working with JSON/XML formats. • Experience with Jira and Agile methodologies. • Familiarity with version control and code review processes. Preferred Qualifications • Experience contributing to automation frameworks using PyTest. • Exposure to Apache Delta Lake or Azure Data Factory. • Understanding of ETL processes and data pipeline validation. • Familiarity with SonarQube or code quality tools.