100 Salesforce, Inc.

Compensation

Full Description

To get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating efforts. Job Category Software Engineering Job Details About Salesforce Salesforce is the #1 AI CRM, where humans with agents drive customer success together. Here, ambition meets action. Tech meets trust. And innovation isn’t a buzzword — it’s a way of life. The world of work as we know it is changing and we're looking for Trailblazers who are passionate about bettering business and the world through AI, driving innovation, and keeping Salesforce's core values at the heart of it all. Ready to level-up your career at the company leading workforce transformation in the agentic era? You’re in the right place! Agentforce is the future of AI, and you are the future of Salesforce. We are seeking an experienced Salesforce Software Quality Lead Member of Technical Staff (LMTS) with a strong technical background. This engineer should have an AI first approach and be able to help the team translate from traditional testing to using AI in driving acceleration and accuracy in testing and be a multiplier using AI tools. Prior experience as a member of a Data Science, ML Science, or ML Engineering team is a plus. As a Quality LMTS, you will play a key role in defining, implementing, and maintaining the quality strategy for Salesforce products, with a strong focus on integrating cutting-edge AI technologies. You will collaborate with cross-functional teams, including product development, data science, and AI teams, to ensure that Salesforce’s AI-driven solutions meet the highest quality standards for enterprise applications. This role requires onsite presence in San Francisco, California office. Key Responsibilities: Drive Innovation & Adoption: Identify opportunities for integrating AI/ML solutions into existing workflows, propose new ones that are high-quality and efficient, and generally positively influence engineering decision-making by communicating and evaluating solution options, and facilitating agreement among key stakeholders. Ensure that we are continuously raising our standard of engineering excellence and producing high business impact. Continued Excellence in AI/ML: Be tuned into developments in the field of AI/ML, by tracking publicly available models, frameworks, libraries and publications, while being focused on their practical application and relevance to Salesforce. Technical Leadership on Proof of Concepts: Influence the direction of R&D as a whole through your technical, process, or product knowledge leadership. Industry-expert level in understanding of quality concerns and validation techniques. Able to drive behaviors and initiatives that both focus on quality and throughput. Collaborate on AI Model Improvements: Work closely with data scientists and machine learning engineers to provide feedback on LLM performance and recommend improvements based on quality testing results. Evaluate LLM Performance: Assess and optimize Large Language Models (LLMs) for quality, accuracy, relevance, and safety in various use cases. Human Evaluation: Oversee human evaluation processes for subjective quality dimensions, such as response engagement, user safety, and contextual accuracy. Define Quality Strategies: Develop and implement robust quality strategies for Salesforce’s SaaS products, focusing on AI/ML and LLM integrations. Multiplier: Provide technical leadership for critical areas that significantly impact customer success. You have depth of expertise in key technologies and you are often consulted on the design and delivery of new solutions. You bring new best practices to R&D and actively ensure that they are being used. Continues to deepen and widen their understanding of the application and drives discussion of sometimes complex or controversial issues in open forums such as concept reviews, VAT discussions, and cross team discussions. Cross-Platform Collaboration: Use your understanding of customers’ needs across industries and multiple technology landscapes (CRM, Modern Data Stack, Analytics & BI, CRM and AI) to develop solutions across Salesforce's technology stack. Work in a consultative fashion to improve communication, teamwork and alignment among teams inside and outside of the organization. Mentor and Organization Builder: Be a cornerstone in the infrastructure of technical expertise represented by the organization's senior engineers. You challenge and engage with them to develop their expertise and leadership contributions. You are a key resource for engineers seeking to advance to the next level. Required Skills and Qualifications: Having an overall 10+ years of experience with software development engineer in test or quality engineering experience. Proficiency in Java programming languages, with hands-on experience in testing frameworks. AI & Machine Learning Expertise: Strong understanding of AI/ML principles, particularly in evaluating and optimizing model performance, response consistency and safety, fine-tuning of Small Language Models and model distillation. Although the focus is LLMs, the candidate is also expected to be familiar with non-LLM AI/ML techniques and practices such as model selection, picking of appropriate metrics, embeddings, areas such as fairness and explainable AI, traditional models such as Random Forest, Gradient Boosting, etc. Experience with libraries such as scikit, Transformers (Hugging Face), Pytorch and TensorFlow. LLM Expertise: Hands-on experience evaluating Large Language Models (LLMs) for quality response, including familiarity with GPT-like models and AI evaluation frameworks. Focus on Delivery: Ability to deliver practical solutions for an active user base, which you are expected to follow-up with enhancements and improvements, as needed. Collaboration & Communication: Excellent communication skills, with the ability to work cross-functionally with product managers, AI/ML engineers, and data scientists. Problem-Solving & Analytical Skills: Strong analytical and problem-solving abilities with a focus on identifying quality gaps and driving improvement. Familiarity with API testing tools (e.g., Postman, SoapUI). Basic knowledge of SQL for database validation. Fluent with automation technologies such as JUnit, Jest, Selenium and Jenkins Experience with developer tools like git, Maven and Eclipse IDE Solid understanding of REST principles Excellent written and verbal communication skills. A related technical degree required. Preferred Qualifications: Prior experience in a Data Science or a Machine Learning Science or a Machine Learning Engineering team. Experience in ethical AI practices and evaluating models for interpretability, fairness, bias, and user safety. Strong understanding of public cloud infrastructure - AWS/Azure/GCP; Certification in Salesforce. Can design, implement, test and deliver AI/ML-based frameworks for highly scalable products. Unleash Your Potential When you join Salesforce, you’ll be limitless in all areas of your life. Our benefits and resources support you to find balance and be your best, and our AI agents accelerate your impact so you can do your best. Together, we’ll bring the power of Agentforce to organizations of all sizes and deliver amazing experiences that customers love. Apply today to not only shape the future — but to redefine what’s possible — for yourself, for AI, and the world. Accommodations If you require assistance due to a disability applying for open positions please submit a request via this Accommodations Request Form. Posting Statement Salesforce is an equal opportunity employer and maintains a policy of non-discrimination with all employees and applicants for employment. What does that mean exactly? It means that at Salesforce, we believe in equality for all. And we believe we can lead the path to equality in part by creating a workplace that’s inclusive, and free from discrimination. Know your rights: workplace discrimination is illegal. Any employee or potential employee will be assessed on the basis of merit, competence and qualifications – without regard to race, religion, color, national origin, sex, sexual orientation, gender expression or identity, transgender status, age, disability, veteran or marital status, political viewpoint, or other classifications protected by law. This policy applies to current and prospective employees, no matter where they are in their Salesforce employment journey. It also applies to recruiting, hiring, job assignment, compensation, promotion, benefits, training, assessment of job performance, discipline, termination, and everything in between. Recruiting, hiring, and promotion decisions at Salesforce are fair and based on merit. The same goes for compensation, benefits, promotions, transfers, reduction in workforce, recall, training, and education. In the United States, compensation offered will be determined by factors such as location, job level, job-related knowledge, skills, and experience. Certain roles may be eligible for incentive compensation, equity, and benefits. Salesforce offers a variety of benefits to help you live well including: time off programs, medical, dental, vision, mental health support, paid parental leave, life and disability insurance, 401(k), and an employee stock purchasing program. More details about company benefits can be found at the following link: https://www.salesforcebenefits.com.Pursuant to the San Francisco Fair Chance Ordinance and the Los Angeles Fair Chance Initiative for Hiring, Salesforce will consider for employment qualified applicants with arrest and conviction records. At Salesforce, we believe in equitable compensation practices that reflect the dynamic nature of labor markets across various regions. The typical base salary range for this position is $172,500 - $260,100 annually. In select cities within the San Francisco and New York City metropolitan area, the base salary range for this role is $207,800 - $285,800 annually. The range represents base salary only, and does not include company bonus, incentive for sales roles, equity or benefits, as applicable. We're Salesforce, the Customer Company, inspiring the future of business with AI + Data + CRM. Leading with our core values, we help companies across every industry blaze new trails and connect with customers in a whole new way. And, we empower you to be a Trailblazer, too — driving your performance and career growth, charting new paths, and improving the state of the world. If you believe in business as the greatest platform for change and in companies doing well and doing good – you've come to the right place.