Braintrust

Compensation

Full Description

Job Description: We are seeking multiple Tech Leads (Coders) to help lead our GenAI code initiatives as hands-on experts. You’ll write and refine code, design automated evaluation frameworks, and partner with research, engineering, and product to improve code-centric LLM performance and reliability. • To Note: This is for an immediate project need. Project is approved for 3-months initially, with possibility to extend based on project/client demands. Responsibilities: • Write, evaluate, and rewrite code to solve complex, real-world problems (hands-on). • Build frameworks, test suites, and benchmarks to validate model-generated code. • Analyze and improve correctness, efficiency, and security of human- and AI-written code. • Define and track code quality metrics. • Collaborate cross-functionally to integrate feedback and drive model improvements. • Accelerate validation and refinement of code-generating models; ensure production readiness; drive innovation in GenAI use cases. Requirements: • 5+ years building and shipping complex software solutions. • Strong proficiency in at least one: Python, Java, C, C++, JavaScript. • Experience creating test harnesses; evaluating code for correctness, efficiency, security. • Familiarity with LLMs for code (generation, fine-tuning, evaluation) preferred. • Preferred: STEM/domain expertise; data analysis/visualization; SQL/databases; JSON, HTML, Markdown; web viz platforms; data libraries. • Senior/tech-lead level; comfortable with smaller, high-complexity datasets. • Nice-to-have: “technical raters” with strength in JavaScript/JSON, HTML, Markdown.