via Remote Rocketship
$200K - 250K a year
Develop and operate AI features, manage AI platform components, and ensure quality and reliability of AI services.
Requires 5+ years in software engineering with 2+ years in production ML/AI, deep expertise in prompt engineering, evaluation tooling, and Python.
Job Description: • Apply AI to Real Financial Problems: Use GenAI and ML to help users make sense of their money, whether that's understanding spending patterns, surfacing actionable insights, or automating tedious financial tasks. You'll identify where AI can make a meaningful difference and build solutions that users rely on daily. • Choose the Right Tool for Each Problem: Navigate the AI toolkit thoughtfully. Know when a well-crafted prompt suffices, when retrieval systems add value, and when custom models are worth the investment. You'll balance innovation with pragmatism to ship features that work reliably at scale. • Ship with Confidence: Leverage and enhance our sophisticated evaluation framework to ensure AI quality. You'll design test datasets, implement new scorers, and use our Braintrust-based eval system to validate changes before they reach users. • You Own: AI feature development, agent design and orchestration, ML model improvements, evaluation datasets and scorers, prompt engineering, and feature-level quality. • AI Platform Owns: LLM routing and provider management, observability and cost attribution, infrastructure reliability, and shared AI services. • Together You Own: End-to-end feature quality, evaluation frameworks, production incident response, and AI roadmap priorities. Requirements: • 5+ years of experience in software engineering, with at least 2 years focused on building and operating production ML/AI systems. • A proven track record of shipping LLM-powered features, with deep, hands-on expertise in prompt engineering, RAG systems, and evaluation techniques. • Strong fundamentals in machine learning: embeddings, similarity search, classification, and probabilistic reasoning. • Demonstrated experience building and using AI evaluation tooling (e.g., golden sets, rubric scoring, LLM-as-judge). • Excellent Python skills and a history of building production-grade AI features and services. • Strong collaboration and communication skills with a sharp product sensibility. • A strategic mindset, comfortable making build-vs-buy decisions and designing features for long-term reliability. Benefits: • Work wherever you want! As a fully remote company with no central office, we want you to work wherever you are happiest and most productive. Whether that’s out of your home, a co-working space, or elsewhere. • Competitive cash and equity compensation in a hyper growth, early stage company 🚀. • Stipend to set-up your ideal working environment. • Competitive Benefit Plans for employees based on your location (e.g. in the US we offer: Medical, dental and vision benefits and the ability to contribute to a 401k plan). • Unlimited PTO. • 3 day weekend every month! We take off the “First Friday” every month to focus on rest, recuperation, or just having fun!
This job posting was last updated on 2/19/2026