Find your dream job faster with JobLogr
AI-powered job search, resume help, and more.
Try for Free
MSI Data LLC

MSI Data LLC

via Indeed

All our jobs are verified from trusted employers and sources. We connect to legitimate platforms only.

Principal AI & ML Architect

Anywhere
Full-time
Posted 12/5/2025
Verified Source
Key Skills:
AI/ML architecture
System Design
Data Engineering
Microservices
Event-Driven Architecture
API Design
Scaling Systems

Compensation

Salary Range

$200K - 300K a year

Responsibilities

Lead AI & ML strategy, build and mentor the team, and architect scalable AI systems.

Requirements

10+ years of software engineering, 3-5 years in AI/ML architecture, leadership experience, expertise with LLMs, vector databases, and system scaling.

Full Description

Description: MSI Data is embarking on a transformative initiative to integrate advanced Artificial Intelligence across our entire application suite. We are seeking a Principal AI & ML Architect to lead this charge. This is not a maintenance role. As the most critical hire in our new AI organization, you will be the technical visionary responsible for defining the "how" and "what" of our ML & AI strategy. You will build the foundation, hire the team, and architect a scalable, rapid-growth AI product line from the ground up. You will operate at the intersection of systems architecture, agent design, and engineering leadership. Key Responsibilities 1. Technical Strategy & Leadership • Define the Vision: Own the technical roadmap for MSI’s ML & AI initiatives. You will select the technology stack, define the architectural standards, and ensure our strategy aligns with long-term business goals. • Build the Team: You will lead the hiring process for the AI technical team. You will mentor, guide, and initially manage this team through a period of rapid growth and high-velocity execution. • Vendor & Tech Selection: Lead the evaluation and selection of LLMs, vector databases, inference engines, and third-party AI tools. Make build vs. buy decisions that optimize for speed and scalability. 2. Core AI & System Architecture • Agent Design: Architect sophisticated, autonomous AI agents and define the tooling required for them to interact with external systems and user data effectively. • Information Retrieval (RAG): Design robust Information Retrieval architectures (RAG) that ensure our AI is grounded in accurate, context-aware data. • Real-Time Architecture: Build low-latency, real-time communication infrastructures (streaming/WebSockets) to support seamless, conversational AI experiences. • Systems Infrastructure: Design the cloud infrastructure required to host, scale, and monitor AI services, ensuring high availability and fault tolerance. 3. Quality, Performance & Security • Metrics & Optimization: Partner with Product to define success metrics. You will be responsible for the technical realization of these metrics, focusing on latency, token usage efficiency, and response quality. • Security & Governance: Architect "secure-by-design" AI systems. Manage data privacy, API security, and compliance within the AI workflow to protect customer data. • Scalability & Standards: Establish rigorous code quality standards and API design patterns. Ensure the platform is built to handle rapid user adoption and data volume growth without technical debt. Requirements: • Experience: 10+ years of software engineering experience, with at least 3-5 years dedicated to AI/ML architecture, System Design, or Data Engineering at scale. • Leadership: Proven experience hiring, mentoring, and managing high-performing technical teams. You are comfortable wearing the "Manager" hat during our initial growth phase. • Architectural Mastery: Deep understanding of modern application architecture, including microservices, event-driven architecture, and API design (REST/gRPC). • AI Proficiency: Hands-on experience with LLMs (OpenAI, Anthropic, Llama), Vector Databases (Pinecone, Weaviate, Milvus), and frameworks like LangChain or LlamaIndex. • Agentic Workflows: Experience designing AI agents that can use tools (function calling) to perform actions, not just generate text. • Scale: A track record of building systems that scale. You understand the nuances of latency, throughput, and cost optimization in an AI context. Why Join Us? • Greenfield Opportunity: This is a rare chance to build a new product line and team from scratch within an established company. • High Impact: Your architectural decisions will directly shape the future of our product and the efficiency of our customers. • Leadership Track: As the founding member of this team, you will have significant influence over the culture and technical direction of the organization.

This job posting was last updated on 12/11/2025

Ready to have AI work for you in your job search?

Sign-up for free and start using JobLogr today!

Get Started »
JobLogr badgeTinyLaunch BadgeJobLogr - AI Job Search Tools to Land Your Next Job Faster than Ever | Product Hunt