Akraya, Inc.

Build and integrate evaluation systems for AI development tools, automate reproducible benchmark runs, calibrate metrics against human judgment, and improve evaluation workflow reliability. | Requires experience evaluating AI coding tools, strong Git and Docker skills, and proficiency in Python, Java, or JavaScript. | Primary Skills: Python (advanced), Git (advanced), AI coding tools (advanced), API Integration (intermediate), Docker (Proficient) Contract Type: W2 Duration: 6 months (Possible extension) Location: San Diego, CA ( PST) Pay Range: $65.00- $73.00 per hour #LP Job Summary: This role focuses on building and scaling the systems used to measure the performance of AI-powered software development tools. You will engineer evaluation frameworks and automate benchmarking processes to ensure reproducible and reliable results. The core of this position is ensuring the accuracy of measurements, not solely the automation of tasks. Key Responsibilities: • Develop and integrate evaluation systems for AI development tools. • Automate benchmark runs with versioned, reproducible environments. • Calibrate evaluation metrics against human judgment for accuracy. • Support performance benchmarking across quality and efficiency. • Analyze and improve the reliability of evaluation workflows. Must-Have Skills: • Experience with AI coding tools and harnesses. • Proven evaluation and benchmarking experience. • Strong proficiency in Git and containerization with Docker. • Python, Java or JavaScript Industry Experience: Experience in software development, particularly with AI-assisted coding tools and their evaluation, is highly beneficial. ABOUT AKRAYA Akraya is an award-winning IT staffing firm consistently recognized for our commitment to excellence and a thriving work environment. Most recently, we were recognized Stevie Employer of the Year 2025, SIA Best Staffing Firm to work for 2025, Inc 5000 Best Workspaces in US (2025 & 2024) and Glassdoor's Best Places to Work (2023 & 2022)! Industry Leaders in Tech Staffing As Talent solutions provider for Fortune 100 Organizations, Akraya's industry recognitions solidify our leadership position in the IT staffing space. We don't just connect you with great jobs, we connect you with a workplace that inspires! Join Akraya Today! Let us lead you to your dream career and experience the Akraya difference. Browse our open positions and join our team!

Lead cross-functional projects managing location master data and ensuring data accuracy in logistics systems. | 5+ years in supply chain or logistics operations with hands-on MDM experience and strong project management skills. | Primary Skills: Master Data Management (MDM) (Expert), Logistics / Supply Chain (Expert), Project Management (Advanced), SAP / Oracle ERP (Advanced), Microsoft Excel / SQL ((Advanced) Contract Type: W2 OR C2C Duration: 12 Months+ Location: Atlanta, GA (100% Remote) Pay Range: $55-$60/hr on W2 or C2C Job Summary: We are looking for a highly organized and proactive Logistics MDM Analyst Lead with strong hands-on Master Data Management experience and proven project management skills. The ideal candidate will have a background in supply chain, logistics operations, or supply chain systems, with experience managing location master data, coordinating cross-functional projects, and maintaining data accuracy in enterprise systems such as SAP or Oracle. This role requires someone who can balance daily operational requests with project deliverables while communicating effectively with internal and external stakeholders. Key Responsibilities: • Lead cross-functional workstreams, track project milestones and deliverables, and ensure timely completion of activities. • Manage location master data requests, including creating, updating, validating, and maintaining location codes in logistics systems. • Review and validate location information, shipping codes, routing rules, and supporting documentation to ensure data accuracy and compliance. • Coordinate with supply chain, logistics, warehouse, transportation, and project teams to resolve issues and support business requirements. • Develop and maintain KPIs, dashboards, SOPs, and process documentation to monitor data quality and improve operational efficiency. Must-Have Skills: • 5+ years of experience in Supply Chain, Logistics Operations, Master Data Management, or related fields. • Hands-on experience with location master data, location code creation and maintenance, data auditing, and ticket management. • Strong project management skills, including managing cross-functional deliverables, milestones, multiple requests, and stakeholder communications. • Experience with SAP, Oracle, or similar ERP / supply chain systems, along with strong Excel skills (Pivot Tables, formulas, macros, or SQL). Industry Experience: • Prior experience in logistics or transportation management, ABOUT AKRAYA Akraya is an award-winning IT staffing firm consistently recognized for our commitment to excellence and a thriving work environment. Most recently, we were recognized Stevie Employer of the Year 2025, SIA Best Staffing Firm to work for 2025, Inc 5000 Best Workspaces in US (2025 & 2024) and Glassdoor's Best Places to Work (2023 & 2022)! Industry Leaders in Tech Staffing As Talent solutions provider for Fortune 100 Organizations, Akraya's industry recognitions solidify our leadership position in the IT staffing space. We don't just connect you with great jobs, we connect you with a workplace that inspires! Join Akraya Today! Let us lead you to your dream career and experience the Akraya difference. Browse our open positions and join our team! Remote Skills: Auditing, Communication Skills, Cross-Functional, Data Management, Data Quality, Documentation, ERP (Enterprise Resource Planning), Leadership, Logistics, Logistics Analysis, Logistics Management, Manufacturing Data Management, Master Data Management (MDM), Microsoft Excel, Operational Improvement, Operational Strategy, Oracle, Oracle ERP, Organizational Skills, Performance Metrics, Pivot Tables, Problem Solving Skills, Project Tracking, Project/Program Management, Quality Monitoring, Reporting Dashboards, SAP, SAP ECC (fka SAP R/3 and SAP ERP), SQL (Structured Query Language), Standard Operating Procedures (SOP), Supply Chain, Supply Chain Operations, Technical Recruiting, Time Management, Warehousing Akraya, Inc.