CustomAI Studio is hiring a Data Scientist to sit between strategy and engineering on every engagement. You’ll partner with our Solutions Architects during Blueprint discovery, build the ROI models that anchor the business case, and own the evals and measurement layer behind every production system.
What you’ll do
- Analyze client workflows and operational data to identify the highest-leverage AI opportunities.
- Build ROI models, FTE analyses, and scenario forecasts that inform what we build and why.
- Design and run evals for production AI systems — accuracy, cost, latency, and business-metric outcomes.
- Establish baseline metrics and track post-deployment performance against them across the client base.
- Contribute to the AgenticOS Framework with patterns, benchmarks, and methodology improvements.
What we’re looking for
- Strong applied data science / analytics background — comfortable with messy operational data, not just clean datasets.
- Experience modeling business outcomes and translating analysis into executive-grade narratives.
- Hands-on experience with LLM evals, RAG benchmarking, or AI system performance measurement.
- Excellent communication — you’ll present to client leadership teams.
- Bonus: domain expertise in healthcare, legal, financial services, or operationally complex industries.
What we offer
- Competitive compensation and meaningful equity.
- Fully remote, async-friendly team.
- Direct exposure to client leadership teams across 10+ industries.
- The chance to define how applied AI is measured at scale.
Apply for this role
Tell us about yourself. We read every application, and someone on the team will get back to you.