Skip to content
Search jobs inside your AI agent. Claude, ChatGPT, Claude Code, Codex, Gemini, Cursor and Grok
Connect

Cast AI

Senior Applied ML Engineer — Real-Time LLM Router

Posted Updated

Description

Cast AI is hiring for an applied ML Platform Engineer to own the routing model end to end. You will define features, objectives, training, calibration, and release cadence, ensuring production-parity benchmarks and robust evaluation with error bars.

You will transform per-request outcomes and benchmark rollouts into training signals, balancing task success with token cost and decoding speed. This is a remote, globally distributed role with strong emphasis on instrumentation, experimentation, and

Own the routing model end to end: features, objective, training, calibration, release cadence. Build and maintain production-parity evaluation with error bars andholdouts. Turn fleet data into training signals while managing data quality. Model the objective from user perspective: task success, token cost, and speed. Run shadow, A/B, and full rollout with drift monitoring and retraining. You have 5+ years in applied ML or ML research with real-time decision experience. Strong

Skills

What Senior ML / AI jobs ask for — and how much of it you have →
Apply

See also

ML / AI jobs by country — openings, pay and top skills →