Agent Reliability & Evaluation Algorithm Engineer

SHOPEE IP SINGAPORE PRIVATE LIMITEDD05 Pasir Panjang, Hong Leong Garden, Clementi New Town, SingaporeFull-timePosted SGD 10,000-15,000 / monthly
Apply on MyCareersFutureCheck your resume against this job

About this role

Job Description: Design and own the evaluation system for LLM Agents, including benchmark construction, LLM-as-Judge with human annotation, and regression/comparison pipelines. Continuously monitor product metrics to guide Agent and model optimization. Build Agent reliability analysis, including err

This is a short preview. Read the full description on MyCareersFuture before you apply.

Get new jobs like these by email

Free. Unsubscribe in one click.

Similar jobs in Singapore

More jobs