Apply with hirly
Agent Evaluation & Instrumentation Engineer
Umanist Staffing LLC · India
Upload your resume to see how well you match this job — free, in seconds, no account needed.
Your resume is used only to score it against this job. If you don't create an account, it is deleted within 24 hours.
Agent Evaluation & Instrumentation Engineer Location: Pune | Experience: 8–11 Years | CTC: Up to ₹33 LPA(576) Notice Period: Immediate–45 Days | Preference: Local Pune Candidates Interview: 2 Technical Rounds Client Round
HR Mandate Criteria
– NON-NEGOTIABLE 6 years in ML/Data/Software Engineering with strong evaluation/quality focus Hands-on LLM/ML evaluation experience Strong Python skills Experience with Promptfoo / DeepEval / custom evaluation frameworks Strong understanding of LLM/Agen…