Apply with hirly
Senior AI Systems Quality Engineer
Jobgether · US
Upload your resume to see how well you match this job — free, in seconds, no account needed.
Your resume is used only to score it against this job. If you don't create an account, it is deleted within 24 hours.
Already have an account? Sign in to see your saved application
This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior AI Systems Quality Engineer based in United States. This role focuses on engineering quality, reliability, and trust into production-grade AI systems used in mission-critical healthcare environments. You will design automated testing frameworks, evaluation pipelines, and scalable quality practices for agentic and LLM-driven applications. The position goes beyond traditional QA, emphasizing quality-by-design, safe failure behavior, measurable evaluation signals, and continuous validation throughout the development lifecycle. You will help build an AI testing platform integrated with Databricks and MLflow to support traceability, lineage, and auditability at scale. Working closely with AI engineering, platform, security, and delivery teams, you will influence release readiness and operational confidence. This is an automation-first engineering opportunity for someone passionate about making advanced AI systems reliable, governed, and production-ready.