Senior Machine Learning Engineer - Evaluations (Design Generation)
Is this job for you?
Build my CV Build your CV and see how well you match this role — and every other one.
Track your applications on mobile The free Whileresume app, on iPhone and Android.
The role
Lead the evaluation strategy and scalable infrastructure for design generation systems, guiding teams on appropriate methods and metrics.
Design and implement automated, scalable evaluation pipelines that score generated designs while balancing accuracy with computational cost.
Define evaluation strategies for pre-deployment validation, continuous monitoring, A/B analyses, and model comparison.
Curate robust evaluation datasets and benchmark suites representing diverse use cases, edge cases, and quality dimensions.
Integrate evaluation into CI/CD workflows by creating automated quality gates that catch regressions before production.
Collaborate across research and engineering to socialize best practices, ensure tooling adoption, and align architecture with evaluation needs.
Design and implement automated, scalable evaluation pipelines that score generated designs while balancing accuracy with computational cost.
Define evaluation strategies for pre-deployment validation, continuous monitoring, A/B analyses, and model comparison.
Curate robust evaluation datasets and benchmark suites representing diverse use cases, edge cases, and quality dimensions.
Integrate evaluation into CI/CD workflows by creating automated quality gates that catch regressions before production.
Collaborate across research and engineering to socialize best practices, ensure tooling adoption, and align architecture with evaluation needs.
See the full job post
Responsibilities, requirements, skills and benefits — create your free account.
or
Already have an account?
Log inYou might also like these jobs
No closely matching jobs yet — here are the most recent ones.