Senior Software Engineer, Model Evaluation

Clera

  • San Francisco, CA
  • On-site
  • Senior level
  • 3+ yrs experience
  • AI/ML Engineering
  • Visa: not specified
  • $180k–$250k

The role in 30 seconds

Join an early-stage AI team at Clera building agents for manufacturing operations. You will create benchmarks and train models against real procurement and supply-chain workflows, helping ensure agents can handle customer-facing tasks reliably.

Is this role a fit for you?

The backgrounds this role is most likely to hire from, as RoleStack reads the posting.

Strong match

  • Data platform / ML pipeline
  • Internal tooling / back-office systems
  • B2B infrastructure / API / developer tools
  • Internal users (employees, ops teams)
  • Developers / technical users

Workable stretch

  • B2B enterprise platform / workflow software
  • Creator / builder / self-serve tool
  • Enterprise users (complex workflows, admin panels, role-based access)
  • SMB / small business (self-serve, simplicity-focused)
  • Growth-stage (scaling existing systems, reliability concerns)

Harder transition

  • B2C consumer-facing application
  • Marketplace / multi-sided platform
  • Embedded systems / hardware-adjacent
  • Consumer / general public (high polish, conversion-focused)
  • Enterprise-scale (high availability, compliance, large distributed systems)

Industry: Manufacturing & Industrial. See your personal match score

What they're really screening for

Must-haves

  • CORE At least 3 years of experience, operating at a senior or staff level.
  • CORE Hands-on experience designing benchmarks and evaluations, including authoring tasks, reference solutions or rubrics, and quality checks.
  • CORE Practical experience training and fine-tuning models, not only using models through APIs.
  • CORE Ability to work closely with non-ML domain experts and translate their knowledge into measurable tasks.
  • PLUS Supply-chain, procurement, manufacturing, or early-stage startup experience.

Résumé keywords for this role

Terms the posting stresses. Include the ones you can honestly back up.

Tools & technologies

  • AI
  • agents
  • manufacturing operations
  • supply-chain
  • compliance documents
  • purchase orders
  • freight
  • order tracking
  • models
  • evaluation
  • benchmarks
  • rubrics
  • graders
  • train
  • fine-tune

Concepts & phrases

  • Senior Software Engineer
  • Model Evaluation
  • AI team
  • manufacturing operations
  • supplier sourcing
  • qualification, compliance documents
  • purchase orders, freight
  • order tracking
  • procurement and manufacturing experts
  • reference answers and rubrics
  • build graders
  • train and fine-tune models
  • evaluation results
  • agent failures
  • production systems

Words that count as the same thing: "agents" ≈ AI agents, Autonomous agents, Intelligent agents · "models" ≈ Machine learning models, AI models · "training and fine-tuning" ≈ Model training, Model fine-tuning, ML model development

Check my résumé against these keywords

Hiring at Clera

All Clera hiring data

Open senior roles RoleStack tracks right now, posted in the last 30 days.

More open roles at Clera

Full job description from Clera

From Clera's posting. View the original

ABOUT THE ROLE

Join an early-stage AI team building agents for manufacturing operations. You will create benchmarks and train models against real procurement and supply-chain workflows, helping ensure agents can handle customer-facing tasks reliably.

WHAT YOU'LL DO

- Design and build evaluation suites for supplier sourcing, qualification, compliance documents, purchase orders, freight, and order tracking.

Show full description Show less

- Work with procurement and manufacturing experts to scope tasks, write reference answers and rubrics, and build graders.

- Train and fine-tune models, using evaluation results to guide experiments.

- Identify agent failures, improve production systems, and measure whether changes work.

- Help establish the team's research and evaluation practices.

WHAT WE'RE LOOKING FOR

- At least 3 years of experience, operating at a senior or staff level.

- Hands-on experience designing benchmarks and evaluations, including authoring tasks, reference solutions or rubrics, and quality checks.

- Practical experience training and fine-tuning models, not only using models through APIs.

- Ability to work closely with non-ML domain experts and translate their knowledge into measurable tasks.

- Supply-chain, procurement, manufacturing, or early-stage startup experience is helpful.

COMPENSATION & BENEFITS

Base salary is $180,000 to $250,000 annually, plus equity. Visa sponsorship details were not provided.

LOCATION

Hybrid in San Francisco, California, United States.

FAQ

How much does a Senior Software Engineer, Model Evaluation at Clera make?

The posted pay for this role is $180k–$250k a year.

How much experience do you need?

The posting asks for 3+ years in software engineer. It is a senior-level role.

Does Clera sponsor visas for this role?

The posting does not say whether visa sponsorship is available. Ask the recruiter before you apply.

Is this role remote?

It is an on-site role.

What tools and technologies does the posting mention?

AI, agents, manufacturing operations, supply-chain, compliance documents, purchase orders, freight, order tracking, models, evaluation, benchmarks, rubrics, graders, train, fine-tune.