Senior Technical Program Manager, Robot Evaluation Operations, Robot Evaluation Operations

Amazon

  • New York, NY
  • On-site
  • Senior level
  • 5+ yrs experience
  • Technical Program Management
  • Visa: not specified
  • $164k–$221k

The role in 30 seconds

Amazon is building capable, safe, and delightful robots for everyday life, and this role runs the operation that produces evidence of how well new robot skills work before they reach customers. The Senior Technical Program Manager owns robot evaluation operations end to end across lab and home environments, turning evaluation requests from science and engineering into planned campaigns and delivering trustworthy results that leaders use to decide what ships. The role treats evaluation as a production operation with measurable output, coordinating robots, test environments, operators, and vendor teams to keep results reproducible and comparable across releases.

Is this role a fit for you?

The backgrounds this role is most likely to hire from, as RoleStack reads the posting.

Strong match

  • Embedded systems / hardware-adjacent
  • Data platform / ML pipeline
  • Growth-stage
  • Enterprise-scale

Workable stretch

  • B2B infrastructure / API / developer tools
  • Startup / greenfield

Harder transition

  • B2C consumer-facing application
  • Internal tooling / back-office systems
  • Regulated environment

Industry: Robotics / physical product evaluation (hardware-adjacent). See your personal match score

What they're really screening for

Must-haves

  • CORE 5+ years of technical product or program management experience
  • CORE 7+ years of working directly with engineering teams experience
  • CORE Experience managing programs across cross functional teams, building processes and coordinating release schedules
  • PLUS Bachelor's degree in Computer Science, Engineering, a related field, or equivalent experience
  • CORE Experience running test, validation, evaluation, or field operations programs for physical products such as robots, autonomous vehicles, or consumer devices
  • CORE Experience managing vendors, contractors, or operations teams that execute work on a schedule
  • CORE Experience building for robotics or physical product evaluation in real-world/home environments

Nice-to-haves

  • PLUS Experience evaluating machine learning models or robot policies, or running data collection operations for robot learning
  • PLUS Experience providing evidence for Go/No-Go or launch-readiness decisions
  • PLUS Experience running tests in homes or with members of the public, including privacy and safety procedures
  • PLUS Familiarity with experiment design and statistics, such as trial counts, confidence intervals, and scoring consistency across raters
  • PLUS Ability to analyze data with SQL or Python and build dashboards
  • PLUS Experience with simulation-based testing or hardware-in-the-loop test programs

Résumé keywords for this role

Terms the posting stresses. Include the ones you can honestly back up.

Tools & technologies

  • SQL
  • Python
  • machine learning models
  • robot policies
  • simulation-based testing
  • hardware-in-the-loop
  • dashboards
  • data collection operations

Concepts & phrases

  • robot evaluation operations
  • technical program management
  • cross functional teams
  • release schedules
  • test, validation, evaluation, or field operations programs
  • physical products
  • vendors, contractors, or operations teams
  • evaluation campaigns
  • home environments
  • entry and exit criteria
  • standard run procedures
  • physical test environments
  • versioned configurations
  • in-home evaluation operations
  • scoring standards

Words that count as the same thing: "Go/No-Go" ≈ Launch readiness decision, Ship/no-ship decision, Release gate · "robot policies" ≈ robot control policies, robot learning policies, ML policies for robotics · "hardware-in-the-loop" ≈ HIL testing, HIL test programs · "field operations" ≈ field testing operations, in-field validation operations · "valid-trial yield" ≈ valid run rate, successful trial percentage

Check my résumé against these keywords

Hiring at Amazon

All Amazon hiring data

Open senior roles RoleStack tracks right now, posted in the last 30 days.

More open roles at Amazon

Full job description from Amazon

From Amazon's posting. View the original

Fauna Robotics is building capable, safe, and delightful robots for everyday life. Before a new skill reaches a customer’s home, we need to know how well it works: how often it succeeds, how fast it is, and where it fails, across the range of homes and conditions our customers live in. We are hiring a Senior Technical Program Manager to run the operation that produces that evidence.

In this role, you will own robot evaluation operations end to end, in lab and home environments. Our scientists define what to measure; you make it happen at scale, on schedule, and with results the team can trust. You will turn evaluation requests from science and engineering into planned campaigns, keep robots, test environments, and operators ready, and deliver results that leaders use to decide what ships. You will treat evaluation as a production operation with measurable output, not a support function.

Show full description Show less

Key job responsibilities
- Own the evaluation program from intake to results: take requests from science and engineering teams, prioritize them against shared robot and lab capacity, and publish the campaign schedule

- Run evaluation campaigns in lab and home environments, with clear entry and exit criteria and standard run procedures

- Build and maintain the physical test environments: home-like lab setups, object and fixture inventories, scene resets, and versioned configurations so results stay comparable across software releases and robot hardware revisions

- Stand up in-home evaluation operations with legal, privacy, safety, and research partners, including scheduling, data handling, and on-site safety procedures

- Direct the work of evaluation operators and vendor teams: training and certification, shift coverage, and scoring standards that stay consistent across raters and sites

- Partner with hardware and fleet teams on robot availability for testing, including maintenance windows, repairs, and per-unit acceptance runs

- Enforce logging and traceability standards so every evaluation trial is reproducible and accounted for

- Deliver results as a product: standard scorecards and dashboards, triage of failures to the right owning team, and evidence that feeds launch and release go/no-go decisions

- Track throughput, valid-trial yield, cost per trial, and turnaround time, own the evaluation budget, and identify manual evaluations that are ready for automation or simulation

- Present evaluation status, risks, and tradeoffs to senior leadership, and say “not yet” when demand exceeds capacity

About the team
Fauna Robotics, an Amazon company, is building capable, safe, and genuinely delightful robots for everyday life. Our goal is simple: make robots people actually want to live and interact with in everyday human spaces.

We believe that future won’t arrive until building for robotics becomes far more accessible. Today, too much effort is spent reinventing the fundamentals. We’re changing that by developing tightly integrated hardware and software systems that make it faster, safer, and more intuitive to create real-world robotic products.

Our work spans the full stack: mechanical design, control systems, dynamic modeling, and intelligent software. The focus is not just functionality, but experience. We’re building robots that feel responsive, expressive, and genuinely useful.

At Fauna, you’ll work at the frontier of this space, helping define how robots move, manipulate, and interact with people in natural environments. It’s an opportunity to solve hard problems across hardware and software with a team focused on making robotics accessible and joyful to build.

If you care about making robotics real for everyone and building systems that are as delightful as they are capable, we’re interested in hearing from you.

Basic Qualifications
- 5+ years of technical product or program management experience
- 7+ years of working directly with engineering teams experience
- Experience managing programs across cross functional teams, building processes and coordinating release schedules
- Bachelor's degree in Computer Science, Engineering, a related field, or equivalent experience
- Experience running test, validation, evaluation, or field operations programs for physical products such as robots, autonomous vehicles, or consumer devices
- Experience managing vendors, contractors, or operations teams that execute work on a schedule

Preferred Qualifications
- Experience evaluating machine learning models or robot policies, or running data collection operations for robot learning
- Experience providing evidence for Go/No-Go or launch-readiness decisions
- Experience running tests in homes or with members of the public, including privacy and safety procedures
- Familiarity with experiment design and statistics, such as trial counts, confidence intervals, and scoring consistency across raters
- Ability to analyze data with SQL or Python and build dashboards
- Experience with simulation-based testing or hardware-in-the-loop test programs

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.

The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.

USA, NY, New York - 163,600.00 - 221,300.00 USD annually

FAQ

How much does a Senior Technical Program Manager, Robot Evaluation Operations, Robot Evaluation Operations at Amazon make?

The posted pay for this role is $164k–$221k a year.

How much experience do you need?

The posting asks for 5+ years in technical product or program management. It is a senior-level role.

Does Amazon sponsor visas for this role?

The posting does not say whether visa sponsorship is available. Ask the recruiter before you apply.

Is this role remote?

It is an on-site role.

What tools and technologies does the posting mention?

SQL, Python, machine learning models, robot policies, simulation-based testing, hardware-in-the-loop, dashboards, data collection operations.