Senior Engineering Manager, AI Platform

OpenLoop Health

  • Remote - US
  • Remote
  • Senior level
  • 10+ yrs experience
  • AI/ML Engineering
  • Visa: not specified

The role in 30 seconds

OpenLoop is building the future of healthcare infrastructure. This role will lead the Applied AI team, responsible for building and productionizing LLM-based agents and assistants used by operations, clinical, and patient-facing teams, ensuring security, privacy, and reliability while managing a senior engineering team.

Is this role a fit for you?

The backgrounds this role is most likely to hire from, as RoleStack reads the posting.

Strong match

  • Data platform / ML pipeline
  • B2B enterprise platform / workflow software
  • B2B infrastructure / API / developer tools
  • Internal users (employees, ops teams)
  • Enterprise users (complex workflows, admin panels, role-based access)

Workable stretch

  • Internal tooling / back-office systems
  • Creator / builder / self-serve tool
  • Developers / technical users (docs, APIs, CLIs)
  • Startup / greenfield (build from scratch, speed over polish)
  • Product-led growth (PLG) / self-serve

Harder transition

  • B2C consumer-facing application
  • Marketplace / multi-sided platform
  • Embedded systems / hardware-adjacent
  • Consumer / general public (high polish, conversion-focused)
  • SMB / small business (self-serve, simplicity-focused)

Industry: Healthcare & Life Sciences. See your personal match score

What they're really screening for

Must-haves

  • PLUS Bachelor's degree in Computer Science, Engineering, or a related technical field
  • CORE 10+ years of software engineering experience
  • CORE 3+ years managing engineers directly (hiring, performance management, career development)
  • CORE Led or built LLM-based systems in production that real users relied on, not only demos, prototypes or personal projects.
  • CORE Experience managing senior and Staff-level engineers and earning their technical trust.
  • CORE Enough hands-on understanding of agent runtime, evaluation, retrieval and observability to review designs, challenge assumptions and make sound architecture calls.
  • CORE You hold teams to measuring whether AI systems work with evaluation data, rather than "it seemed to work."
  • CORE Strong grounding in production engineering across testing, services, APIs, deployment, incident management and on-call.
  • CORE Experience leading teams that handle sensitive data with a security-first mindset.
  • PLUS Comfort building in a greenfield space, and clear communication with technical and non-technical partners

Nice-to-haves

  • CORE Healthcare (PHI, HIPAA), finance or insurance.
  • PLUS Leading teams that run production services on Google Cloud.
  • CORE Grew an engineering team from zero, or from one team to several.
  • PLUS Led migrations between model versions or providers.
  • PLUS Machine learning experience beyond LLMs.
  • CORE Led a platform used by other engineering teams.

Résumé keywords for this role

Terms the posting stresses. Include the ones you can honestly back up.

Tools & technologies

  • AI Platform
  • LLM
  • AI agents
  • AI assistants
  • Senior Staff
  • Staff
  • Senior
  • Applied AI Engineers
  • agent runtime
  • orchestration
  • retrieval
  • model access
  • observability
  • evaluation
  • regression tests

Concepts & phrases

  • Senior Engineering Manager, AI Platform
  • Applied AI team
  • LLM-based agents and assistants
  • production AI systems
  • agent runtime
  • model access and observability
  • evaluation sets, regression tests
  • AI-graded evals
  • operational health of AI systems
  • sensitive data with a security-first mindset
  • Senior, Staff and Senior Staff
  • technical depth
  • evaluation rigor
  • engineering fundamentals
  • regulated-industry experience

Words that count as the same thing: "LLM-based agents and assistants" ≈ AI agents, AI assistants, Large Language Model applications · "PHI" ≈ Protected Health Information, Patient Data · "HIPAA" ≈ Health Insurance Portability and Accountability Act

Check my résumé against these keywords

Hiring at OpenLoop Health

Open senior roles RoleStack tracks right now, posted in the last 30 days.

More open roles at OpenLoop Health

Full job description from OpenLoop Health

From OpenLoop Health's posting. View the original

ABOUT OPENLOOP

OpenLoop was co-founded by CEO, Dr. Jon Lensing, and COO, Christian Williams, with the vision to bring care anywhere. Our telehealth support solutions are thoughtfully designed to streamline and simplify go-to-market care delivery for companies offering meaningful virtual support to patients across an expansive array of specialties, in all 50 states.

OpenLoop is building the future of healthcare infrastructure. We're hiring a Senior Engineering Manager to build and lead our Applied AI team, the engineers who ship the LLM-based agents and assistants our operations, clinical and patient-facing teams use every day.

Show full description Show less

This is a leadership role with real technical depth. You'll hire and grow a team of Senior, Staff and Senior Staff Applied AI Engineers, own delivery of production AI systems, and set the standards for how we build, evaluate and safely run AI on patient data. You don't need to write production code daily, but you need to be credible in architecture and eval reviews and know what good looks like.

What You'll Do

- Build & Lead the Team: Hire, onboard and develop a team of Applied AI Engineers across Senior, Staff and Senior Staff levels, and grow it from a single pod into multiple teams as the work expands.

- Own Delivery of Production Agents: Drive the roadmap and execution of LLM-based agents and assistants that real users rely on, from scoping to launch to ongoing operation.

- Set the Technical Bar: Partner with Staff+ engineers on architecture for agent runtime and orchestration, retrieval, model access and observability. Make the call on trade-offs when the team needs one.

- Evaluation as a Standard: Make evaluation sets, regression tests and AI-graded evals a required part of how the team ships, so we can show improvement with numbers and catch regressions before users do.

- Reliability, Cost & Operations: Own the operational health of AI systems in production, including on-call, incident response, provider fallbacks, model version upgrades and AI spend by agent and use case.

- Security, Privacy & Safety: Make sure every AI system protects patient data (PHI), follows least-privilege access, and defends against misuse such as prompt injection. Partner with Security and Compliance on HIPAA requirements.

- Workflow & Use Case Prioritization: Work with Product and Operations leaders to find where agents can reliably take over human workflows, where they should hand off to a person, and which bets to make first.

- Cross-functional Leadership: Explain AI capabilities, risks and timelines in plain language to product, operations, clinical and executive stakeholders, including when the honest answer is "the AI isn't ready for this yet."

- Team Health & Process: Run planning, prioritization and delivery rituals that keep a senior team shipping fast without burning out. Give clear, direct feedback and build career paths.

- Other duties as assigned.

WHO YOU ARE

REQUIRED QUALIFICATIONS

- Bachelor's degree in Computer Science, Engineering, or a related technical field

- Proven Engineering Experience: 10+ years of software engineering experience, including 3+ years managing engineers directly (hiring, performance management, career development).

- Production LLM Experience: Led or built LLM-based systems in production that real users relied on, not only demos, prototypes or personal projects.

- Senior Team Leadership: Experience managing senior and Staff-level engineers and earning their technical trust.

- Technical Depth: Enough hands-on understanding of agent runtime, evaluation, retrieval and observability to review designs, challenge assumptions and make sound architecture calls.

- Evaluation Rigor: You hold teams to measuring whether AI systems work with evaluation data, rather than "it seemed to work."

- Engineering Fundamentals: Strong grounding in production engineering across testing, services, APIs, deployment, incident management and on-call.

- Data & Security Fluency: Experience leading teams that handle sensitive data with a security-first mindset.

- Comfort building in a greenfield space, and clear communication with technical and non-technical partners

PREFERRED QUALIFICATIONS

- Regulated-Industry Experience: Healthcare (PHI, HIPAA), finance or insurance.

- GCP Experience: Leading teams that run production services on Google Cloud.

- Scaling Teams: Grew an engineering team from zero, or from one team to several.

- Model Operations: Led migrations between model versions or providers.

- Classic ML Background: Machine learning experience beyond LLMs.

- Internal Platforms: Led a platform used by other engineering teams.

Our Benefits

In addition to a competitive base pay, for salaried positions you would also be eligible for:

- Medical, Dental, and Vision plans

- Flexible Spending/Health Savings Accounts

- Flexible PTO

- 401(k) + Company Match

- Life Insurance, Pet insurance, and more

OUR COMPANY

We have a relatively flat organizational structure here at OpenLoop. Everyone is encouraged to bring ideas to the table and make things happen. This fits in well with our core values of Autonomy, Competence and Belonging, as we want everyone to feel empowered and supported to do their best work.

Sound like a good fit? We’d love to meet you.

FAQ

How much experience do you need?

The posting asks for 10+ years in software engineering. It is a senior-level role.

Does OpenLoop Health sponsor visas for this role?

The posting does not say whether visa sponsorship is available. Ask the recruiter before you apply.

Is this role remote?

It is a remote role.

What tools and technologies does the posting mention?

AI Platform, LLM, AI agents, AI assistants, Senior Staff, Staff, Senior, Applied AI Engineers, agent runtime, orchestration, retrieval, model access, observability, evaluation, regression tests.