Staff Software Engineer, Applied AI

Superdial

  • Burlingame, CA
  • On-site
  • Staff/Principal level
  • 5+ yrs experience
  • AI/ML Engineering
  • Visa: not specified

The role in 30 seconds

SuperDial is transforming AI in healthcare by building scalable, AI-powered solutions that optimize revenue cycle management. This Staff Software Engineer, Applied AI role focuses on building and scaling the backend systems that power LLM applications in healthcare, designing APIs, pipelines, and infrastructure to make LLMs reliable, secure, and cost-efficient in production. The goal is to push LLMs beyond demos into mission-critical healthcare workflows.

Is this role a fit for you?

The backgrounds this role is most likely to hire from, as RoleStack reads the posting.

Strong match

  • B2B infrastructure / API / developer tools
  • Software, SaaS & AI Platform
  • Growth-stage
  • Enterprise-scale

Workable stretch

  • B2B enterprise platform / workflow software
  • Startup / greenfield

Harder transition

  • Internal tooling / back-office systems
  • B2C consumer-facing application
  • Regulated environment

Industry: Healthcare & Life Sciences. See your personal match score

What they're really screening for

Must-haves

  • CORE 5+ years of backend or full-stack software engineering experience, with 3+ years working on ML/LLM-enabled applications.
  • CORE Strong coding skills in Python (and ideally one statically typed language such as Go, Java, or TypeScript).
  • CORE Experience with LLM integration frameworks (Hugging Face, LangChain, LlamaIndex, OpenAI APIs, Anthropic, etc.).
  • CORE Deep knowledge of distributed systems, service-oriented architecture, and building APIs at scale.
  • CORE Cloud-native expertise: AWS/GCP/Azure, Kubernetes, Docker, Terraform, etc.
  • CORE Familiarity with MLOps/LLMOps practices: CI/CD for models, evaluation harnesses, monitoring, and reproducibility.
  • CORE Excellent system design skills and the ability to align technical architecture with product goals.
  • CORE HIPAA-ready infrastructure, data governance, and auditability for LLM-powered applications.

Nice-to-haves

  • CORE Experience applying LLMs in healthcare or other regulated industries (FHIR, HL7, HIPAA).
  • CORE Hands-on experience with RAG pipelines, vector databases, and structured-output orchestration.
  • PLUS Background in enterprise SaaS or mission-critical platforms where uptime, latency, and scale matter.
  • PLUS Knowledge of responsible AI, safety, and privacy-preserving ML techniques.

Résumé keywords for this role

Terms the posting stresses. Include the ones you can honestly back up.

Tools & technologies

  • Staff Software Engineer, Applied AI
  • LLM
  • Python
  • Go
  • Java
  • TypeScript
  • Hugging Face
  • LangChain
  • LlamaIndex
  • OpenAI APIs
  • Anthropic
  • AWS
  • GCP
  • Azure
  • Kubernetes

Concepts & phrases

  • Staff Software Engineer, Applied AI
  • build and scale the backend systems
  • LLM applications in healthcare
  • backend architecture and applied AI
  • APIs, pipelines, and infrastructure
  • LLMs reliable, secure, and cost-efficient
  • push LLMs beyond demos
  • mission-critical healthcare workflows
  • Backend for LLMs
  • scalable, low-latency APIs and services
  • optimize LLMs for healthcare use cases
  • Data & Retrieval Pipelines
  • retrieval-augmented generation (RAG) pipelines
  • ground LLMs in clinical and revenue-cycle data
  • LLMOps & Observability

Words that count as the same thing: "LLM" ≈ Large Language Model · "RAG" ≈ Retrieval Augmented Generation · "PLG" ≈ Product-Led Growth, Self-serve growth · "Agile" ≈ Scrum, Iterative development

Check my résumé against these keywords

Hiring at Superdial

Open senior roles RoleStack tracks right now, posted in the last 30 days.

More open roles at Superdial

Full job description from Superdial

From Superdial's posting. View the original

SuperDial is seeking a Staff Software Engineer, Applied AI to build and scale the backend systems that power LLM applications in healthcare. This role is ideal for an engineer who thrives at the intersection of backend architecture and applied AI, designing APIs, pipelines, and infrastructure that make LLMs reliable, secure, and cost-efficient in production. If you want to push LLMs beyond demos into mission-critical healthcare workflows, we’d love to hear from you.

Show full description Show less

About the Role:

- Backend for LLMs – Architect and implement scalable, low-latency APIs and services that wrap, orchestrate, and optimize LLMs for healthcare use cases.

- Data & Retrieval Pipelines – Build ingestion, preprocessing, and retrieval-augmented generation (RAG) pipelines to ground LLMs in clinical and revenue-cycle data.

- LLMOps & Observability – Design systems for model monitoring, evaluation, cost tracking, and guardrails, ensuring reliability and responsible use.

- Performance & Optimization – Engineer solutions for caching, batching, load balancing, and scaling LLM workloads across cloud and containerized environments.

- Security & Compliance – Implement HIPAA-ready infrastructure, data governance, and auditability for LLM-powered applications.

- Cross-Functional Collaboration – Partner with product, ML engineers, and healthcare experts to translate business workflows into robust backend systems.

- Technical Leadership – Drive end-to-end delivery of LLM backend projects, establish engineering best practices, and mentor peers in LLM system design.

About You:

- 5+ years of backend or full-stack software engineering experience, with 3+ years working on ML/LLM-enabled applications.

- Strong coding skills in Python (and ideally one statically typed language such as Go, Java, or TypeScript).

- Experience with LLM integration frameworks (Hugging Face, LangChain, LlamaIndex, OpenAI APIs, Anthropic, etc.).

- Deep knowledge of distributed systems, service-oriented architecture, and building APIs at scale.

- Cloud-native expertise: AWS/GCP/Azure, Kubernetes, Docker, Terraform, etc.

- Familiarity with MLOps/LLMOps practices: CI/CD for models, evaluation harnesses, monitoring, and reproducibility.

- Excellent system design skills and the ability to align technical architecture with product goals.

Preferred Qualifications:

- Experience applying LLMs in healthcare or other regulated industries (FHIR, HL7, HIPAA).

- Hands-on experience with RAG pipelines, vector databases, and structured-output orchestration.

- Background in enterprise SaaS or mission-critical platforms where uptime, latency, and scale matter.

- Knowledge of responsible AI, safety, and privacy-preserving ML techniques.

WHAT’S IN IT FOR YOU?

- The opportunity to apply cutting-edge AI to one of the world’s most important industries.

- A leadership role with ownership over core ML/LLM systems and influence on technical direction.

- Competitive salary, equity options, and benefits, including health, dental, and vision coverage.

WHO WE ARE

SuperDial is transforming AI in healthcare by building scalable, AI-powered solutions that optimize revenue cycle management. Join us and help shape the future of AI in healthcare.

Compensation: The base salary for this role ranges from $200,000 to $275,000, depending on experience and qualifications. We also offer equity and benefits as part of our total compensation package.

FAQ

How much experience do you need?

The posting asks for 5+ years in backend or full-stack software engineering. It is a staff/principal-level role.

Does Superdial sponsor visas for this role?

The posting does not say whether visa sponsorship is available. Ask the recruiter before you apply.

Is this role remote?

It is an on-site role.

What tools and technologies does the posting mention?

Staff Software Engineer, Applied AI, LLM, Python, Go, Java, TypeScript, Hugging Face, LangChain, LlamaIndex, OpenAI APIs, Anthropic, AWS, GCP, Azure, Kubernetes.