Senior Software Engineer
Hippocratic AI
- Menlo Park, CA
- On-site
- Senior level
- 4+ yrs experience
- Backend Engineering
- Visa: not specified
The role in 30 seconds
This role owns the backend infrastructure that keeps Hippocratic AI's AI agents fast, reliable, and scalable inside real hospitals and health systems. The engineer architects high-availability backend systems and multi-modal data pipelines for healthcare data and LLM processing, working closely with data scientists, ML engineers, and product managers to turn healthcare requirements into production-grade infrastructure.
Is this role a fit for you?
The backgrounds this role is most likely to hire from, as RoleStack reads the posting.
Strong match
- B2B infrastructure / API / developer tools
- Data platform / ML pipeline
- B2B enterprise platform / workflow software
- Growth-stage
- Enterprise-scale
Workable stretch
- Marketplace / multi-sided platform
- Creator / builder / self-serve tool
- Startup / greenfield
Harder transition
- B2C consumer-facing application
- Embedded systems / hardware-adjacent
Industry: Healthcare & Life Sciences (central to role identity). See your personal match score
What they're really screening for
Must-haves
- PLUS Bachelor's degree in Computer Science, Computer Engineering, or a related field
- CORE 4+ years of backend development experience using Python, Golang, or similar languages
- CORE Experience building and maintaining multi-modal (speech, vision, text) data pipelines using Ray, Apache Airflow, or similar for distributed processing and model experimentation, including distributed computing frameworks like Spark or Hadoop
- PLUS Familiarity with relational database systems and RESTful APIs
- PLUS Basic understanding of cloud infrastructure (AWS, GCP, or similar)
- CORE Experience building backend systems for high-volume healthcare data and LLM processing at 99.9%+ uptime
- PLUS Experience in healthcare or adjacent regulated-data domain
Nice-to-haves
- PLUS Exposure to AI/ML concepts or experience working with LLMs
- PLUS Experience working in teams that handle sensitive or regulated data
- PLUS Familiarity with gRPC, GraphQL, or similar
- PLUS Experience with real-time audio
- PLUS Exposure to DevOps concepts — CI/CD, deployment, Terraform, build systems
- PLUS Experience with data science
- PLUS Master's degree in Computer Science or related field
Résumé keywords for this role
Terms the posting stresses. Include the ones you can honestly back up.
Tools & technologies
- Python
- Golang
- Ray
- Apache Airflow
- Spark
- Hadoop
- RESTful APIs
- AWS
- GCP
- LLMs
- gRPC
- GraphQL
- CI/CD
- Terraform
- build systems
Concepts & phrases
- Senior Software Engineer
- backend infrastructure
- 99.9%+ uptime
- high-volume healthcare data
- LLM processing
- multi-modal (speech, vision, text)
- distributed processing
- model experimentation
- relational database systems
- RESTful APIs
- cloud infrastructure
- real-time audio
- sensitive or regulated data
- data preparation through model deployment
- AI model interaction
Words that count as the same thing: "Golang" ≈ Go, Go language · "LLM" ≈ Large Language Model, large language models · "multi-modal" ≈ multimodal, multi-modal data (speech, vision, text) · "CI/CD" ≈ continuous integration / continuous deployment, continuous delivery · "RESTful APIs" ≈ REST APIs, REST
Check my résumé against these keywordsHiring at Hippocratic AI
Open senior roles RoleStack tracks right now, posted in the last 30 days.
More open roles at Hippocratic AI
Full job description from Hippocratic AI
From Hippocratic AI's posting. View the original
SENIOR SOFTWARE ENGINEER
ABOUT THE ROLE
Hippocratic AI's AI agents are already working inside real hospitals and health systems — this role owns the backend infrastructure that keeps them fast, reliable, and ready to scale as that footprint grows. You'll architect systems built for tomorrow's volume, not just today's, working closely with data scientists, ML engineers, and product managers to turn healthcare requirements into production-grade infrastructure.
Show full description Show less
WHAT YOU'LL DO
Build Scalable, Reliable AI Infrastructure
- Architect backend systems that sustain 99.9%+ uptime for high-volume healthcare data and LLM processing as usage grows exponentially
- Implement monitoring that surfaces issues before they reach production AI agents
- Own performance and reliability improvements across backend systems in collaboration with data scientists and ML engineers
Engineer Data Pipelines for Healthcare AI
- Design data pipelines that ingest, process, and prepare large-scale, multi-modal (speech, vision, text) healthcare datasets for training and inference with minimal latency
- Build tag management and metadata systems that make large datasets organized and retrievable
- Develop and optimize infrastructure supporting data ingestion, feature extraction, and tagging workflows
Ship APIs and ML Enablement
- Develop APIs and microservices that reduce processing time and improve responsiveness for AI model interaction and data retrieval
- Build infrastructure that makes ML workflows reproducible end-to-end, from data preparation through model deployment
- Accelerate time-to-production for new AI capabilities
LOCATION AND TRAVEL
We believe the best ideas happen together. To support fast collaboration and a strong team culture, this role is expected to be in our Menlo Park office five days a week.
WHAT YOU BRING
MUST-HAVE
- Bachelor's degree in Computer Science, Computer Engineering, or a related field (Master's preferred)
- 4+ years of backend development experience using Python, Golang, or similar languages
- Experience building and maintaining multi-modal (speech, vision, text) data pipelines using Ray, Apache Airflow, or similar for distributed processing and model experimentation, including distributed computing frameworks like Spark or Hadoop
- Familiarity with relational database systems and RESTful APIs
- Basic understanding of cloud infrastructure (AWS, GCP, or similar)
NICE-TO-HAVE
- Exposure to AI/ML concepts or experience working with LLMs
- Experience working in teams that handle sensitive or regulated data
- Familiarity with gRPC, GraphQL, or similar
- Experience with real-time audio
- Exposure to DevOps concepts — CI/CD, deployment, Terraform, build systems
- Experience with data science
WHAT SUCCESS LOOKS LIKE
Within 6-12 months, the backend systems you've built or hardened are sustaining 99.9%+ uptime under exponential growth in healthcare data and LLM traffic. New AI capabilities move from data preparation to production faster because the ML workflows and pipelines you designed are reproducible end-to-end. Your monitoring catches issues before they ever reach a live AI agent in a hospital setting.
WHY JOIN HIPPOCRATIC AI
Reinvent healthcare with AI that puts safety first. We’re building the world’s first healthcare‑only, safety‑focused LLM — a breakthrough platform designed to transform patient outcomes at a global scale. This is category creation.
Work with the people shaping the future. Hippocratic AI was co‑founded by CEO Munjal Shah and a team of physicians, hospital leaders, AI pioneers, and researchers from institutions like El Camino Health, Johns Hopkins, Washington University in St. Louis, Stanford, Google, Meta, Microsoft, and NVIDIA.
Backed by the world’s leading healthcare and AI investors. We recently raised a $126M Series C at a $3.5B valuation, led by Avenir Growth, bringing total funding to $404M with participation from CapitalG, General Catalyst, a16z, Kleiner Perkins, Premji Invest, UHS, Cincinnati Children’s, WellSpan Health, John Doerr, Rick Klausner, and others.
Build alongside the best in healthcare and AI. Join experts who’ve spent their careers improving care, advancing science, and building world‑changing technologies — ensuring our platform is powerful, trusted, and truly transformative.
EQUAL OPPORTUNITY
Hippocratic AI is an equal opportunity employer. We do not discriminate on the basis of race, color, religion, national origin, sex, age, disability, sexual orientation, gender identity or expression, genetic information, military or veteran status, or any other characteristic protected by applicable law. We are committed to building a team that reflects the patients we serve. We actively encourage applications from candidates of all backgrounds. If you require accommodations during the hiring process, please contact people@hippocraticai.com.
Please be aware of recruitment scams impersonating Hippocratic AI. All recruiting communication will come from @hippocraticai.com http://hippocraticai.com email addresses. We will never request payment or sensitive personal information during the hiring process.
FAQ
How much experience do you need?
The posting asks for 4+ years in backend development. It is a senior-level role.
Does Hippocratic AI sponsor visas for this role?
The posting does not say whether visa sponsorship is available. Ask the recruiter before you apply.
Is this role remote?
It is an on-site role.
What tools and technologies does the posting mention?
Python, Golang, Ray, Apache Airflow, Spark, Hadoop, RESTful APIs, AWS, GCP, LLMs, gRPC, GraphQL, CI/CD, Terraform, build systems.