Senior Test Automation Engineer
Rad AI
- Remote - US ; San Francisco, CA
- Remote
- Senior level
- 6+ yrs experience
- Quality Assurance
- Visa: not specified
- $150k–$185k
The role in 30 seconds
At Rad AI, we are on a mission to transform healthcare with artificial intelligence, revolutionizing radiology by saving time, reducing burnout, and improving patient care. As a Senior Test Automation Engineer, you will be the quality and automation expert for your product domain, owning test automation strategy and designing scalable frameworks to ensure the reliability and quality of AI-driven healthcare solutions.
Is this role a fit for you?
The backgrounds this role is most likely to hire from, as RoleStack reads the posting.
Strong match
- Software, SaaS & AI Platform
- B2B enterprise platform / workflow software
- B2B infrastructure / API / developer tools
- Growth-stage
- Startup / greenfield
Workable stretch
- Internal tooling / back-office systems
- Creator / builder / self-serve tool
- Marketplace / multi-sided platform
- Enterprise-scale
Harder transition
- B2C consumer-facing application
- Embedded systems / hardware-adjacent
- Data platform / ML pipeline
- Regulated environment
Industry: Healthcare & Life Sciences. See your personal match score
What they're really screening for
Must-haves
- CORE 6+ years of software engineering or test automation experience, including 3+ years designing and owning automation frameworks.
- CORE Strong programming skills in TypeScript and/or Python; experience with an object-oriented language such as C# or Java is a plus.
- CORE Deep experience with end-to-end frameworks such as Playwright, Selenium, or Cypress.
- CORE API testing experience across REST and GraphQL services (for example ASP.NET http://ASP.NET Core Minimal API, FastAPI, Postman), including how tests interact with data and downstream dependencies.
- CORE Experience building tests into CI/CD pipelines such as GitHub Actions or CircleCI, including PR-level gating, parallelization, and reporting.
- CORE A track record of reducing flakiness and suite runtime, backed by data.
- CORE Experience with risk-based test strategy for integration-heavy systems that run across many customer configurations.
- CORE Strong debugging skills across services, data, and environments, with working knowledge of SQL, logs, and observability tools.
- CORE A shift-left mindset: you've helped developers own their tests rather than owning every test yourself.
- CORE Hands-on use of AI tools to write, maintain, and triage tests, with the judgment to review what they produce.
Nice-to-haves
- PLUS Worked in healthcare or another regulated environment (HIPAA, PHI, SOC 2), ideally at a startup.
- PLUS Familiar with radiology systems: PACS, RIS, dictation platforms such as PowerScribe or Fluency, HL7/FHIR, FHIRcast, or DICOM.
- PLUS Automated Windows desktop or Electron applications, for example with WinAppDriver or UI Automation.
- PLUS Tested ML, AI, or speech systems where outputs aren't deterministic.
- PLUS Owned performance or load testing, or integrated security checks into pipelines.
- PLUS Worked with AWS or Google Cloud, and provisioned test environments with tools like Docker or Terraform.
- PLUS Used a test case management system such as Testmo, or built quality dashboards in tools like Grafana.
Résumé keywords for this role
Terms the posting stresses. Include the ones you can honestly back up.
Tools & technologies
- TypeScript
- Python
- C#
- Java
- Playwright
- Selenium
- Cypress
- REST
- GraphQL
- ASP.NET Core Minimal API
- FastAPI
- Postman
- GitHub Actions
- CircleCI
- CI/CD
Concepts & phrases
- Senior Test Automation Engineer
- transform healthcare with artificial intelligence
- AI-driven solutions
- revolutionizing radiology
- proprietary radiology report datasets
- AI-assisted test generation
- customer-matched environments
- non-deterministic outputs
- escaped defects
- shift-left mindset
- influence without authority
- regulated environment
- HIPAA, PHI, SOC 2
- radiology systems
- PACS, RIS
Words that count as the same thing: "shift-left" ≈ early testing, developer-owned testing, preventative quality · "flakiness" ≈ unreliable tests, intermittent failures, noisy test results · "telemetry" ≈ observability, monitoring data, logging
Check my résumé against these keywordsHiring at Rad AI
Open senior roles RoleStack tracks right now, posted in the last 30 days.
More open roles at Rad AI
- Senior Implementation Project Manager $125k–$160k
- Senior Software Engineer - Health Data Platform $187k–$224k
- Senior Software Engineer, Full Stack - Reporting Product $150k–$224k
- Head of Quality Engineering $215k–$250k
Full job description from Rad AI
From Rad AI's posting. View the original
ABOUT RAD AI
At Rad AI, we’re on a mission to transform healthcare with artificial intelligence. Founded by a radiologist, our AI-driven solutions are revolutionizing radiology—saving time, reducing burnout, and improving patient care. With one of the largest proprietary radiology report datasets in the world, our AI has helped uncover hundreds of new cancer diagnoses and reduced error rates in tens of millions of radiology reports by nearly 50%.
Show full description Show less
Rad AI has secured over $140M in funding, including a recently oversubscribed Series C ($68M round) led by Transformation Capital, bringing our valuation to $528M. Our investors include Khosla Ventures, World Innovation Lab, Gradient Ventures, Cone Health Ventures, and others—all backing our mission to empower physicians with cutting-edge AI.
Our latest advancements in generative AI are used by thousands of radiologists daily, supporting more than one-third of radiology groups and healthcare systems and nearly 50% of all medical imaging in the U.S. at partners including Cone Health, Jefferson Einstein Health, Geisinger, Guthrie Healthcare System, and Henry Ford Health.
Recognized as one of the most promising healthcare AI companies by CB Insights and AuntMinnie https://www.radai.com/news/auntminnie-recognizes-rad-ai-omni-reporting-as-2023s-best-new-radiology-software, and ranked by Deloitte https://www2.deloitte.com/us/en/pages/technology-media-and-telecommunications/articles/fast500-winners.html as the 19th fastest-growing company in North America, we are building AI-powered solutions that make a real impact. Most recently, Rad AI was named to CNBC’s Disruptor 50 https://www.cnbc.com/2025/06/10/2025-cnbc-disruptor-50-see-the-full-list-of-companies.html list, highlighting the innovation and momentum behind our mission.
If you’re ready to shape the future of healthcare, we’d love to have you on our team!
WHY WE NEED YOU
Radiologists use our products every day to produce the reports that decide what care a patient gets next. A missed regression here isn't an inconvenience; it's a blank report after signing, a missing accession, or a formatting error in a clinical impression. That's not a context where "good enough" ships.
Our quality engineers are embedded in product teams across Reporting, Impressions, Continuity, Speech, and Interop. Some areas already run PR-level checks, developer-written end-to-end tests, AI-assisted test creation, and automated regression triage. We're now building one quality operating model so those practices hold in every product area, and so testing reflects how radiologists actually work.
Our principle: Engineering owns quality; Quality owns the quality system. As a Senior Test Automation Engineer, you'll own test automation strategy for a product domain. You'll design automation that engineers build on, make release risk explicit, and help us move from catching defects to preventing them.
HERE'S WHAT YOU'LL BE DOING
You'll be the quality and automation expert for your product domain, where you'll:
- Own test automation strategy for your domain. Decide what to test, at which level, and why, across complex features and the teams that build them. Balance short-term delivery with the long-term health of our test suites.
- Design automation others build on. Build scalable, maintainable frameworks, fixtures, and utilities that engineers use to write their own tests. Partner with engineers to improve testability, and use AI-assisted test generation where it raises quality and speed.
- Make release risk explicit. Run pre-release risk assessments, build the test matrix across integrations, environments, and customer workflows, and lead test planning for high-risk releases and hotfixes. Help define the go/no-go signals your domain ships on.
- Test the way radiologists work. Turn radiologist personas and real workflows into test cases. Bring customer-matched environments into validation, such as Windows and Electron workstations, dictation systems, and PACS/RIS integrations, and use exploratory testing where automation falls short.
- Keep the test signal trustworthy. Drive down flaky and low-signal tests, triage failures quickly, cut suite execution time, and improve test data and environment stability with our platform teams.
- Lead non-functional quality in your domain. Lead or co-lead performance and load testing, security checks in pipelines, and accessibility and compliance coverage such as HIPAA-related auditability.
- Test AI systems responsibly. Design evaluations for non-deterministic outputs, such as speech recognition and generated impressions, that don't hinge on a single result.
- Turn escaped defects into prevention. Use incident reviews and customer-reported defects to add regression coverage and update risk profiles, so the same failure doesn't reach a radiologist twice.
- Use data to guide decisions. Track escaped defects, test stability, and time to detect for your domain, and keep suites organized in our test case management system so results are visible and comparable.
- Raise the bar around you. Mentor TAEs and software engineers across teams, act as a trusted quality partner to Engineering Managers on risk and release readiness, and contribute to hiring, onboarding, and our Quality community.
WHO WE'RE LOOKING FOR
1. 6+ years of software engineering or test automation experience, including 3+ years designing and owning automation frameworks.
2. Strong programming skills in TypeScript and/or Python; experience with an object-oriented language such as C# or Java is a plus.
3. Deep experience with end-to-end frameworks such as Playwright, Selenium, or Cypress.
4. API testing experience across REST and GraphQL services (for example ASP.NET http://ASP.NET Core Minimal API, FastAPI, Postman), including how tests interact with data and downstream dependencies.
5. Experience building tests into CI/CD pipelines such as GitHub Actions or CircleCI, including PR-level gating, parallelization, and reporting.
6. A track record of reducing flakiness and suite runtime, backed by data.
7. Experience with risk-based test strategy for integration-heavy systems that run across many customer configurations.
8. Strong debugging skills across services, data, and environments, with working knowledge of SQL, logs, and observability tools.
9. A shift-left mindset: you've helped developers own their tests rather than owning every test yourself.
10. Hands-on use of AI tools to write, maintain, and triage tests, with the judgment to review what they produce.
11. Detail-oriented, collaborative, and able to influence without authority, with clear communication and experience mentoring engineers.
IT WOULD BE NICE IF
- You've worked in healthcare or another regulated environment (HIPAA, PHI, SOC 2), ideally at a startup.
- You're familiar with radiology systems: PACS, RIS, dictation platforms such as PowerScribe or Fluency, HL7/FHIR, FHIRcast, or DICOM.
- You've automated Windows desktop or Electron applications, for example with WinAppDriver or UI Automation.
- You've tested ML, AI, or speech systems where outputs aren't deterministic.
- You've owned performance or load testing, or integrated security checks into pipelines.
- You've worked with AWS or Google Cloud, and provisioned test environments with tools like Docker or Terraform.
- You've used a test case management system such as Testmo, or built quality dashboards in tools like Grafana.
Join our world-class team as we build and deploy AI solutions that empower physicians and transform patient care—making a meaningful impact on millions of lives. Driven by our mission, we prioritize transparency, inclusion, and close collaboration, bringing together exceptional people to revolutionize healthcare. If you're passionate about driving innovation and delivering impactful healthcare solutions, we'd love to hear from you!
To learn more about what it's like to work at Rad AI, visit https://www.radai.com/life-at-rad-ai and be sure to follow us on LinkedIn https://www.linkedin.com/company/radai/?utm_campaign=Recruiting_2026&utm_content=recruiting-job-posting-website&utm_source=recru%5B%E2%80%A6%5Db-posting-website to stay up to date!
Location Details:
For roles listed as San Francisco - Onsite:
- This role will be based in our San Francisco office and we expect employees to work onsite four days per week. The remaining time may be worked remotely or onsite, depending on team and business needs.
For roles listed as United States - Remote:
- This role is open to candidates located anywhere in the United States.
For roles listed as San Francisco - Onsite + United States - Remote:
- We will prioritize candidates who can work onsite four days per week in San Francisco, while also considering remote candidates located anywhere in the United States.
For US-Based Full-Time Roles, Rad AI offers a variety of benefits, including:
- Comprehensive Medical, Dental, Vision & Life insurance
- HSA (with employer match), FSA, & DCFSA
- 401(k)
- 11 Paid Company Holidays
- Flexible PTO policy
- Annual company-wide offsite
- Periodic team offsites
- Annual equipment stipend
- For roles based outside the US, your recruiter can share more details
At Rad AI, we value diversity and provide equal employment opportunities (EEO) to all employees and applicants without regard to race, color, religion, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status. We will consider for employment qualified applicants with criminal histories in a manner consistent with the requirements of the San Francisco Fair Chance Ordinance.
Please be vigilant regarding job scams. We advise all candidates to apply directly through our official careers page. Our recruiters will use email addresses with the domain @radai.com http://radai.com or no-reply@ashbyhq.com.
FAQ
How much does a Senior Test Automation Engineer at Rad AI make?
The posted pay for this role is $150k–$185k a year.
How much experience do you need?
The posting asks for 6+ years in software engineering or test automation. It is a senior-level role.
Does Rad AI sponsor visas for this role?
The posting does not say whether visa sponsorship is available. Ask the recruiter before you apply.
Is this role remote?
It is a remote role.
What tools and technologies does the posting mention?
TypeScript, Python, C#, Java, Playwright, Selenium, Cypress, REST, GraphQL, ASP.NET Core Minimal API, FastAPI, Postman, GitHub Actions, CircleCI, CI/CD.