Head of Platform Software
D-Matrix
- Santa Clara, CA
- Hybrid
- Director+ level
- 12+ yrs experience
- Platform Software Engineering
- Visa: not specified
- $220k–$330k
The role in 30 seconds
At D-Matrix, we are building the future of AI inference with a novel memory-centric architecture. As the Head of Platform Software, you will lead the team responsible for the entire physical platform layer, ensuring our AI accelerator systems power on, remain healthy, and are ready for workloads. This role involves owning node and rack bring-up, device health, fault detection, and firmware integration, defining the critical interface between hardware and the workload stack.
Is this role a fit for you?
The backgrounds this role is most likely to hire from, as RoleStack reads the posting.
Strong match
- B2B infrastructure / API / developer tools
- Internal tooling / back-office systems
- B2B enterprise platform / workflow software
- Data platform / ML pipeline
- Enterprise-scale (high availability, compliance, large distributed systems)
Workable stretch
- Creator / builder / self-serve tool
- Marketplace / multi-sided platform
- Startup / greenfield (build from scratch, speed over polish)
Harder transition
- B2C consumer-facing application
- Embedded systems / hardware-adjacent
- Regulated environment (healthcare, finance, government)
Industry: Software, SaaS & AI Platform. See your personal match score
What they're really screening for
Must-haves
- PLUS Bachelor’s degree in Computer Science, Electrical or Computer Engineering, or a related field, or equivalent practical experience.
- CORE 12+ years in systems software, including substantial experience with rack-scale, cluster-scale, or large server infrastructure.
- CORE Track record of taking a platform or infrastructure program from design to shipped software with milestones.
- CORE Depth in several of the following: hardware bring-up, device and firmware interfaces, BMC and out-of-band management, fleet management, and fault handling.
- CORE Hands-on experience with BMC and out-of-band management standards (Redfish, OpenBMC, PLDM) and firmware update frameworks.
- CORE Experience building and leading engineering teams, including hiring, growing leaders, and managing cross-functional dependencies.
- PLUS Strong judgment in interface and contract design between systems layers.
Nice-to-haves
- PLUS Master’s degree in a related field.
- CORE Experience with accelerator or GPU infrastructure, including taking a new hardware platform from early silicon through first customer deployments.
- CORE Experience with high-speed interconnect and fabric software such as PCIe, NVLink-class, CXL, RDMA, InfiniBand, or Ethernet-based fabrics, including heterogeneous rack-scale designs where multiple vendors’ compute shares one fabric.
- PLUS Experience with Kubernetes, device plugins, and cluster lifecycle tooling.
Résumé keywords for this role
Terms the posting stresses. Include the ones you can honestly back up.
Tools & technologies
- AI
- inference
- memory-centric architecture
- AI infrastructure
- chips
- software
- rack-scale systems
- platform software
- hardware
- device
- link
- firmware
- BMC
- fleet
- fabric manager
Concepts & phrases
- Head of Platform Software
- AI inference
- memory-centric architecture
- AI infrastructure
- rack-scale systems
- platform software layer
- hardware bring-up
- device and link discovery
- health, fault detection
- readiness gating
- firmware and BMC integration
- bring-up and fleet tooling
- fabric manager
- runtime
- schedulers
Words that count as the same thing: "AI inference" ≈ AI acceleration, ML inference · "rack-scale AI accelerator system" ≈ cluster-scale AI system, large-scale AI infrastructure · "platform software layer" ≈ infrastructure software, low-level system software · "fabric manager" ≈ interconnect manager, network fabric controller · "runtime" ≈ execution environment, application runtime
Check my résumé against these keywordsHiring at D-Matrix
Open senior roles RoleStack tracks right now, posted in the last 30 days.
Full job description from D-Matrix
From D-Matrix's posting. View the original
Join d-Matrix and help build the future of AI inference. We’ve pioneered a memory-centric architecture that brings compute directly into memory, making AI faster, more energy efficient, and accessible on a global scale. From chips and software to rack-scale systems, our team is tackling some of AI infrastructure’s hardest challenges — and shipping breakthrough technology today. If you want to create what comes next and help make infinite inference possible, we’d love to hear from you.
Show full description Show less
Our culture is built on respect, collaboration, and direct communication. We value humility, we believe our different perspectives lead to better solutions, and we’re looking for people who are driven by execution and energized by hard problems.
Role Overview
The platform software layer sits between hardware bring-up and the workload stack. It determines whether a rack-scale AI accelerator system powers on, joins its fabric, passes validation, and stays healthy in the field. As the senior leader of platform software, you will own the physical platform layer: device and link discovery, health, fault detection, readiness gating, firmware and BMC integration, and bring-up and fleet tooling. You will build the team that delivers it and publish a clean, versioned interface to the fabric manager, runtime, and schedulers above it. You will partner closely with hardware, runtime, diagnostics, validation, deployment, operations, and product teams.
What you will do
- Own node, rack, and cluster bring-up software, including discovery, provisioning, configuration, and readiness gating before any workload traffic, in partnership with the fabric software team.
- Define and maintain a versioned interface between the platform layer and the workload stack (fabric manager, runtime, and schedulers), with explicit state transitions and events pushed to consumers rather than inferred.
- Own device and link discovery and health, and publish normalized state and events for devices and links across their lifecycle.
- Drive fault detection and classification, including severity-based handling, escalation paths, and hand-offs to recovery owners and data center operations.
- Own firmware, BMC, and low-level platform software integration, packaging, and update flows.
- Deliver health telemetry, diagnostics integration, and fleet monitoring for deployed clusters, and integrate with orchestration so the platform layer owns device and fabric readiness.
- Build tooling and recipes to turn up, stabilize, and hand off initial clusters to production operations at a defined readiness threshold, with feedback loops to hardware, diagnostics, manufacturing, and field teams.
- Hire and lead the platform software team, owning technical direction, milestones, quality, and on-call, and convert open architecture documents into owned, dated deliverables.
What you will bring
- Bachelor’s degree in Computer Science, Electrical or Computer Engineering, or a related field, or equivalent practical experience.
- 12+ years in systems software, including substantial experience with rack-scale, cluster-scale, or large server infrastructure.
- Track record of taking a platform or infrastructure program from design to shipped software with milestones.
- Depth in several of the following: hardware bring-up, device and firmware interfaces, BMC and out-of-band management, fleet management, and fault handling.
- Hands-on experience with BMC and out-of-band management standards (Redfish, OpenBMC, PLDM) and firmware update frameworks.
- Experience building and leading engineering teams, including hiring, growing leaders, and managing cross-functional dependencies.
- Strong judgment in interface and contract design between systems layers.
Preferred Qualifications
- Master’s degree in a related field.
- Experience with accelerator or GPU infrastructure, including taking a new hardware platform from early silicon through first customer deployments.
- Experience with high-speed interconnect and fabric software such as PCIe, NVLink-class, CXL, RDMA, InfiniBand, or Ethernet-based fabrics, including heterogeneous rack-scale designs where multiple vendors’ compute shares one fabric.
- Experience with Kubernetes, device plugins, and cluster lifecycle tooling.
Equal Opportunity Employment Policy
d-Matrix is proud to be an equal opportunity workplace and affirmative action employer. We’re committed to fostering an inclusive environment where everyone feels welcomed and empowered to do their best work. We hire the best talent for our teams, regardless of race, religion, color, age, disability, sex, gender identity, sexual orientation, ancestry, genetic information, marital status, national origin, political affiliation, or veteran status. Our focus is on hiring teammates with humble expertise, kindness, dedication, and a willingness to embrace challenges and learn together every day.
d-Matrix does not accept resumes or candidate submissions from external agencies. We appreciate the interest and effort of recruitment firms, but we kindly request that individuals interested in opportunities with d-Matrix apply directly through our official channels. This approach allows us to streamline our hiring processes and maintain a consistent and fair evaluation of all applicants. Thank you for your understanding and cooperation.
FAQ
How much does a Head of Platform Software at D-Matrix make?
The posted pay for this role is $220k–$330k a year.
How much experience do you need?
The posting asks for 12+ years in systems software. It is a director+-level role.
Does D-Matrix sponsor visas for this role?
The posting does not say whether visa sponsorship is available. Ask the recruiter before you apply.
Is this role remote?
It is a hybrid role: part remote, part in the office.
What tools and technologies does the posting mention?
AI, inference, memory-centric architecture, AI infrastructure, chips, software, rack-scale systems, platform software, hardware, device, link, firmware, BMC, fleet, fabric manager.