Staff Software Engineer ML Platform (6244)
Shield AI
- San Diego, CA ; San Mateo, CA
- On-site
- Staff/Principal level
- Platform Engineering
- Visa: not specified
- $200k–$300k
The role in 30 seconds
Shield AI is seeking a Staff Software Engineer to build backend services for their ML platform, focusing on experiment tracking and model registry functionalities. This role is crucial for enabling reliable ML workflows, allowing engineers to reproduce results, manage model artifacts, and simplify the process of moving trained models into production, all within the context of defense-tech and autonomy systems.
Is this role a fit for you?
The backgrounds this role is most likely to hire from, as RoleStack reads the posting.
Strong match
- B2B infrastructure / API / developer tools
- Platform, Infrastructure & SRE
- AI/ML Platform
- Internal tooling / back-office systems
- Enterprise-scale
Workable stretch
- B2B enterprise platform / workflow software
- Creator / builder / self-serve tool
- Startup / greenfield
Harder transition
- B2C consumer-facing application
- Embedded systems / hardware-adjacent
- Marketplace / multi-sided platform
- Data platform / ML pipeline
Industry: Defense & Aerospace. See your personal match score
What they're really screening for
Must-haves
- CORE Experience building production backend services for machine-learning platforms or data-intensive workflows.
- CORE Strong software engineering skills in Python or a comparable backend language.
- CORE Experience designing APIs, metadata models and persistent state for services used by other engineers.
- CORE Experience handling storage, partial failures, retries and consistency in distributed systems.
- CORE Understanding of training runs, checkpoints and model versioning.
- CORE Ability to work directly with machine-learning users and deliver maintainable software that solves their workflow problems.
- PLUS Experience with MLflow, Weights & Biases, model registries or comparable experiment-management tools.
- PLUS Experience integrating Kubernetes jobs, object storage or machine-learning workflow systems.
- PLUS Experience with reproducibility, data provenance or evaluation records.
- PLUS Experience supporting open-source software or on-premises and air-gapped deployments.
Résumé keywords for this role
Terms the posting stresses. Include the ones you can honestly back up.
Tools & technologies
- Python
- MLflow
- Weights & Biases
- Kubernetes
- API
- metadata models
- distributed systems
- object storage
- ML workflow systems
- open-source
Concepts & phrases
- Staff Software Engineer ML Platform
- Senior Software Engineer
- experiment-tracking and model-registry services
- MLflow where appropriate
- exact dataset, code and configuration versions
- training runs, checkpoints and model versions
- APIs and adapters
- training jobs, data services and artifact storage
- interrupted or failed workflows
- reliable state handling, retries and useful diagnostics
- checkpoints, model artifacts and evaluation results
- machine-learning engineers
- simplify their workflows
- manual record keeping
- tested services with observability
Words that count as the same thing: "machine-learning engineers" ≈ ML engineers · "model versioning" ≈ version control for models · "experiment-tracking" ≈ experiment management · "model registries" ≈ model catalog, model repository · "data provenance" ≈ data lineage
Check my résumé against these keywordsHiring at Shield AI
Open senior roles RoleStack tracks right now, posted in the last 30 days.
More open roles at Shield AI
- Staff Engineer, Reliability (R6517) $156k–$234k
- Senior Engineer, Component (R6605) $121k–$182k
- Senior Staff Engineer, System Security (R6509) $175k–$262k
- Senior Staff Technical Program Manager - Mission Autonomy $184k–$276k
- Sr. Staff Solutions Architect – HCM (R6255) $148k–$267k
Full job description from Shield AI
From Shield AI's posting. View the original
Shield AI is a venture-backed defense-tech company with the mission of protecting service members and civilians with intelligent systems. Its products include Hivemind autonomy software, V-BAT and X-BAT aircraft, and Aechelon simulation and synthetic reality technologies. With offices and facilities across the U.S., Europe, the Middle East, and Asia-Pacific, Shield AI’s technology actively supports operations worldwide. For more information, visit www.shield.ai. Follow Shield AI on LinkedIn, X, Instagram, and YouTube.
Show full description Show less
Job Description:
Model development produces experiments, checkpoints, evaluation results and many versions of the same model. Keeping those records connected lets engineers reproduce results, compare approaches and move a trained model into use.
We are looking for a Senior Software Engineer to build the backend services that make those workflows reliable. You will connect training runs to their data, code and configuration, manage model artifacts and help machine-learning engineers spend less time reconstructing what happened in an experiment.
• Build experiment-tracking and model-registry services, integrating tools such as MLflow where appropriate.
• Connect exact dataset, code and configuration versions to training runs, checkpoints and model versions.
• Develop APIs and adapters that connect training jobs, data services and artifact storage.
• Make interrupted or failed workflows recoverable through reliable state handling, retries and useful diagnostics.
• Make checkpoints, model artifacts and evaluation results easy to find and retrieve for further training, evaluation or deployment.
• Work directly with machine-learning engineers to simplify their workflows and reduce manual record keeping.
• Deliver tested services with observability and compatible upgrades across supported cloud and customer-managed environments.
• Engineers can trace a model version back to the data, code, configuration and run that produced it.
• Checkpoints and evaluation evidence remain available when jobs fail or workflows change.
• Developers can compare experiments and retrieve model artifacts through consistent APIs.
• Teams can reproduce results without manually reconstructing experiment history.
• Experience building production backend services for machine-learning platforms or data-intensive workflows.
• Strong software engineering skills in Python or a comparable backend language.
• Experience designing APIs, metadata models and persistent state for services used by other engineers.
• Experience handling storage, partial failures, retries and consistency in distributed systems.
• Understanding of training runs, checkpoints and model versioning.
• Ability to work directly with machine-learning users and deliver maintainable software that solves their workflow problems.
• Experience with MLflow, Weights & Biases, model registries or comparable experiment-management tools.
• Experience integrating Kubernetes jobs, object storage or machine-learning workflow systems.
• Experience with reproducibility, data provenance or evaluation records.
• Experience supporting open-source software or on-premises and air-gapped deployments.
The AI Factory is the foundation for how Shield AI develops and deploys autonomy.
As a Senior Staff Engineer, you will help build the reference architecture used internally by our engineering teams and delivered to customers building their own AI capabilities. Your work will directly impact how quickly researchers can iterate, how efficiently compute resources are utilized, and how AI systems move from experimentation to operational deployment.
This is an opportunity to work at the intersection of modern AI, distributed systems, Kubernetes, and defense, building a platform that enables the next generation of autonomy systems while leveraging the best of the open-source AI ecosystem.
FAQ
How much does a Staff Software Engineer ML Platform (6244) at Shield AI make?
The posted pay for this role is $200k–$300k a year.
Does Shield AI sponsor visas for this role?
The posting does not say whether visa sponsorship is available. Ask the recruiter before you apply.
Is this role remote?
It is an on-site role.
What tools and technologies does the posting mention?
Python, MLflow, Weights & Biases, Kubernetes, API, metadata models, distributed systems, object storage, ML workflow systems, open-source.