Senior Software Engineer, AI Platform
Procore
- Austin, TX
- Hybrid
- Senior level
- 5+ yrs experience
- Platform, Infrastructure & SRE
- Visa: not specified
- $141k–$194k
The role in 30 seconds
Procore is seeking a Senior AI Infrastructure Engineer to keep the platform infrastructure powering its AI agents high-performing, resilient, and cost-efficient as customer adoption scales. The role partners with application engineers, data scientists, and platform teams to build multi-cloud deployment pipelines, scale vector databases, and optimize a multi-provider LLM gateway across GCP and AWS. It reports to the VP of Engineering and is a hybrid role based in Austin, TX.
Is this role a fit for you?
The backgrounds this role is most likely to hire from, as RoleStack reads the posting.
Strong match
- Data platform / ML pipeline
- B2B infrastructure / API / developer tools
- Enterprise-scale
- Growth-stage
Workable stretch
- B2B enterprise platform / workflow software
- Internal tooling / back-office systems
- Regulated environment
Harder transition
- B2C consumer-facing application
- Embedded systems / hardware-adjacent
- Startup / greenfield
Industry: Construction technology / SaaS AI platform. See your personal match score
What they're really screening for
Must-haves
- CORE 5+ years of experience building and operating production infrastructure at scale
- CORE Deep hands-on expertise across Google Cloud (GKE, Vertex AI, IAM, VPC networking, BigQuery, Cloud Monitoring)
- CORE Proven AWS production experience (EKS, Lambda, IAM, RDS/Aurora, SQS/SNS)
- CORE Infrastructure management using Terraform across multi-cloud environments
- CORE Production Kubernetes expertise, including autoscaling, resource tuning, cluster lifecycle management, Helm, and GitOps workflows (Argo CD or equivalent)
- CORE Practical experience running LLMs in production via provider APIs, including quota management, load balancing, and multi-provider routing (Vertex AI, Bedrock, Anthropic)
- CORE Demonstrated experience deploying and operating distributed vector databases, search engines, and stateful data stores on Kubernetes
- CORE Strong background in observability design, including defining meaningful alert policies, SLOs, Datadog dashboards, and incident response runbooks
- PLUS Track record of executing measurable performance and cost optimizations across cloud architectures, with the ability to clearly articulate engineering trade-offs
- PLUS Bachelor's degree in Computer Science, a related technical field, or equivalent practical experience
Nice-to-haves
- PLUS Senior MLOps Engineer / AI Platform Engineer background
- PLUS Senior Cloud Infrastructure Engineer (GCP / AWS) background
- PLUS Senior Site Reliability Engineer (Kubernetes & Stateful Distributed Systems) background
- PLUS Platform / Developer Experience Engineer (AI/ML Enablement) background
Résumé keywords for this role
Terms the posting stresses. Include the ones you can honestly back up.
Tools & technologies
- Google Cloud
- GCP
- AWS
- GKE
- EKS
- Vertex AI
- Amazon Bedrock
- Anthropic
- Kubernetes
- Terraform
- Helm
- Argo CD
- Lambda
- IAM
- VPC networking
Concepts & phrases
- Senior Software Engineer, AI Platform
- AI Infrastructure Engineer
- multi-cloud deployment pipelines
- multi-provider LLM gateway
- production infrastructure at scale
- GPU-backed self-hosted model serving
- regional availability routing
- provider fallback
- cluster lifecycle management
- GitOps workflows
- distributed vector databases
- stateful data stores
- observability design
- incident response runbooks
- performance and cost optimizations
Words that count as the same thing: "GKE" ≈ Google Kubernetes Engine, Kubernetes on GCP · "EKS" ≈ Amazon Elastic Kubernetes Service, Kubernetes on AWS · "GitOps" ≈ Argo CD, Flux, declarative continuous delivery · "LLM gateway" ≈ LLM routing layer, model gateway, multi-provider LLM proxy · "SLOs" ≈ Service Level Objectives, service-level objectives
Check my résumé against these keywordsHiring at Procore
Open senior roles RoleStack tracks right now, posted in the last 30 days.
More open roles at Procore
- Principal Software Engineer - Infrastructure Platform $198k–$273k
- Senior Manager, Analytics Engineering & Data Science $198k–$273k
- Senior Software Engineer $141k–$194k
- Staff Software Engineer - Networking $169k–$232k
- Senior Business Systems Analyst, Process Improvement $95k–$130k
Full job description from Procore
From Procore's posting. View the original
Procore Technologies is the leading technology partner for every stage of construction. We empower construction teams to drive efficiency and mitigate risk through actionable AI & data-driven insights. For over 20 years, we have been transforming the industry with purpose-built solutions for construction professionals and we’re looking for talented people to help us build together.
We are looking for a Senior AI Infrastructure Engineer to ensure the platform infrastructure powering our AI agents remains high-performing, resilient, and cost-efficient as customer adoption scales. As the Senior AI Infrastructure Engineer on our AI Infrastructure team, you will work closely with application engineers, data scientists, and platform teams to build multi-cloud deployment pipelines, scale vector databases, and optimize our multi-provider LLM gateway. Your strengths in multi-cloud infrastructure (GCP/AWS), Kubernetes orchestration, and AI/LLM production operations will drive your success.
Show full description Show less
You will report to the VP of Engineering and will be a 2 days per week hybrid role based in our Austin, TX office.
What You’ll Do
• Operate, scale, and maintain production workloads across Google Cloud and AWS to provide a resilient, unified multi-cloud foundation for Procore's AI agent portfolio.
• Manage production AI model workloads across Vertex AI, Amazon Bedrock, and Anthropic, implementing explicit provider fallback, regional availability routing, and GPU-backed self-hosted model serving on Kubernetes.
• Optimize Kubernetes (GKE and EKS) clusters through precision resource requests, limits, and dynamic autoscaling to ensure compute fleets scale efficiently with real-time customer demand.
• Proactively plan capacity and right-size stateful backends, queues, BigQuery storage, and vector databases using empirical workload patterns and growth forecasts to keep production ahead of customer usage.
• Lead the lifecycle management, staging rollouts, upgrades, and automated rollback strategies for production databases and search infrastructure to eliminate downtime and mitigate operational risk.
• Establish comprehensive service-level objectives (SLOs), automated alerting, distributed agent tracing, and Datadog monitoring that reflect true user experience and eliminate operational noise.
• Build secure, modern CI/CD pipelines, reproducible staging environments, and developer tooling to accelerate software delivery and empower application engineers building on the AI platform.
What You Bring
• 5+ years of experience building and operating production infrastructure at scale, with deep hands-on expertise across Google Cloud (GKE, Vertex AI, IAM, VPC networking, BigQuery, Cloud Monitoring).
• Proven AWS production experience (EKS, Lambda, IAM, RDS/Aurora, SQS/SNS) and infrastructure management using Terraform across multi-cloud environments.
• Production Kubernetes expertise, including autoscaling, resource tuning, cluster lifecycle management, Helm, and GitOps workflows (Argo CD or equivalent).
• Practical experience running LLMs in production via provider APIs, including quota management, load balancing, and multi-provider routing (Vertex AI, Bedrock, Anthropic).
• Demonstrated experience deploying and operating distributed vector databases, search engines, and stateful data stores on Kubernetes.
• Strong background in observability design, including defining meaningful alert policies, SLOs, Datadog dashboards, and incident response runbooks.
• Track record of executing measurable performance and cost optimizations across cloud architectures, with the ability to clearly articulate engineering trade-offs.
• Bachelor's degree in Computer Science, a related technical field, or equivalent practical experience.
Strong-fit Background Might Include
• Senior MLOps Engineer / AI Platform Engineer
• Senior Cloud Infrastructure Engineer (GCP / AWS)
• Senior Site Reliability Engineer (Kubernetes & Stateful Distributed Systems)
• Platform / Developer Experience Engineer (AI/ML Enablement)
Discover our recruiting process and interview tips from our talent acquisition team on our #LifeAtProcore blog.
Additional Information
Base Pay Range:
140,960.00 - 193,820.00 USD Annual
This role may also be eligible for Equity Compensation and/or Bonus Incentive Compensation. Procore is committed to offering competitive, fair, and commensurate compensation. Actual compensation will be based on a candidate’s job-related skills, experience, education or training, and location.
For Los Angeles County (unincorporated) Candidates:
Procore will consider for employment all qualified applicants, including those with arrest or conviction records, in accordance with the requirements of applicable federal, state, and local laws, including the City of Los Angeles’ Fair Chance Initiative for Hiring Ordinance, the Los Angeles County Fair Chance Ordinance for Employers, and the California Fair Chance Act.
A criminal history may have a direct, adverse, and negative relationship on the following job duties, potentially resulting in the withdrawal of the conditional offer of employment: 1. appropriately managing, accessing, and handling confidential information including proprietary and trade secret information, as well as accessing Procore's information technology systems and platforms; 2. interacting with and occasionally having unsupervised contact with internal/external customers, stakeholders, and/or colleagues; and 3. exercising sound judgment.
FAQ
How much does a Senior Software Engineer, AI Platform at Procore make?
The posted pay for this role is $141k–$194k a year.
How much experience do you need?
The posting asks for 5+ years in production infrastructure engineering. It is a senior-level role.
Does Procore sponsor visas for this role?
The posting does not say whether visa sponsorship is available. Ask the recruiter before you apply.
Is this role remote?
It is a hybrid role: part remote, part in the office.
What tools and technologies does the posting mention?
Google Cloud, GCP, AWS, GKE, EKS, Vertex AI, Amazon Bedrock, Anthropic, Kubernetes, Terraform, Helm, Argo CD, Lambda, IAM, VPC networking.