Senior Agentic AI Infrastructure Engineer I - Core Platforms

American Express

  • New York, NY ; Sunrise, FL ; Phoenix, AZ
  • Hybrid
  • Senior level
  • 5+ yrs experience
  • Platform, Infrastructure & SRE
  • No visa sponsorship

The role in 30 seconds

The Enterprise Technology Services organization at American Express supports the delivery and operations of technology, digital, and data capabilities, platforms, and services globally. Specifically, our team is responsible for the company’s technology engineering, architecture, and infrastructure, providing 24x7 support. We also provide product management for core enterprise platforms, and lead technology risk and information security, enterprise data governance and platforms, digital product and design, and enterprise AI platforms on behalf of the company.

Is this role a fit for you?

The backgrounds this role is most likely to hire from, as RoleStack reads the posting.

Strong match

  • B2B infrastructure / API / developer tools
  • Data platform / ML pipeline
  • Internal tooling / back-office systems
  • Enterprise-scale
  • Growth-stage

Workable stretch

  • B2B enterprise platform / workflow software
  • Creator / builder / self-serve tool
  • Startup / greenfield

Harder transition

  • B2C consumer-facing application
  • Marketplace / multi-sided platform
  • Embedded systems / hardware-adjacent
  • Regulated environment

Industry: Financial Services & FinTech. See your personal match score

What they're really screening for

Must-haves

  • CORE Designing infrastructure for AI agents, including agent runtimes, orchestration frameworks, tool integrations, asynchronous execution, and stateful workflows. Examples include LangGraph, Semantic Kernel, and comparable frameworks.
  • CORE Experience applying Agentic AI tools to support infrastructure engineering, platform support, or cloud operations work, including reviewing AI-generated operational insights.
  • CORE Experience validating AI-generated operational outputs and incorporating AI-enabled practices into infrastructure workflows, including AI-assisted operational recommendations requiring human review and approval.
  • CORE Experience with Kubernetes-based AI platforms, containers, workload schedulers, and GPU or accelerator orchestration in cloud or hybrid environments.
  • CORE Experience operating model-serving or inference platforms and optimizing throughput, latency, availability, and cost for production AI workloads.
  • CORE Experience with distributed training or inference infrastructure, high-performance networking and storage, accelerator telemetry, and capacity planning.
  • CORE Experience implementing security, reliability engineering, observability, and FinOps practices for multi-tenant AI infrastructure.
  • CORE 5+ Years of experience in infrastructure engineering, cloud engineering, DevOps, or a related technical field, including at least 2 years of hands-on experience supporting AI-enabled infrastructure, AI automation, or agentic AI technologies.
  • PLUS Bachelor's degree in Computer Science, Information Technology, Engineering, and/or comparable experience; advanced degree preferred
  • PLUS Knowledge of application infrastructure and standards

Nice-to-haves

  • PLUS Advanced degree preferred
  • CORE Mentors junior Infrastructure Engineers and cross-functional team of colleagues, fostering a culture of excellence and innovation
  • CORE Guides stakeholders on aligning processes with industry best practices and business objectives
  • CORE Provides guidance and support to junior engineers, fostering professional growth and development within the team
  • CORE Collaborates with application teams to integrate business needs into comprehensive infrastructure solutions, aligning with business objectives and platform roadmap
  • CORE Leads infrastructure design and selection, ensuring solutions meet customer needs and strategic goals
  • CORE Diagnoses and resolves complex infrastructure issues, providing support during outages to ensure minimal disruption
  • PLUS Monitors and addresses capacity and availability issues, conducts performance and security assessments, and supports certification and accreditation processes
  • PLUS Leads the efforts towards defining and maintaining processes, documentation, and engineering diagrams for technical and operational support
  • CORE Embeds AI-assisted observability, automation, and documentation capabilities into team workflows to improve deployment efficiency, issue detection, infrastructure analysis, troubleshooting, production support, system readiness, and operational support for specialized compute environments supporting AI-enabled workloads.

Résumé keywords for this role

Terms the posting stresses. Include the ones you can honestly back up.

Tools & technologies

  • Agentic AI
  • AI Infrastructure
  • Core Platforms
  • Enterprise Technology Services
  • AI-enabled workloads
  • AI Infrastructure Engineer
  • LLM platforms
  • AWS Bedrock
  • Azure AI Foundry
  • Azure OpenAI
  • Google Vertex AI
  • GPU
  • TPU
  • Kubernetes
  • containers

Concepts & phrases

  • Senior Agentic AI Infrastructure Engineer I
  • Core Platforms
  • Enterprise Technology Services
  • AI-enabled workloads
  • complex technical issues
  • strong system performance
  • reliability, and security
  • infrastructure initiatives
  • platform strategy
  • Mentors junior Infrastructure Engineers
  • cross-functional team of colleagues
  • culture of excellence and innovation
  • multiple cross-functional teams
  • timely issue resolution
  • high standards of design

Words that count as the same thing: "Agentic AI" ≈ AI Agents, Autonomous AI systems · "AIOps" ≈ AI for IT Operations, MLOps for Infrastructure · "FinOps" ≈ Cloud Financial Management, Cloud Cost Optimization · "LLM platforms" ≈ Large Language Model platforms, Generative AI platforms

Check my résumé against these keywords

Hiring at American Express

Open senior roles RoleStack tracks right now, posted in the last 30 days.

More open roles at American Express

Full job description from American Express

From American Express's posting. View the original

The Enterprise Technology Services organization partners with every part of the American Express business to power the company’s growth and innovation with trust and efficiency, and drive competitive differentiation with speed. We support the delivery and operations of technology, digital, and data capabilities, platforms, and services globally. Specifically, our team is responsible for the company’s technology engineering, architecture, and infrastructure, providing 24x7 support to ensure an uninterrupted, high-quality experience for customers and colleagues. We also provide product management for core enterprise platforms, and lead technology risk and information security, enterprise data governance and platforms, digital product and design, and enterprise AI platforms on behalf of the company.

Show full description Show less

The AI Infrastructure Engineer collaborates with application and platform teams to design, implement, and optimize secure, scalable infrastructure solutions for AI-enabled workloads. This role resolves complex technical issues, ensures strong system performance, reliability, and security, and leads infrastructure initiatives that align with business objectives and platform strategy.

• Mentors junior Infrastructure Engineers and cross-functional team of colleagues, fostering a culture of excellence and innovation
• Leads projects collaborating with multiple cross-functional teams within budget and schedule, ensuring timely issue resolution and maintaining high standards of design, implementation, testing, and compliance
• Guides stakeholders on aligning processes with industry best practices and business objectives
• Provides guidance and support to junior engineers, fostering professional growth and development within the team
• Collaborates with application teams to integrate business needs into comprehensive infrastructure solutions, aligning with business objectives and platform roadmap
• Leads infrastructure design and selection, ensuring solutions meet customer needs and strategic goals
• Diagnoses and resolves complex infrastructure issues, providing support during outages to ensure minimal disruption
• Monitors and addresses capacity and availability issues, conducts performance and security assessments, and supports certification and accreditation processes
• Leads the efforts towards defining and maintaining processes, documentation, and engineering diagrams for technical and operational support
• Embeds AI-assisted observability, automation, and documentation capabilities into team workflows to improve deployment efficiency, issue detection, infrastructure analysis, troubleshooting, production support, system readiness, and operational support for specialized compute environments supporting AI-enabled workloads.
• Embeds ML-powered AIOps and custom anomaly detection into team workflows, using metrics, logs, and traces to detect anomalies, predict failures, and correlate incidents across distributed systems.
• Embeds AI-assisted infrastructure-as-code development and review practices using tools such as GitHub Copilot, Claude Code, Cursor, and similar capabilities into engineering workflows, improving consistency, deployment quality, and operational efficiency.
• Supports infrastructure environments hosting AI-enabled workloads, including cloud-based LLM platforms such as AWS Bedrock, Azure AI Foundry/Azure OpenAI, and Google Vertex AI, while mentoring engineers on responsible use of AI-enabled infrastructure tools, prompt engineering, runbook generation, incident troubleshooting, postmortem summarization, operational analysis, validation, oversight, and operational readiness of GPU- and TPU-enabled infrastructure environments.
• Designs and operates GPU- and accelerator-enabled compute platforms, including cluster scheduling, workload placement, capacity management, quota and reservation controls, and utilization optimization.
• Builds reusable platform capabilities for model training, fine-tuning, inference, and agentic workloads using Kubernetes, containers, infrastructure as code, and automated delivery pipelines.
• Engineers high-performance storage, networking, and data-movement patterns required for distributed AI workloads, with measurable service-level objectives for availability, latency, throughput, and recovery.
• Implements end-to-end observability and FinOps controls for AI infrastructure, including workload telemetry, accelerator utilization, cost attribution, anomaly detection, performance tuning, and capacity forecasting.
• Partners with AI engineers, security, risk, and platform teams to establish secure multi-tenant isolation, identity and access controls, secrets management, software supply-chain controls, and operational readiness.

Work Experience

• Designing infrastructure for AI agents, including agent runtimes, orchestration frameworks, tool integrations, asynchronous execution, and stateful workflows. Examples include LangGraph, Semantic Kernel, and comparable frameworks.

• Experience applying Agentic AI tools to support infrastructure engineering, platform support, or cloud operations work, including reviewing AI-generated operational insights.

• Experience validating AI-generated operational outputs and incorporating AI-enabled practices into infrastructure workflows, including AI-assisted operational recommendations requiring human review and approval.

• Experience with Kubernetes-based AI platforms, containers, workload schedulers, and GPU or accelerator orchestration in cloud or hybrid environments.

• Experience operating model-serving or inference platforms and optimizing throughput, latency, availability, and cost for production AI workloads.

• Experience with distributed training or inference infrastructure, high-performance networking and storage, accelerator telemetry, and capacity planning.

• Experience implementing security, reliability engineering, observability, and FinOps practices for multi-tenant AI infrastructure.

• Experience in different programming languages, DevOps tools such as Ansible, Puppet, Terraform, Python, Shell scripting and PowerShell, and their applications in infrastructure.

• Experience in infrastructure components such as servers, storage, networking, and virtualization technologies.

• Experience in network protocols and their job in infrastructure management.

• Experience in networking fundamentals.

• Experience in databases.

• Experience in tools used in planning, analyzing, crafting, building, testing, configuring, and maintaining applications.

• Experience in cloud platforms (e.g., AWS, Azure, Google Cloud).

• Experience in monitoring technologies such as Prometheus, ElasticSearch and Grafana.

Education and Knowledge

• 5+ Years of experience in infrastructure engineering, cloud engineering, DevOps, or a related technical field, including at least 2 years of hands-on experience supporting AI-enabled infrastructure, AI automation, or agentic AI technologies.

• Bachelor's degree in Computer Science, Information Technology, Engineering, and/or comparable experience; advanced degree preferred

• Knowledge of application infrastructure and standards

• Knowledge of storage management (e.g., SAN, NAS) design and support

• Knowledge of middleware technologies

• Knowledge of software defined networking, automation, and orchestration and their applications

• Knowledge of platform delivery methodology (Agile, Scrum, Agile XP, Best in Class Development, Waterfall, etc.)

• Knowledge of scripting and automation skills (e.g., PowerShell, Bash, Python)

• Knowledge of DevOps practices and tools (e.g., continuous integration/continuous deployment pipelines, Docker, Kubernetes)

• Knowledge of cloud technologies

• Knowledge of Windows and Linux administration

• Working knowledge of AI-assisted infrastructure automation, observability, and deployment support capabilities, and infrastructure services commonly used to support AI-enabled workloads

• Working Knowledge of AI use cases in configuration management, incident analysis, infrastructure operations, and AI-assisted operational workflows that incorporate human oversight and approval controls.

Employment eligibility to work with American Express in the United States is required as the company will not pursue visa sponsorship for these positions.

FAQ

How much experience do you need?

The posting asks for 5+ years in infrastructure engineering, cloud engineering, devops, or a related technical field. It is a senior-level role.

Does American Express sponsor visas for this role?

The posting says visa sponsorship is not available.

Is this role remote?

It is a hybrid role: part remote, part in the office.

What tools and technologies does the posting mention?

Agentic AI, AI Infrastructure, Core Platforms, Enterprise Technology Services, AI-enabled workloads, AI Infrastructure Engineer, LLM platforms, AWS Bedrock, Azure AI Foundry, Azure OpenAI, Google Vertex AI, GPU, TPU, Kubernetes, containers.