Sr Data Engineer II
American Express
- Phoenix, AZ ; Palo Alto, CA
- Hybrid
- Senior level
- Data Engineering
- Sponsors visas
The role in 30 seconds
The Senior Data Engineer - AI & Intelligent Payment Platforms role at American Express involves designing, building, and evolving highly scalable data platforms and real-time streaming pipelines. This role focuses on creating AI-ready architectures to enable machine learning, Generative AI, and real-time intelligence use cases for payment operations. The position requires technical leadership and the application of modern engineering practices in a distributed, cloud-native environment. American Express is investing in next-generation payment network products and AI capabilities to support global growth.
Is this role a fit for you?
The backgrounds this role is most likely to hire from, as RoleStack reads the posting.
Strong match
- B2B infrastructure / API / developer tools
- B2B enterprise platform / workflow software
- Data platform / ML pipeline
- Enterprise-scale
- Growth-stage
Workable stretch
- Internal tooling / back-office systems
- Creator / builder / self-serve tool
- Startup / greenfield
Harder transition
- B2C consumer-facing application
- Marketplace / multi-sided platform
- Embedded systems / hardware-adjacent
Industry: Financial Services & FinTech. See your personal match score
What they're really screening for
Must-haves
- CORE Experience designing, implementing, and operating large-scale distributed data platforms and systems.
- CORE Strong experience with NoSQL technologies such as Cassandra, Elasticsearch, Couchbase, or Redis.
- CORE Experience with large-scale distributed data processing technologies such as Apache Spark.
- CORE Strong programming experience with Python, Java, Scala, or similar languages.
- CORE Experience designing data pipelines, data models, APIs, and event-driven architectures.
- CORE Strong understanding of distributed system concepts, including scalability, reliability, resiliency, security, and performance.
- CORE Demonstrated ability to solve complex engineering problems and deliver production-grade solutions.
- CORE Experience with real-time distributed processing using technologies such as Spark, Kafka, Cassandra, and Elasticsearch.
- PLUS Experience developing microservices and cloud-native applications.
- PLUS Experience with Docker, Kubernetes, OpenShift, or similar container platforms.
Nice-to-haves
- CORE Experience building AI/ML-ready data platforms supporting machine learning, Generative AI, or intelligent application use cases.
- CORE Familiarity with Generative AI, LLMs, RAG, embeddings, vector databases/search, and AI agent architectures.
- PLUS Experience integrating AI/ML models and services into production environments.
- PLUS Familiarity with MLOps/LLMOps, including deployment, evaluation, monitoring, observability, governance, and lifecycle management.
- CORE Experience with distributed messaging and streaming platforms such as Apache Kafka.
Résumé keywords for this role
Terms the posting stresses. Include the ones you can honestly back up.
Tools & technologies
- AI
- Intelligent Payment Platforms
- data platforms
- AI-powered
- payment network
- distributed
- near-real-time
- low-latency
- availability
- resiliency
- AI-ready
- machine learning
- Generative AI
- LLMs
- Large Language Models
Concepts & phrases
- Sr Data Engineer II
- Senior Data Engineer
- AI & Intelligent Payment Platforms
- intelligent payment platforms
- next-generation payment network products
- data platforms
- AI-powered capabilities
- Card Network
- highly distributed
- near-real-time
- low-latency platform
- exceptional availability
- resiliency
- AI-ready data platforms
- real-time intelligence
Words that count as the same thing: "Generative AI" ≈ GenAI · "LLMs" ≈ Large Language Models · "RAG" ≈ Retrieval-Augmented Generation · "AI agents" ≈ agentic workflows · "CI/CD" ≈ Continuous Integration/Continuous Deployment
Check my résumé against these keywordsHiring at American Express
Open senior roles RoleStack tracks right now, posted in the last 30 days.
More open roles at American Express
Full job description from American Express
From American Express's posting. View the original
Joining Amex Tech means discovering and shaping your contribution to something big. Here, you can work alongside talented tech teams and build a unique career with the Powerful Backing of American Express. With a range of opportunities to work with the latest technologies, and a commitment to back the broader engineering community through open source, our mission is to power your success. Because Amex Tech is powered by our technology, our culture, and our colleagues.
Show full description Show less
Senior Data Engineer – AI & Intelligent Payment Platforms
Are you ready to help build the next generation of intelligent payment platforms?
American Express is making strategic investments in next-generation payment network products, data platforms, and AI-powered capabilities to support its global growth agenda.
The American Express Card Network operates as a highly distributed, near-real-time, low-latency platform designed for exceptional availability and resiliency—processing transactions around the world, 24 hours a day, 365 days a year.
As a Senior Data Engineer – AI & Intelligent Payment Platforms, you will help design, build, and evolve highly scalable, AI-ready data platforms that power critical payment capabilities and enable real-time intelligence, advanced analytics, machine learning, and Generative AI use cases.
You will work at the intersection of data engineering, distributed systems, cloud-native technologies, and AI, helping transform large-scale payment data into intelligent, secure, and reliable products and experiences.
• Design and build highly scalable, resilient, and low-latency data platforms supporting mission-critical payment workloads.
• Develop distributed data processing and real-time streaming pipelines capable of handling high-volume transactional data.
• Build AI-ready data architectures and pipelines that enable machine learning, Generative AI, and real-time intelligence use cases.
• Explore and implement emerging AI capabilities, including Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), embeddings, vector search, and AI agents, where appropriate.
• Design and develop microservices, APIs, and event-driven architectures using modern engineering practices.
• Drive adoption of cloud-native technologies, containerization, orchestration, CI/CD, automation, and observability.
• Establish engineering practices for performance, scalability, resiliency, security, data quality, and operational excellence.
• Apply Responsible AI and data governance principles, including privacy, security, explainability, model evaluation, and appropriate controls.
• Evaluate emerging technologies across AI, data, and distributed computing and translate them into practical solutions for payment platforms.
• Provide technical leadership, mentor engineers, conduct design reviews, and contribute to engineering standards and best practices.
• Partner with product, architecture, data science, and engineering teams to turn complex business opportunities into scalable technology solutions.
Minimum Qualifications
• Experience designing, implementing, and operating large-scale distributed data platforms and systems.
• Strong experience with NoSQL technologies such as Cassandra, Elasticsearch, Couchbase, or Redis.
• Experience with large-scale distributed data processing technologies such as Apache Spark.
• Strong programming experience with Python, Java, Scala, or similar languages.
• Experience designing data pipelines, data models, APIs, and event-driven architectures.
• Strong understanding of distributed system concepts, including scalability, reliability, resiliency, security, and performance.
• Demonstrated ability to solve complex engineering problems and deliver production-grade solutions.
Preferred Qualifications
• Experience building AI/ML-ready data platforms supporting machine learning, Generative AI, or intelligent application use cases.
• Familiarity with Generative AI, LLMs, RAG, embeddings, vector databases/search, and AI agent architectures.
• Experience integrating AI/ML models and services into production environments.
• Familiarity with MLOps/LLMOps, including deployment, evaluation, monitoring, observability, governance, and lifecycle management.
• Experience with distributed messaging and streaming platforms such as Apache Kafka.
• Experience with real-time distributed processing using technologies such as Spark, Kafka, Cassandra, and Elasticsearch.
• Experience developing microservices and cloud-native applications.
• Experience with Docker, Kubernetes, OpenShift, or similar container platforms.
• Experience with CI/CD, DevOps, infrastructure automation, and production observability.
• Understanding of Responsible AI, data privacy, security, governance, and model risk considerations.
• Experience architecting large-scale systems with an emphasis on availability, scalability, performance, resiliency, and cost efficiency.
• Ability to stay current with emerging AI and data engineering technologies and identify opportunities to apply them to real-world business problems.
• Strong communication, collaboration, and technical leadership skills, with the ability to mentor engineers and influence technical direction.
Depending on factors such as business unit requirements, the nature of the position, cost and applicable laws, American Express may provide visa sponsorship for certain positions.
FAQ
Does American Express sponsor visas for this role?
The posting says visa sponsorship is available.
Is this role remote?
It is a hybrid role: part remote, part in the office.
What tools and technologies does the posting mention?
AI, Intelligent Payment Platforms, data platforms, AI-powered, payment network, distributed, near-real-time, low-latency, availability, resiliency, AI-ready, machine learning, Generative AI, LLMs, Large Language Models.