Senior Staff Engineer, Big Data Infrastructure
- Remote - US
- Staff/Principal level
- 12+ yrs experience
- Infrastructure Engineering
- Visa: not specified
The role in 30 seconds
As the technical leader for the Big Data Infrastructure organization at Stripe, you will guide a large engineering team to scale foundational data systems and modernize the tech stack. You will partner closely with major internal customers to execute the transition to the "Agentic Era", building "invisible infrastructure" where AI agents operate data pipelines end-to-end.
Is this role a fit for you?
The backgrounds this role is most likely to hire from, as RoleStack reads the posting.
Strong match
- B2B infrastructure / API / developer tools
- Internal tooling / back-office systems
- Software, SaaS & AI Platform
- Enterprise-scale (high availability, compliance, large distributed systems)
- Growth-stage (scaling existing systems, reliability concerns)
Workable stretch
- B2B enterprise platform / workflow software
- Data platform / ML pipeline
- Startup / greenfield (build from scratch, speed over polish)
Harder transition
- B2C consumer-facing application
- Creator / builder / self-serve tool
- Marketplace / multi-sided platform
- Embedded systems / hardware-adjacent
- Regulated environment (healthcare, finance, government)
Industry: Financial Services & FinTech. See your personal match score
What they're really screening for
Must-haves
- PLUS BS or MS in Computer Science or a related field
- CORE 12+ years of professional experience in a software development role
- CORE A strong engineering background in distributed infrastructure and/or platform services, including one or more of the following: storage, databases, or compute
- CORE Experience leading projects on a cross-team and company-wide scale, including scaling and migrating systems with little to no downtime
- CORE Experience developing, maintaining, and debugging distributed systems while optimizing their reliability and security
- CORE Experience driving a culture of operational excellence, with a deep understanding of metrics, alerts, and dashboards
- CORE Airflow modernization
- CORE Data Catalog modernization
- CORE YARN to Kubernetes migrations
- CORE native vectorization (Gluten/Velox)
Nice-to-haves
- CORE Experience driving AI-led architectural transformations and integrating agentic workflows into large-scale data systems
- PLUS Experience in a development team at AWS, Azure, OCI, or Google
- CORE Experience with big data infrastructure at scale, such as Spark, Iceberg, S3, Airflow, YARN, and Celeborn
- PLUS Experience with database internals
- CORE Experience with Kubernetes
Résumé keywords for this role
Terms the posting stresses. Include the ones you can honestly back up.
Tools & technologies
- Airflow
- Spark
- Celeborn
- Iceberg
- Hive
- S3
- Azure Blob Storage
- Kubernetes
- YARN
- Gluten
- Velox
- AWS
- OCI
- AI/ML
Concepts & phrases
- Senior Staff Engineer
- Big Data Infrastructure
- financial infrastructure platform
- increase the GDP of the internet
- Data Orchestration (Airflow)
- Batch Compute (Spark, Celeborn)
- Data Lake (Iceberg, Hive, S3, Azure Blob Storage)
- massive scale
- 800 PB of data
- 325,000 applications a day
- Agentic Era
- invisible infrastructure
- AI agents operate data pipelines
- critical modernization bets
- YARN to Kubernetes migrations
Words that count as the same thing: "Agentic Era" ≈ AI-driven infrastructure, Automated data pipelines, Invisible infrastructure · "KTLO" ≈ Keep the Lights On, Operational Maintenance, Routine Operations
Check my résumé against these keywordsHiring at Stripe
All Stripe hiring dataOpen senior roles RoleStack tracks right now, posted in the last 30 days.
More open roles at Stripe
Full job description from Stripe
From Stripe's posting. View the original
Who we are
About Stripe
Stripe is a financial infrastructure platform for businesses. Millions of companies - from the world’s largest enterprises to the most ambitious startups - use Stripe to accept payments, grow their revenue, and accelerate new business opportunities. Our mission is to increase the GDP of the internet, and we have a staggering amount of work ahead. That means you have an unprecedented opportunity to put the global economy within everyone’s reach while doing the most important work of your career.
Show full description Show less
About the team
In this role, you’d be joining the Big Data Infrastructure team. Our team builds and maintains the platforms that power data work across Stripe, managing three core layers:
• Data Orchestration (Airflow)
• Batch Compute (Spark, Celeborn)
• Data Lake (Iceberg, Hive, S3, Azure Blob Storage)
We support over 2,000 engineers and 600+ internal teams, processing workloads that organically grow more than 30% year over year. Our infrastructure handles massive scale, managing over 800 PB of data, running 325,000 applications a day, and accounting for hundreds of millions of dollars in annual spend, directly powering critical pipelines like inbound payments, network reconciliation, and capital underwriting.
What you’ll do
As the technical leader for the Big Data Infrastructure organization, you will guide a 40+ person engineering team to scale our foundational data systems. You will partner closely with major internal customers like Data Foundations, Payins Engineering, and AI/ML Foundations to modernize our tech stack and execute Stripe's transition to the "Agentic Era" - building "invisible infrastructure" where AI agents operate data pipelines end-to-end.
Responsibilities
• Serve as the technical leader for the Big Data Infrastructure organization, overseeing distributed systems that manage 20% of Stripe's total AWS spend
• Execute Stripe's transition to the "Agentic Era" by building invisible infrastructure that empowers AI agents to author, validate, ship, and operate data pipelines
• Drive the architecture and delivery of critical modernization bets, including YARN to Kubernetes migrations, native vectorization (Gluten/Velox), and Airflow and Data Catalog modernization
• Lead the implementation of a multi-region and multi-cloud data strategy for high availability, disaster recovery, and Azure Blob Storage compliance
• Reduce operational burden and maintenance overhead (KTLO) from over 40% to under 10% by shifting fixes into the platform instead of relying on runbooks
• Foster a culture of operational excellence and mentor engineers at various stages in their careers, up to Staff+
Who you are
We’re looking for someone who meets the minimum requirements to be considered for the role. If you meet these requirements, you are encouraged to apply. The preferred qualifications are a bonus, not a requirement.
Minimum requirements
• BS or MS in Computer Science or a related field
• This is a Senior Staff role, so ideally 12+ years of professional experience in a software development role
• A strong engineering background in distributed infrastructure and/or platform services, including one or more of the following: storage, databases, or compute
• Experience leading projects on a cross-team and company-wide scale, including scaling and migrating systems with little to no downtime
• Experience developing, maintaining, and debugging distributed systems while optimizing their reliability and security
• Experience driving a culture of operational excellence, with a deep understanding of metrics, alerts, and dashboards
Preferred qualifications
• Experience driving AI-led architectural transformations and integrating agentic workflows into large-scale data systems
• Experience in a development team at AWS, Azure, OCI, or Google
• Experience with big data infrastructure at scale, such as Spark, Iceberg, S3, Airflow, YARN, and Celeborn
• Experience with database internals and/or with Kubernetes
FAQ
How much experience do you need?
The posting asks for 12+ years in software development. It is a staff/principal-level role.
Does Stripe sponsor visas for this role?
The posting does not say whether visa sponsorship is available. Ask the recruiter before you apply.
What tools and technologies does the posting mention?
Airflow, Spark, Celeborn, Iceberg, Hive, S3, Azure Blob Storage, Kubernetes, YARN, Gluten, Velox, AWS, OCI, Google, AI/ML.