Sr Software Development Engineer - Amazon MSK, Managed Streaming for Kafka
- Seattle, WA
- On-site
- Senior level
- 5+ yrs experience
- Backend Engineering
- Visa: not specified
- $168k–$227k
The role in 30 seconds
As a Sr Software Development Engineer for Amazon MSK, you will build and operate a fully managed service that enables customers to process streaming data using Apache Kafka at AWS scale. This role involves contributing to the core Kafka platform, making upstream open-source contributions, and designing/building scalable services to enhance the customer experience with data streaming.
Is this role a fit for you?
The backgrounds this role is most likely to hire from, as RoleStack reads the posting.
Strong match
- B2B infrastructure / API / developer tools
- Software, SaaS & AI Platform
- Growth-stage
- Enterprise-scale
Workable stretch
- B2B enterprise platform / workflow software
- Internal tooling / back-office systems
- Startup / greenfield
Harder transition
- B2C consumer-facing application
- Embedded systems / hardware-adjacent
- Regulated environment
Industry: Software, SaaS & AI Platform. See your personal match score
What they're really screening for
Must-haves
- CORE 5+ years of non-internship professional software development experience
- CORE 5+ years of programming with at least one software programming language experience
- CORE 5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience
- CORE Experience as a mentor, tech lead or leading an engineering team
- CORE Experience designing large-scale systems supporting millions of transactions per second
- CORE In-depth understanding of streaming data technologies like Amazon Kinesis or Apache Kafka
- PLUS Experience with open-source data processing frameworks like Apache Spark, Apache Flink, or Apache Storm
Nice-to-haves
- PLUS 5+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
- PLUS Bachelor's degree in computer science or equivalent
- CORE Contributions to open source projects, especially Apache Kafka
- CORE Experience with performance improvements in large-scale distributed systems
- PLUS Experience identifying and investigating new technologies
- CORE Experience building scalable services
Résumé keywords for this role
Terms the posting stresses. Include the ones you can honestly back up.
Tools & technologies
- Amazon MSK
- Managed Streaming for Kafka
- Apache Kafka
- AWS
- Amazon Kinesis
- Apache Spark
- Apache Flink
- Apache Storm
- S3
- Amazon Elastic Compute Cloud
- EC2
- IoT
- 5+
- design patterns
- reliability
Concepts & phrases
- Sr Software Development Engineer
- Amazon MSK
- Managed Streaming for Kafka
- core data plane stack
- large scale AWS service
- open source technology
- large-scale systems
- millions of transactions per second
- streaming data technologies
- Apache Kafka
- Amazon Kinesis
- open-source data processing frameworks
- Apache Spark
- Apache Flink
- Apache Storm
Words that count as the same thing: "Managed Streaming for Kafka" ≈ Amazon MSK, MSK · "Apache Kafka" ≈ Kafka · "streaming data technologies" ≈ Amazon Kinesis · "open-source data processing frameworks" ≈ Apache Spark, Apache Flink, Apache Storm · "non-internship professional software development experience" ≈ professional software development experience
Check my résumé against these keywordsHiring at Amazon
All Amazon hiring dataOpen senior roles RoleStack tracks right now, posted in the last 30 days.
More open roles at Amazon
- Senior PMT - AI Automation, Prime Video $151k–$205k
- Principal, Product Mgmt - Tech - AMZ19240.13 $180k–$243k
- Senior Manager, Product Management, Amazon Games $198k–$295k
- Sr. Product Manager - Tech, Digital Acceleration $151k–$205k
- Sr. Product Manager - Finance/ Supply Chain Analytics & Data Engineering, Amazon Leo Finance Acceleration (ALFA) $151k–$205k
Full job description from Amazon
From Amazon's posting. View the original
Come build the future of data streaming with the Amazon Managed Streaming for Kafka (MSK) team!
We are seeking builders for our Amazon MSK service, a fully managed service that makes it easy for customers to build and run applications that use Apache Kafka to process streaming data. We are looking for engineers who are enthusiastic about data streaming, and are as passionate about contributing to open source as they are about solving real customers' business needs, at AWS scale.
Show full description Show less
As a member of the Amazon MSK team, you will be making contributions to the entire core data plane stack that make up the MSK service, the core Kafka platform, and stand-alone tools that make it easier for Kafka community to operate Kafka better. Upstream compatibility is a core tenet of MSK. Your code changes to the Kafka platform will be released back to open source. As a member of an AWS service that builds on top of a popular open source technology, this is a unique opportunity to work on a team that straddles both worlds – open source and Amazon-internal software. You will design and build new features, make performance improvements, identify and investigate new technologies, prototype solutions, build scalable services, and test and review changes, to deliver an exceptional customer experience.
The ideal candidate has experience designing large-scale systems supporting millions of transactions per second, enjoys solving complex software problems, and possesses analytical, design and problem-solving skills. Ideally you have an in-depth understanding of streaming data technologies like Amazon Kinesis or Apache Kafka, and experience with open-source data processing frameworks like Apache Spark, Apache Flink, or Apache Storm. Your responsibilities will include collaborating with other engineers to build a large scale AWS service, and work with senior leaders to define your team's roadmap, including identifying design and code changes needed in the underlying open source platforms.
Learn more about Amazon MSK: - AWS re:Invent 2018: Amazon Managed Streaming for Kafka (Amazon MSK) Launch
* AWS re:Invent 2020: How Goldman Sachs uses an Amazon MSK backbone for Transaction Banking Platform
* AWS re:Invent 2020: How New Relic is migrating its Apache Kafka cluster to Amazon MSK
* AWS re:Invent 2021: How Coinbase uses Amazon MSK as an event store for applications
* MSK Tiered Storage: Optimize cost and improve Kafka scalability
* AWS re:Invent 2023: How Rivian builds real-time analytics from electric vehicles
Utility Computing (UC)
AWS Utility Computing (UC) provides product innovations — from foundational services such as Amazon’s Simple Storage Service (S3) and Amazon Elastic Compute Cloud (EC2), to consistently released new product innovations that continue to set AWS’s services and features apart in the industry. As a member of the UC organization, you’ll support the development and management of Compute, Database, Storage, Internet of Things (Iot), Platform, and Productivity Apps services in AWS, including support for customers who require specialized security solutions for customers who require specialized security solutions for their cloud services.
About the team
About AWS
Amazon Web Services (AWS) is the world’s most comprehensive and broadly adopted cloud platform. We pioneered cloud computing and never stopped innovating — that’s why customers from the most successful startups to Global 500 companies trust our robust suite of products and services to power their businesses.
Diverse Experiences
AWS values diverse experiences. Even if you do not meet all of the qualifications and skills listed in the job description, we encourage candidates to apply. If your career is just starting, hasn’t followed a traditional path, or includes alternative experiences, don’t let it stop you from applying.
Work/Life Balance
We value work-life harmony. Achieving success at work should never come at the expense of sacrifices at home, which is why we strive for flexibility as part of our working culture. When we feel supported in the workplace and at home, there’s nothing we can’t achieve in the cloud.
Inclusive Team Culture
Here at AWS, it’s in our nature to learn and be curious. Our employee-led affinity groups foster a culture of inclusion that empower us to be proud of our differences. Ongoing events and learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon (gender diversity) conferences, inspire us to never stop embracing our uniqueness.
Mentorship & Career Growth
We’re continuously raising our performance bar as we strive to become Earth’s Best Employer. That’s why you’ll find endless knowledge-sharing, mentorship and other career-advancing resources here to help you develop into a better-rounded professional.
Basic Qualifications
- 5+ years of non-internship professional software development experience
- 5+ years of programming with at least one software programming language experience
- 5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience
- Experience as a mentor, tech lead or leading an engineering team
Preferred Qualifications
- 5+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
- Bachelor's degree in computer science or equivalent
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.
The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.
USA, WA, Seattle - 168,100.00 - 227,400.00 USD annually
FAQ
How much does a Sr Software Development Engineer - Amazon MSK, Managed Streaming for Kafka at Amazon make?
The posted pay for this role is $168k–$227k a year.
How much experience do you need?
The posting asks for 5+ years in software development. It is a senior-level role.
Does Amazon sponsor visas for this role?
The posting does not say whether visa sponsorship is available. Ask the recruiter before you apply.
Is this role remote?
It is an on-site role.
What tools and technologies does the posting mention?
Amazon MSK, Managed Streaming for Kafka, Apache Kafka, AWS, Amazon Kinesis, Apache Spark, Apache Flink, Apache Storm, S3, Amazon Elastic Compute Cloud, EC2, IoT, 5+, design patterns, reliability.