Databricks Data Engineer, Senior

BAH

  • Bethesda, MD ; Charleston, SC
  • Senior level
  • 8+ yrs experience
  • Data Engineering
  • No visa sponsorship
  • $78k–$176k

The role in 30 seconds

As a senior Databricks Data Engineer at BAH, you will hands-on design, build, and maintain robust data pipelines within Databricks and AWS, while providing technical leadership and mentorship to a multi-disciplinary team. You will bridge raw data and actionable insights by creating optimized ETL flows, designing data models within a medallion architecture, and ensuring data security and compliance for federal clients in an agile environment.

Is this role a fit for you?

The backgrounds this role is most likely to hire from, as RoleStack reads the posting.

Strong match

  • Data platform / ML pipeline
  • B2B infrastructure / API / developer tools
  • Enterprise-scale
  • Regulated environment

Workable stretch

  • B2B enterprise platform / workflow software
  • Internal tooling / back-office systems
  • Growth-stage

Harder transition

  • B2C consumer-facing application
  • Embedded systems / hardware-adjacent
  • Startup / greenfield

Industry: Government / Public Sector (federal client data platforms). See your personal match score

What they're really screening for

Must-haves

  • CORE 8+ years of experience designing, developing, deploying, and managing ETL processes and data pipelines with comprehensive logging and robust error handling
  • CORE 3+ years of experience building, debugging, and optimizing data pipelines using Databricks notebooks, clusters, and job orchestration tools (Delta Lake, Databricks Delta, Unity Catalog)
  • CORE 3+ years of experience writing Python and PySpark code for ETL scripts and custom transformations
  • CORE Experience in data modeling, including dimensional vs relational models within a medallion architecture (Bronze, Silver, Gold)
  • CORE Experience using AWS services including AWS Glue, Amazon S3, and Amazon RDS
  • PLUS Knowledge of performance optimization techniques for ETL jobs such as partitioning, bucketing, caching, and troubleshooting to improve query performance
  • PLUS Ability to design and implement data models from defining schemas to optimizing data structures for efficient queries and analytics
  • PLUS Ability to obtain and maintain a Public Trust or Suitability/Fitness determination based on client requirements
  • PLUS Bachelor's degree in Computer Science, Computer Engineering, Engineering, Mathematics, Physics, Information Systems, or Information Technology
  • PLUS Experience building data solutions for federal government / public sector clients

Nice-to-haves

  • PLUS Experience with AWS cloud-native data services such as AWS Lambda or CloudWatch supporting serverless architectures for data processing
  • PLUS Experience with tools such as AWS Glue Data Catalog or Collibra for managing metadata, data lineage, and cataloging data assets
  • PLUS Knowledge of data governance practices, data lineage, and compliance requirements including GDPR or CCPA
  • PLUS Ability to explain complex technical concepts to a non-technical audience, including describing tradeoffs in architectural design

Résumé keywords for this role

Terms the posting stresses. Include the ones you can honestly back up.

Tools & technologies

  • Databricks
  • Delta Lake
  • Databricks Delta
  • Unity Catalog
  • Python
  • PySpark
  • AWS
  • AWS Glue
  • Amazon S3
  • Amazon RDS
  • AWS Lambda
  • CloudWatch
  • AWS Glue Data Catalog
  • Collibra
  • GDPR

Concepts & phrases

  • Databricks Data Engineer
  • data pipelines
  • ETL processes
  • end-to-end data flows
  • data models
  • data security and compliance
  • medallion architecture
  • Bronze, Silver, or Gold
  • performance optimization techniques
  • query performance
  • data governance practices
  • data lineage
  • architectural design
  • Public Trust
  • Suitability/Fitness determination

Words that count as the same thing: "ETL" ≈ Extract Transform Load, Data pipeline development, Data integration · "medallion architecture" ≈ Bronze/Silver/Gold architecture, Lakehouse layered architecture, Multi-hop data architecture · "Delta Lake" ≈ Databricks Delta, Delta tables · "PySpark" ≈ Spark with Python, Apache Spark Python API · "Public Trust" ≈ Government suitability determination, Fitness determination, Federal background clearance

Check my résumé against these keywords

Hiring at BAH

Open senior roles RoleStack tracks right now, posted in the last 30 days.

More open roles at BAH

Full job description from BAH

From BAH's posting. View the original

Databricks Data Engineer, SeniorThe Opportunity:

As a senior Databricks Data Engineer, you will be hands-on designing, building, and maintaining robust data pipelines within Databricks and contributing independently while also providing technical leadership and mentorship within the team. Your key responsibilities will include creating and optimizing end-to-end data flows, handling extract, transform, load (ETL) processes, designing data models, ensuring data security and compliance, collaborating with cross-functional teams, and continuously improving performance and scalability. Your experience in both Databricks and AWS environments and services will position you as a technical team leader. Your expertise will bridge the gap between raw data and actionable insights, enabling efficient data processing and analytics across the business.

Show full description Show less

Here, you’ll contribute to and mentor a multi-disciplinary team of analysts, data engineers, developers, and data consumers in a fast-paced, agile environment. You’ll use your expertise in analytical exploration and data examination while you oversee the assessment, design, building, and maintenance of scalable platforms for your clients.

Work with us to use data for good.

Join us. The world can’t wait.

You Have:

• 8+ years of experience designing, developing, deploying, and managing ETL processes and data pipelines utilizing comprehensive logging and robust error handling mechanisms to troubleshoot and resolve issues
• 3+ years of experience building, debugging, and optimizing data pipelines using Databricks notebooks, clusters, and job orchestration tools using Databricks tools such as Delta Lake, Databricks Delta, and Unity Catalog
• 3+ years of experience writing Python and PySpark code for ETL scripts and custom transformations
• Experience in data modeling, including when to use dimensional vs relation data models within a medallion architecture, including Bronze, Silver, or Gold
• Experience using various AWS services, including AWS Glue, Amazon S3, Amazon RDS
• Knowledge of performance optimization techniques for ETL jobs such as partitioning, bucketing, caching, and troubleshooting to improve query performance
• Ability to design and implement data models from initially defining schemas to optimizing data structures that support efficient queries and analytics
• Ability to obtain and maintain a Public Trust or Suitability/Fitness determination based on client requirements
• Bachelor’s degree in Computer Science, Computer Engineering, Engineering, Mathematics, Physics, Information Systems, or Information Technology

Nice If You Have:

• Experience with AWS cloud-native data services such as AWS Lambda or CloudWatch that support serverless architectures for data processing
• Experience with tools such as AWS Glue Data Catalog or Collibra for managing metadata, data lineage, and cataloging data assets
• Knowledge of data governance practices, data lineage, and compliance requirements, including GDPR or CCPA, in support of data quality, privacy, and security
• Ability to explain complex technical concepts to a non-technical audience, including describing tradeoffs in architectural design

Vetting:

Applicants selected will be subject to a government investigation and may need to meet eligibility requirements of the U.S. government client.

Compensation

At Booz Allen, we celebrate your contributions, provide you with opportunities and choices, and support your total well-being. Our offerings include health, life, disability, financial, and retirement benefits, as well as paid leave, professional development, tuition assistance, work-life programs, and dependent care. Our recognition awards program acknowledges employees for exceptional performance and superior demonstration of our values. Full-time and part-time employees working at least 20 hours a week on a regular basis are eligible to participate in Booz Allen’s benefit programs. Individuals that do not meet the threshold are only eligible for select offerings, not inclusive of health benefits. We encourage you to learn more about our total benefits by visiting the Resource page on our Careers site and reviewing Our Employee Benefits page.

Salary at Booz Allen is determined by various factors, including but not limited to location, the individual’s particular combination of education, knowledge, skills, competencies, and experience, as well as contract-specific affordability and organizational requirements. The projected compensation range for this position is $77,600.00 to $176,000.00 (annualized USD). The estimate displayed represents the typical salary range for this position and is just one component of Booz Allen’s total compensation package for employees. This posting will close within 90 days from the Posting Date.

Identity Statement

As part of the hiring process, we will ask you to complete an identity verification process that leverages advanced biometrics and artificial intelligence to ensure authenticity and protect against identity fraud. You are expected to be on camera during interviews and assessments. We reserve the right to take your picture to verify your identity and prevent fraud.

Candidate AI Usage Policy

AI is a part of our daily work at Booz Allen, and we are committed to the responsible and ethical use of AI tools. However, we want to ensure a fair candidate process based on your own skills and knowledge. As part of this commitment, the use of artificial intelligence (AI) or other tools to assist with responses during interviews (whether in-person or virtual) is prohibited unless permission is explicitly provided.

Work Model
Our people-first culture prioritizes the benefits of collaboration. To support engagement and effective communication, employees working virtually are generally expected to have their cameras on during meetings.

• Remote: If this position is listed as remote, there may still be occasions when you are required to work in person at a Booz Allen or customer facility.
• Hybrid: If this position is listed as hybrid, you will be expected to work from a Booz Allen or customer facility, in alignment with your leadership's expectations and the needs of the role.
• Onsite: If this position is listed as onsite, work will primarily be performed full-time at a customer facility, where employees will collaborate directly with colleagues and customers as required by the role.

Commitment to Non-Discrimination

All qualified applicants will receive consideration for employment without regard to disability, status as a protected veteran or any other status protected by applicable federal, state, local, or international law.

FAQ

How much does a Databricks Data Engineer, Senior at BAH make?

The posted pay for this role is $78k–$176k a year.

How much experience do you need?

The posting asks for 8+ years in etl / data pipeline engineering. It is a senior-level role.

Does BAH sponsor visas for this role?

The posting says visa sponsorship is not available.

What tools and technologies does the posting mention?

Databricks, Delta Lake, Databricks Delta, Unity Catalog, Python, PySpark, AWS, AWS Glue, Amazon S3, Amazon RDS, AWS Lambda, CloudWatch, AWS Glue Data Catalog, Collibra, GDPR.