Senior Data Engineer

SCP Health

  • Lafayette, LA ; Atlanta, GA ; Dallas, TX
  • Hybrid
  • Senior level
  • 8+ yrs experience
  • Data Engineering
  • Visa: not specified
  • $87k–$128k

The role in 30 seconds

At SCP Health, you will have the opportunity to make a difference by defining and evolving reference architectures and standards for data ingestion, transformation, orchestration, and serving layers. This role involves owning critical data products and pipelines that support revenue cycle, physician scheduling, and billing, while also leading complex integrations and ensuring HIPAA-aligned controls for sensitive data. You will mentor other engineers and partner with management to shape the data platform roadmap.

Is this role a fit for you?

The backgrounds this role is most likely to hire from, as RoleStack reads the posting.

Strong match

  • Data platform / ML pipeline
  • B2B enterprise platform / workflow software
  • B2B infrastructure / API / developer tools
  • Enterprise-scale
  • Growth-stage

Workable stretch

  • Internal tooling / back-office systems
  • E-commerce, Retail & Consumer Goods
  • Startup / greenfield

Harder transition

  • B2C consumer-facing application
  • Creator / builder / self-serve tool
  • Marketplace / multi-sided platform
  • Embedded systems / hardware-adjacent
  • Regulated environment

Industry: Healthcare & Life Sciences. See your personal match score

What they're really screening for

Must-haves

  • CORE Expert SQL & data engineering craft: Expert-level ability to design, optimize, and troubleshoot complex SQL workloads; diagnose performance at the query and system level; and define scalable patterns for data access and transformation.
  • CORE Snowflake platform leadership: Deep expertise with Snowflake architecture and operations, including workload strategy, governance controls, performance tuning, cost optimization, and operational monitoring; ability to set standards and coach others using usage and query analytics.
  • CORE dbt proficiency & platform conventions: Advanced proficiency with dbt project organization, macros, testing and documentation strategy, incremental modeling, and environment promotion; ability to define, enforce, and evolve conventions that scale across teams.
  • CORE Data modeling & domain architecture: Ability to define canonical models and data products across domains (e.g., dimensional/domain-oriented), manage change over time (SCDs), and drive alignment on definitions that reduce ambiguity across the organization.
  • CORE Reliability & operations leadership: Define SLAs/SLOs and availability targets; design monitoring/alerting and runbooks; lead incident response and postmortems for critical issues; and drive systemic improvements through problem management.
  • CORE Integration patterns & scalable onboarding: Advanced knowledge of batch and near-real-time patterns (watermarking, CDC, replay/backfill strategy, idempotency), APIs and authentication, and semi-structured/columnar formats (JSON, Parquet); ability to build reusable onboarding patterns adopted across multiple facilities and domains.
  • CORE Governance, security & privacy: HIPAA-aligned design for PHI/PII, least-privilege access models, masking and row/column policies, auditability, and secure sharing; ability to partner with Security/Compliance to design controls and lead remediation when gaps are found.
  • PLUS Influence & enablement: Lead discovery and design reviews, make pragmatic tradeoffs, and influence without authority; drive adoption through enablement (documentation, office hours, templates), clear communication, and consistent standards.
  • PLUS Strategic thinking & platform roadmap: Identify systemic issues and investment opportunities, articulate multi-quarter technical plans, evaluate build vs. buy tradeoffs, and sequence work to reduce risk and increase long-term leverage.
  • PLUS Executive-ready communication: Communicate clearly with technical and non-technical partners, align on definitions and expectations, and provide transparent status, risk, and tradeoff updates for cross-team initiatives.

Nice-to-haves

  • PLUS SnowPro Advanced: Data Engineer (preferred) or SnowPro Core Certification.
  • PLUS dbt Analytics Engineering Certification (preferred), with demonstrated experience operating dbt in production.
  • PLUS Relevant certification or license in Data, Analytics, Cloud, or Security is a plus.

Résumé keywords for this role

Terms the posting stresses. Include the ones you can honestly back up.

Tools & technologies

  • Snowflake
  • dbt
  • SQL
  • SQL workloads
  • EHR extracts
  • HL7
  • FHIR
  • APIs
  • JSON
  • Parquet
  • RBAC
  • PHI
  • PII
  • Snowflake architecture
  • performance tuning

Concepts & phrases

  • Senior Data Engineer
  • SCP Health
  • Platform architecture & technical direction
  • Highest-impact data products
  • Complex integrations & facility onboarding
  • Medallion lifecycle standards
  • Operational ownership & major-incident leadership
  • Performance, reliability & FinOps leadership
  • Governance, security & compliance architecture
  • Data quality strategy, testing & observability
  • Cross-team technical leadership
  • Mentorship & technical bar-raising
  • Release engineering & SDLC improvements
  • Technical roadmap partnership
  • Expert SQL & data engineering craft

Words that count as the same thing: "HIPAA" ≈ Health Insurance Portability and Accountability Act, Healthcare data privacy, Patient data security · "RCM" ≈ Revenue Cycle Management, Healthcare billing, Medical claims processing · "PHI/PII" ≈ Protected Health Information, Personally Identifiable Information, Sensitive personal data · "FHIR" ≈ Fast Healthcare Interoperability Resources, Healthcare data standard · "HL7" ≈ Health Level Seven, Healthcare data messaging standard

Check my résumé against these keywords

Hiring at SCP Health

Open senior roles RoleStack tracks right now, posted in the last 30 days.

Full job description from SCP Health

From SCP Health's posting. View the original

At SCP Health, what you do matters

As part of the SCP Health team, you have an opportunity to make a difference. At our core, we work to bring hospitals and healers together in the pursuit of clinical effectiveness. With a portfolio of over 8 million patients, 7500 providers, 30 states, and 400 healthcare facilities, SCP Health is a leader in clinical practice management spanning the entire continuum of care, including emergency medicine, hospital medicine, wellness, telemedicine, intensive care, and ambulatory care.

Show full description Show less

Why you will love working here:

- Strong track record of providing excellent work/life balance.

- Comprehensive benefits package and competitive compensation.

- Commitment to fostering an inclusive culture of belonging and empowerment through our core values - collaboration, courage, agility, and respect.

Responsibilities:

• Platform architecture & technical direction: Define and evolve reference architectures and standards for ingestion, transformation, orchestration, and serving layers (Snowflake + dbt and adjacent tooling); lead design reviews and set guardrails that enable teams to deliver scalable, secure, observable, and maintainable solutions.
• Highest-impact data products (ownership & service levels): Own end-to-end delivery and operational excellence for the most critical datasets and pipelines that support revenue cycle, physician scheduling, billing, and performance monitoring; define SLAs/SLOs, error budgets (where applicable), and support models for sustained reliability.
• Complex integrations & facility onboarding at scale: Lead strategy and implementation for complex, multi-facility integrations (EHR extracts, HL7, FHIR, APIs, flat files), including backfills, reconciliation, and long-term maintainability; establish repeatable onboarding playbooks and reusable patterns adopted across teams.
• Medallion lifecycle standards & governance leadership: Own and enforce platform-wide conventions across Bronze/Silver/Gold layers (naming, modeling, testing, documentation, lineage, certification); drive alignment on canonical definitions and patterns to reduce ambiguity and rework across domains.
• Operational ownership & major-incident leadership: Serve as an escalation point for major incidents impacting critical pipelines or multiple domains; lead triage, coordinate cross-team resolution, run blameless post-incident reviews, and drive systemic fixes (alerting, runbooks, resilience patterns, and backlog priorities) to prevent recurrence.
• Performance, reliability & FinOps leadership: Lead Snowflake performance and cost optimization initiatives (warehouse/workload design, scheduling, resource monitors, query tuning); establish team practices and decision frameworks that balance reliability, latency, and consumption, and communicate tradeoffs and drivers to stakeholders.
• Governance, security & compliance architecture: Architect and implement HIPAA-aligned controls for PHI/PII (least-privilege RBAC, masking, row/column policies, auditing, secure sharing); partner with Security/Compliance on access patterns, periodic reviews, audits, and remediation for platform-level controls.
• Data quality strategy, testing & observability: Define and operationalize platform-level data quality strategy (tests, reconciliation, anomaly detection, freshness/completeness targets) and observability standards; ensure measurable coverage for critical pipelines and data products and guide teams toward consistent adoption.
• Cross-team technical leadership: Lead technical discovery with stakeholders; clarify ambiguous requirements; propose implementation options; and align on definitions, acceptance criteria, change impacts, and rollout plans across multiple teams and initiatives.
• Mentorship & technical bar-raising: Mentor Data Engineers I–III through coaching, pairing, and feedback; raise the engineering bar via code/design reviews, reusable libraries/macros, documentation standards, and pragmatic guidance on tradeoffs.
• Release engineering & SDLC improvements: Lead improvements to data CI/CD and release practices (testing gates, automated checks, environment promotion, release strategy, rollback planning) that reduce defects and improve delivery predictability across teams.
• Technical roadmap partnership: Partner with the Data Engineering Manager and stakeholders to shape the platform roadmap, identify systemic risks and dependencies, and propose investments that improve scalability, reliability, governance, and team velocity.

Knowledge, Skills, and Abilities:

• Expert SQL & data engineering craft: Expert-level ability to design, optimize, and troubleshoot complex SQL workloads; diagnose performance at the query and system level; and define scalable patterns for data access and transformation.
• Snowflake platform leadership: Deep expertise with Snowflake architecture and operations, including workload strategy, governance controls, performance tuning, cost optimization, and operational monitoring; ability to set standards and coach others using usage and query analytics.
• dbt proficiency & platform conventions: Advanced proficiency with dbt project organization, macros, testing and documentation strategy, incremental modeling, and environment promotion; ability to define, enforce, and evolve conventions that scale across teams.
• Data modeling & domain architecture: Ability to define canonical models and data products across domains (e.g., dimensional/domain-oriented), manage change over time (SCDs), and drive alignment on definitions that reduce ambiguity across the organization.
• Reliability & operations leadership: Define SLAs/SLOs and availability targets; design monitoring/alerting and runbooks; lead incident response and postmortems for critical issues; and drive systemic improvements through problem management.
• Integration patterns & scalable onboarding: Advanced knowledge of batch and near-real-time patterns (watermarking, CDC, replay/backfill strategy, idempotency), APIs and authentication, and semi-structured/columnar formats (JSON, Parquet); ability to build reusable onboarding patterns adopted across multiple facilities and domains.
• Governance, security & privacy: HIPAA-aligned design for PHI/PII, least-privilege access models, masking and row/column policies, auditability, and secure sharing; ability to partner with Security/Compliance to design controls and lead remediation when gaps are found.
• Influence & enablement: Lead discovery and design reviews, make pragmatic tradeoffs, and influence without authority; drive adoption through enablement (documentation, office hours, templates), clear communication, and consistent standards.
• Strategic thinking & platform roadmap: Identify systemic issues and investment opportunities, articulate multi-quarter technical plans, evaluate build vs. buy tradeoffs, and sequence work to reduce risk and increase long-term leverage.
• Executive-ready communication: Communicate clearly with technical and non-technical partners, align on definitions and expectations, and provide transparent status, risk, and tradeoff updates for cross-team initiatives.

EDUCATION (Required and/or Preferred):

• Bachelor’s degree (BA/BS) in MIS, Computer Science, or a related field; or equivalent combination of education and experience.

FIELD OF STUDY:

• Degree preferred in MIS, Computer Science, or business discipline with appropriate exposure to information technology concepts, processes, and systems.

WORK EXPERIENCE/QUALIFICATIONS:

• 8+ years of progressive professional experience in Data Engineering, Analytics Engineering, or a related technical role, including ownership of production data pipelines and data products across multiple domains and leadership of complex cross-domain initiatives.
• 4+ years of hands-on experience building and operating solutions within the Snowflake ecosystem, including performance tuning and practical cost management.
• Experience in Healthcare, Revenue Cycle (RCM), and/or integrating clinical data feeds is strongly preferred; experience working with PHI/PII and regulated data is expected.
• Experience working in an Agile/Scrum environment, including technical leadership across initiatives (design reviews, estimation, delivery coordination) and mentoring other engineers through implementation and support.

CERTIFICATES AND LICENSES:

• Relevant certification or license in Data, Analytics, Cloud, or Security is a plus.
• SnowPro Advanced: Data Engineer (preferred) or SnowPro Core Certification.
• dbt Analytics Engineering Certification (preferred), with demonstrated experience operating dbt in production.
• HIPAA Security/Privacy training (required) and/or related healthcare compliance certifications (preferred).

WORK ENVIRONMENT AND PHYSICAL DEMANDS:

• Professional setting.
• Continuous sitting.
• Continuous oral & written communication and listening skills.
• Continuous computer use.
• Occasional bending, kneeling, lifting, pulling & pushing up to 10 pounds.
• Minimum travel, when applicable.
• Job requires a high level of mental awareness.

PRIMARY LOCATION:

• Lafayette, LA (Corporate HQ)

SECONDARY LOCATION(S):

• Atlanta, GA
• Dallas, TX

Pay Range:

86,539.00 - 128,101.00 USD annuallyThis range represents the anticipated base salary for this role. Actual compensation will be determined based on experience, qualifications, and internal equity considerations.

• We offer a comprehensive benefits package designed to support your health, financial well-being, and work-life balance, including medical dental, vision insurance, a 401(k) plan with a company match, paid time off and holidays, professional development support, and employee wellness resources.

Visit our website for further information. https://myscpbenefits.com/

Login name: corp-guest

Password: weheal

FAQ

How much does a Senior Data Engineer at SCP Health make?

The posted pay for this role is $87k–$128k a year.

How much experience do you need?

The posting asks for 8+ years in data engineering. It is a senior-level role.

Does SCP Health sponsor visas for this role?

The posting does not say whether visa sponsorship is available. Ask the recruiter before you apply.

Is this role remote?

It is a hybrid role: part remote, part in the office.

What tools and technologies does the posting mention?

Snowflake, dbt, SQL, SQL workloads, EHR extracts, HL7, FHIR, APIs, JSON, Parquet, RBAC, PHI, PII, Snowflake architecture, performance tuning.