Staff Data Engineer | Allconnect

Red Ventures

  • Remote - US
  • Remote
  • Staff/Principal level
  • 10+ yrs experience
  • Data Engineering
  • No visa sponsorship
  • $130k–$220k

The role in 30 seconds

As a Staff Data Engineer at Red Ventures, you'll own the design and modernization of our Databricks environments, working with multiple engineering teams and with technical stakeholders inside and outside Red Ventures. You'll also build the AI/ML data infrastructure, from feature stores to LLM-ready pipelines, that gives ML engineering teams reliable, governed and cost-efficient model inputs at scale.

Is this role a fit for you?

The backgrounds this role is most likely to hire from, as RoleStack reads the posting.

Strong match

  • B2B infrastructure / API / developer tools
  • B2B enterprise platform / workflow software
  • Data platform / ML pipeline
  • Enterprise-scale
  • Growth-stage

Workable stretch

  • Internal tooling / back-office systems
  • Startup / greenfield

Harder transition

  • B2C consumer-facing application
  • Creator / builder / self-serve tool

Industry: Software, SaaS & AI Platform. See your personal match score

What they're really screening for

Must-haves

  • CORE 10+ years of data engineering experience designing and operating large-scale data platforms
  • CORE Production experience with Databricks, SQL, Spark and Python
  • CORE Infrastructure-as-code experience with Terraform for data platforms
  • PLUS Experience with an orchestration tool such as Airflow or Dagster
  • PLUS Experience with streaming and messaging platforms such as Kafka, Kinesis or Rudderstack
  • CORE Experience with data governance frameworks, such as Unity Catalog, DataHub, Collibra, Atlan, RBAC and PII controls
  • PLUS Experience with data quality and observability tools, such as Great Expectations, Soda, Monte Carlo or OpenLineage
  • CORE Experience in DevOps and FinOps, such as GitHub Actions, data contracts and platform-level cost optimization
  • CORE Explain technical trade-offs to stakeholders outside engineering and guide design discussions with external partners

Nice-to-haves

  • CORE Design and operate AI/ML data infrastructure, including feature stores and vector databases
  • CORE Build LLM-ready pipelines covering embedding generation, retrieval and RAG data flows, and training-data versioning
  • CORE Partner with ML engineering teams to deliver governed, reliable and cost-efficient model inputs at scale
  • CORE Establish data governance, data quality and observability standards across pipelines, including access controls and PII protections
  • CORE Drive platform-level cost optimization and DevOps practices, including CI/CD automation and data contracts between producers and consumers
  • PLUS Mentor engineers and lead design reviews to raise technical standards across teams

Résumé keywords for this role

Terms the posting stresses. Include the ones you can honestly back up.

Tools & technologies

  • Databricks
  • SQL
  • Spark
  • Python
  • Terraform
  • Airflow
  • Dagster
  • Kafka
  • Kinesis
  • Rudderstack
  • Unity Catalog
  • DataHub
  • Collibra
  • Atlan
  • RBAC

Concepts & phrases

  • Staff Data Engineer
  • large-scale data platforms
  • Infrastructure-as-code
  • data platforms
  • orchestration tool
  • streaming and messaging platforms
  • data governance frameworks
  • data quality and observability tools
  • DevOps and FinOps
  • GitHub Actions
  • data contracts
  • platform-level cost optimization
  • technical trade-offs
  • design discussions
  • technical stakeholders

Words that count as the same thing: "Databricks environments" ≈ Databricks · "AI/ML data infrastructure" ≈ Machine Learning Data Infrastructure, Artificial Intelligence Data Infrastructure · "LLM-ready pipelines" ≈ Pipelines for Large Language Models · "RAG" ≈ Retrieval Augmented Generation · "DevOps" ≈ Development Operations

Check my résumé against these keywords

Hiring at Red Ventures

All Red Ventures hiring data

Open senior roles RoleStack tracks right now, posted in the last 30 days.

More open roles at Red Ventures

Full job description from Red Ventures

From Red Ventures's posting. View the original

This role is not open to visa sponsorship or transfer of visa sponsorship including those on H1-B, F-1, OPT, STEM-OPT, or TN visa, nor is it available to work corp-to-corp.

For the Allconnect website click here. Curious how Allconnect fits into Red Ventures? Click here.

As a Staff Data Engineer at AllConnect, you'll own the design and modernization of our Databricks environments, working with multiple engineering teams and with technical stakeholders inside and outside AllConnect. You'll also build the AI/ML data infrastructure, from feature stores to LLM-ready pipelines, that gives ML engineering teams reliable, governed and cost-efficient model inputs at scale.

Show full description Show less

What You’ll Do:

• Drive technical design with internal and external AllConnect stakeholders, turning their needs into clear architecture decisions

• Lead the development and modernization of Databricks environments across multiple teams

• Design and operate AI/ML data infrastructure, including feature stores and vector databases

• Build LLM-ready pipelines covering embedding generation, retrieval and RAG data flows, and training-data versioning

• Partner with ML engineering teams to deliver governed, reliable and cost-efficient model inputs at scale

• Establish data governance, data quality and observability standards across pipelines, including access controls and PII protections

• Drive platform-level cost optimization and DevOps practices, including CI/CD automation and data contracts between producers and consumers

• Mentor engineers and lead design reviews to raise technical standards across teams

What We’re Looking For:

• 10+ years of data engineering experience designing and operating large-scale data platforms

• Production experience with Databricks, SQL, Spark and Python

• Infrastructure-as-code experience with Terraform for data platforms

• Experience with an orchestration tool such as Airflow or Dagster (no particular tool required)

• Experience with streaming and messaging platforms such as Kafka, Kinesis or Rudderstack (any one meets the bar)

• Experience with data governance frameworks, such as Unity Catalog, DataHub, Collibra, Atlan, RBAC and PII controls (no specific tool required)

• Experience with data quality and observability tools, such as Great Expectations, Soda, Monte Carlo or OpenLineage (any of them or similar)

• Experience in DevOps and FinOps, such as GitHub Actions, data contracts and platform-level cost optimization

• Explain technical trade-offs to stakeholders outside engineering and guide design discussions with external partners

Compensation:

Total Cash Compensation Range: $130,000 – $220,000 per year

New York City Total Cash Compensation Range: $162,000 – $275,000 per year

Actual compensation varies based on location, experience, and qualifications.

Additionally, the following benefits are provided by Red Ventures, subject to eligibility requirements.

• Health Insurance Coverage (medical, dental, and vision)

• Life Insurance

• Short and Long-Term Disability Insurance

• Flexible Spending Accounts

• Holiday Pay

• 401(k) with match

• Employee Assistance Program

• Paid Parental Bonding Benefit Program

• Flexible Paid Time Off (PTO): We believe time to rest and recharge is essential. That’s why we offer a generous and flexible PTO policy. Full-time employees accrue 20 days of PTO for a full calendar year annually, with an increase to 25 days after five years of service.

Who We Are:

Red Ventures is a global portfolio of high-growth companies — spanning several U.S. businesses, a joint venture in the health services industry, and strategic investments in Europe. Their businesses include The Points Guy, Lonely Planet, Bankrate, the Allconnect Platform, RV Home Client Growth, RV Growth & Transformation, Sage Home Loans Corporation, and more. Across the portfolio, Red Ventures businesses deliver seamless digital experiences for consumers, help Fortune 100 clients solve large-scale digital growth challenges, and create world-class experiences and opportunities for employees. Learn more at redventures.com and follow @RedVentures on LinkedIn and Instagram.

At Red Ventures, we believe diverse, inclusive teams are better. To help you better understand our core values and beliefs, we encourage you to watch this brief YouTube video: Our Belief Statements. This will give you insight into the principles that guide our work and our commitment to fostering an inclusive environment.

Red Ventures is an equal opportunity employer that does not discriminate against any employee or applicant because of race, creed, color, religion, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or any other basis protected by law. Employment at Red Ventures is based solely on a person's merit and qualifications.

We are committed to providing equal employment opportunities to qualified individuals with disabilities. This includes providing reasonable accommodation where appropriate. Should you require a reasonable accommodation to apply or participate in the job application or interview process, please contact accommodation@redventures.com.

If you are based in California, we encourage you to read this important information for California residents linked here.

#li-sf1

At Red Ventures, we believe in real human connection. That’s why we do not hire someone through text, social media, or email only. As part of the hiring process, you should expect live conversations with RV teammates before any offer is made. Also, keep an eye on the sender: we only use official @redventures.com email addresses at the portfolio level or business specific email addresses (e.g., @thepointsguy.com), not ones like “redventurescareer.com.” We will never ask candidates to send money, buy equipment, or share financial account info during your journey with us. You can always find our open roles on redventures.com— if you receive a message that seems suspicious, please use redventures.com to verify the opportunity.

For more, the U.S. Federal Trade Commission has published helpful articles to help individuals learn more about protecting themselves from recruiter scams. If you think you’ve been targeted, feel free to report it to your local authorities. Stay safe out there!

Click here for more details regarding the employee privacy policy: https://www.redventures.com/legal/us-emp-privacy-notice

Questions about this Privacy Notice can be directed to employeerights@redventures.com. Alternatively, you may raise any questions or concerns to your manager, HR Business Partner, or through the Privacy Team.

FAQ

How much does a Staff Data Engineer | Allconnect at Red Ventures make?

The posted pay for this role is $130k–$220k a year.

How much experience do you need?

The posting asks for 10+ years in data engineering. It is a staff/principal-level role.

Does Red Ventures sponsor visas for this role?

The posting says visa sponsorship is not available.

Is this role remote?

It is a remote role.

What tools and technologies does the posting mention?

Databricks, SQL, Spark, Python, Terraform, Airflow, Dagster, Kafka, Kinesis, Rudderstack, Unity Catalog, DataHub, Collibra, Atlan, RBAC.