Senior Software Engineer, ML Platform

Stack AV

  • Pittsburgh, PA
  • Remote
  • Senior level
  • 5+ yrs experience
  • AI/ML Engineering (ML Platform / ML Infrastructure)
  • Visa: not specified

The role in 30 seconds

Stack AV's ML Data Understanding team provides trusted, useful data to power all ML applications end-to-end — from mining to training to safety evaluation — for autonomous trucking. The team builds semantic search, data mining, curation, annotation, and high-throughput serving infrastructure in partnership with AV autonomy teams. This Senior Software Engineer role architects next-generation multimodal semantic search and data discovery platforms, applying frontier LLMs, VLMs, RAG, and vector databases to accelerate AV development.

Is this role a fit for you?

The backgrounds this role is most likely to hire from, as RoleStack reads the posting.

Strong match

  • Data platform / ML pipeline
  • B2B infrastructure / API / developer tools
  • Growth-stage
  • Enterprise-scale

Workable stretch

  • B2B enterprise platform / workflow software
  • Internal tooling / back-office systems
  • Startup / greenfield

Harder transition

  • B2C consumer-facing application
  • Embedded systems / hardware-adjacent
  • Regulated environment

Industry: Automotive & Transportation (autonomous trucking) — domain central to role identity. See your personal match score

What they're really screening for

Must-haves

  • CORE Experience with both ML platforms and building ML-based applications
  • CORE 5+ years of relevant domain experience
  • CORE Proven track record of building scalable, reliable infrastructure in a fast-paced environment
  • PLUS Deep understanding of design trade-offs with the ability to articulate those trade-offs and achieve alignment with others
  • CORE Hands-on background in developing semantic search infrastructure, generating multimodal (video/image/audio) embeddings, and managing vector databases
  • CORE Experience with multi-modal data indexing, model training infrastructure, model optimization, or large data processing pipelines
  • PLUS Experience building ML models or infrastructure in autonomous vehicles, perception, and decision-making domains
  • CORE Experience with real-time semantic search services (text/images/videos) and vector databases
  • PLUS Experience building low latency / high throughput batch or stream processing pipelines
  • PLUS Experience with autonomous driving / AV data domains

Résumé keywords for this role

Terms the posting stresses. Include the ones you can honestly back up.

Tools & technologies

  • LLMs
  • visual language models
  • RAG
  • Ray
  • Spark
  • Lance
  • LanceDB
  • Iceberg
  • vector databases
  • C++
  • Python
  • AI-assisted software engineering
  • open-world models
  • multimodal embeddings

Concepts & phrases

  • Senior Software Engineer, ML Platform
  • ML Data Understanding
  • multimodal semantic search
  • data discovery platforms
  • Retrieval Augmented Generation
  • agentic data mining
  • data curation workflows
  • real-time querying
  • vector databases
  • batch/stream processing
  • end-to-end data mining solutions
  • low latency/high throughput
  • high-performance Python/C++ code
  • ML platforms
  • ML-based applications

Words that count as the same thing: "RAG" ≈ Retrieval Augmented Generation, retrieval-augmented generation · "LLMs" ≈ large language models, LLM · "VLMs" ≈ visual language models, vision language models · "AV" ≈ autonomous vehicles, autonomous driving, self-driving · "vector DBs" ≈ vector databases, vector database, LanceDB

Check my résumé against these keywords

Hiring at Stack AV

Open senior roles RoleStack tracks right now, posted in the last 30 days.

More open roles at Stack AV

Full job description from Stack AV

From Stack AV's posting. View the original

About Stack:

Stack is developing revolutionary AI and advanced autonomous systems designed to enhance safety, reliability, and efficiency of modern operations. Stack's autonomous technology incorporates cutting-edge advancements in artificial intelligence, robotics, machine learning, and cloud technologies, empowering us to create innovative solutions that address the needs and challenges of the dynamic trucking transportation industry. With decades of experience creating and deploying real world systems for demanding environments, the Stack team is dedicated to developing an autonomous solution ecosystem tailored to the trucking industry's unique demands.

Show full description Show less

If you are an Internal Candidate, please apply via our Internal Job Board.

About the Role:

In the ML Data Understanding team, our mission is to provide trusted and useful data to efficiently power all of Stack's ML applications end-to-end from mining to training to safety evaluation. We work hand-in-hand with AV autonomy teams to provide cutting-edge solutions to all their data needs, working across data engineering, mining, modeling and infrastructure. In particular, we provide services to find (data mining), curate (datasets), annotate (data labeling), search and serve (high throughput data access) data for all ML needs.

• Data Mining: We are building a framework and infrastructure to find interesting events quickly and flexibly. As part of this mission, you would be setting the direction for and helping us build an inference service using LLMs, open-world models and vector databases.

• Semantic Search for Data Mining: We are building the infrastructure of a highly scalable semantic search service for multimodal data to find interesting events quickly and flexibly. As part of this mission, you would be setting the direction for and helping us build an inference service using the latest AI models & approaches.

• Dataset management for training: We are building state of the art infrastructure to support machine learning training and inference workloads using OSS components such as Ray, Spark, Lance and Iceberg.

Responsibilities:

• Leverage AI-assisted software engineering to architect next-generation multimodal semantic search and data discovery platforms for autonomous driving development.

• Investigate and apply frontier large language models, visual language models, and state-of-the-art Retrieval Augmented Generation (RAG) techniques.

• Build out agentic data mining, semantic search, and data curation workflows as part of a recursive self-improvement machine learning loop.

• Develop data understanding platform infrastructure for real-time querying/vector databases and batch/stream processing using technologies like Ray, Spark, LanceDB, or similar.

• Deliver end-to-end data mining solutions that span onboard (C++) and offboard (ML & Data Infra) infrastructure to accelerate AV product development.

• Develop e2e solution for real-time semantic search services (text/images/videos) and vector DBs.

• Discover and identify key issues in existing ML infra and proactively improve system performance.

• Build low latency/high throughput batch or stream processing pipelines.

• Drive technical discussions across multiple orgs and deliver solutions on a timely basis.

• Write readable and high-performance Python/C++ code.

Qualifications:

• Experience with both ML platforms and building ML-based applications.

• 5+ years of relevant domain experience.

• Proven track record of building scalable, reliable infrastructure in a fast-paced environment.

• Deep understanding of design trade-offs with the ability to articulate those trade-offs and achieve alignment with others.

• Hands-on background in developing semantic search infrastructure, generating multimodal (video/image/audio) embeddings, and managing vector databases.

• Experience with multi-modal data indexing, model training infrastructure, model optimization, or large data processing pipelines.

• Experience in building ML models or infrastructure in autonomous vehicles, perception, and decision-making domains (desirable but not required).

#LI-AW1

We are proud to be an equal opportunity workplace. We believe that diverse teams produce the best ideas and outcomes. We are committed to building a culture of inclusion, entrepreneurship, and innovation across gender, race, age, sexual orientation, religion, disability, and identity.

Check out our Privacy Policy.

Please Note: Pursuant to its business activities and use of technology, Stack AV complies with all applicable U.S. national security laws, regulations, and administrative requirements, which can restrict Stack AV’s ability to employ certain persons in certain positions pursuant to a range of national security-related requirements. As such, this position may be contingent upon Stack AV verifying a candidate’s residence, U.S. person status, and/or citizenship status. This position may also involve working with software and technologies subject to U.S. export control regulations. Under these regulations, it may be necessary for Stack AV to obtain a U.S. government export license prior to releasing its technologies to certain persons. If Stack AV determines that a candidate’s residence, U.S. person status, and/or citizenship status will require a license, prohibit the candidate from working in this position, or otherwise be subject to national security-related restrictions, Stack AV expressly reserves the right to either consider the candidate for a different position that is not subject to such restrictions, on whatever terms and conditions Stack AV shall establish in its sole discretion, or, in the alternative, decline to move forward with the candidate’s application.

FAQ

How much experience do you need?

The posting asks for 5+ years in ml platform / ml infrastructure engineering. It is a senior-level role.

Does Stack AV sponsor visas for this role?

The posting does not say whether visa sponsorship is available. Ask the recruiter before you apply.

Is this role remote?

It is a remote role.

What tools and technologies does the posting mention?

LLMs, visual language models, RAG, Ray, Spark, Lance, LanceDB, Iceberg, vector databases, C++, Python, AI-assisted software engineering, open-world models, multimodal embeddings.