Member of Technical Staff, Pretraining Architecture and Scaling

Hark

  • San Jose, CA
  • Hybrid
  • Senior level
  • Machine Learning Research
  • Visa: not specified
  • $180k–$450k

The role in 30 seconds

Hark is an artificial intelligence company building advanced, personalized intelligence that is proactive, multimodal, and capable of interacting with the world through speech, text, vision, and persistent memory. The Omni team at Hark is building the next generation of AI experiences beyond text, enabling models to understand and generate content across multiple modalities. As part of the Omni team, you will build the multimodal foundation models at the core of this effort.

Is this role a fit for you?

The backgrounds this role is most likely to hire from, as RoleStack reads the posting.

Strong match

  • B2B infrastructure / API / developer tools
  • Software, SaaS & AI Platform
  • Data platform / ML pipeline
  • Growth-stage (scaling existing systems, reliability concerns)
  • Enterprise-scale (high availability, compliance, large distributed systems)

Workable stretch

  • B2B enterprise platform / workflow software
  • Startup / greenfield (build from scratch, speed over polish)

Harder transition

  • B2C consumer-facing application
  • Internal tooling / back-office systems
  • Creator / builder / self-serve tool
  • Marketplace / multi-sided platform
  • Embedded systems / hardware-adjacent

Industry: Software, SaaS & AI Platform. See your personal match score

What they're really screening for

Must-haves

  • CORE Hands-on experience training large models and making trade-offs among model quality, compute cost, and training stability.
  • CORE Strong experimental judgment, including designing controlled experiments that distinguish between competing hypotheses.
  • CORE Experience applying scaling laws to experiment design and evaluating extrapolations from smaller training runs.
  • CORE Experience implementing and debugging distributed training workloads across GPU clusters.
  • CORE Strong engineering skills, including implementing research ideas, profiling training workloads, and debugging model behavior.
  • PLUS A record of improving model quality or training efficiency through research, engineering, open-source contributions, or production work.

Nice-to-haves

  • CORE Experience with mixture-of-experts routing, sparse architectures, or long-context methods.
  • PLUS Work on data mixtures, curriculum, or tokenizer design.
  • PLUS Kernel-level optimization or mixed-precision training experience.
  • PLUS Experience with efficiency work aimed at constrained inference targets, including on-device.

Résumé keywords for this role

Terms the posting stresses. Include the ones you can honestly back up.

Tools & technologies

  • AI
  • multimodal
  • next-generation hardware
  • agentic systems
  • multimodal models
  • next-generation AI hardware
  • AI hardware
  • multimodal foundation models
  • pretraining
  • data curation
  • mixture design
  • model architecture
  • scaling
  • distributed training
  • evaluation

Concepts & phrases

  • Member of Technical Staff
  • Pretraining Architecture and Scaling
  • artificial intelligence company
  • advanced, personalized intelligence
  • proactive, multimodal
  • persistent memory
  • next-generation hardware
  • universal interface
  • humans and machines
  • agentic systems
  • multimodal models
  • next-generation AI hardware
  • unified interface
  • new era of intelligent systems
  • multimodal foundation models

Words that count as the same thing: "multimodal" ≈ text, audio, vision · "agentic systems" ≈ proactive AI, AI that interacts with the world · "foundation models" ≈ large models, pretraining

Check my résumé against these keywords

Hiring at Hark

Open senior roles RoleStack tracks right now, posted in the last 30 days.

More open roles at Hark

Full job description from Hark

From Hark's posting. View the original

About Hark

Hark is an artificial intelligence company building advanced, personalized intelligence. One that is proactive, multimodal, and capable of interacting with the world through speech, text, vision, and persistent memory.

We're pairing that intelligence with next-generation hardware to create a universal interface between humans and machines. While today's AI largely operates through chat boxes and decade-old devices, Hark is focused on what comes next: agentic systems that interact naturally with people and the real world.

Show full description Show less

To get there, we're developing multimodal models and next-generation AI hardware together - designed from the ground up as a single, unified interface for a new era of intelligent systems.

About the Role

The Omni team at Hark is building the next generation of AI experiences beyond text, enabling models to understand and generate content across multiple modalities, including text, audio, and beyond. Our goal is to create seamless, real-time multimodal intelligence that powers intuitive and immersive user experiences.

As part of the Omni team, you will build the multimodal foundation models at the core of this effort. You will work across the full pretraining stack, from large-scale data curation and mixture design to model architecture, scaling, distributed training, and evaluation, to create natively multimodal models that reason and respond fluidly across modalities. Your work will set the base capabilities that every downstream Omni experience is built on. You'll research architectures and training methods for Hark's multimodal foundation models. You'll design experiments, study how results change with model and dataset scale, and use the findings to improve model quality and training efficiency. The role includes implementing research ideas and developing training recipes with data researchers and training engineers.

Responsibilities

• Conduct research on model architecture, optimization, and scaling to improve the capability and efficiency of our largest models.

• Establish baselines and run controlled experiments to evaluate which architectural and optimization changes improve performance at larger scales.

• Develop training recipes, including learning-rate schedules, context lengths, token budgets, and compute allocation.

• Investigate mixture-of-experts architectures, hybrid attention, and support for long-context training.

• Diagnose loss spikes, divergence, and numerical issues, working with training engineers to distinguish modeling problems from infrastructure failures.

Requirements

• Hands-on experience training large models and making trade-offs among model quality, compute cost, and training stability.

• Strong experimental judgment, including designing controlled experiments that distinguish between competing hypotheses.

• Experience applying scaling laws to experiment design and evaluating extrapolations from smaller training runs.

• Experience implementing and debugging distributed training workloads across GPU clusters.

• Strong engineering skills, including implementing research ideas, profiling training workloads, and debugging model behavior.

• A record of improving model quality or training efficiency through research, engineering, open-source contributions, or production work.

Bonus Qualifications

• Experience with mixture-of-experts routing, sparse architectures, or long-context methods.

• Work on data mixtures, curriculum, or tokenizer design.

• Kernel-level optimization or mixed-precision training experience.

• Experience with efficiency work aimed at constrained inference targets, including on-device.

Compensation

The US base salary range for this full-time position is between $180,000 - $450,000 annually.

The pay offered for this position may vary based on several individual factors, including job-related knowledge, skills, and experience. The total compensation package may also include additional components/benefits depending on the specific role. This information will be shared if an employment offer is extended.

FAQ

How much does a Member of Technical Staff, Pretraining Architecture and Scaling at Hark make?

The posted pay for this role is $180k–$450k a year.

Does Hark sponsor visas for this role?

The posting does not say whether visa sponsorship is available. Ask the recruiter before you apply.

Is this role remote?

It is a hybrid role: part remote, part in the office.

What tools and technologies does the posting mention?

AI, multimodal, next-generation hardware, agentic systems, multimodal models, next-generation AI hardware, AI hardware, multimodal foundation models, pretraining, data curation, mixture design, model architecture, scaling, distributed training, evaluation.