Member of Technical Staff, Mid-training
Hark
- San Jose, CA
- On-site
- Mid level
- Machine Learning Engineering
- Visa: not specified
- $180k–$450k
The role in 30 seconds
Hark is an AI company building advanced, personalized intelligence. The Omni team is developing multimodal foundation models to create seamless, real-time multimodal intelligence that powers intuitive and immersive user experiences beyond text. As part of the Omni team, you will build the mid-training stages that adapt pretrained models before post-training.
Is this role a fit for you?
The backgrounds this role is most likely to hire from, as RoleStack reads the posting.
Strong match
- Software, SaaS & AI Platform
- B2B infrastructure / API / developer tools
- AI platform
- Enterprise-scale
- Growth-stage
Workable stretch
- B2B enterprise platform / workflow software
- Data platform / ML pipeline
- Startup / greenfield
Harder transition
- Internal tooling / back-office systems
- B2C consumer-facing application
- Creator / builder / self-serve tool
- Marketplace / multi-sided platform
- Embedded systems / hardware-adjacent
Industry: Software, SaaS & AI Platform. See your personal match score
What they're really screening for
Must-haves
- CORE Experience with continued pretraining or late-stage training, such as learning-rate decay, high-quality data mixtures, or context extension.
- CORE Experience building synthetic data pipelines, including generation, verification, and filtering, and evaluating their effects on model quality and data diversity.
- CORE Strong experimental judgment, including isolating recipe changes in controlled ablations and assessing whether improvements transfer to larger runs.
- CORE Experience implementing and debugging distributed training workloads across GPU clusters.
- CORE Experience designing evaluations and identifying confounds such as benchmark contamination, prompt sensitivity, and formatting effects.
- CORE Strong engineering skills, including implementing training methods and building reliable data and experimentation pipelines.
- CORE A record of improving model capabilities or training methods through research, datasets, systems, or production work.
Nice-to-haves
- PLUS Experience with distillation, rejection sampling, or model-based data generation for reasoning, code, or math.
- PLUS Experience with long-context training, including rotary position embedding (RoPE) scaling, context parallelism, or long-document datasets.
- PLUS Experience with post-training and evaluating how pretrained checkpoints respond to subsequent adaptation.
- PLUS Experience training or distilling smaller models for constrained inference budgets.
- PLUS Experience with audio, speech, image, video, or interleaved multimodal datasets.
- PLUS Experience detecting benchmark contamination and removing overlapping examples from training data.
Résumé keywords for this role
Terms the posting stresses. Include the ones you can honestly back up.
Tools & technologies
- AI
- artificial intelligence
- multimodal
- speech
- text
- vision
- persistent memory
- hardware
- universal interface
- chat boxes
- devices
- agentic systems
- models
- pretraining
- post-training
Concepts & phrases
- Member of Technical Staff
- advanced, personalized intelligence
- next-generation hardware
- universal interface
- omnimodal models
- next-generation AI hardware
- seamless, real-time multimodal intelligence
- multimodal foundation models
- mid-training recipes
- learning-rate schedules
- context extension
- synthetic data pipelines
- code execution tests
- reasoning traces
- controlled experiments
Words that count as the same thing: "mid-training" ≈ continued pretraining, late-stage training, adaptation phase training · "context extension" ≈ long-context training, document packing, sequence construction · "distill" ≈ knowledge distillation, model compression
Check my résumé against these keywordsHiring at Hark
Open senior roles RoleStack tracks right now, posted in the last 30 days.
More open roles at Hark
Full job description from Hark
From Hark's posting. View the original
About Hark
Hark is an artificial intelligence company building advanced, personalized intelligence. One that is proactive, multimodal, and capable of interacting with the world through speech, text, vision, and persistent memory.
We're pairing that intelligence with next-generation hardware to create a universal interface between humans and machines. While today's AI largely operates through chat boxes and decade-old devices, Hark is focused on what comes next: agentic systems that interact naturally with people and the real world.
Show full description Show less
To get there, we're developing multimodal models and next-generation AI hardware together - designed from the ground up as a single, unified interface for a new era of intelligent systems.
About the Role
The Omni team at Hark is building the next generation of AI experiences beyond text, enabling models to understand and generate content across multiple modalities, including text, audio, and beyond. Our goal is to create seamless, real-time multimodal intelligence that powers intuitive and immersive user experiences.
As part of the Omni team, you will build the multimodal foundation models at the core of this effort. You'll develop the training stages that adapt pretrained models before post-training. This work includes high-quality and synthetic data mixtures, learning-rate schedules, context extension, and distillation. You'll run experiments to improve model capabilities and work with evaluation and post-training researchers to assess checkpoint quality.
Responsibilities
• Develop mid-training recipes using high-quality and synthetic data, including learning-rate decay schedules and data-mixture changes.
• Build synthetic data pipelines with code execution tests, math-answer checks, and filters for reasoning traces.
• Distill capabilities from larger models into smaller models through synthetic data generation and rejection sampling.
• Develop long-context data recipes, including document packing and sequence construction, and evaluate their effect on both long- and short-context performance.
• Evaluate mid-training checkpoints with the post-training team, measure how well results predict subsequent model quality, and select checkpoints for further training.
• Run controlled experiments on learning-rate schedules, mixture weights, and data ordering across text, code, and multimodal training data.
Requirements
• Experience with continued pretraining or late-stage training, such as learning-rate decay, high-quality data mixtures, or context extension.
• Experience building synthetic data pipelines, including generation, verification, and filtering, and evaluating their effects on model quality and data diversity.
• Strong experimental judgment, including isolating recipe changes in controlled ablations and assessing whether improvements transfer to larger runs.
• Experience implementing and debugging distributed training workloads across GPU clusters.
• Experience designing evaluations and identifying confounds such as benchmark contamination, prompt sensitivity, and formatting effects.
• Strong engineering skills, including implementing training methods and building reliable data and experimentation pipelines.
• A record of improving model capabilities or training methods through research, datasets, systems, or production work.
Bonus Qualifications
• Experience with distillation, rejection sampling, or model-based data generation for reasoning, code, or math.
• Experience with long-context training, including rotary position embedding (RoPE) scaling, context parallelism, or long-document datasets.
• Experience with post-training and evaluating how pretrained checkpoints respond to subsequent adaptation.
• Experience training or distilling smaller models for constrained inference budgets.
• Experience with audio, speech, image, video, or interleaved multimodal datasets.
• Experience detecting benchmark contamination and removing overlapping examples from training data.
Compensation
The US base salary range for this full-time position is between $180,000 - $450,000 annually.
The pay offered for this position may vary based on several individual factors, including job-related knowledge, skills, and experience. The total compensation package may also include additional components/benefits depending on the specific role. This information will be shared if an employment offer is extended.
FAQ
How much does a Member of Technical Staff, Mid-training at Hark make?
The posted pay for this role is $180k–$450k a year.
Does Hark sponsor visas for this role?
The posting does not say whether visa sponsorship is available. Ask the recruiter before you apply.
Is this role remote?
It is an on-site role.
What tools and technologies does the posting mention?
AI, artificial intelligence, multimodal, speech, text, vision, persistent memory, hardware, universal interface, chat boxes, devices, agentic systems, models, pretraining, post-training.