Member of Technical Staff, Pretraining Architecture and Scaling
Hark
- San Jose, CA
- Hybrid
- Senior level
- Machine Learning Research
- Visa: not specified
- $180k–$450k
The role in 30 seconds
Hark is an artificial intelligence company building advanced, personalized intelligence that is proactive, multimodal, and capable of interacting with the world through speech, text, vision, and persistent memory. The Omni team at Hark is building the next generation of AI experiences beyond text, enabling models to understand and generate content across multiple modalities. As part of the Omni team, you will build the multimodal foundation models at the core of this effort.
Is this role a fit for you?
The backgrounds this role is most likely to hire from, as RoleStack reads the posting.
Strong match
- B2B infrastructure / API / developer tools
- Software, SaaS & AI Platform
- Data platform / ML pipeline
- Growth-stage (scaling existing systems, reliability concerns)
- Enterprise-scale (high availability, compliance, large distributed systems)
Workable stretch
- B2B enterprise platform / workflow software
- Startup / greenfield (build from scratch, speed over polish)
Harder transition
- B2C consumer-facing application
- Internal tooling / back-office systems
- Creator / builder / self-serve tool
- Marketplace / multi-sided platform
- Embedded systems / hardware-adjacent
Industry: Software, SaaS & AI Platform. See your personal match score
What they're really screening for
Must-haves
- CORE Hands-on experience training large models and making trade-offs among model quality, compute cost, and training stability.
- CORE Strong experimental judgment, including designing controlled experiments that distinguish between competing hypotheses.
- CORE Experience applying scaling laws to experiment design and evaluating extrapolations from smaller training runs.
- CORE Experience implementing and debugging distributed training workloads across GPU clusters.
- CORE Strong engineering skills, including implementing research ideas, profiling training workloads, and debugging model behavior.
- PLUS A record of improving model quality or training efficiency through research, engineering, open-source contributions, or production work.
Nice-to-haves
- CORE Experience with mixture-of-experts routing, sparse architectures, or long-context methods.
- PLUS Work on data mixtures, curriculum, or tokenizer design.
- PLUS Kernel-level optimization or mixed-precision training experience.
- PLUS Experience with efficiency work aimed at constrained inference targets, including on-device.
Résumé keywords for this role
Terms the posting stresses. Include the ones you can honestly back up.
Tools & technologies
- AI
- multimodal
- next-generation hardware
- agentic systems
- multimodal models
- next-generation AI hardware
- AI hardware
- multimodal foundation models
- pretraining
- data curation
- mixture design
- model architecture
- scaling
- distributed training
- evaluation
Concepts & phrases
- Member of Technical Staff
- Pretraining Architecture and Scaling
- artificial intelligence company
- advanced, personalized intelligence
- proactive, multimodal
- persistent memory
- next-generation hardware
- universal interface
- humans and machines
- agentic systems
- multimodal models
- next-generation AI hardware
- unified interface
- new era of intelligent systems
- multimodal foundation models
Words that count as the same thing: "multimodal" ≈ text, audio, vision · "agentic systems" ≈ proactive AI, AI that interacts with the world · "foundation models" ≈ large models, pretraining
Check my résumé against these keywordsHiring at Hark
Open senior roles RoleStack tracks right now, posted in the last 30 days.
More open roles at Hark
- Member of Technical Staff, Distributed Training Performance $180k–$450k
- Member of Technical Staff, Pretraining Evaluations $180k–$450k
- Member of Technical Staff, Mid-training $180k–$450k
Full job description from Hark
From Hark's posting. View the original
About Hark
Hark is an artificial intelligence company building advanced, personalized intelligence. One that is proactive, multimodal, and capable of interacting with the world through speech, text, vision, and persistent memory.
We're pairing that intelligence with next-generation hardware to create a universal interface between humans and machines. While today's AI largely operates through chat boxes and decade-old devices, Hark is focused on what comes next: agentic systems that interact naturally with people and the real world.
Show full description Show less
To get there, we're developing multimodal models and next-generation AI hardware together - designed from the ground up as a single, unified interface for a new era of intelligent systems.
About the Role
The Omni team at Hark is building the next generation of AI experiences beyond text, enabling models to understand and generate content across multiple modalities, including text, audio, and beyond. Our goal is to create seamless, real-time multimodal intelligence that powers intuitive and immersive user experiences.
As part of the Omni team, you will build the multimodal foundation models at the core of this effort. You will work across the full pretraining stack, from large-scale data curation and mixture design to model architecture, scaling, distributed training, and evaluation, to create natively multimodal models that reason and respond fluidly across modalities. Your work will set the base capabilities that every downstream Omni experience is built on. You'll research architectures and training methods for Hark's multimodal foundation models. You'll design experiments, study how results change with model and dataset scale, and use the findings to improve model quality and training efficiency. The role includes implementing research ideas and developing training recipes with data researchers and training engineers.
Responsibilities
• Conduct research on model architecture, optimization, and scaling to improve the capability and efficiency of our largest models.
• Establish baselines and run controlled experiments to evaluate which architectural and optimization changes improve performance at larger scales.
• Develop training recipes, including learning-rate schedules, context lengths, token budgets, and compute allocation.
• Investigate mixture-of-experts architectures, hybrid attention, and support for long-context training.
• Diagnose loss spikes, divergence, and numerical issues, working with training engineers to distinguish modeling problems from infrastructure failures.
Requirements
• Hands-on experience training large models and making trade-offs among model quality, compute cost, and training stability.
• Strong experimental judgment, including designing controlled experiments that distinguish between competing hypotheses.
• Experience applying scaling laws to experiment design and evaluating extrapolations from smaller training runs.
• Experience implementing and debugging distributed training workloads across GPU clusters.
• Strong engineering skills, including implementing research ideas, profiling training workloads, and debugging model behavior.
• A record of improving model quality or training efficiency through research, engineering, open-source contributions, or production work.
Bonus Qualifications
• Experience with mixture-of-experts routing, sparse architectures, or long-context methods.
• Work on data mixtures, curriculum, or tokenizer design.
• Kernel-level optimization or mixed-precision training experience.
• Experience with efficiency work aimed at constrained inference targets, including on-device.
Compensation
The US base salary range for this full-time position is between $180,000 - $450,000 annually.
The pay offered for this position may vary based on several individual factors, including job-related knowledge, skills, and experience. The total compensation package may also include additional components/benefits depending on the specific role. This information will be shared if an employment offer is extended.
FAQ
How much does a Member of Technical Staff, Pretraining Architecture and Scaling at Hark make?
The posted pay for this role is $180k–$450k a year.
Does Hark sponsor visas for this role?
The posting does not say whether visa sponsorship is available. Ask the recruiter before you apply.
Is this role remote?
It is a hybrid role: part remote, part in the office.
What tools and technologies does the posting mention?
AI, multimodal, next-generation hardware, agentic systems, multimodal models, next-generation AI hardware, AI hardware, multimodal foundation models, pretraining, data curation, mixture design, model architecture, scaling, distributed training, evaluation.