Founding Senior Applied AI Engineer
Goaly
- Palo Alto, CA
- On-site
- Senior level
- 5+ yrs experience
- AI/ML Engineering
- Sponsors visas
The role in 30 seconds
Goaly is building a platform to democratize AI development, enabling companies to become their own AI labs. As a Founding Senior Applied AI Engineer, you will build the core agent harness layer, shipping production systems that allow real users to leverage frontier AI models. You will own problems end-to-end, from initial prototypes to scalable, observable systems that run thousands of agent rollouts daily.
Is this role a fit for you?
The backgrounds this role is most likely to hire from, as RoleStack reads the posting.
Strong match
- B2B infrastructure / API / developer tools
- Software, SaaS & AI Platform
- AI/ML platform
- Developers / technical users
- Internal users (employees, ops teams)
Workable stretch
- Internal tooling / back-office systems
- B2C consumer-facing application
- Creator / builder / self-serve tool
- Enterprise users (complex workflows, admin panels, role-based access)
- SMB / small business (self-serve, simplicity-focused)
Harder transition
- Embedded systems / hardware-adjacent
- Marketplace / multi-sided platform
- Consumer / general public (high polish, conversion-focused)
- Regulated environment (healthcare, finance, government)
- Community / developer-led
Industry: Software, SaaS & AI Platform. See your personal match score
What they're really screening for
Must-haves
- CORE 5+ years building production software, with real experience running systems at scale (many users, high request volume, on-call scars).
- CORE Built and shipped an agentic system with tool use that real users depend on, and debugged it when it broke.
- CORE First-hand experience with the failure modes: context overflow, agents looping, tool misuse, prompt injection, runaway cost.
- CORE Strong Python plus at least one of TypeScript, Go, or Rust; comfortable with Docker, Linux, and cloud infrastructure.
- PLUS A habit of building your own evals instead of trusting public benchmarks; you measure before you claim.
- PLUS A strong pull toward the simplest system that works, and a low tolerance for complexity that does not earn its keep.
- PLUS Comfort operating without a playbook, in ambiguity, and being wrong quickly in front of customers.
- PLUS The ability to explain trade-offs clearly to engineers, researchers, and customers.
Nice-to-haves
- CORE Experience building agent platforms, workflow systems, model-serving products, ML infrastructure, or other developer-facing AI systems.
- PLUS Experience with multi-tenant control planes, identity and access management, metering or billing, enterprise security, or high-throughput APIs.
- CORE Familiarity with LLM inference, fine-tuning, evaluation, tool use, sandboxes, or the operational lifecycle of production agents.
- PLUS Experience owning open-source SDKs, developer tools, API documentation, examples, or community-facing integrations.
- PLUS Full-stack ability and an eye for interaction design when a product problem requires work beyond the backend.
Résumé keywords for this role
Terms the posting stresses. Include the ones you can honestly back up.
Tools & technologies
- AI
- Superintelligence Labs
- model
- agent
- harness
- loop
- tool interface
- system prompts
- permissions
- stop conditions
- retries
- budget caps
- output checks
- sandboxed execution environments
- containers
Concepts & phrases
- Founding Senior Applied AI Engineer
- AI lab
- agent harness
- founding role
- agent loop
- tool interface
- system prompts
- sandboxed execution environments
- context engineering
- agent run observable
- eval stack
- production traces
- LLM-as-judge
- real users
- workflow from prototype
Words that count as the same thing: "AI lab" ≈ AI development environment, AI experimentation platform · "agent harness" ≈ agent execution environment, AI agent framework · "agentic system" ≈ AI agent system, autonomous agent · "tool use" ≈ tool integration, API invocation · "context overflow" ≈ LLM context window limits, input buffer overflow
Check my résumé against these keywordsHiring at Goaly
Open senior roles RoleStack tracks right now, posted in the last 30 days.
Full job description from Goaly
From Goaly's posting. View the original
ABOUT US
We’re building toward a world where every company can become its own AI lab.
Goaly is a stealth AI startup founded by ex-Meta Superintelligence Labs engineers and researchers. Our mission is to dramatically lower the cost, time, and talent barriers to building proprietary AI — and make each generation of models faster and cheaper to build than the last.
Backed by leading AI investors and endorsed by frontier AI researchers and builders, we’re looking for exceptional new grads who want to work on hard, foundational AI systems problems with outsized ownership from day one.
Show full description Show less
ABOUT THE ROLE
You will be one of the first engineers building the layer between frontier models and real users: the agent harness. That means the loop, the tools, the context, the sandbox the agent runs in, and the evals that tell us whether it actually works. You will ship this into production for real customers, then turn what we learn from those runs into better environments, better evals, and better models.
This is a founding role. There is no playbook yet; you help write it. You will own problems end to end, from the first prototype with a customer to a system that runs thousands of agent rollouts a day without anyone watching it.
WHAT YOU'LL DO
- Own the harness: the agent loop, tool interface, system prompts, permissions, stop conditions, retries, budget caps, and output checks that turn a model into a dependable agent.
- Build sandboxed execution environments (containers / microVMs) that are isolated, reproducible, and fast enough to run thousands of rollouts in parallel, used both for serving and for RL and evals.
- Design context engineering: what goes into the window, when to compact, file-backed memory and state, retrieval, and hand-offs between sub-agents on long-running tasks.
- Make every agent run observable and replayable: trace every model call, tool call, and state change, so a failure at 3am can be reproduced at 9am.
- Build the eval stack: offline suites, tests on production traces, LLM-as-judge, and checks that catch reward hacking and silent failures before they poison training data.
- Ship with customers: embed with real users, take a workflow from prototype to stable production, and turn repeated patterns into reusable building blocks (tools, MCP servers, agent skills, playbooks).
- Close the loop with research: convert production traces and failures into tasks, environments, and reward signals for post-training.
- Make the model calls: pick which model runs where, and own the cost, latency, and quality trade-offs.
YOU MAY BE A GOOD FIT IF YOU HAVE
- 5+ years building production software, with real experience running systems at scale (many users, high request volume, on-call scars).
- Built and shipped an agentic system with tool use that real users depend on, and debugged it when it broke.
- First-hand experience with the failure modes: context overflow, agents looping, tool misuse, prompt injection, runaway cost.
- Strong Python plus at least one of TypeScript, Go, or Rust; comfortable with Docker, Linux, and cloud infrastructure.
- A habit of building your own evals instead of trusting public benchmarks; you measure before you claim.
- A strong pull toward the simplest system that works, and a low tolerance for complexity that does not earn its keep.
- Comfort operating without a playbook, in ambiguity, and being wrong quickly in front of customers.
- The ability to explain trade-offs clearly to engineers, researchers, and customers.
STRONG PLUSES
- Experience building agent platforms, workflow systems, model-serving products, ML infrastructure, or other developer-facing AI systems.
- Experience with multi-tenant control planes, identity and access management, metering or billing, enterprise security, or high-throughput APIs.
- Familiarity with LLM inference, fine-tuning, evaluation, tool use, sandboxes, or the operational lifecycle of production agents.
- Experience owning open-source SDKs, developer tools, API documentation, examples, or community-facing integrations.
- Full-stack ability and an eye for interaction design when a product problem requires work beyond the backend.
HOW WE WORK
- Mission first. We choose work for its impact on the mission and take responsibility for the outcome, not just our assigned tasks.
- High agency. We identify what is missing, form a plan, and move without waiting for perfect clarity.
- Speed with rigor. We ship, measure, and iterate quickly while protecting correctness, safety, and reliability.
- Flexible scope. We cross team and technical boundaries when that is the fastest way to solve the real problem.
- Low ego, high standards. We give direct feedback, change our minds when the evidence changes, and help the whole team win.
- Continuous learning. The stack changes quickly; we are willing to learn unfamiliar systems, methods, and domains as the work demands.
Location, visa sponsorship & benefits
- Hybrid in Palo Alto: 4+ days/week in office.
- Visa sponsorship: H-1B and OPT/CPT support available, with immigration counsel.
- Meals & perks: Complimentary lunch, dinner, snacks, and drinks.
A note on qualifications. We value exceptional ability over perfect keyword matches. If the work excites you and you can show strong technical ability, learning speed, or ownership, we encourage you to apply.
EQUAL OPPORTUNITY
We are an equal opportunity employer. We consider qualified applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, disability, veteran status, genetic information, or any other characteristic protected by applicable law. We provide reasonable accommodations for candidates who need them during the hiring process.
FAQ
How much experience do you need?
The posting asks for 5+ years in production software. It is a senior-level role.
Does Goaly sponsor visas for this role?
The posting says visa sponsorship is available.
Is this role remote?
It is an on-site role.
What tools and technologies does the posting mention?
AI, Superintelligence Labs, model, agent, harness, loop, tool interface, system prompts, permissions, stop conditions, retries, budget caps, output checks, sandboxed execution environments, containers.