Senior AI Engineer
Osano
- Remote - US
- Remote
- Senior level
- 5+ yrs experience
- AI/ML Engineering
- Visa: not specified
The role in 30 seconds
Osano is hiring a Senior AI Engineer to build and improve its intelligent privacy assistant. The role involves taking AI capabilities from first idea to production, with an emphasis on reliability, measurability, and trustworthiness. The engineer will work on agentic systems, RAG, and evaluation frameworks while embedding privacy-by-design principles.
Is this role a fit for you?
The backgrounds this role is most likely to hire from, as RoleStack reads the posting.
Strong match
- B2B enterprise platform / workflow software
- B2B infrastructure / API / developer tools
- Growth-stage
- Enterprise-scale
Workable stretch
- Data platform / ML pipeline
- Creator / builder / self-serve tool
- Startup / greenfield
Harder transition
- B2C consumer-facing application
- Embedded systems / hardware-adjacent
- Regulated environment
Industry: Software, SaaS & AI Platform (with privacy/security focus). See your personal match score
What they're really screening for
Must-haves
- CORE 5+ years of professional software engineering or AI/ML experience
- CORE Demonstrated experience building and running agentic systems in production with real users, not just prototypes or internal demos
- CORE Deep technical understanding of LLM usage and orchestration beyond prompt engineering
- CORE Proven experience building complex RAG systems and autonomous AI agents
- PLUS Clear written and verbal communication; able to explain technical trade-offs to engineers and non-technical stakeholders
- PLUS Concrete examples of getting from ambiguity to results
- PLUS Experience building for privacy/security-conscious enterprise users or similar users
- PLUS Experience in privacy, compliance, or adjacent regulated domain
Nice-to-haves
- PLUS Strong expertise in the Python AI ecosystem, including FastAPI and LangGraph
- PLUS Experience with Knowledge Graphs to enhance RAG precision
- PLUS Familiarity with Privacy-Enhancing Technologies (PETs)
- PLUS Experience with data anonymization techniques
- PLUS Background in compliance-heavy or regulated environments
Résumé keywords for this role
Terms the posting stresses. Include the ones you can honestly back up.
Tools & technologies
- LLM
- RAG
- agentic
- FastAPI
- LangGraph
- Knowledge Graphs
- Privacy-Enhancing Technologies (PETs)
- Python
Concepts & phrases
- Senior AI Engineer
- agentic systems
- LLM-powered systems
- retrieval (RAG) systems
- autonomous AI agents
- evaluation frameworks
- privacy-by-design
- data sovereignty
- responsible AI
- production deployments
- structured outputs
- technical trade-offs
- ambiguity to results
- privacy
- compliance
Words that count as the same thing: "RAG" ≈ Retrieval-Augmented Generation, retrieval-augmented generation · "LLM" ≈ Large Language Model, large language model · "agentic systems" ≈ AI agents, autonomous agents, agent-based systems · "PETs" ≈ Privacy-Enhancing Technologies, privacy enhancing technologies
Check my résumé against these keywordsHiring at Osano
Open senior roles RoleStack tracks right now, posted in the last 30 days.
More open roles at Osano
Full job description from Osano
From Osano's posting. View the original
This role may require in-person interview/s.
About Osano:
Osano is an innovative B-Corporation built around a simple belief: privacy is a fundamental right. Since day one, we’ve been focused on giving modern enterprises the ability to innovate quickly, stay competitive, and earn customer trust by respecting data privacy and complying with consent guidelines. Our products help organizations operate confidently in a rapidly evolving regulatory and technological landscape.
Show full description Show less
About the Role:
We’re hiring a Senior AI Engineer to build and improve Osano AI, our intelligent privacy assistant. As part of the Osano AI team, you will take capabilities from first idea to production, with an emphasis on delivering capabilities that are reliable, measurable, and trustworthy.
This role goes beyond wrapping APIs or building chat interfaces. We are looking for an engineer who has shipped LLM-powered systems that real users depend on. That means that you’ve dealt with hallucinations, latency, cost, evaluation, and tricky edge cases within agentic systems, and you know what it takes to keep these non-deterministic systems working after launch.
You will often work on problems that aren’t well-defined. Success here depends on how you think, communicate, and work with others as much as on what you build. This position is ideal for someone who is highly technical, thrives in ambiguity, takes ownership of 0→1 initiatives, wants to have an outsized impact, and believes responsible AI is non-negotiable.
Responsibilities:
Build and ship production AI
• Design, build, and maintain agentic features across our products, from early prototype to scaled production deployments.
• Build retrieval (RAG) systems that build trust through verifiable sources.
• Build agentic and multi-step workflows with guardrails, observability, and structured outputs.
• Balance quality, latency, reliability, and cost in production.
Measure and improve AI systems
• Build thorough evaluation frameworks that cover accuracy, grounding, latency, and reliability, utilizing both offline evaluations and real-world production signals.
• Deploy data-driven methods to decide what to ship, how to fix it, and what to stop doing.
• Continuously refine deployed systems based on measurable outcomes.
Collaborate and communicate
• Work closely with product managers, engineers, privacy experts, and other stakeholders to decide what to build, how to build it, and why.
• Write clear design documents and run effective technical discussions.
Privacy-First Development
• Embed privacy-by-design principles across the AI stack.
• Ensure compliance, data sovereignty, and secure handling practices.
• Collaborate cross-functionally to align AI capabilities with regulatory standards.
About You:
• You’re curious, self-directed, and motivated to learn quickly.
• You’re comfortable navigating ambiguity and creating clarity for others.
• You’re excited about privacy, responsible AI, and building trustworthy technology.
• You are willing to relentlessly pursue the best, most responsible ways to leverage AI—without overselling its capabilities or ignoring its limitations.
Must-Haves:
• 5+ years of professional software engineering or AI/ML experience
• Demonstrated experience building and running agentic systems in production with real users, not just prototypes or internal demos.
• Deep technical understanding of LLM usage and orchestration beyond prompt engineering.
• Proven experience building complex RAG systems and autonomous AI agents.
• Clear written and verbal communication. You can explain technical trade-offs to both engineers and non-technical stakeholders.
• Concrete examples of getting from ambiguity to results.
Nice-to-Haves:
• Strong expertise in the Python AI ecosystem, including FastAPI and LangGraph.
• Experience with Knowledge Graphs to enhance RAG precision
• Familiarity with Privacy-Enhancing Technologies (PETs)
• Experience with data anonymization techniques
• Background in compliance-heavy or regulated environments
Why Us:
• We're a welcoming team that's dependable, curious, moves fast, and full of talented people
• We're a B-corporation with a mission that matters, in a high-growth space with significant potential
• You'll have access to our training program, well-defined career paths, and a leadership team that values professional development
Benefits:
• Competitive-pay compensation and ownership interest/equity
• Unlimited paid time off, plus a requirement to take at least two weeks off per year
• We're a Best Place for Working Parents and offer paid parental leave for all new parents
• Osano sponsors individual premiums on base plans at 100% and dependent premiums at 50% for Medical, Dental, and Vision insurance via Aetna
• A fully and permanently remote company, so you can work from anywhere in the U.S.
• Receive a MacBook and $600 to craft your home workspace
• Annual company trip designed to foster connection, creativity, and fun
• Mental health benefits with free memberships to mindfulness and talk therapy services
A Bit More About Osano
Osano is a leading data privacy platform that helps organizations quickly and confidently comply with laws like GDPR, CCPA, and other global privacy regulations. From consent management to vendor risk monitoring, Osano makes complex privacy tasks refreshingly simple, so companies can focus on what they do best, while we handle the rest.
We’re backed by top-tier investors including Baird Capital, Jump Capital, and LiveOak, and we’re scaling fast with a multi-year runway and ambitious growth plans. We’ve also been recognized as a Great Place to Work for four years running, with 97% of employees saying Osano is a great place to work.
As we grow, we're looking for individuals who lean into modern technologies and smarter systems to drive efficiency, clarity, and speed; both in our product and in how we operate. If you're excited by the idea of helping build a high-growth, privacy-first company that embraces thoughtful automation, emerging tech, and intentional collaboration, we’d love to hear from you.
Osano is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, marital status, genetic information, disability, veteran status, or any other characteristic protected by applicable law.
FAQ
How much experience do you need?
The posting asks for 5+ years in software engineering or ai/ml. It is a senior-level role.
Does Osano sponsor visas for this role?
The posting does not say whether visa sponsorship is available. Ask the recruiter before you apply.
Is this role remote?
It is a remote role.
What tools and technologies does the posting mention?
LLM, RAG, agentic, FastAPI, LangGraph, Knowledge Graphs, Privacy-Enhancing Technologies (PETs), Python.