Senior Software Engineer

Worth AI

  • Miami, FL
  • Remote
  • Senior level
  • 8+ yrs experience
  • AI/ML Engineering
  • Visa: not specified

The role in 30 seconds

Worth AI is seeking a Senior Software Engineer - AI Innovation to design and ship production agent systems for AI onboarding and underwriting, focusing on fintech and financial institutions. The role involves architecting agent graphs, building retrieval layers, implementing evaluation frameworks, and ensuring compliance with SOC 2, GDPR, and CCPA standards, while mentoring other engineers.

Is this role a fit for you?

The backgrounds this role is most likely to hire from, as RoleStack reads the posting.

Strong match

  • Internal tooling / back-office systems
  • B2B infrastructure / API / developer tools
  • Software, SaaS & AI Platform
  • Internal users (employees, ops teams)
  • Developers / technical users (docs, APIs, CLIs)

Workable stretch

  • B2C consumer-facing application
  • Marketplace / multi-sided platform
  • SMB / small business (self-serve, simplicity-focused)
  • Startup / greenfield (build from scratch, speed over polish)

Harder transition

  • Embedded systems / hardware-adjacent
  • Data platform / ML pipeline
  • Consumer / general public (high polish, conversion-focused)
  • Regulated environment (healthcare, finance, government)

Industry: Financial Services & FinTech. See your personal match score

What they're really screening for

Must-haves

  • CORE 8+ years of professional software engineering experience, with at least 2 years building production LLM or agentic systems (not just notebooks or demos).
  • CORE Solid software engineering experience - front-end, APIs, async patterns, queues, databases, and the failure modes of distributed systems.
  • CORE Demonstrated ownership of major features or subsystems in production.
  • PLUS Demonstrated experience mentoring junior engineers and raising team quality standards.
  • PLUS Demonstrated experience with event-driven systems: enrichment, retries, dead-lettering, backpressure.
  • PLUS Experience managing containerized applications in Kubernetes, EKS, ArgoCD, operators, Kustomize.
  • CORE Deep, hands-on experience with at least one modern agent framework (LangGraph strongly preferred) and a track record of shipping agents that actually run, fail gracefully, and recover.
  • CORE Real experience with evals you’ve built golden sets, run offline and online evaluations, and used them to make ship/no-ship calls.
  • CORE Production MLOps fluency: you’ve deployed LLM workloads under real latency, cost, and reliability constraints, and you instrument what you ship.
  • CORE Strong proficiency in Python; comfortable in TypeScript / Node.js for integrating with Worth’s services.

Nice-to-haves

  • PLUS Prior experience in fintech, lending, payments, KYB/KYC, fraud, or AML — or any other regulated, high-stakes data domain.
  • PLUS Experience building MCP servers or other structured tool interfaces for LLMs.
  • PLUS Background in classical ML (ranking, scoring, calibration) you can bring to bear alongside LLM systems.
  • PLUS Experience designing explainable / auditable AI workflows for regulated environments (SOC 2, model risk management, fair lending).
  • PLUS Open-source contributions to agent frameworks, eval tooling, or retrieval libraries.
  • PLUS Hands-on AWS depth (EKS, MSK, RDS, S3, Lambda) and IaC with Terraform.

Résumé keywords for this role

Terms the posting stresses. Include the ones you can honestly back up.

Tools & technologies

  • Python
  • Node.js
  • TypeScript
  • LangGraph
  • LangChain
  • Claude Agent SDK
  • MCP
  • OpenAI SDK
  • Anthropic Claude
  • OpenAI
  • Llama
  • Mistral
  • PostgreSQL
  • pgvector
  • vector DBs

Concepts & phrases

  • Senior Software Engineer - AI Innovation
  • AI onboarding and underwriting
  • revolutionize decision-making
  • artificial intelligence helping fintechs
  • onboard small businesses faster
  • infrastructure that powers real-time KYB
  • enterprise scale
  • Worth Score
  • unified credit score
  • designing and shipping production agent systems
  • making consequential decisions
  • regulated financial data
  • consolidates onboarding and underwriting
  • single AI-powered system
  • read, reason over, and act on

Words that count as the same thing: "agentic systems" ≈ production LLM systems, planner/executor systems, tool-using systems · "KYB" ≈ KYC, underwriting, risk monitoring · "LangGraph" ≈ CrewAI, AutoGen, Claude Agent SDK · "evals" ≈ golden sets, offline evaluations, online evaluations · "Production MLOps" ≈ LLM deployment, latency constraints, cost constraints

Check my résumé against these keywords

Hiring at Worth AI

Open senior roles RoleStack tracks right now, posted in the last 30 days.

More open roles at Worth AI

Full job description from Worth AI

From Worth AI's posting. View the original

Worth AI, a leader in AI onboarding and underwriting, is looking for a talented and experienced Senior Software Engineer - AI Innovation to join our team. At Worth AI, we are on a mission to revolutionize decision-making with the power of artificial intelligence helping fintechs, lenders, payment processors, and financial institutions onboard small businesses faster, smarter, and more confidently. We’re building the infrastructure that powers real-time KYB, KYC/IDV, underwriting, and continuous risk monitoring at enterprise scale, and the Worth Score™ our unified credit score derived from 1,200+ data points across 700M+ SMBs.

Show full description Show less

As a Senior Software Engineer - AI Innovation, you won’t be wiring up demos you’ll be designing and shipping production agent systems that make consequential decisions on regulated financial data. Worth’s platform consolidates onboarding and underwriting into a single AI-powered system, and our agents read, reason over, and act on the messy, high-stakes signals that come with that domain. You’ll own the end-to-end lifecycle: architecting agent graphs, building the retrieval and tool layers they rely on, instrumenting them with evals and observability, and getting them deployed against SOC 2 / GDPR / CCPA guardrails. You’ll partner closely with our Chief AI Officer, applied scientists, product, and platform teams to turn agentic patterns into customer outcomes.

Responsibilities

• Design and ship multi-step agentic systems (planner/executor, tool-using, multi-agent, human-in-the-loop) that automate KYB, underwriting, case review, and risk monitoring workflows.
• Architect agent graphs in LangGraph (or comparable frameworks CrewAI, AutoGen, Claude Agent SDK) with explicit state, durable execution, retries, and safe fallbacks.
• Build and harden the retrieval layer powering our agents chunking strategies, hybrid search, reranking, and grounded citation across SoS filings, IRS records, bank data, and Worth’s 700M+ SMB graph.
• Own the eval stack: golden sets, offline regression suites, LLM-as-judge, online A/B and shadow evals, and red-teaming for jailbreaks, prompt injection, and PII leakage.
• Wire agents into Worth’s production systems via well-typed tools, MCP servers, and existing services (decisioning engine, case management, crosswalking). Treat tool surface area as a product.
• Drive production MLOps for agents: deployment, versioning, traffic shaping, cost/latency budgets, observability (traces, token spend, tool call success), and on-call playbooks for agent incidents.
• Partner with security, compliance, and legal to keep agents inside Worth’s SOC 2, GDPR, CCPA, and fair-lending posture — building from day one, not bolted on.
• Translate ambiguous product bets (“what if the underwriter had an AI co-pilot for this?”) into concrete agent designs, prototypes, and shipped features.
• Mentor engineers across the org on agent patterns, prompt engineering hygiene, eval discipline, and the failure modes of LLM systems.
• Stay ahead of the frontier new models, frameworks, and patterns — and bring back what actually works in production.
Technology Stack

• Languages & Runtimes: Python, Node.js, TypeScript
• Agent / LLM frameworks: LangGraph, LangChain, Claude Agent SDK, MCP, OpenAI SDK
• Models: Anthropic Claude, OpenAI, open-weight (Llama, Mistral) where appropriate
• Retrieval & Data: PostgreSQL, pgvector / vector DBs, OpenSearch, Kafka, Redshift, Redis
• Infra & Orchestration: AWS, Kubernetes (EKS), ArgoCD, Terraform
• Evals & Observability: LangSmith / Langfuse / Braintrust-style tooling, DataDog, custom eval harnesses

• 8+ years of professional software engineering experience, with at least 2 years building production LLM or agentic systems (not just notebooks or demos).
• Solid software engineering experience - front-end, APIs, async patterns, queues, databases, and the failure modes of distributed systems.
• Demonstrated ownership of major features or subsystems in production.
• Demonstrated experience mentoring junior engineers and raising team quality standards.
• Demonstrated experience with event-driven systems: enrichment, retries, dead-lettering, backpressure.
• Experience managing containerized applications in Kubernetes, EKS, ArgoCD, operators, Kustomize.
• Deep, hands-on experience with at least one modern agent framework (LangGraph strongly preferred) and a track record of shipping agents that actually run, fail gracefully, and recover.
• Real experience with evals you’ve built golden sets, run offline and online evaluations, and used them to make ship/no-ship calls.
• Production MLOps fluency: you’ve deployed LLM workloads under real latency, cost, and reliability constraints, and you instrument what you ship.
• Strong proficiency in Python; comfortable in TypeScript / Node.js for integrating with Worth’s services.
• Clear, calibrated communicator - able to explain agent trade-offs to product, security, and customers without hand-waving.
• Operates with extreme ownership in ambiguous, fast-moving environments. Excited to work alongside a team that values “One Team”, “Extreme Ownership”, and “Create Raving Fans.”
Success Metrics

• Agent Quality: Measurable improvements in task success rate, grounding accuracy, and hallucination rate on Worth’s eval suites, tied to customer-visible outcomes.
• Production Reliability: Agents you own meet defined SLOs for latency (P90/P99), tool-call success rate, and cost per task.
• Velocity: New agent capabilities go from prototype to production in weeks, not quarters, without skipping evals or guardrails.
• Risk Posture: Zero material incidents tied to prompt injection, PII leakage, or unsafe tool use on agents you own.
• Force Multiplier: Patterns, tools, and eval scaffolding you build are adopted by other engineers across Worth.
Bonus Points (nice to haves, not requirements)

• Prior experience in fintech, lending, payments, KYB/KYC, fraud, or AML — or any other regulated, high-stakes data domain.
• Experience building MCP servers or other structured tool interfaces for LLMs.
• Background in classical ML (ranking, scoring, calibration) you can bring to bear alongside LLM systems.
• Experience designing explainable / auditable AI workflows for regulated environments (SOC 2, model risk management, fair lending).
• Open-source contributions to agent frameworks, eval tooling, or retrieval libraries.
• Hands-on AWS depth (EKS, MSK, RDS, S3, Lambda) and IaC with Terraform.

**All Remote Hires — will be required to travel to Orlando, Florida at least twice per year for Town Halls and team collaboration, in addition to orientation in Orlando, Florida.

FAQ

How much experience do you need?

The posting asks for 8+ years in software engineering. It is a senior-level role.

Does Worth AI sponsor visas for this role?

The posting does not say whether visa sponsorship is available. Ask the recruiter before you apply.

Is this role remote?

It is a remote role.

What tools and technologies does the posting mention?

Python, Node.js, TypeScript, LangGraph, LangChain, Claude Agent SDK, MCP, OpenAI SDK, Anthropic Claude, OpenAI, Llama, Mistral, PostgreSQL, pgvector, vector DBs.