Senior Anti-Fraud Engineer (Full-Time)

Toloka

  • Remote - US ; United Kingdom ; Netherlands ; Serbia
  • Remote
  • Senior level
  • Anti-Fraud Engineering
  • Visa: not specified

The role in 30 seconds

At Toloka, our team builds the systems that detect and stop fraud on the Toloka platform. We are looking for a Senior Anti-Fraud Engineer to explore data for new fraud patterns, design metrics for protection effectiveness, and develop production solutions including ML models and LLM-based approaches to stay ahead of evolving threats.

Is this role a fit for you?

The backgrounds this role is most likely to hire from, as RoleStack reads the posting.

Strong match

  • B2B infrastructure / API / developer tools
  • Internal tooling / back-office systems
  • Software, SaaS & AI Platform
  • Growth-stage
  • Startup / greenfield

Workable stretch

  • B2C consumer-facing application
  • Marketplace / multi-sided platform
  • Enterprise-scale

Harder transition

  • Embedded systems / hardware-adjacent
  • Data platform / ML pipeline
  • Regulated environment

Industry: Software, SaaS & AI Platform. See your personal match score

What they're really screening for

Must-haves

  • CORE Analytical thinking. You can frame a vague problem, choose the right metrics, and draw sound conclusions from messy data.
  • CORE Hypothesis-driven approach. You generate ideas from data and know how to test them properly.
  • CORE SQL. You write confident, efficient queries on large datasets
  • CORE Python & ML. You can build features, train and evaluate models, and ship them to production.
  • CORE Data pipelines. You have working experience with Airflow or similar orchestration tools.
  • PLUS Product sense. You understand the trade-offs of protection: false positives, impact on honest users, and cost.
  • CORE Experience building systems that detect and stop fraud on the Toloka platform.
  • CORE Experience with LLMs to detect and stop fraud.
  • PLUS Experience with ClickHouse
  • PLUS Practical experience with LLMs

Nice-to-haves

  • CORE Hands-on experience in anti-fraud, trust & safety, risk, or abuse prevention
  • PLUS Experience with anomaly detection, graph analysis, or behavioral modeling.
  • PLUS Experience applying LLMs to analytical or classification tasks.
  • PLUS Experience with crowdsourcing or data annotation platforms.
  • PLUS Experience with ClickHouse is a plus.
  • PLUS Practical experience with LLMs is a plus.
  • PLUS Experience with Databricks.

Résumé keywords for this role

Terms the posting stresses. Include the ones you can honestly back up.

Tools & technologies

  • GenAI
  • LLMs
  • SQL
  • Python
  • Airflow
  • ML models
  • LLM-based approaches
  • ClickHouse
  • Databricks
  • AI/ML
  • Anomaly detection
  • Graph analysis
  • Behavioral modeling

Concepts & phrases

  • Senior Anti-Fraud Engineer
  • Toloka AI
  • data that powers
  • GenAI models
  • frontier labs
  • big tech
  • AI startups
  • renowned AI startups
  • Experts + Crowd + Tech Platform
  • teach AI models
  • evaluate their efficacy
  • diverse global crowds
  • remote-first team
  • detect and stop fraud
  • fraudulent impersonating

Words that count as the same thing: "LLM" ≈ Large Language Model

Check my résumé against these keywords

Hiring at Toloka

Open senior roles RoleStack tracks right now, posted in the last 30 days.

More open roles at Toloka

Full job description from Toloka

From Toloka's posting. View the original

At Toloka AI we create data that powers leading GenAI models and innovations. We work with frontier labs, big tech, renowned AI startups, enterprises and non-profit research organizations worldwide. We use a combination of Experts + Crowd + Tech Platform to teach AI models to reason and evaluate their efficacy and safety. We have experts in more than 50 different domains - from doctors and lawyers to physicists and engineers - and boast one of the most diverse global crowds, representing over 100 countries and speaking 40+ languages. We are a well-funded startup with an enviable portfolio of clients including Anthropic, Amazon, Microsoft, Poolside, Recraft, and Shopify.

Show full description Show less

Recently, we secured strategic investment led by Bezos Expeditions and Nebius Group with participation from Mikhail Parakhin, CTO of Shopify and board advisor to leading GenAI companies, who now serves as our Chairman of the Board. Our remote-first team is globally distributed around the world: USA, UK, the Netherlands, Serbia, and more.

What this role is about (& Project details)

Our team builds the systems that detect and stop fraud on the Toloka platform. Fraud here is a moving target: bad actors adapt quickly, test our defenses, and increasingly use automation and LLMs to get around them. The same technologies give us a lot of room for new ideas, and we’re looking for someone to help us stay ahead.

You’ll sit at the intersection of analytics and applied ML. You’ll dig into data, find patterns nobody has noticed yet, turn them into hypotheses, and then into working defenses: models and automated pipelines running in production.

What you'll actually do

• Explore data to find new fraud patterns, anomalies, and insights, and to understand how fraudsters operate.

• Design metrics that show how our protection works, and build dashboards and charts that make them visible.

• Generate hypotheses from data and test them rigorously.

• Turn validated hypotheses into production solutions: rules and heuristics, ML models, and LLM-based approaches.

• Build and maintain data pipelines (SQL, Python, Airflow) that keep our defenses running and up to date.

• Think like an attacker. Anticipate how a new defense could be bypassed, and design it to hold up from day one.

• Own your area end to end: from the first insight to a deployed solution and its ongoing monitoring.

• Help shape anti-fraud rules and policies, including how we define and classify fraud.

What we evaluate

• Analytical thinking. You can frame a vague problem, choose the right metrics, and draw sound conclusions from messy data.

• Hypothesis-driven approach. You generate ideas from data and know how to test them properly.

• SQL. You write confident, efficient queries on large datasets (ClickHouse experience is a plus).

• Python & ML. You can build features, train and evaluate models, and ship them to production. Practical experience with LLMs is a plus.

• Data pipelines. You have working experience with Airflow or similar orchestration tools.

• Product sense. You understand the trade-offs of protection: false positives, impact on honest users, and cost.

Nice to have, none required

• Hands-on experience in anti-fraud, trust & safety, risk, or abuse prevention (a big plus).

• Experience with anomaly detection, graph analysis, or behavioral modeling.

• Experience applying LLMs to analytical or classification tasks.

• Experience with Databricks.

• Experience with crowdsourcing or data annotation platforms.

What we can offer

• You will be part of an international, dynamic environment that drives innovation and sets new standards in the AI and technology sector.

• Competitive compensation package including base salary, bonus, and ESOP.

• Flexibility: we offer remote or hybrid employment. You will also design with your manager a workday that works best for you;

• Paid PTO and benefits will vary depending on location.

• IT setup and home office allowances.

• Personal and career development: we support employee’s ambition for professional development and encourage them to implement their ideas in their projects;

[Important Notice] Scam Alert Regarding Fake Job Postings

It has come to our attention that an individual or group is fraudulently impersonating Toloka to post fake jobs and solicit personal information from applicants.Please be aware:

• Official Communication: Our recruiting team will only contact you from an official "toloka.ai" email address. We will NEVER use Gmail, Yahoo, Tolokainc, toloka.inc, or other personal or seemingly business email accounts.

• Our Process: We will never ask for your bank account details, credit card number, or any fees as part of the application or interview process.

• Official Listings: All legitimate job openings are posted on our official careers page: https://toloka.ai/careers#job-list

What to do: If you see a suspicious job posting or have been contacted by someone you suspect is a scammer, please do not provide any personal information. Instead, report the incident to us directly at security@toloka.ai and report the profile/post to LinkedIn.We are taking this matter very seriously and are working with the appropriate parties to resolve it.

Thank you for your vigilance!

FAQ

Does Toloka sponsor visas for this role?

The posting does not say whether visa sponsorship is available. Ask the recruiter before you apply.

Is this role remote?

It is a remote role.

What tools and technologies does the posting mention?

GenAI, LLMs, SQL, Python, Airflow, ML models, LLM-based approaches, ClickHouse, Databricks, AI/ML, Anomaly detection, Graph analysis, Behavioral modeling.