Description review
Research Engineer, AI Security
tolmo.com · Remote - San Francisco · back to the listing
HR standards
69/100
needs work
Title ↔ description
77/100
solid
Reads as
Unclear
no confident match
What this role officially is
data scientist — ESCO, the EU occupation classification
Data scientists find and interpret rich data sources, manage large amounts of data, merge data sources, ensure consistency of data-sets, and create visualisations to aid in understanding data. They build mathematical models using data, present and communicate data insights and findings to specialists and scientists in their team and if required, to a non-expert audience, and recommend ways to apply the data.
Also known as: data scientists, data engineer, research data scientist, data expert, data research scientist
How others title the same work
Large employers
- Applied AI Engineer Automattic
- Machine Learning Engineer, CX Intelligence Coinbase
- AI Engineer - FDE (Forward Deployed Engineer) Databricks
- AI Engineer - FDE (Forward Deployed Engineer) - U.S. Federal Sector Databricks
- Senior AI Engineer – Notebooks Datadog
Startups
- Attendi | Medior Machine Learning Engineer | Amsterdam, Netherlands | ONSITE (hybrid) | €6,000 - €7,000 per month | Full-time (80–100%, ~4–5 days/week) | Visa sponsorship + 30% ruling possible Attendi
- Member of Technical Staff (applied) Anthrogen
- Aptura AI | Full-Time | MTS (Applied AI), MTS (SWE / Product) | London | ONSITE / HYBRID Aptura AI
- Arcforma AI (arcforma.ai) | AI Engineer (Marketing / Construction / Arcforma AI (arcforma.ai)
- Staff AI Engineer - Agent Architecture & Behavior Artisan
What the listing never says
- 21 bullet points. Long requirement lists deter qualified candidates, who read them as hard gates. Scope clarity
- No pay range published. Candidates cannot tell whether applying is worth their time. Pay transparency
The listing, marked up
Nothing in the wording of this listing tripped a check. The scores above still judge how complete and coherent it is.
About Tolmo
Tolmo is cybersecurity for the age of AI. Coding agents now ship software faster than any human team can review or secure it; 100+ pull requests per engineer per week is no longer an outlier, and attackers are using the same agents to find and exploit weaknesses in days, not months. The old playbook of quarterly pentests and endless alert queues breaks at this speed.
We're building a new security playbook. Tolmo runs a fleet of AI security agents that reason over a live graph of your entire production system (code, CI, cloud, and telemetry) and continuously attack a faithful copy of it like a real adversary. Every finding arrives validated, with its blast radius and a remediation plan that lands in your workflow, ready for a coding agent to fix. Hours to integrate, days to your first validated finding.
We've done this before: Tolmo's founders built Sqreen (acquired by Datadog) and led security products that thousands of organizations trusted. We're backed by Accel and Y Combinator and just getting started.
The role
Our product is only as good as our agents' judgment. As a Research Engineer on AI Security, you make that judgment better and measurably so: how our agents plan, reason over a graph of a customer's production system, decide what is worth testing, and know when a finding is real.
This sits between research and engineering. In one week you might design an eval that catches a new class of false positive, change how an agent plans a multi-step investigation, compare models on a hard benchmark, and harden the agents themselves against prompt injection from the systems they inspect. You'll work directly with the founders, our engineers, and the security leads who run pentests with our agents, and your work ships to production.
What you'll do
• Agent reasoning: improve how our agents plan, use tools, and reason over a live graph of code, cloud, and telemetry, so they reach real findings faster and with fewer dead ends.
• Evaluation: build the evals, benchmarks, and graders that tell us whether an agent actually got better, and make them part of how every change ships.
• Model selection and tuning: compare models, prompts, and agent designs on cost, latency, and quality, and turn the results into production decisions.
• Model and agent security: defend our agents against prompt injection, data exfiltration, and manipulation by the very systems they test, and research the security of LLM-based applications our customers build.
• Reliability at scale: make long-running agents dependable across thousands of runs: verification, self-checks, and sensible stopping.
• Learning from the field: study agent runs from customer engagements, find where reasoning broke, and turn each failure into an eval and a fix.
What we're looking for
• Hands-on experience building, evaluating, or improving LLM-based agents or systems in production.
• A rigorous, empirical approach: you design experiments, distrust single anecdotes, and let the evals decide.
• Strong engineering skills: you write production-quality code (Python, TypeScript, or Go) and build tools other people rely on.
• A working understanding of security, or a strong drive to learn it fast: how real systems are attacked and how findings are validated.
• Familiarity with LLM security risks such as prompt injection, jailbreaks, and tool misuse.
• You build with AI coding agents daily (e.g., Claude Code, Cursor) and have opinions about what makes them reliable.
Nice to have
• Research background in machine learning, AI safety, or security: publications, open-source work, or talks.
• Offensive security experience: penetration testing, red teaming, bug bounty, or CTFs.
• Experience with reinforcement learning, fine-tuning, or synthetic data generation for agents.
• Experience with graph data models or reasoning over structured data.
• Prior early-stage startup experience.
Compensation & benefits
• Competitive salary, depending on level and experience.
• Early-stage equity: you're joining early; you'll own a real piece of what we build.
• Comprehensive medical, dental, and vision coverage, and the equipment you need to do your best work.
• Based in San Francisco; we work in person.
Tolmo is building a team with wide-ranging backgrounds, perspectives, and paths into security; we think it makes our product and judgment better. If you're excited about this role but don't match every point above, we'd still like to hear from you. We're an equal opportunity employer and welcome applicants of every background.
Tolmo is cybersecurity for the age of AI. Coding agents now ship software faster than any human team can review or secure it; 100+ pull requests per engineer per week is no longer an outlier, and attackers are using the same agents to find and exploit weaknesses in days, not months. The old playbook of quarterly pentests and endless alert queues breaks at this speed.
We're building a new security playbook. Tolmo runs a fleet of AI security agents that reason over a live graph of your entire production system (code, CI, cloud, and telemetry) and continuously attack a faithful copy of it like a real adversary. Every finding arrives validated, with its blast radius and a remediation plan that lands in your workflow, ready for a coding agent to fix. Hours to integrate, days to your first validated finding.
We've done this before: Tolmo's founders built Sqreen (acquired by Datadog) and led security products that thousands of organizations trusted. We're backed by Accel and Y Combinator and just getting started.
The role
Our product is only as good as our agents' judgment. As a Research Engineer on AI Security, you make that judgment better and measurably so: how our agents plan, reason over a graph of a customer's production system, decide what is worth testing, and know when a finding is real.
This sits between research and engineering. In one week you might design an eval that catches a new class of false positive, change how an agent plans a multi-step investigation, compare models on a hard benchmark, and harden the agents themselves against prompt injection from the systems they inspect. You'll work directly with the founders, our engineers, and the security leads who run pentests with our agents, and your work ships to production.
What you'll do
• Agent reasoning: improve how our agents plan, use tools, and reason over a live graph of code, cloud, and telemetry, so they reach real findings faster and with fewer dead ends.
• Evaluation: build the evals, benchmarks, and graders that tell us whether an agent actually got better, and make them part of how every change ships.
• Model selection and tuning: compare models, prompts, and agent designs on cost, latency, and quality, and turn the results into production decisions.
• Model and agent security: defend our agents against prompt injection, data exfiltration, and manipulation by the very systems they test, and research the security of LLM-based applications our customers build.
• Reliability at scale: make long-running agents dependable across thousands of runs: verification, self-checks, and sensible stopping.
• Learning from the field: study agent runs from customer engagements, find where reasoning broke, and turn each failure into an eval and a fix.
What we're looking for
• Hands-on experience building, evaluating, or improving LLM-based agents or systems in production.
• A rigorous, empirical approach: you design experiments, distrust single anecdotes, and let the evals decide.
• Strong engineering skills: you write production-quality code (Python, TypeScript, or Go) and build tools other people rely on.
• A working understanding of security, or a strong drive to learn it fast: how real systems are attacked and how findings are validated.
• Familiarity with LLM security risks such as prompt injection, jailbreaks, and tool misuse.
• You build with AI coding agents daily (e.g., Claude Code, Cursor) and have opinions about what makes them reliable.
Nice to have
• Research background in machine learning, AI safety, or security: publications, open-source work, or talks.
• Offensive security experience: penetration testing, red teaming, bug bounty, or CTFs.
• Experience with reinforcement learning, fine-tuning, or synthetic data generation for agents.
• Experience with graph data models or reasoning over structured data.
• Prior early-stage startup experience.
Compensation & benefits
• Competitive salary, depending on level and experience.
• Early-stage equity: you're joining early; you'll own a real piece of what we build.
• Comprehensive medical, dental, and vision coverage, and the equipment you need to do your best work.
• Based in San Francisco; we work in person.
Tolmo is building a team with wide-ranging backgrounds, perspectives, and paths into security; we think it makes our product and judgment better. If you're excited about this role but don't match every point above, we'd still like to hear from you. We're an equal opportunity employer and welcome applicants of every background.