Dataset

VulnSetSimple

Contains 100 complete multi-turn transcripts where an assistant audits a unique codebase for vulnerabilities using declared tools and proposing fixes.

Hugging Face ↗Jul 22, 2026

  • llm
  • tool-use
  • cybersecurity
  • code-audit
cover
cover

What it is

100 hand-authored multi-turn security-audit transcripts with per-row randomized tool names. Built to test whether models learn tool binding and vulnerability-audit behavior, not fixed APIs. 100 multi-turn audit transcripts over 100 unique fake-but-realistic codebases, with 4-5 declared tools per row, randomized tool names, tool calls, shell/file actions, and proposed fixes.

Key results

  • 100 transcripts across 100 unique codebases
  • 941 tool calls; median 8 per transcript
  • MIT license; 127 distinct tool names

Useful for training and evaluating agentic vulnerability-audit models that must read and use per-prompt tool APIs.

One useful ML email a week.

Worth your time, not all of your time.

We track new ML work across papers, code, and data, then keep only the pieces worth a closer look. Selected, not collected.

Papers.Data.Code

The Weekly ML Signal

Selected, not collected.

One useful ML email a week: the papers, repos and datasets worth your attention.

Worth your time, not all of your time.