Repo

kev

Reads one state once and scores many typed questions in parallel with exact question isolation, outputting probabilities instead of generated text.

GitHub ↗Sep 17, 2026Paper ↗

  • llm
  • classification
  • calibration
  • lora
Per-source accuracy comparing Kev models vs Jev baseline with scaling curve
Per-source accuracy comparing Kev models vs Jev baseline with scaling curve

What it is

Local decision model that reads a document once and returns calibrated probabilities for many typed questions in one forward pass. Answers many yes/no, multiple-choice, and score questions about one document in parallel, returning learned probabilities in a single prefill pass with no text decoding.

Key results

  • Packed vs separate max delta is 3.7e-6, with packed 2.0× faster
  • kev-4b gets 0.806 locked-test OOD accuracy and serves in ~1 s on M5
  • Supports noul, choice, and score questions with 2-255 options

Shows that a small local LLM can do Jev-style multi-question decisioning in one pass with exact branch isolation.

One useful ML email a week.

Worth your time, not all of your time.

We track new ML work across papers, code, and data, then keep only the pieces worth a closer look. Selected, not collected.

Papers.Data.Code

The Weekly ML Signal

Selected, not collected.

One useful ML email a week: the papers, repos and datasets worth your attention.

Worth your time, not all of your time.