Nov 02 – Nov 08
Real-world agent evaluation
WeeklyIssue #12
Papers.Data.Code
Selected, not collected.
Papers, repos, datasets, and trends worth your attention.
Nov 02 – Nov 08
WeeklyIssue #12
Oct 26 – Nov 01
WeeklyIssue #11
October 2026
MonthlyIssue #10
Oct 12 – Oct 18
WeeklyIssue #9
Oct 05 – Oct 11
WeeklyIssue #8
Sep 28 – Oct 04
WeeklyIssue #7
We track new ML work across papers, code, and data, then keep only the pieces worth a closer look. Selected, not collected.
Picked Nov 6
Raises Qwen3.6-35B-A3B from 23.0 to 41.0 avg (43.2 with RL); frontier models drop up to 38.2 pts on Pro benchmarks.
Unlike mostly evaluation benchmarks, it releases 18,363 full agent-training trajectories plus 484 RL tasks with verified tool-use.
Built from 5,699 comparisons at 124 sites; active matchmaking hits ~90% ranking agreement in 400-500 trials vs ~1,000 uniform.
Combines formal end-to-end correctness with large reported gains: up to 61.3× vs DuckDB and 28.3× vs Umbra.
Picked Nov 5
Oracle routing beats the best fixed candidate by 5.4 points; learned routers gain 0.3 overall, 2.1 on video, 1.1 on robots with 24% less policy time, and 8.82x efficiency.
Makes continuous project delivery measurable beyond single tasks by scoring checkpoint outputs and final packages separately in one workspace.
The Weekly ML Signal.