← All weeks

Week of Jun 22, 2026 — Jun 28, 2026

Trending ML Papers

This week in ML

This week's most upvoted papers tell a consistent story: the field is no longer just trying to make a smarter base model — it is trying to make better agents, and to do that it is building out the supporting cast. Four of the top five are explicitly about agents: a stress test for tool-using agents (PlanBench-XL), a learned simulator to train them against (Qwen-AgentWorld), an architectural pattern for managing their runtime state (OpenRath), and a model dedicated to producing the data they will be trained on (DataClaw0). The fifth, DanceOPD, comes from image generation but rhymes with the others — it is about composing many specialized capabilities cleanly into a single deployed model, which is exactly the multi-skill packaging problem product teams care about.

Themes

Three patterns stand out. First, infrastructure for agents is finally getting serious attention: the headline contributions are not new model architectures but evaluation harnesses, simulators, runtime abstractions, and data pipelines. Second, the focus is on long, messy, realistic settings — sprawling tool ecosystems, multi-domain environments, hour-long videos, unreliable APIs — rather than the clean, short benchmarks that dominated earlier years. Third, training-time and inference-time are blurring: simulators double as both practice gyms and warm-up training data, and data curators are themselves trained agents, which suggests a future where the line between 'the model' and 'everything around the model' keeps fading.

Open questions

A few things are conspicuously unresolved. PlanBench-XL shows agents collapse under realistic tool unreliability, but nobody is proposing a clear fix yet — that gap will probably define the next year of agent research. Qwen-AgentWorld leans on a simulator's text predictions being 'good enough' to train against, but how to detect when a simulator is quietly lying to the agent is unsolved. OpenRath bets that a single runtime object can be the lingua franca across graph runtimes, tracing, tools, and memory stores — whether the ecosystem actually converges on something like it or stays balkanized is an open political and technical question. And DataClaw0 raises a deeper one: if curated data from a model trains a better model, are we entering a recursive loop where each model generation increasingly reflects the priorities of the curator that came before it?

  1. PlanBench-XL: Evaluating Long-Horizon Planning of LLM Tool-Use Agents in Large-Scale Tool Ecosystems

    Jiayu Liu, Qihan Lin, Cheng Qian, Rui Wang +7 more

    What it is. This is a new test suite for AI agents that have to get things done by calling external tools — think of an assistant that books refunds, looks up orders, and updates accounts by calling hundreds of company APIs. The benchmark sets the agent loose in a simulated retail business with 1,665 tools and 327 multi-step tasks, but importantly it only lets the agent see a handful of tools at a time via search, and it can sabotage critical tools mid-task to see whether the agent notices and recovers. Even the strongest model tested, GPT-5.4, solves about 52% of tasks in clean conditions but drops to roughly 11% when key tools are broken.

    Where it fits. Most existing evaluations for tool-using agents either hand the agent a tidy list of every tool it could possibly need, or they test one-shot tool calls in isolation. Real deployments — corporate MCP servers, sprawling SaaS API catalogs — look nothing like that: agents see only what a search retrieves, tools sometimes fail or return junk, and a task can require chaining 25 tool calls without ever knowing the full menu. A wave of recent benchmarks has chipped away at pieces of this (long horizons, noisy outputs, retrieval) but rarely all at once, which left a real gap in measuring whether today's agents are actually ready for enterprise tool ecosystems.

    Why it matters. Anyone building or buying an agent that touches a company's tool stack should care: this is the first time we have a sharp number on how badly things degrade once tools become unreliable or hidden behind retrieval — a 40-point accuracy drop is not a rounding error. The result is a useful reality check on agent-platform marketing, and a concrete training and evaluation environment for teams trying to make agents that actually re-plan when a tool breaks instead of charging ahead. It does not, however, tell us how to fix the problem — just how big it is.

    LLM agents·tool use·benchmarks·long-horizon planning·robustness
  2. Qwen-AgentWorld: Language World Models for General Agents

    Qwen Team

    What it is. Qwen-AgentWorld is a large language model trained to act as a 'world simulator' — given the current state of an environment (a terminal, an Android phone, a web page, a code repo, etc.) and an action, it predicts what would happen next, in text. You can think of it as a learned stand-in for the real environment that an agent would otherwise have to call out to. The team trains two versions (a smaller 35B-active-parameter model and a 397B one) across seven domains, and shows that an agent can either use it as a synthetic practice gym, or absorb the simulator's training as a 'warm-up' that makes the agent itself stronger.

    Where it fits. Researchers have argued for a long time that any truly general agent must, somewhere inside it, have a model of how the world reacts — what would happen if I clicked this button, ran this command, opened that page? Until now, almost all 'world model' work has been about pixels and physics for robotics or video. Applying the same idea to the messy, text-based worlds where LLM agents actually live — operating systems, browsers, IDEs — is much newer, and most agent training still happens either against real environments (slow, expensive, sometimes irreversible) or hand-written simulators (brittle, narrow).

    Why it matters. If a language model can convincingly fake a terminal or browser, you can train and stress-test agents at a scale and in scenarios that would be impractical to spin up for real — irreversible operations, edge cases your real environment never throws, proprietary systems you cannot reproduce. The reported gains on coding, terminal, and tool-calling benchmarks suggest this is more than a toy. The big open question is fidelity drift: a simulator that is 'mostly right' can teach an agent the wrong lessons in subtle ways, and we still do not have great ways to measure that drift for text environments.

    world models·LLM agents·reinforcement learning·agent training·Qwen
  3. DanceOPD: On-Policy Generative Field Distillation

    Wei Zhou, Xiongwei Zhu, Zelin Xu, Bo Dong +7 more

    What it is. This paper is about training one image-generation model to do several jobs well at the same time — generating images from text, editing a small region of an existing image, and changing the overall style or layout — without the skills cannibalizing each other. The trick is to treat each capability as a separate 'expert teacher' and, for every training image, route it to exactly one teacher rather than blending all of them. The student model practices on images it is currently producing (rather than a fixed dataset), so its training matches the situations it will actually see at generation time.

    Where it fits. Today's leading text-to-image systems are built on 'flow matching' — a class of generative models, closely related to diffusion, that learn to gradually turn noise into an image. Vendors want one model that can generate, inpaint, restyle, and edit, but training those skills jointly tends to make each one worse: editing erodes prompt fidelity, global restyles fight local edits, and so on. The field has tried merging weights, mixing datasets, and combining models at inference time, each with familiar tradeoffs.

    Why it matters. For anyone shipping a creative product, this is mainly a quality and cost story: one model that meaningfully does T2I, local editing, and global editing — and reportedly beats specialist baselines by 8–16% on relevant benchmarks — is cheaper to host, easier to update, and simpler to expose as a single API than juggling a fleet of specialists. The technique also absorbs classifier-free guidance into the student, which can simplify inference. It is still a research result on standard benchmarks, so real-world quality at production scale and the cost of training the expert teachers in the first place are the practical caveats.

    image generation·diffusion models·flow matching·model distillation·image editing
  4. OpenRath: Session-Centered Runtime State for Agent Systems

    Fukang Wen, Zhijie Wang, Ruilin Xu

    What it is. OpenRath is less a model and more a way to organize the plumbing of an agent application. Today, the various things an agent does during a run — the chat transcript, tool calls, files it edited, memory it pulled up, branches of exploration it abandoned — get scattered across logs, traces, and side files, which makes it hard to audit or replay what happened. OpenRath proposes wrapping all of that into a single 'Session' object that flows through the program, can be forked or merged like a git branch, and carries the full audit trail with it.

    Where it fits. As agent stacks mature, the field is splitting into specialized layers: graph runtimes (LangGraph), tracing SDKs (OpenAI Agents SDK, OpenTelemetry), tool protocols (MCP), sandboxes, and memory stores. Each of those records something useful — checkpoints for the scheduler, spans for the observer — but no layer is really designed to be the single value that the agent program itself passes around, branches off, and replays. Borrowing the framing of PyTorch's module-and-tensor abstraction is a deliberate echo of how that pattern made deep-learning code modular and inspectable.

    Why it matters. For teams running agents in production, the day-to-day pain is not 'my agent failed' but 'I have no idea why my agent failed, and I cannot reproduce it.' A first-class, forkable, replayable session object directly attacks that, and would make compliance, debugging, and A/B testing meaningfully easier — particularly in multi-agent setups. The paper itself is cautious: the authors explicitly limit their claims to runtime properties and defer head-to-head benchmark wins to future work, so adoption will depend on whether the abstraction holds up across real tool and memory backends.

    LLM agents·infrastructure·agent frameworks·observability·developer tools
  5. DataClaw0: Agentic Tailoring Multimodal Data from Raw Streams

    Cong Wan, Zeyu Guo, Zijian Cai, Jiangyang Li +5 more

    What it is. DataClaw0 is a 9-billion-parameter vision-language model whose job is to clean up other people's training data. Given a long, messy raw input — say, an hours-long tutorial video, a screen-recording of someone using an app, or an embodied-agent trajectory — and a description of what you want to use it for, the model picks out the relevant moments, extracts the key steps, and reformats everything into a structured supervision example that another model can actually learn from. The authors then show that models trained on these tailored, smaller datasets outperform models trained on the original full-scale data on video generation, visual question answering, and GUI navigation.

    Where it fits. Multimodal foundation models — the systems behind video understanding, screen-reading agents, robotics policies — are increasingly bottlenecked not by compute but by good training data. Raw multimodal streams are abundant but extremely noisy: a 90-minute tutorial may contain ten minutes of actually useful content. Until now, cleaning that up has either been manual annotation (slow, expensive) or off-the-shelf VLM captioning (fast, but hallucinates and loses procedural detail). The idea of training a model specifically to be a data curator is part of a broader shift toward treating data engineering itself as a learnable skill.

    Why it matters. The practical claim — same or better downstream performance from much smaller, task-tailored datasets — directly attacks the cost of fine-tuning multimodal models, which is one of the biggest barriers to building specialized agents on top of open models. For companies sitting on piles of internal video, screen recordings, or operational logs they would love to train on but cannot afford to label, an agentic curator is a plausible unlock. The honest caveat: the model is itself a VLM, so it inherits the failure modes of its base — including potential bias in what counts as 'task-critical evidence' — and the proof points are still mostly on the authors' own benchmarks.

    multimodal·data curation·vision-language models·post-training·video understanding