AvalancheBench: Evaluating Enterprise Data Agents Through Latent World Recovery

arXiv:2605.24183v1 Announce Type: cross
Abstract: We introduce AvalancheBench, a benchmark for evaluating enterprise data agents through emphlatent world recovery. AvalancheBench improves on existing benchmarks in three ways. First, it evaluates analytical understanding rather than pipeline completion: systems are scored on whether they recover the segments, drivers, temporal events, and relationships that explain the data, not merely on whether they execute a workflow or produce a plausible report. Second, it provides ground truth for goal-driven analytics by generating observations from a known latent world, enabling partial credit for incomplete but valid recoveries. Third, it exposes how early analytical mistakes propagate into later conclusions: missed segments, merged events, or wrong attributions can lead to systematically wrong recommendations. In this sense, AvalancheBench complements real-data benchmarks by providing a controlled setting for diagnosing whether agents recover the analytical structure behind enterprise data. On a first e-commerce use case, the strongest configuration of a leading coding agent recovers only 26% of the rubric, with failures concentrated in generic customer segmentations and merged temporal events.