MCP-Bench: Benchmarking Tool-Using LLM Agents with Complex Real-World Tasks 2025 (arxiv.org)

How do you handle partial success in the benchmark? If an agent picks the wrong tool mid-chain but fixes it with backtracking, does it still count as a full success?