The card says reasoning_effort defaults to max and recommends keeping that default for benchmark reproduction. **Agent's Last Exam (CLI)**: We evaluate ALE using the official evaluation protocol with the Claude Code harness (reasoning effort=max, 1M context, and 64K maximum output). Each of the 105 tasks runs in an isolated Docker container using the resources declared in its Task Card. The default timeout is 4 hours, with task-specific limits taking precedence (up to 8 hours). Tool Search is disabled, and results are scored by the official ALE evaluators.
条件
GLM-5.3; task release unspecified. The GLM source does not state a unit; no percentage inferred. 2026-11-18按完整模型卡修正单位、指标/题集或协议标注,数字不变。
GLM-5.3 · Agents' Last Exam (ALE-CLI) · GLM-5.3模型卡;ALE-CLI · Scores and configurations
GLM-5.3 record for Agents' Last Exam (ALE-CLI) · GLM-5.3模型卡;ALE-CLI. 1 score record for this release, including 1 exact value (may include historical records). Includes 2 source locations.
The card says reasoning_effort defaults to max and recommends keeping that default for benchmark reproduction. **Agent's Last Exam (CLI)**: We evaluate ALE using the official evaluation protocol with the Claude Code harness (reasoning effort=max, 1M context, and 64K maximum output). Each of the 105 tasks runs in an isolated Docker container using the resources declared in its Task Card. The default timeout is 4 hours, with task-specific limits taking precedence (up to 8 hours). Tool Search is disabled, and results are scored by the official ALE evaluators.
Conditions
GLM-5.3; task release unspecified. The GLM source does not state a unit; no percentage inferred. 2026-11-18按完整模型卡修正单位、指标/题集或协议标注,数字不变。