The card says reasoning_effort defaults to max and recommends keeping that default for benchmark reproduction. **Terminal-Bench 3.0**: We evaluate Terminal-Bench-3 tasks with the Claude Code 2.1.207 harness (reasoning effort=max, 400K context, and 128K maximum output), reporting avg@3 over three rollouts per task. Each rollout runs in an isolated container built from the task's official image, and is capped at 600 agent turns with a 10-hour timeout. Tool Search is disabled, and the artifacts each agent produces are scored by the task's official separate verifier.
条件
GLM-5.3; exact serving/API endpoint and weight precision not stated. 2026-11-18按完整模型卡修正单位、指标/题集或协议标注,数字不变。
GLM-5.3 · Terminal-Bench · GLM-5.3模型卡;3.0 · Scores and configurations
GLM-5.3 record for Terminal-Bench · GLM-5.3模型卡;3.0. 1 score record for this release, including 1 exact value (may include historical records). Includes 2 source locations.
The card says reasoning_effort defaults to max and recommends keeping that default for benchmark reproduction. **Terminal-Bench 3.0**: We evaluate Terminal-Bench-3 tasks with the Claude Code 2.1.207 harness (reasoning effort=max, 400K context, and 128K maximum output), reporting avg@3 over three rollouts per task. Each rollout runs in an isolated container built from the task's official image, and is capped at 600 agent turns with a 10-hour timeout. Tool Search is disabled, and the artifacts each agent produces are scored by the task's official separate verifier.
Conditions
GLM-5.3; exact serving/API endpoint and weight precision not stated. 2026-11-18按完整模型卡修正单位、指标/题集或协议标注,数字不变。