The card says reasoning_effort defaults to max and recommends keeping that default for benchmark reproduction. **PostTrainBench**: We evaluate GLM-5.3 using Claude Code 2.1.207 with max effort level, `temperature = 1.0`, `top_p = 1.0`, `max_new_tokens = 128000`, and a 1M-token context window. We report the weighted average over 3 runs. Runs that fail to produce a score fall back to the official zero-shot base-model baseline score. For checks intended to prevent the use of third-party APIs, we removed the original pattern-matching-based checks, as they produced false positives when a local vLLM endpoint was accessed through the OpenAI SDK. Instead, we use an LLM agent to inspect solutions for external API usage.
条件
GLM-5.3; benchmark version, score definition and unit unspecified. 2026-11-18按完整模型卡修正单位、指标/题集或协议标注,数字不变。
GLM-5.3 · PostTrainBench · GLM-5.3模型卡;unknown · Scores and configurations
GLM-5.3 record for PostTrainBench · GLM-5.3模型卡;unknown. 1 score record for this release, including 1 exact value (may include historical records). Includes 2 source locations.
The card says reasoning_effort defaults to max and recommends keeping that default for benchmark reproduction. **PostTrainBench**: We evaluate GLM-5.3 using Claude Code 2.1.207 with max effort level, `temperature = 1.0`, `top_p = 1.0`, `max_new_tokens = 128000`, and a 1M-token context window. We report the weighted average over 3 runs. Runs that fail to produce a score fall back to the official zero-shot base-model baseline score. For checks intended to prevent the use of third-party APIs, we removed the original pattern-matching-based checks, as they produced false positives when a local vLLM endpoint was accessed through the OpenAI SDK. Instead, we use an LLM agent to inspect solutions for external API usage.
Conditions
GLM-5.3; benchmark version, score definition and unit unspecified. 2026-11-18按完整模型卡修正单位、指标/题集或协议标注,数字不变。