ExploitGym (2h / 6h) · GLM-5.3模型卡;2h / 6h · 测试定义与成绩

ExploitGym (2h / 6h) · GLM-5.3模型卡;2h / 6h 收录 1 次模型发布的评测披露或成绩。

测试版本与指标

别名 ExploitGym (2h / 6h)

  • pass-at-1 · 单位未标注 · 越高越好

各系列最新模型 · 公布成绩

此测试使用完整公开配置。排名按指标与评测协议分组,已记录的工具、预算及框架分别展示。条件未说明的组保留公布值供查证。

pass-at-1

允许工具 / max · 输出上限 128000 tokens / Claude Code 2.1.207 · The card says reasoning_effort defaults to max and recommends keeping that default for benchmark reproduction. **ExploitGym**: We evaluate GLM-5.3, Kimi-K3 and Qwen3.8 Max in Claude Code 2.1.207 (max reasoning effort, no web tools with `temperature=1.0`, `top_p=1.0`, `max_new_tokens=128000`). The reported results are single-run Pass@1 on 869 tasks under two timeout budgets: 2 hours and 6 hours, which are calculated as the API inference time rescaled by per-model tokens per second rate (per-model TPS sourced from Artificial Analysis; that is, we rescale GLM-5.3's results by 115 TPS, Kimi K3's results by 40 TPS and Qwen3.8 Max's results by 47 TPS), plus the non-API overhead. We also apply a domain whitelist (allowing only essential domains such as pypi.org and deb.debian.org for basic tool installation) to prevent the agent from cheating.

ExploitGym (2h / 6h) · GLM-5.3模型卡;2h / 6h · pass-at-1 · 允许工具 / max · 输出上限 128000 tokens / Claude Code 2.1.207 · The card says reasoning_effort defaults to max and recommends keeping that default for benchmark reproduction. **ExploitGym**: We evaluate GLM-5.3, Kimi-K3 and Qwen3.8 Max in Claude Code 2.1.207 (max reasoning effort, no web tools with `temperature=1.0`, `top_p=1.0`, `max_new_tokens=128000`). The reported results are single-run Pass@1 on 869 tasks under two timeout budgets: 2 hours and 6 hours, which are calculated as the API inference time rescaled by per-model tokens per second rate (per-model TPS sourced from Artificial Analysis; that is, we rescale GLM-5.3's results by 115 TPS, Kimi K3's results by 40 TPS and Qwen3.8 Max's results by 47 TPS), plus the non-API overhead. We also apply a domain whitelist (allowing only essential domains such as pypi.org and deb.debian.org for basic tool installation) to prevent the agent from cheating.
模型与配置成绩记录与证据
GLM-5.3GLM-5.3 · max105 / 130非精确值

历史记录 · 1 次发布

  • GLM-5.3本次发布有 1 条成绩记录,暂无精确值