工具条件未记录 / 输出上限 64k tokens / 框架未记录 · The card says reasoning_effort defaults to max and recommends keeping that default for benchmark reproduction. **NL2Repo**: We evaluated NL2Repo with `temperature=1.0`, `top_p=1.0`, and `max_new_tokens=64k` under 1M context. To prevent hacking, we use rule-based and a LLM-based judgement to prevent malicious behaviors (e.g., unauthorized pip or curl operations).
NL2Repo · GLM-5.3模型卡;unknown · Reported score · 工具条件未记录 / 输出上限 64k tokens / 框架未记录 · The card says reasoning_effort defaults to max and recommends keeping that default for benchmark reproduction. **NL2Repo**: We evaluated NL2Repo with `temperature=1.0`, `top_p=1.0`, and `max_new_tokens=64k` under 1M context. To prevent hacking, we use rule-based and a LLM-based judgement to prevent malicious behaviors (e.g., unauthorized pip or curl operations).
Regular display scope. Rankings are grouped by metric and evaluation protocol. Recorded tool access, budgets, and frameworks are shown separately. Scores remain available for reference when conditions are unspecified.
Reported score
Tool access not recorded / Output limit 64k tokens / Framework not recorded · The card says reasoning_effort defaults to max and recommends keeping that default for benchmark reproduction. **NL2Repo**: We evaluated NL2Repo with `temperature=1.0`, `top_p=1.0`, and `max_new_tokens=64k` under 1M context. To prevent hacking, we use rule-based and a LLM-based judgement to prevent malicious behaviors (e.g., unauthorized pip or curl operations).
NL2Repo · GLM-5.3模型卡;unknown · Reported score · Tool access not recorded / Output limit 64k tokens / Framework not recorded · The card says reasoning_effort defaults to max and recommends keeping that default for benchmark reproduction. **NL2Repo**: We evaluated NL2Repo with `temperature=1.0`, `top_p=1.0`, and `max_new_tokens=64k` under 1M context. To prevent hacking, we use rule-based and a LLM-based judgement to prevent malicious behaviors (e.g., unauthorized pip or curl operations).