整批生成 · 100 个实例Full batch · 100 instances
可用实例Usable instances+25.3%
纯 SkillSkill only75/100
状态机State machine94/100
有效候选Valid candidates+37.0%
纯 SkillSkill only511/1000
状态机State machine700/1000
每分钟产出可用补丁Usable patches per minute+22.9%
纯 SkillSkill only5.58
状态机State machine6.86
bug 生成 · 400 个候选Bug generation · 400 candidates
程序修改Procedural modification+1.7%
纯 SkillSkill only177/200
状态机State machine180/200
LM 错误改写LM bug rewrite+71.4%
纯 SkillSkill only42/100
状态机State machine72/100
LM 完整重写LM full rewrite+96.6%
纯 SkillSkill only29/100
状态机State machine57/100
整批生成 · 100 个实例Full batch · 100 instances
| 指标Metric | 纯 SkillSkill only | 状态机State machine | 变化Change |
| 可用实例数Usable instances | 75 | 94 | +25.3% |
| 有效候选数(计划 1,000)Valid candidates (1,000 planned) | 511 | 700 | +37.0% |
| 已测试候选有效率Valid rate of tested candidates | 52.41% | 70.42% | +18.0 pp |
| 每分钟产出可用实例Usable instances per minute | 0.819 | 0.921 | +12.5% |
| 每分钟产出可用补丁Usable patches per minute | 5.58 | 6.86 | +22.9% |
bug 生成 · 400 个候选Bug generation · 400 candidates
| 策略Strategy | 每边候选Candidates | 纯 SkillSkill only | 状态机State machine | 变化Change |
| 程序修改Procedural modification | 200 | 177 | 180 | +1.7% |
| LM 错误改写LM bug rewrite | 100 | 42 | 72 | +71.4% |
| LM 完整重写LM full rewrite | 100 | 29 | 57 | +96.6% |
| 合计Total | 400 | 248 | 309 | +24.6% |
| 有效率Valid rate | | 62.0% | 77.3% | +15.3 pp |