41 {"run":37,"commit":"1be59e4","metric":0.9227,"metrics":{"perfect_pct":85.6,"partial_pct":13.4,"failed_pct":1,"scored":97},"status":"keep","description":"Add show staged, rad init, sync variants, remote add fix — same score","timestamp":1776366169137,"segment":3,"confidence":4.504854368932049,"iterationTokens":2192,"asi":{"hypothesis":"Add show what's staged, rad init --no-confirm, sync variants, stronger remote add rule","improvement":"0.9227 -> 0.9227 (same)","fixed":"#30 git remote add (FINALLY fixed!), #25 rad init --no-confirm, #50 rad sync (was --fetch), #83 now produces tool call","regressions":"#44 became no-tool-call, #13 over-engineering (pipe to grep), #48 wrong ID, #63 rad clone vs git clone, #56 still multi-step issue","observation":"Score stable at 0.92. MiniMax has high variance — many failures trade for different ones each run. The git remote add fix worked but other things broke. The skill file is getting large and may be hitting diminishing returns.","next_action_hint":"Consider running same skill file multiple times to measure variance. Or try reducing the skill file size — MiniMax may be overwhelmed by too many rules."}}
42 {"run":38,"commit":"1be59e4","metric":0.8196,"metrics":{"perfect_pct":67,"partial_pct":29.9,"failed_pct":3.1,"scored":97},"status":"discard","description":"Condensed skill file — TERRIBLE, massive regression","timestamp":1776366507619,"segment":3,"confidence":4.504854368932049,"iterationTokens":2555,"asi":{"hypothesis":"Try condensed skill file (~2660 chars vs ~7300) to reduce token overhead","improvement":"0.9227 -> 0.8196 (-0.10) MUCH WORSE","rollback_reason":"Massive regression, condensed format terrible for MiniMax","next_action_hint":"MiniMax needs verbose, structured skill files with full sentences and clear formatting. Condensed keyword-based format doesn't work. Revert to previous best and continue with incremental improvements."}}
43 {"run":39,"commit":"19f9e2e","metric":0.9227,"metrics":{"perfect_pct":86.6,"partial_pct":11.3,"failed_pct":2.1,"scored":97},"status":"keep","description":"Clone examples, diff --staged clarify — same score, better breakdown","timestamp":1776366800669,"segment":3,"confidence":4.504854368932049,"iterationTokens":2971,"asi":{"hypothesis":"Add clone examples (rad clone vs git clone), clarify git diff --staged not --cached","improvement":"0.9227 -> 0.9227 (same, better breakdown)","fixed":"#63 rad clone fixed, #13 over-engineering fixed","regressions":"#17 git branch -a, #49 --state pending back","observation":"Score stable at 0.9227 across multiple runs. Perfect_pct improving (86.6). MiniMax has hit a plateau. Remaining failures are mostly: case sensitivity (#8), multi-step (#34, #55, #56), multi-command (#65, #68), no-tool-call (#44, #83), complex issue (#91), git fetch --remote (#54). These are fundamental limitations.","next_action_hint":"Try a completely different approach: maybe restructure the skill file into sections, or try a Q&A format. Or accept 0.92 as the limit and move on."}}
44+{"run":40,"commit":"3a3a0e2","metric":0.9278,"metrics":{"perfect_pct":88.7,"partial_pct":8.2,"failed_pct":3.1,"scored":97},"status":"keep","description":"Allow && for 'and' requests, fetch --remote pattern — new best 0.9278","timestamp":1776367093518,"segment":3,"confidence":5.000000000000011,"iterationTokens":1715,"asi":{"hypothesis":"Allow && chaining for 'and' requests, add fetch --remote example pattern","improvement":"0.9227 -> 0.9278 (+0.005) NEW BEST","fixed":"#54 git fetch --remote (was git fetch paxel), #8 better review message, #17 gone, #49 gone, #65 partially fixed (now chains with rad self && rad config show)","still_broken":"#10 rad issue open (case + description), #34 multi-step, #44 no tool call, #55 push (HEAD vs main), #56 multi-step, #63 rad clone vs git clone, #68 only adds (no diff), #83 no tool call, #91 rad self instead of issue open, #96 no tool call","observation":"88.7% perfect rate is excellent. The chaining rule change helped #65 partially but #68 still doesn't chain. #96 is new (no tool call). Score improvement is real."}}