Intent-Classification
LoRA Skill Compilation Is a Double-Headed Coin Flip
Ten LoRA seeds on identical data spread 3.62 points, against 4.65 for prompt compilation. Not one beat the no-adapter base. Measured on an RTX 3090.
I Got the AI Result I Wanted. Then I Ran It Nine More Times
A frontier model read my logs and wrote a skill that beat my local 27B baseline by 10.6 points. Nine more compilation runs showed the number was fake.