A language model rewrote its own weights and improved
Researchers gave an open 27B model access to its weights, graded answers and a way to test edits, while blocking gradients and optimisers. The model raised held-out accuracy by 6.6 points and repaired a damaged copy of itself, but smaller models failed under the same conditions.