growlab

Scaling laws ask: given compute C, choose N and D. They assume the parameter count N is constant for the whole run — and never argued for it.

So: given compute C, choose the trajectory N(t). The answer is a shape, not a number.

connecting…

The control

Flat vs grown, identical LR schedule, identical FLOP budget, multiple seeds. The original result changed four things at once and ran one seed.

Verdict
running…

Validation loss vs compute spent

Both arms stop at the same FLOP budget. Lower is better.

Parameter trajectory N(t)

The shape under test. Both arms end at the same architecture.

AutoLab — searching trajectory space

Six hand-run points is not a search. An autonomous agent proposes, runs and merges growth schedules against the objective.

dashboard ↗
waiting for the agent…