tape_validation/torch_20260906_005049/next_token_mse

Tiny next-token regression MSE.

Participate

measurement = experiment.measure(checkpoint)

@measurement.evaluate(params=0, batch=1)
def evaluate(params, batch):
    ...

@measurement.aggregate
def aggregate(outputs):
    ...

score = measurement.run(checkpoint, batches)
measurement.submit("tape_validation/torch_20260906_005049/next_token_mse", score)

# Next steps? Getting started docs

Results

2 runs

Result trend


tape_validation/torch_20260906_005049_baking_window8	authenticated	0.04	2026-09-06 00:50:57
tape_validation/torch_20260906_005049_astronomy_window8	authenticated	0.07	2026-09-06 00:50:56