← Latent physics world modelsDocumentation indexGlossaryCode

v3.1 stage three, step zero — is the dream alive?

THE DREAM IS NOT A USABLE TRAINING ENVIRONMENT FOR THIS TASK. At its chosen temperature no model puts a ball below the band at a rate comparable to the world’s (0.80 arrivals per 150 frames, decoded-height sd 0.164) — baseline almost never a ball below the band; clock almost never a ball below the band; clock_priv almost never a ball below the band; clock_emerge almost never a ball below the band. No other (model, temperature) cell is in that range either. A ball decoded above the band is scenery — the paddle cannot reach it and no action changes it; a ball parked at the band’s lower edge is a fixed point, not a trajectory. So every controller trained below is fitted to what its M’s REWARD HEAD says about latents that contain no reachable ball, not to a simulated interception task, and every controller number must be read that way.

64 dreams x 150 steps per cell, warm-started on 8 real frames from ['data/v31/train_mix'], driven by a fixed sticky-random action stream. Every model and every temperature sees the identical starts and the identical actions, so the cells are paired.

The real data, measured with the same detector

reference frames ball present ball below the band arrivals below the band per 150 frames ball-height sd re-emergence (of runs starting hidden)
data/v31/train_mix, 4096 random frames 4096 35.7% 2.4%
the real continuation of the dreams’ own 64 starts 64x150 35.5% 2.5% 0.80 0.164 70.0% (40)

The detector’s ball present is a half-a-ball-outside-the-band threshold, so it should land between the dataset’s frac_frames_visible (24.9%, the ball entirely clear of the band) and visible + partial (57 %) — i.e. at roughly the fraction of frames with ball_visible > 0.5. It does. ball below the band is the reference the dream is graded against: the fraction of frames on which the ball is in the strip where the paddle can act at all, which in this world is only a few per cent.

Every cell

model tau ball present ball below band arrivals / run (real 0.80) ball-height sd (real 0.164) mean decoded ball y re-emergence (of dreams starting hidden) r(reward head, -abs decoded gap) n pairs
baseline <– chosen 0.0 6.1% 0.1% 0.03 0.053 0.762 0.0% (39) 0.97 585
baseline 0.5 11.6% 10.4% 3.62 0.059 0.121 100.0% (39) 0.96 1114
baseline 1.0 14.9% 12.8% 4.78 0.116 0.140 100.0% (39) 0.92 1427
clock <– chosen 0.0 5.9% 0.1% 0.03 0.053 0.762 0.0% (39) 0.98 566
clock 0.5 45.9% 0.0% 0.02 0.068 0.774 0.0% (39) 0.98 4403
clock 1.0 47.2% 0.0% 0.03 0.070 0.770 2.6% (39) 0.94 4534
clock_priv <– chosen 0.0 6.2% 0.1% 0.03 0.053 0.766 0.0% (39) 0.97 598
clock_priv 0.5 40.1% 0.0% 0.02 0.071 0.765 0.0% (39) 0.95 3853
clock_priv 1.0 36.9% 0.0% 0.03 0.076 0.758 2.6% (39) 0.92 3540
clock_emerge 0.0 4.1% 0.1% 0.02 0.044 0.762 0.0% (39) 0.96 391
clock_emerge 0.5 2.0% 0.0% 0.02 0.034 0.777 0.0% (39) 0.93 189
clock_emerge <– chosen 1.0 22.5% 0.1% 0.11 0.082 0.760 10.3% (39) 0.20 2157

The reward head, teacher-forced on real latents

M’s dense reward head against the true 1 - |ball_x - paddle_x| on real latents and real actions. This is the ceiling on what the head can contribute inside a dream.

model R2 Pearson r rmse pred mean true mean n
baseline 0.719 0.851 0.1168 0.743 0.741 6,965
clock 0.703 0.839 0.1200 0.735 0.741 6,965
clock_priv 0.687 0.838 0.1233 0.719 0.741 6,965
clock_emerge 0.627 0.800 0.1345 0.764 0.741 6,965

Chosen training temperature per model

The tau whose count of arrivals below the band is closest to the real continuation’s 0.80 per 150 frames, ties going to the lower tau (stage two: a sampled v3.1 dream does not conserve the hidden ball’s direction of travel).

model chosen tau its arrivals / run real
baseline 0.0 0.03 0.80
clock 0.0 0.03 0.80
clock_priv 0.0 0.03 0.80
clock_emerge 1.0 0.11 0.80

Wall clock 242 s.