R.2

Metrics

The metrics this manual reads, with their range on our setup.

The ranges come from our lab runs: Qwen3-0.6B on GSM8K on one GB10, 32 prompts with 8 answers each, a limit of 1,024 tokens. They hold for that setup. Build your own ranges from two or three seeds of yours.

Rollout

MetricMeaningOur range
rollout/raw_rewardthe mean reward of the step0.53 to 0.87 per step over 48 steps
rollout/response_lengthsthe mean answer length in tokens396 to 787
rollout/truncatedthe share of answers that hit the length limit0.02 to 0.43

Training

MetricMeaningOur range
train/train_rollout_logprob_abs_diffthe mean absolute gap between the trainer and engine log probabilities, per token0.0136 to 0.0164 with plain sampling
train/train_rollout_klthe KL between the engine and trainer distributions at the sampled tokens0.00063 to 0.00076
train/grad_normthe gradient norm0.35 to 4.95
train/pg_clipfracthe share of tokens where the update hit the clip limit0 at every step
train/ppo_klthe KL between the old and the new trainer probabilities0 at step 0 in a healthy run
train/entropy_lossthe entropy term of the loss0 in our runs

Time

MetricMeaningOur value
perf/step_timethe full step152.6 s median of 48 steps, in a run made before the heat guard
perf/rollout_timethe rollout phase47.5 s median of 48 steps, in a run made before the heat guard
perf/log_probs_timethe trainer scoring of the samples23.4 s median of 48 steps, in a run made before the heat guard
perf/train_timethe training phase, with the scoring100.3 s median of 48 steps, in a run made before the heat guard
perf/update_weights_timethe copy of new weights into the engine0.63 to 0.65 s for Qwen3-0.6B
perf/sleep_timethe trainer moving its state to host memory after training0.76 s median over 48 steps for Qwen3-0.6B, and 1.9 to 3.7 s in the first two steps of the same 48-step run
perf/wake_up_timethe trainer moving its state back before the log probabilities0.87 s median over 48 steps for Qwen3-0.6B
perf/train_wait_timethe time the trainer waits for sampleslogged in every step

Time values hold only for steps that no heat-guard pause touched. The lab notes give the rule.

Evaluation and async

MetricMeaning
eval/lag_stepshow many steps late an eval on a dedicated fleet finished
the weight version statistics in the rollout metricshow old the samples of an async run are

We did not run evaluation or async training, so this table has no ranges.

Miles radixark/miles:latest, Miles main of 2026-10-15 · 08752a1 · 2026-10-15 · Edition 2026.10