Effort-conditioned reward

Effort-conditioned reward

Group-relative advantage

×

tensor

How much better than its subgroup each response was. The update that uses it is not written in the report.

shape
AA [B batch, |𝔅|, M]
Sources1

Contextual evidence

§5.2.1: prompts are dispatched by “the GRPO group size”; the report writes no objective, clipping or KL term.

group · deepseek-ai/DeepSeek-V4.1-Flash / DeepSeek_V41_Tech_Report.pdf
Pinned revision 2cba9e42aa02 ↗ · p. 30