How Kimi K3 was made: the stages on its path, top to bottom, and what changes from one to the next.
Of the 8 stages (7 on the path, 1 off it), the sources give or let us compute tokens for 0, and state or let us conclude the context length for 5, the objective for 8 and what is trained for 5; what is concluded is drawn dashed. The rest is hatched: nothing is filled in.
Select a stage for its numbers, its reason and the model as that stage trains it.