Cold start kills distributed training efficiency before training even begins. Most setups waste hours on manual config per node, hardcoded role assignments, and brittle memory budgets that break when you swap hardware. The actual gradient computation? That's the easy part. The orchestration nightmare beforehand is what burns your time and money.