Inside OpenAI’s 131,000-GPU AI training fabric
OpenAI’s MRC protocol runs their 131,000-GPU training fabric by disabling BGP and OSPF and pushing routing intelligence to the endpoints. A look at how “dumb” switches and a lossy Ethernet design cut the tail latency that stalls massive GPU clusters.