Microsoft is building datacenter superclusters that span continents

The 100 trillion-parameter models of the near future can’t be built in one place
Microsoft believes the next generation of AI models will use hundreds of trillions of parameters. To train them, it’s not just building bigger, more efficient datacenters – it’s started connecting distant facilities using high-speed networks spanning hundreds or thousands of miles.…The RegisterRead More