Did decentralized training ever go anywhere?

The Mythos situation feels like a canary in a coalmine. As LLMs become increasingly more powerful and integral to national security, it's hardly a given that China won't turn the tap off. The thing that first comes to mind is decentralized training, which was a big point of discussion back in the day, but I haven't seen much about it since, like, 2024-2025? Did it just turn out to be infeasible (as opposed to not competitive, which is a given)? Could we see a resurgence of the approach? Or was there progress and I'm just out of the loop?