Hypothetically speaking...

Would it not be possible to create crowd sourced, truly open sourced distilled LLMs with a simple wrapper around command line based AI services that exist today?

I'm imagining a layer that goes around whatever application people currently use for coding/AI boyfriend that collects your inputs and associates them with your outputs. With enough volunteers doing this, you could create huge data sets. I understand training these models requires massive computer infrastructure, but the training step doesn't have to be super fast, so this could also be distributed on the GPUs of gamers who want to channel their inner Richard Stallman.

I suppose the most difficult step is the coordination and central authority that would have to exist that puts it all together and releases the model. Enough people would have to trust this authority to use their data for the actual goal of releasing the LLM publicly, but I think such an entity could arise. If it started with smaller models and then got larger, a track record of following through would attract more and more volunteers.

Surely smarter people than myself have already come up with this idea.