I have been working on special licence and a library project for years, finally getting close to be fully released to the public. It comes with 3 new licences, The D.I.C ( pronounce diss licence), The D.I.C.K Licence ( say it the D-Licence ), and the D-Code open sovereign licence. Which had a special clause for AI bot and llm training forcing any llm training on this subset of data to also be published under the D-open code sovereign licence .

Read more at

Https://datapond.earth And Https://dsafe.us

The project is not officially launched yet, in two weeks I will have much more Information on how to join and grow this public domain D-initiative.

This has definitely been discussed. There have even been some projects, although I haven't checked on the status of any of them lately. As best as I can recall, there are some specific structural reasons why it's hard to train LLM's this way, but I don't recall all the details offhand.

https://www.google.com/search?q=distributed+model+training+s...

https://news.ycombinator.com/item?id=35799843

https://www.reddit.com/r/ArtificialInteligence/comments/18q6...

https://www.reddit.com/r/slatestarcodex/comments/1gtnxgd/wha...

https://github.com/BOINC/boinc/wiki/Using-BOINC-for-AI

https://the-decoder.com/ai-startup-prime-intellect-trains-fi...

This is a great question and this would be a great side project to work on.