Asked Gemini about that: "are there efforts to train big LLM in a distributed fashion à la seti@home ? "

answer was really interesing: - https://github.com/PrimeIntellect-ai/prime - https://www.together.ai/