Common people like us who want to try huge LLMs locally instead of using ChatGPT should consider hosting a BigScience petal. It's a GPU swarm where each seeder contributes towards a specific model layer, somewhat like BitTorrent.