this dude lucidrains is a total legend and is trying to open source ChatGPT with Google's PALM underneath (instead of GPT3). he's been first to open source a ton of NLP models Looks like you need 540gb just to load PALM weights tho lol