This is a unoptimized (read: in practice unusable) implementation of PaLM + RLHF. You could theoretically use this to train PaLM and then a ChatGPT model on top of it but it would take many times longer than if you used an opti