PaLM + RLHF is an open source text-generating model that behaves similarly to ChatGPT. It isn't pretrained, so users will need to compile the data from which the model can learn from and find hardware that can handle the training workload.