Combine: - A powerful general purpose language model - A powerful retrieval model, trained with simple contrastive learning. You get: ChatGPT with (approximatively) cited sources. Lots of caveat with that approach but impressive as a proof of concept!