You cannot pre-train GPT-3 or ChatGPT further on own documents. The other responses mention fine-tuning, but this also does not allow you to really add specific documents, it is rather for improving performance for a specific ta