It's really the RLHF fine-tuning that makes chatgpt special. Anybody can reference an external vector store for deep memory using tools like LangChain and GPT-index (though these tools are quite recent in their maturity).