ChatGPT basically forgets everything older than 8192 tokens besides its default prompt. This allows it to select and encode important topics of discussion so it can carry them forward past 8192 tokens of history