i think it's prolly due to LLMs like ChatGPT (first LLM for public use with considerable context length - AFAIK - with 8192 tokens) coming out of the box handicapped. if we have the Stable Diffusion of LLMs with double or triple the context length.