One thing I've been quite amazed about is how much the context size has increased for LLMs. I think ChatGPT is 8k tokens. It's clearly not enough for millions of lines of code but it might be enough to include the local code and interfaces