With all the buzz around ChatGPT, it seems like a good time to ask how LLMs process information. We find that at least for parsing, Transformer's reach exceeds its grasp! Have a peek at our new paper to find out more: