I love this work. They define formal vs. functional linguistic competence. They explain that LLMs are good at formal but not so good at functional and suggest that other approaches like data+training+architecture+objectives will be needed (similar to ChatGPT, but beyond it).