Here "Large Language Models" are "very large" ones like GPT-3 / ChatGPT. Understanding reasoning in these models is interesting because it can determine the extent to which these models are capable of performing like humans or if they simply rely on heuristics to respond to us