Agree with this person. That a LM can pass any test as of today is an observation on the test, not the LM. There maybe LMs in future which can automate parta of code, but as of today, LMs regurgitate what they learnt in a relevant context.