Totally blown away by these findings! In the interests of moving the goalposts, I wonder how GPT3 might handle novel 2nd order relations in the digit task? Like a progression where the addend changes (e.g. first x, then 2x). ChatGPT seems to struggle: