I fed some of the example chats shown in articles about LaMDA to GPT-J 6b (which is a far simpler model than ChatGPT), and didn't have much trouble getting it to spit out the same profound bullshit that fooled Lemoine. It's impressive.