I think another issue is, ChatGPT is fine tuned by human written instructions. What we need here is the human spoken instructions. Probably these two types of instructions have very different patterns