So I defaulted to a more practical definition of should/could, tied to what they are. Which is that these arent sentient. They detect patterns, there is no rationale to their answers. Its the same reason why ChatGPT has the hots