Nice, thanks! Here are a handful of reasoning failures that I've collected from others myself that I believe robustly cause failures. Changes from time to time (eg ChatGPT being unable to answer gender of first