There are many ways in which ChatGPT could benefit from a non-connectionist co-processor, and finding ways to integrate such co-processors into the transformer architecture seems like a fun project...