What's confusing about ChatGPT is that you expect nerual networks to interpolate between things seen during learning. However it is able to solve problems that look intuitively very discrete (writing programs never seen before, for instance). Yet for the way the weights were 1/N