ChatGPT addresses some of the issues raised here for code generation, but two remaining problems caught my eye - They are good locally, but have trouble keeping focus globally - We know rules for a valid program, not easy to incorporate into transformer