Currently I reckon its largely UI and prompt engineering thats making the difference. But InstructGPT/ChatGPT has changed everything. Making models safer/friendlier/faster/cheaper/better with bespoke datasets and online