I think better embedding generation is a much more important development than ChatGPT (for most tasks it makes no sense to add the noisy embedding transformation). But it is far less intuitive for the averag