RLHF is getting popular due to chatGPT. But can it tackle the issue of long term coherence in input/output? Policy gradients with large scale human feedback will help mitigate a bit but there are limits due to exploration coverage, and therefore eventually for alignment. 1/3