In LLM world, I assume direct user feedback is not massively provided (e.g. there is thumbs up and down in ChatGPT but I rarely use it). Instead, feedback to retrain models are mostly curated through a group of expert annotators, for "alignment".