We use a similar approach on the chatbot on our documentation website. The language model is only used to formulate the response once the best matching paragraph has been identified. It can still hallucinate but