A lot of people are using LLMs such as ChatGPT now to get information and advice, meaning they will have huge influence on people's life - but we have relatively few ways of controlling what they actually generate.