As we've seen, recent large language models like ChatGPT are pretty damn good. They're also extremely powerful to bootstrap a quick manual curation effort. In no time, you'll have a nice domain-specific gold dataset to train a more efficient model, tailor-made for your use-case.