Large language models like BERT and ChatGPT are, well, really large (e.g., running GPT-3 in production requires over of hardware). SparseGPT shows that these models can be shrunk dramatically but retain accuracy. Watch here: