Very good question! My personal opinion: maybe 1-3% are genuinely new ideas. This isn't meant to disparage the majority of arXiv papers; recombinations can be useful. But, I don't think ChatGPT could have come up with Attention Is All You Nee