We humans love quantifiability. Since you used the word "measure", do you believe the measurement you're aspiring for is quantifiable?
I currently assert that it's not, but I would also say that trying to follow your suggestion is better than our current approach of measuring everything by money.
No. Screw quantifiability. I don't want "we've improved the sota by 1.931%" on basically anything that matters. Show me improvements that are obvious, improvements that stand out.
Claude Plays Pokemon is one of the few really important "benchmarks". No numbers, just the progress and the mood.
I currently assert that it's not, but I would also say that trying to follow your suggestion is better than our current approach of measuring everything by money.