The good and the ugly of AI performance

A reader brought to my attention the 2024 Stanford AI index Report, and it's basically catnip for someone like me. I shall regale you with various charts from the report over the next few days, but let's start with the good and the ugly (we'll get to the bad later). Here's how basic AI performance has progressed over the past decade:

Impressive. Practically everything is now performing at human level except for high-level math, and it's been on a rocket recently, going from nothing to 90% in only two years. But here's the ugly:

Even the good AI models make up shit 20% of the time, and the bad ones might as well be Donald Trump. This is by far the biggest short-term Achilles heel of AI. Nobody can rely on it for anything serious until this gets cleaned up.

Facebook
Twitter
Email
Print

Author Of article : Kevin Drum

Read full article