AI's bewildering rate of change

If you have been bewildered by the rate of change in AI, you aren't alone.

In 2021, AI was only able to correctly solve around 5% of the problems in the MATH benchmark. 1

Researchers were asked to predict how AI would perform in the following year. Their forecast landed at 12.7%.

The results? AI was able to achieve a 50% pass rate in 2022, crushing the predicted result.

Today AI is successfully solving over 90% of the problems correctly.

"Over and over again, year after year, skeptics have claimed 'deep learning won’t be able to do X' and have been quickly proven wrong."

"If there’s one lesson we’ve learned from the past decade of AI, it’s that you should never bet against deep learning." 2


Subscribe for a low volume digest about GenAI, startups and making it all work 👇