The Data: The Future of AI: LLMs at Warp Speed: By 2030, LLMs May Tackle Monthlong Tasks in Hours

Benchmarking large language models presents some unusual challenges. For one, the main purpose of many LLMs is to provide compelling text that's indistinguishable from human writing. And success in that task may not correlate with metrics traditionally used to judge processor performance, such as instruction execution rate.