Running a computer benchmark test on any PC tells us about its capabilities. Benchmarking is a method of quantifying a system’s performance. It helps you make your next hardware purchase decision.

The nonprofit Center for AI Safety (CAIS) and Scale AI, a company that provides a number of data labeling and AI development services, have released a challenging new benchmark for frontier AI systems ...

Analysts have evidence suggesting that several state-of-the-art AI models can reproduce test sets for popular benchmarks such as MMLU (Massive Multitask Language Understanding) and GSM8K (Grade ...

The first Geekbench 6 results (via BenchLeaks on X) for Nvidia’s RTX 5090 laptop GPU are here. They show extremely poor ...

For instance, the GLUE benchmark, designed to test an AI’s ability to understand natural language by completing tasks like deciding if two sentences are equivalent or determining the correct ...

It is widely considered a necessary, even fundamental, element of intelligence. The ARC-AGI benchmark tests for sample efficient adaptation using little grid square problems like the one below.