![Sonos Abandons Streaming Device That Aimed to Rival Apple TV [Report]](https://www.iclarified.com/images/news/96703/96703/96703-640.jpg)
![HomePod With Display Delayed to Sync With iOS 19 Redesign [Kuo]](https://www.iclarified.com/images/news/96702/96702/96702-640.jpg)
![iPhone 17 Air to Measure 9.5mm Thick Including Camera Bar [Rumor]](https://www.iclarified.com/images/news/96699/96699/96699-640.jpg)
-xl-(1)-xl-xl-xl.jpg)
_Andrii_Yalanskyi_Alamy.jpg?#)
![[The AI Show Episode 139]: The Government Knows AGI Is Coming, Superintelligence Strategy, OpenAI’s $20,000 Per Month Agents & Top 100 Gen AI Apps](https://www.marketingaiinstitute.com/hubfs/ep%20139%20cover-2.png)
![[The AI Show Episode 138]: Introducing GPT-4.5, Claude 3.7 Sonnet, Alexa+, Deep Research Now in ChatGPT Plus & How AI Is Disrupting Writing](https://www.marketingaiinstitute.com/hubfs/ep%20138%20cover.png)
.jpg?width=1920&height=1920&fit=bounds&quality=80&format=jpg&auto=webp#)
.jpg?width=1920&height=1920&fit=bounds&quality=80&format=jpg&auto=webp#)
AI Reasoning Benchmark: MathR-Eval
We designed a new benchmark, Mathematical Reasoning Eval: MathR-Eval, to test the LLMs’ reasoning abilities, with 100 logical mathematics questions. Benchmark results Results show that OpenAI’s o1 and o3-mini are the best performing LLMs in our benchmark. Methodology Our dataset includes 100 mathematics questions, which do not include advanced calculus but require reasoning and problem-solving
We designed a new benchmark, Mathematical Reasoning Eval: MathR-Eval, to test the LLMs’ reasoning abilities, with 100 logical mathematics questions. Benchmark results Results show that OpenAI’s o1 and o3-mini are the best performing LLMs in our benchmark. Methodology Our dataset includes 100 mathematics questions, which do not include advanced calculus but require reasoning and problem-solving
