AI2025 : Meet your Random Analyst
- 11 May 2025

Would you trust a financial advisor who flips coins to make decisions? đȘ Of course not! But thatâs precisely the way AI behave today.
A groundbreaking study just tested 10+ leading AI models on financial analysis tasks.
The result?
Even the best AI scored under 50% accuracy. That's worse than a coin flip!
Here's what the study revealed:
-
AI excelled at simple tasks like finding numbers in reports âš> well ⊠thank you but that doesnât sound so groundbreaking.
-
AI completely failed at identifying market trends (most models scored 0%)âš> Gen AI is not so good at number patterns for now
-
The best models cost > $3 per question. Yes PER questionâš> imagine the bill at the end of the month âšStill, best models are 10x better than the previous generating of models.
So may be next year models will score 100% on this ⊠as itâs been the case in every benchmark.
The question is do you want to bet and when ?
Src:
Various AI helped Jean-Paul Paoli draft this post and its visual. Reach out if you believe part of this content infringes on copyrighted material