AI2025 : Meet your Random Analyst

AI2025 : Meet your Random Analyst

Would you trust a financial advisor who flips coins to make decisions? đŸȘ™ Of course not! But that’s precisely the way AI behave today.

A groundbreaking study just tested 10+ leading AI models on financial analysis tasks.

The result?

Even the best AI scored under 50% accuracy. That's worse than a coin flip!

Here's what the study revealed:

  • AI excelled at simple tasks like finding numbers in reports ‹> well 
 thank you but that doesn’t sound so groundbreaking.

  • AI completely failed at identifying market trends (most models scored 0%)‹> Gen AI is not so good at number patterns for now

  • The best models cost > $3 per question. Yes PER question‹> imagine the bill at the end of the month ‹Still, best models are 10x better than the previous generating of models.

So may be next year models will score 100% on this 
 as it’s been the case in every benchmark.

The question is do you want to bet and when ?

Src:


Various AI helped Jean-Paul Paoli draft this post and its visual. Reach out if you believe part of this content infringes on copyrighted material