Patrick Teen’s Post

View profile for Patrick Teen, graphic

eesel AI | ex-Atlassian

AI can see the future. At least, they can see it a lot better than humans can. Studies using ‘crowd’ LLMs have shown the significantly greater forecasting ability than the typical human ‘crowd’ used in forecasting. Utilising human crowds have some serious limitations: ➡️ biases ➡️ scalability ➡️ cost and time Researchers created their own LLM ‘crowd' using models from companies like OpenAI, Google, Anthropic, and Meta, to replicated a human crowd. With standardised prompting, their accuracy was indistinguishable from human predictions & in some testing even outperformed them. However... I’m a bit confused as to why these LLMs are performing better than humans. But perhaps it shouldn’t be that surprising. I mean, LLMs are the ultimate “crowd source” by definition. They’re the sum aggregate of millions of written artefacts, and the absolute average of thought in some sense. And aggregating across different language models only pushes that further. Food for thought, anyway. It’s really exciting to see such novel applications of LLMs coming out. The next time someone’s doing the “count jelly beans in the jar as a crowd exercise” - let’s maybe use LLMs? Super keen to see what other uses these AI-crowds have in a more practical sense.

  • diagram

To view or add a comment, sign in

Explore topics