Punctuated Equilibrium in AI : Is it Better to Be A First Mover or A Last Mover?
Machine learning advances tend to evolve in bursts. Researchers publish a new paper with a newly discovered technique. It launches the industry forward & more researchers rapidly iterate to improve it further.
Progress looks like this – a series of aS curves one after another.
No one knows the time period between the rapid progress or the slope of the curves or how much progress we’ll make during one of these curves.
In the last few years, since the release of Attention is All You Need Paper, AI has boomed. The rapid pace of iteration has led to the release of model after model.
A collection of human evaluators marks our progress using a score called Elo collected by LMSyS, modeled after chess grandmaster rankings. If we plot Elo by Rank, we see an S-curve.
And if you look very closely at the upper right, which indicates the performance of the most recent models : GPT-4o, Claude 3.5 Sonnet, Gemini Pro, & Llama 3 – if you squint, perhaps you can imagine another elbow, another rapid advance of progress in performance.
OpenAI categorizes levels of AI similarly to self-driving cars. The five levels are
Level
Name
Description
1
Chatbots
robots that can chat with you
2
Reasoners
robots that use logic to solve problems
3
Agents
robots that act independently of humans
4
Innovators
robots that create new ideas independently
5
Organizations
robots that replicate the work of organizations
OpenAI has also said it’s close to moving from Level 1 to Level 2. What if that little orange elbow is the beginning of reasoning in AI?
In some software categories, first mover advantage exists. In search, last mover advantage (Google) won because they benefitted from the learnings of all who came before.
AI is characterized by waves of innovation & sudden change, a tecnological punctuated equilibrium.
Will the winners in this era be those who started early before the rapid advance or those who waited until afterwards?
—————
Boost Internet Speed–
Free Business Hosting–
Free Email Account–
Dropcatch–
Free Secure Email–
Secure Email–
Cheap VOIP Calls–
Free Hosting–
Boost Inflight Wifi–
Premium Domains–
Free Domains