Generative AI is a bubble – we know what happens next

generative AI bubble
Image by Sira Anamwong | Bigstockphoto

Generative AI has ‘bubble’ written all over it. The signs are everywhere, from ridiculous valuations to outlandish use cases and every man and his dog now wanting to build one. But the technology has no chance of living up to the hype meaning that sooner or later, the house of cards will fall.

That does not mean that there is not money to be made or advantage to be won, but it needs to be executed from the point of view that the bonanza is temporary.

This kind of excitement, hype and speculation is nothing new, but is in fact a manifestation of a well-known and documented phenomenon referred to as the madness of crowds.

In his 1841 book on the subject, Charles MacKay describes this as crowd psychology that can create an emotional feedback loop, whereby dissent may be stifled as the crowd, not wanting to miss out, hears only what they want.

The madness of AI crowds

The first well-documented case occurred in The Netherlands between 1634 and 1637 and was concerned with speculation in the price of tulip bulbs. Another was the South Sea Bubble in the UK in 1720, in which the South Sea Company was granted a monopoly to trade in South America, from which unimaginable riches were supposed to flow. More recently we had the Internet Bubble of 1999 and 2000, as well as the cryptocurrency craze which came a cropper just last year.

The circumstances of these bubbles are always different but there are some characteristics that are common to all of them. These include popular awareness and interest, investments made with no regard for fundamental analysis or valuation, unrealistic expectations and (more recently) every company deciding to use the technology in question for fear of being left behind.

Andreessen Horowitz’s leading of a $200 million round in Character.ai at a $1 billion valuation, when the company has no revenues and no product, is just the latest example. That follows Google’s $300 million investment in generative AI company Anthropic, which could easily be nothing more than vapour. Anthropic is just 6 months old, and joins the quickly expanding field of new companies popping up to soak up the free money on offer.

This is exactly what happened in the last AI craze about five years ago, and led to RFM’s categorization of most AI companies as tricksters who don’t use AI at all but say they do in order to raise money at a better valuation.

Unrealistic expectations

The problem with all of this excitement is that it is setting expectations for the capabilities of generative AI that rigorous scientific testing confirms are unrealistic.

Generative AI is exceptionally good at giving the impression that it is aware, which is leading to the conclusion that general AI is just around the corner. IIn simple terms, general artificial intelligence is the ability of a machine to take what it has learned from one task and apply it to another. This requires causal understanding of the task to be present.

However, all of the scientific literature demonstrates that AIs that are created using neural networks of any size have no causal understanding of what it is that they do. Instead, they recognise statistical patterns in data. In the case of large language models, they calculate the probabilities of words occurring next to one another in a sentence.

This is why all of the chatbots around today make the most horrendous mistakes and have no concept of what is acceptable and what is not. This is also why they need human overseers to ensure that they do not go off the rails.

This weakness is inherent in all of these systems that are powered by large neural networks. This is what drives my opinion that the route to general AI does not lie down this route. This means that general AI is decades away, which is not the message that is being pushed out through the media and on social media.

Consequently, when general AI fails to meet expectations (as it has been doing pretty consistently for the last 60 years), the money will dry up and the valuations will collapse.

The 4th AI Winter

The result will be the 4th AI Winter, which will look very similar to what crypto is currently experiencing and what the Internet experienced between 2001 and 2007.

This gloomy assessment does not preclude one from making money, but one needs to look at this from the point of view that investment or sales strategies need to be temporary in nature.

These generative AI models consume vast resources, meaning that those that supply these resources look set to receive a good portion of the money that is being thrown at the sector right now. This includes Nvidia and AMD who supply the chips that all of these models are trained on, and further afield, the likes of Qualcomm, MediaTek and yes, even Intel.

At MWC 2023, Qualcomm provided a very able demonstration of a 1-billion parameter model running on a device, and is now in a position to use this as a selling point of its latest Snapdragon 8 Gen 2 chipset, regardless of whether anyone makes use of it. Intel, despite its issues, is also a major supplier of silicon to the data centre, and this latest craze could trigger a pick-up in its fortunes albeit for a short period of time.

This kind of madness is enough to drive Nvidia and AMD well past their recent highs, implying that there is short-term upside despite the obvious valuation issues. In other words, this is one for traders and speculators, not investors who may be better served by picking through the crypto wreckage as all the silly money is pulling out and going into generative AI instead.

The currencies remain extremely risky but there are proper use cases for the blockchain technology once it has been fixed and the assets are now properly on sale.

The 4th AI winter beckons.

1 Comment

  1. While the article raises valid concerns about the potential overvaluation of generative AI companies and the hype surrounding the technology, it misses several key points that could refute the claim of an imminent AI bubble. As an expert on market trends, I would like to address these points.
    General AI vs. Narrow AI: The article focuses on the idea that general AI is decades away, and therefore, the investments in the AI space are misguided. However, the majority of AI applications today are narrow AI, which are designed to perform specific tasks. These applications have already proven their value in industries such as healthcare, finance, and manufacturing, driving efficiency and innovation. The success of narrow AI should not be discounted just because general AI is not yet within reach.
    AI’s impact on multiple industries: The article overlooks the fact that AI technology is already transforming various sectors. From natural language processing in customer service chatbots to image recognition in autonomous vehicles and medical diagnosis, AI is being integrated into the very fabric of modern life. Its broad impact across industries signifies that it is not a fleeting trend, but rather a foundational technology that will continue to drive growth and innovation.
    Continuous improvements in AI technology: The article suggests that generative AI models have inherent limitations, which may cause the AI bubble to burst. While it is true that current models have their shortcomings, it is important to recognise that AI technology is constantly evolving. Researchers are continually developing new techniques and algorithms to address these limitations, and as AI technology improves, so too will its applications and overall value.
    Increasing data availability: One of the main drivers of AI’s growth is the increasing availability of data, which allows AI models to become more accurate and efficient. As our world becomes more interconnected, the amount of data generated will continue to grow exponentially. This growth in data availability will contribute to the sustained development and progress of AI technology.
    Long-term investments in AI: The article compares the AI market to past economic bubbles, such as the tulip mania and the internet bubble. However, many large technology companies, including Google, Amazon, and Apple, are making significant long-term investments in AI. These investments are not solely based on market hype but rather a belief in the transformative potential of AI technology. These companies are unlikely to abandon their investments when faced with temporary setbacks or slower-than-expected progress.
    In conclusion, while it is essential to remain cautious about the hype and valuations surrounding generative AI, it is also important to recognise the broader impact and potential of AI technology. The current excitement in the AI space may not be a mere manifestation of the “madness of crowds” but a genuine recognition of AI’s transformative potential across various industries.

What do you think?

This site uses Akismet to reduce spam. Learn how your comment data is processed.