- The Intrinsic Value Newsletter
- Posts
- šļø How ChatGPT Works
šļø How ChatGPT Works
Weāre taking a stab at two hefty topics today: U.S. debt default and ChatGPT. Let us know how we do.
š¤æ On the other side of the pond, UK inflation remains a painful problem. The countryās Consumer Price Index was up 8.7% in April, led higher by energy and food, which increased 12.3% and 19.1% year-over-year, respectively.
U.S. inflation is in better shape, but traders are increasingly betting the Fed will raise rates again in June to keep fighting inflation, pricing the odds of a 0.25% hike at around one in three.
But letās get past the debt ceiling crisis before worrying about what the Fed does next š¬
ā Shawn
Hereās the rundown:
Today, we'll discuss two items in the news:
What a U.S. default would look like
Why tipping prompts are everywhere
Plus, our main story on how ChatGPT really works
All this, and more, in just 5 minutes to read.
POP QUIZ
BROUGHT TO YOU BY
Are you still leaving alpha on the table?
Gaining access to the right financial intelligence platform can make or break your quarter.
Sign up for a trial today to beat FOMO and move faster than the market.
IN THE NEWS
āWhat If the U.S. Defaults? (Economist)
The big question lately: What happens if America defaults on its debt?
It's hard to predict precisely what would happen, but it depends on how quickly policymakers reverse their blunder (days versus months would matter hugely).
Either way, a default would likely send shock waves in markets with real-world consequences manifesting as bankruptcies, recession, and a tarnished national image. In other words, a stock market plunge would be only one of the possible downfalls (UBS predicts the S&P 500 would fall at least 20%).
The probability of default remains low ā the debt limit, currently at $31.4 trillion, has been raised or suspended many times before.
Nonetheless, "Weāre sailing into unchartered waters," Andy Sparks, a portfolio management researcher, told The New York Times.
Why it matters:
The $24 trillion U.S. Treasury market is the primary source of financing for the government. It's also the largest debt market worldwide and the backbone of the financial system, many folksā life savings, critical to mortgage rates, the dollar, and almost everything in between.
Shattering confidence in such a deeply important market would be "catastrophic," said Calvin Norris, another portfolio manager.
Youād expect higher interest rates as investors demand a greater return for investing in Americaās debt, given its willingness to play politics with its finances. Because Treasury bond markets shape borrowing costs throughout the economy, millions of Americans would ultimately be impacted.
Failing to raise the debt ceiling would drive the U.S. into its first sovereign default in modern history. (The U.S. did default during the War of 1812.)
Bank lending, which greases the wheels of economic activity, could freeze up, pushing unemployment higher and sparking financial panic globally. But you might find peace knowing this is precisely why many believe politicians wonāt allow a default to happen.
š¤ Why Tipping Prompts Are Everywhere (WSJ)
Over the last few years, nearly every store has joined the tip club. An iPad or similar device flips your way during checkout: How much would you like to tip on that coffee?
But now tipping prompts have gone further, showing up for locksmiths, baby formula, and wedding dresses. Itās not unusual for bridal shops to now ask brides-to-be to leave tips for the stylists who helped them find their dream gowns.
In a competitive job market with near-record unemployment, businesses say tips help them hire and retain employees. Theyāve also noted that the extra revenue from tips helps them avoid further price increases amid high inflation.
š Matthew ā A friend of mine works at a New Jersey bakery making $15/hour. Thanks to tips, she says her hourly rate doubles to about $30 on a busy day.
Why it matters:
Itās not just coffee shops: Gas stations, plant stores, and virtually every transaction has been prone to tipping, including online orders. Some customers say they feel put on the spot.
Others say they feel āguiltedā into tipping on transactions.
Thereās also the issue of why businesses have a tip option, as some believe the owners should pay their employees more in hourly wages. Then again, thereās the option to leave no tip at all.
But tipping can also be reserved for only superior service, a way to express gratitude or appreciation for a job well done.
Said one online baby formula retailer with a tip option: āTipping offers a very real way for us to let our customers speak up and thank our warehouse team for processing their orders.ā
MORE HEADLINES
š Mortgage demand drops again as rates cross back over 7%
š Filled Broadway seats reach pre-pandemic levels in the 2022-23 season
ā° The odds of the U.S. going past the default date are 25% and rising, says JPMorgan
CHART OF THE DAY
HOW CHATGPT WORKS
Buzzy tech
Artificial intelligence (AI) is all the rage with investors. In 2017, it was blockchain; in 2021, it was the metaverse; and in 2023, everyoneās talking about AI.
āAIā has been mentioned over 1,000 times on earnings calls this year by S&P 500 companies, as AI-related product announcements and investments have sent stocks like Microsoft and Palantir booming. Meanwhile AI-caused setbacks have been met with stern responses.
The educational site Chegg lost almost half its market valuation after warning ChatGPT and related services may reduce its popularity amongst students.
Alphabetās market capitalization fell by $100 billion after its AI chatbot, Bard, botched a demo.
Nvidia, which creates high-end chips and software systems used to build AI models, has been āprinting moneyā this year, per Bloomberg journalist Joe Weisenthal. And its stock has followed suit, surging over 100% year-to-date.
Understanding the tech
Most people have likely experimented with ChatGPT at this point. It does live up to the hype, especially given how quickly new iterations are improving.
But how do AI-powered systems like ChatGPT work?
In a recent interview on the Odd Lots podcast, the managing director and senior analyst of U.S. semiconductors at Bernstein Research, Stacy Rasgon, explains.
He paints a hypothetical picture where you want to achieve some sort of machine learning, aka a neural network, by teaching an artificial intelligence to recognize pictures of cats.
Imagine a black box with a slot on the side where you feed pictures. And on the other side, a display indicates āyes, itās a cat,ā or āno, itās not.ā
āOn the side of the box, there are a billion knobs that you can turn. And theyāll change various parameters of this model that right now are inside the black box.ā
Training the model
This is known as the ātraining.ā
Basically, youād take a picture that you already know is either a cat or not and feed it into the box, asking the model what it is. At first, itāll be inconsistent, but when itās wrong, you fine-tune those parameter knobs until, after a while, the model ālearnsā how to recognize every possible image, including a cat.
Rasgon adds, āItās about varying all of the parametersā¦these models can have billions or hundreds of billions or even more parameters that can be changed,ā which means they require tremendous computing power.
Once the model is trained and can accurately recognize cat images, the computing process becomes less intensive.
In other words, the difficult part is training the AI to recognize patterns, but once that training is complete, prompting it to, for example, recognize a cat image requires less energy.
He compares these neural networks to a ābunch of circlesā where each circle represents a neuron.
These rows of circles, as shown above, are connected with arrows. These circles all have an activation function, or threshold, based on inputs before the neurons fire, just like in your brain. It might give a 50% weight to one neuron (circle) and 20% to another.
These weights are āone set of parametersā that can be changed by the so-called āknobsā being tweaked during the training process.
The threshold that must be reached for a neuron to fire can vary, known as the ābias.ā Put differently, neurons can have different sensitivities before theyāre triggered.
Rasgon adds, āChatGPT has 175 billion separate parameters that get set during the training process.ā And it takes about ā300 sextillion operationsā to train ChatGPT.
Final thoughts
More simply, the chatbot uses predictive text. The model knows ābased on this word and this query and my datasetā¦these other words typically follow, and it kind of constructs the response from that.ā
Still, it doesnāt truly know whether what itās saying is correct.
Itās hard to wrap your head around, but the economic realities are more tangible: Rasgon estimates it took around $80 million to train ChatGPT.
While many focus on ChatGPTās ability to eat into Googleās search monopoly, which facilitates about 10 billion daily searches, Rasgon thinks this understates AIās disruptive capabilities.
Instead, he imagines everyone having personal virtual assistants powered by AI that you could use to book plane tickets, help you drive, or manage your schedule.
Dive deeper
Breaking down how AI models work in a few hundred words is beyond our pay grade, but you can listen to Rasgonās full interview for more context here.
TRIVIA ANSWER
See you next time!
That's it for today on We Study Markets!
Enjoy reading this newsletter? Forward it to a friend.
Was this newsletter forwarded to you? Sign up here.
Keep an eye on your inbox for our newsletters on weekdays around 6pm EST and on weekends. If you have any feedback for us, simply respond to this email.
You can also leave your comments/suggestions/feedback anonymously here.
How would you rate today's newsletter?
All the best,
P.S. The Investor's Podcast Network is excited to launch a subreddit devoted to our fans in discussing financial markets, stock picks, questions for our hosts, and much more!
Join our subreddit r/TheInvestorsPodcast today!
Ā© The Investor's Podcast Network content is for educational purposes only. The calculators, videos, recommendations, and general investment ideas are not to be actioned with real money. Contact a professional and certified financial advisor before making any financial decisions. No one at The Investor's Podcast Network are professional money managers or financial advisors. The Investorās Podcast Network and parent companies that own The Investorās Podcast Network are not responsible for financial decisions made from using the materials provided in this email or on the website.