Chris Miller explains the hidden reason that global superpowers are obsessed with Taiwan.
Show More Show Less View Video Transcript
0:00
When we think about technology, we think about social media, we think about search engines
0:04
we think about apps on our phones, but undergirding all of this are chips
0:08
The reason that technology that we think of exists is because every year chips get better and better
0:13
And so I think we've actually misunderstood what technology means. We think of the easy part, which is writing the software
0:18
but the hard part is actually manufacturing the chips that give us the advances in computing
0:23
that enable us to have a computer on our phone or to attach devices to the Internet
0:28
all that has been made possible by better and better semiconductors. I'm Chris Miller, a professor at the Fletcher School and author of Chip War
0:36
the fight for the world's most critical technology. Chapter 1, how to build a microchip
0:46
Well, I first got interested in chips when I realized you really couldn't understand how the world works without them
0:51
whether it's walking around your house and realizing there are chips in almost every device you rely on
0:56
are trying to understand big shifts in international trade. There's no good that
1:00
is traded more than semiconductors. Or looking at the political dynamics around the world with
1:05
the US-China competition focusing on technology, chips are at the center of all of these major
1:10
trends. A chip is a piece of silicon, often the size of your fingernail. And in it is carved
1:15
thousands or millions, in some cases, billions of tiny devices called transistors, which flip
1:21
circuits on or off, on and off. And when they're on, they produce a one. When they're off, they
1:25
produce a zero, and all of the ones and zeros undergirding computing, undergirding data storage
1:31
all of your Instagram likes, all of your text messages, these are all just long strings of
1:35
ones and zeros, which are created on the chip by these circuits flipping on and off
1:40
There are a couple different categories of chips. Some chips process data, other chips remember data
1:45
and a third category turns real world signals like audio or pictures into ones and zeros so
1:51
that they can then be processed or remembered. And so when we look at the world, we see pictures
1:55
But when a phone, for example, uses a camera to look at the world, it takes in lots of rays of light and then has to learn how to convert those into ones and zeros that can be stored
2:04
And so there's very specific sensors for pictures, for sound, for radio waves that are used in semiconductors to convert these real world signals into strings and ones and zeros that can then be re-represented as pictures later on
2:17
For example, when you pull a photo op on your phone, all of this is done by different types of semiconductors
2:22
So generally chips have a foundation of silicon, but there are dozens of other materials that are layered on top to make the transistors at such tiny scale
2:32
So a typical advanced chip could have several dozen materials. The foundation is silicon, but there are many other chemicals involved in the process
2:41
Yeah, it's true that sand is from silicon and so are chips, but the similarities basically end there
2:46
The silicon that's used in manufacturing chips is among the most purified elements that we have
2:53
And the reason is that when you're manufacturing chips with tiny transistors
2:57
you need to place almost every atom perfectly to make those chips work
3:01
which means that if your silicon or any of the other materials that you're using has even a single atomic impurity, it can cause defects in the way your chip functions
3:09
And so the production of the silicon wafers that are used in the chip manufacturing process
3:13
requires extraordinary levels of purity. There's really just four companies in the world today that are capable of producing silicon wafers at the right level of purity at the scale that's required for contemporary manufacturing
3:25
The good news is that there's silicon everywhere. It's one of the most widely distributed elements in the Earth's crust
3:30
The hard part is really the refining and the purification of silicon to make sure there aren't any impurities that could disrupt the manufacturing process
3:38
So on top of your silicon, you could have boron, gallium, gallium arsenide
3:45
lots of different chemicals that are used. And every chipmaker has its own proprietary process
3:49
So we don't really know inside of a typical chip what materials are used
3:53
because chipmakers usually keep it pretty secretive. That's their special sauce that lets them manufacture chips with the right level of capability
4:01
We're not going to run out of silicon, nor will we run out of the other materials
4:05
that are generally used in chipmaking. There are some concerns that certain materials are predominantly refined and processed in a single country
4:14
So for some of the materials like gallium and germanium, China produces around 90% of those materials
4:20
So there's geopolitical issues that could interrupt supply, but it's not going to be that we're running out of the capability to produce them
4:27
I visited a bunch of chipmaking facilities over the course of the research. The interesting thing, though, is that when you go inside one of these massive facilities called fabs
4:35
what you find is that there are huge machines and not much else
4:39
because the manufacturing process has to be extraordinarily automated because humans are way too imprecise for manufacturing at nanometer scale
4:48
And so inside of a chip-making facility, there are very few humans and lots of big machines that from the outside are impressive in their size
4:55
but you can't see what's actually happening because it's happening at microscopic level
4:59
So there are a handful of companies that play a big role in the making of the machines that make chips
5:04
A couple in the United States, one in the Netherlands, and one other large one in Japan
5:09
Five companies play the dominant role in the manufacture of the machines that make chips
5:14
And in some ways, it's actually harder to make the machines that make chips than it is to make the chips themselves
5:19
Because these tools are among the most precise tools that have ever been deployed
5:24
Just to give you one example, ASML, a company based in the Netherlands, produces machines that are used in the manufacture of almost every high-end chip today
5:32
And these machines are capable of manipulating materials at basically the atomic level
5:37
to produce chips with billions and billions of transistors, like those that are inside of your phone or that are used for training AI systems
5:44
So there's a pretty small number of companies that make chips. And when you look at specific types of chips, you find that there's even more concentration
5:51
The biggest chip maker in the world is the Taiwan Semiconductor Manufacturing Company
5:56
When it comes to advanced processor chips, like the chips in your phone or the chips in your computer
6:00
where TSMC makes around 90% of them. So they've got an extraordinary market share
6:05
and are probably the most important semiconductor company and arguably the most important company in the world
6:10
because the chips that they produce, we rely on for basically everything. There's been a lot of consolidation in the chip industry
6:16
over the past couple of decades, and it's been driven by economics and by technology
6:20
Today, a single cutting edge chip making facility costs $20 billion. They're the most expensive factories in all of human history
6:27
And so there's just a couple of companies that can afford to put up that sum of money on a regular basis to build more and more cutting-edge
6:34
facilities. And to make that work financially, you've got to produce a ton of chips. And so
6:38
there are huge benefits that accrue to the largest firms. The more chips you produce
6:43
the more your cost structure makes sense, and the better your technology gets because you learn from
6:48
every chip you manufacture, you gather data from it, and you tweak your manufacturing process to
6:53
make sure you've got fewer and fewer impurities at every step. And so TSMC is both the world's
6:58
largest chipmaker, but it's also the world's most advanced precisely because it gathers more data
7:02
than anyone else. Because chipmaking requires ultra-purified materials and hugely complex equipment, there's not a single company that can do it on its own. Everyone requires a set of
7:13
partnerships with supply chain providers to give them the materials and the intellectual property
7:18
and the software and the tools that they need to produce advanced chips. And so if you take
7:23
for example the primary processor inside of your smartphone It was probably made in Taiwan but it was made in Taiwan using chip tools from the Netherlands and from the United States and from Japan It was produced using chemicals from Japan and then often assembled and packaged in Malaysia
7:39
before ending up inside of your smartphone. And that's typical. A typical chip requires
7:44
components and materials sourced from dozens of different companies because the process is simply
7:49
too hard for any one company to do on its own. What is nanometer scale, and how does it relate to the innovation process of silicon chips
8:00
A nanometer is a billionth of a meter, and chips today are measured in nanometers
8:06
If you look at the chip inside of your phone, for example, and try to measure the size of the transistors
8:11
of which there will be billions on your smartphone chip, each one of these will be measured in a handful of nanometers
8:18
And so that makes them only slightly larger than atoms, smaller than any sort of living thing, far smaller than a bacteria, smaller than a mitochondria, half the size for the most cutting edge transistors of a coronavirus
8:31
There's basically nothing we manufacture at such tiny scale as we do with semiconductors
8:36
Every year we make more transistors than we've made all other goods combined in all of human history
8:42
And in fact, nothing else really comes close. A typical smartphone chip could have 10 billion transistors just in the main processor chip
8:51
A big data center run by Google or Amazon Web Services would have more transistors than you could plausibly count
8:58
We know that we make more transistors than there are cells in the human body, for example
9:02
We don't even know how many we make in aggregate because there are just so many. Moore's law predicts that the number of transistors per chip and as a result, the computing power per chip will double every couple of years
9:14
And that's been empirically true since the 1960s, which means that the capabilities of chips have gotten vastly better and continue to get much, much better at a faster rate than anything else
9:26
So I like to think, for example, of airplanes to illustrate the difference. If airplanes doubled in speed every two years from the 1960s up to the present, we'd be flying faster literally than the speed of light
9:36
But chips have done that. Chips have increased in that capability because the scale of the transistors has shrunk to the level that today we're manufacturing them, smaller than even viruses
9:47
And that has enabled the explosion of computing power, both in terms of the computing capabilities in high-powered data centers or in your phone, but also the application of computing to all sorts of devices
9:58
Because today there's computing everywhere. It's in your dishwasher. It's in your refrigerator. It's in your coffee maker
10:03
It's in your car. And it's possible to put computing everywhere because today it's so cheap
10:06
We can produce it almost for free. And that has enabled the application of chips to all sorts of different devices
10:14
To understand the change and the rate of innovation, in the 1950s, you could hold a single transistor in your hand
10:20
Today, you can hold 10 billion transistors in your hand in a chip that's the size of your fingernail
10:25
And that's not an expensive chip. That's a chip that often will just cost $50 or so
10:29
So the rate of shrinking transistors as well as the rate of decline in their cost has been unparalleled in any other segment of the economy
10:38
So before transistors, computers used vacuum tubes, which were sort of light bulb-like devices that would turn on and off, on and off to produce the ones and zeros
10:46
And they were cutting edge for their time, but they had huge inefficiencies
10:51
They wasted a lot of heat, for example. They worked pretty slowly. And they also, because they created light, attracted moths
10:57
And so computers had to be regularly debugged in the early days of computing, which meant removing moths from the lights that they were attracted to
11:06
You can see why it was hard to scale that up into a 10 billion unit system
11:11
I think the transistor is the key reason why we've been able to scale down. There's really nothing else, if you look all across the economy, that has shrunk in size and shrunk in cost at that level
11:22
And it's done so not just for a couple of years. It's done so now for over half a century
11:27
And that's why when you compare progress in the computing industry to progress anywhere else, there's really no comparison
11:32
Well, Moore's law is not a law of nature. It's not a law of physics. We wish it were because then we could rely on it to keep delivering advances far into the future
11:39
But it's really a law of economics. It says that if you're able to find a way to shrink, shrink your transistor smaller, then you will be able to find a larger market as well
11:50
And that has incentivized huge investments in shrinking, in improving manufacturing processes, and making chemicals more purified to enable it, which has sustained this rate of advance
12:03
And if ever it turns out that the economics are on Moore's Law break down, the technology will immediately break down as well
12:09
Thankfully, the good news is that right now we're seeing a new wave of excitement about ways you can deploy computing, which has led to a surge of new investment into AI
12:20
but also a surge of new investment into semiconductors because it's now clear that if we can shrink even further
12:25
we'll enable a whole new era of advances in artificial intelligence that rely on even more computing than we've been able to muster thus far
12:32
You can define Moore's law in a bunch of different ways. Is it based on the 2D size of the transistor or the 3D size of the transistor
12:40
Is it based on the processing speed that comes out of it
12:44
And I think there's a lot of people in the industry that are trying to sell a certain chip with given characteristics
12:49
that have an incentive to say Moore's law, based on the other characteristics, has come to a halt
12:54
If you look at the rate of increase of machine learning semiconductors, for example
12:59
chips that are optimized for AI capabilities, they've been doubling in their capability every two years for the past decade or so
13:05
In other words, exactly what Gordon Moore predicted when he set out Moore's law in 1965
13:10
And so my view is that when you zoom out and look at the rate of technological progress, there's really no slowdown that's happening
13:17
When I started my research on semiconductors, I thought that because chips were everywhere
13:21
chips were easy to make, and because nuclear bombs were only controlled by a handful of
13:25
governments, they were hard to make. But what I realized is actually the exact opposite. If you take nuclear weapons, that technology has barely improved since the 1960s
13:33
It's so easy to make nuclear bombs, even the North Koreans can do it. But chips are everywhere because they're cheap and they're tiny
13:40
And making things very inexpensive and very small is extraordinarily difficult, which
13:45
is why there's just a couple companies in the world that can do it at the cutting edge. And the
13:49
reason is that it's brutally expensive and it requires manufacturing processes that get better
13:53
and better and better every single year. And so if you're trying to catch up to the cutting edge
13:58
in the chip industry, you're not trying to catch up to a static cutting edge. You're trying to
14:02
catch up to a cutting edge that is racing forward at the rate of Moore's Law, doubling every two
14:07
years. And so it's a race between companies, but it's the fastest race humans have ever undertaken
14:11
which is why it's extraordinarily difficult to reach the cutting edge. A couple of years ago, it became harder to shrink transistors in two-dimensional format
14:20
For a long time, chips were made. They were described as planar chips, chips in a plane
14:25
in which all the transistors were on the same level. Now we've started making transistors that have three dimensions
14:31
because we're learning to stack them on top of each other, to package more of them together in a way that produces more computing power
14:40
So one of the key trends over the next couple of years is going to be more 3D construction of
14:46
groups of transistors, which will enable more of them to be crammed into a small amount of space
14:50
So the machines that make chips are extraordinarily precise in their manufacturing For example there are tools that can lay down thin films of material that are just a couple of atoms thick with basically perfect uniformity And to pattern the transistors on a piece of silicon you use a tool called a lithography tool
15:08
And today there's one company, ASML of the Netherlands, which makes most of the world's lithography tools
15:13
And for the most advanced chips, these tools can cost $350 million a piece for a single tool
15:19
And they cost so much because they require some of the most precise components ever used
15:25
like a mirror that's the flattest mirror humans have ever made, a laser that's the most powerful
15:30
laser ever deployed in a commercial device, and a ball of tin that falls through a vacuum and is
15:36
struck twice by that laser explodes into a plasma measuring 40 times the temperature of the surface
15:42
of the sun. And this plasma emits light at just the right wavelength, 13.5 nanometers to be
15:47
bounced off the mirrors in exactly the right geometry and land on your chip to carve the
15:52
transistors into the silicon. It's the most complex and expensive machine that humans have
15:58
ever made, and it's required to make all the most advanced chips. Today, there are just three
16:03
companies capable of producing cutting-edge processor chips, the types of chips that go in
16:07
phones or computers or are used for AI. And it used to be a larger number of companies that could
16:13
produce at the cutting edge, but it's shrunken to three and might in the future shrink only to two
16:18
for two reasons. First, the expense is extraordinary. $20 billion per facility is a
16:23
level of spending that many governments can't afford to say nothing of companies
16:27
But second, the scale required to manufacture efficiently is vast. And that means that the
16:34
benefits accrue to the largest firm. And in this case, that's TSMC, the Taiwanese firm that's at
16:39
the center of the chip industry. That's why they manufacture around 90% of the most advanced chips
16:44
because they're cheaper and they're better than their competitors when it comes to manufacturing
16:53
Chapter two, the first chip builders. In the middle of the 20th century, all telephones were managed by AT&T
17:01
They were a monopoly. And the government regulated them. And one of the rules was that their research lab had to share its inventions with the rest of the world
17:09
And they had some of the most brilliant physicists and chemists working in the world at that time, which they hired to improve the phone system
17:17
But in the process, they created some of the key inventions that drove technological progress in computing for decades to come
17:24
The transistor was one of the inventions that emerged out of Bell Labs
17:28
But actually, many of the processes that are used to both design and manufacture semiconductors today were first pioneered by researchers working at Bell Labs
17:37
But because Bell Labs wasn't a computer company, they were able to take those technologies and either spin out their own startup or sell it to somebody else
17:44
And that's how many of the key technological advances undergirding semiconductors first emerged
17:50
So William Shockley, John Bardeen, and Walter Bratton invented the first transistor while they were working at Bell Labs
17:56
They were initially planning to use these transistors as part of the telephone network. But in the late 1950s, the first engineers realized that you could take multiple transistors
18:05
and make them on a single piece of semiconductor material. And so that was the first chip, a piece of material with multiple transistors carved into it
18:15
And that was important because if you had individual transistors, they were connected via wires
18:20
in a way that was okay if you had a handful of transistors. But if you had a thousand connected together, you had a jungle of wires you had to manage
18:26
but the chip managed to have the electrical connection in a piece of material. And so the
18:32
jungle of connections was replaced by a single block of material, which was much more reliable
18:37
and also much more easy to shrink in its size. And so it was the invention of the chip that made
18:42
it possible to deploy lots and lots of transistors together in a way that was economical, but also
18:48
possible to engineer and avoided all of the wiring. The first chips were invented by engineers
18:54
working at Texas Instruments and a company called Fairchild Semiconductor in Silicon Valley. They
18:59
were invented simultaneously. Jack Kilby invented one in 1958 working in a Texas Instruments lab
19:06
And for a long time, they were really at the cutting edge of chip manufacturing. At first
19:11
they were building chips primarily for the U.S. government, for the space program, for example
19:15
and for weapon systems. But they realized early on you could take the exact same chips that the
19:19
government wanted to guide spacecraft and use them for commercial applications like computers or
19:24
pocket calculators. And that set the industry off into its first phase of growth in the 1960s and
19:30
70s and 80s. For the past 15 years, they've taken a different tack. They don't today produce chips
19:36
that are used in computing. They're not, for example, in AI systems in a large way. Instead
19:41
they produce a lot of chips that are in industrial applications or in automobile uses. And so Texas
19:47
Instruments chips are all around you, but you don't see them because they're buried deep in your devices, making sure your windshield wipers work, for example, on your car or that your windows
19:55
move up and down when you press the button. Those are the types of use cases that Texas Instruments
19:59
produces chips for. One of the first startups in Silicon Valley was created by one of the
20:04
researchers who invented the first transistor, William Shockley, who was by all accounts a
20:08
brilliant physicist, but a horrible manager and a horrible person. And so he hired a very talented
20:14
set of engineers in Silicon Valley. He moved to Palo Alto, California, where his mother lived
20:19
for the purpose. And although he hired lots of great people, they detested working for him
20:24
And so eight of them in the late 1950s went out on their own and created Fairchild Semiconductor
20:30
which became one of the key startups that would give rise to Silicon Valley and played a major
20:35
role in Silicon Valley even being named Silicon Valley, because for a long time, it was the absolute
20:40
epicenter of chip design and manufacturing, thanks to people at Fairchild Semiconductor
20:45
Robert Noyce, one of the two inventors of the integrated circuit, Gordon Moore, who later to go
20:50
co-found Intel and many others, first started their career working at Fairchild. Intel was
20:56
founded in 1969 and initially planned to focus on making memory chips. But they realized early on
21:02
that there was a potentially larger market for a type of chip that wouldn't just remember data
21:07
it would also process it, especially if that processing could be programmed in different
21:11
ways for different use cases. And it quickly focused on making chips for personal computers, which at the time was a
21:18
very small market. But they correctly bet that soon everyone would have a personal computer
21:23
And Intel, even today, is the world's largest producer of chips that go inside of PCs
21:30
Gordon Moore was one of the two co-founders of Intel. He's most famous today probably for coining the term Moore's Law
21:37
but he also played an absolutely critical role running Intel's R&D operations
21:40
from the earliest days for many years. And when it came to the microprocessor
21:45
he was an early advocate of focusing on microprocessors at the expense of the more memory-focused chips that Intel had previously made
21:54
And so in some ways, he was the key figure in Intel in making the company focus on microprocessors
22:00
a tiny computer on a chip, as they originally called it. And it gave rise to the idea that you could deploy chips in lots of different use cases without having to redesign the chip itself
22:09
because the chips themselves could have a program running on top of them
22:14
Today, we take it for granted that you can have a chip in your phone and a chip in your dishwasher and a chip in your car
22:18
But at the time, that would have required many different chips for each of those purposes
22:22
Whereas today thanks to the microprocessor we have programmable chips And that was the main source of revenue for the chip industry the main focus of technology until about 20 years ago when the first smartphones began being produced
22:35
And today, smartphone chips are generally designed by one set of companies, but they're manufactured largely in Taiwan
22:42
So the largest designers of smartphone chips are Apple, which designs its own chips in California, Qualcomm, and other companies
22:49
Almost all of them manufacture all of the chips that they design in Taiwan
22:54
And so today the chip industry is split into two different parts. There's the chip designers, which today is essentially like a type of programming almost
23:01
programming where each of the transistors goes on the chip. And the actual manufacturing takes place generally in Taiwan or elsewhere in East Asia
23:09
where different companies specialize in manufacturing at precision scale. Chapter 3, Global Impact
23:19
The chip industry was a global industry from really the earliest days. Fairchild Semiconductor
23:27
was founded in Silicon Valley before it was even called Silicon Valley, but they opened their first
23:31
facility in Hong Kong just a couple of years later. So there was already a globalized nature
23:36
to the chip industry from day one. But one of the things that's changed a lot over the past couple
23:41
of decades is that today each region focuses on a different part of the semiconductor supply chain
23:46
The first chips that were invented in the late 50s and early 60s were used for space programs and missile systems
23:52
So they were at the center of the Cold War competition. And the U.S. was ahead, but the Soviet Union realized that they also needed chips to guide their missiles more accurately or to help their spacecraft launch effectively
24:04
And so they were focused on building their own ship industry, but also on copying whatever they could from the West
24:10
And so since the earliest days of the Cold War, there were Soviet exchange students in physics, for example, studying at Stanford University, but also transmitting the knowledge that they gained back to the Soviet defense industrial complex
24:22
And so there was a lot of copying, a lot of efforts to replicate what the U.S. was doing
24:26
But the Soviets made a couple of key errors. One was that they focused too much on copying and not enough on innovating
24:32
And so they got very good at copying, but not so good at innovating, and that left them behind
24:36
And the second error they made was that they only focused on the military aspects. And the military was where the first chips were used
24:43
But today, most chips go to the private sector. 99% of chips that are made go into phones or PCs or data centers, not for defense equipment
24:51
And so if you only focus on the government and military uses, you've got a tiny market
24:56
relative to the vast consumer market that was out there. U.S. firms were profit-seeking
25:00
They focused on the consumer market as early as they could. In the Soviet Union, they never made that shift
25:05
And so their chip industry was always tiny in comparison to the U.S., which meant they
25:09
could invest less. They could hire fewer workers. And ultimately, their technology fell behind, even though they were pretty good at copying
25:16
So in the U.S. right now, most of the key chip firms only design chips
25:21
Most of the manufacturing of chips happens in East Asia, in Taiwan, for example, or in Korea
25:26
Many of the chemicals that go into chip making come from Japan. And the machines that are used to make chips come from either Silicon Valley, where some of them are still made, or the Netherlands or Japan
25:36
So the industry has globalized, but it's also specialized in the process
25:41
And so there's not a single region today that can make cutting edge chips on its own
25:45
Everyone relies on this internationalized supply chain that brings together the U.S., Taiwan, Europe, Japan, and Korea
25:52
Japan was a major player in electronics assembly early in the 1950s and 1960s
25:58
So devices would be assembled in Japan because labor costs at the time were lower
26:03
But Japanese firms were fixated on moving up the value chain, producing more complex
26:07
more expensive types of goods. And Japanese firms realized very early on that consumer electronics could be a major growth
26:15
area for them, where they could sell not just domestically, but all around the world
26:19
And so companies like Sony, which were among the leaders in the 1970s and 1980s, bet on
26:24
the consumer market to produce the types of goods that would take advantage of the advanced
26:31
chip technology that they were pursuing at the time. And so although we don't remember it much
26:35
today, devices like the Sony Walkman in the 1980s was at the center of the tech industry
26:41
and it put Japan really on the map. And at that point, Japan was, by a lot of metrics
26:46
just as capable as the United States when it came to building advanced chips and then deploying them
26:51
in very profitable uses like the Sony Walkman. One of the places where the Japanese excelled
26:56
was in video games, which most people might not think of as driving technological advances
27:01
But actually, the computing that's required to show graphics that look real life is extraordinarily complex
27:09
And so the Japanese companies like Sony, Nintendo is another one, were fixated on how to make better graphics
27:16
And it required more and more computing power to make better and better graphics
27:20
And today, they're no longer major players in that sphere. But NVIDIA, which is the central player in AI, actually started as a video game company
27:28
It made graphics cards for computers. And for most of their early history, they were selling chips primarily to gamers because the graphics were better and rendered more rapidly
27:37
But it turns out that the same essential math that's used for showing graphics on a screen is pretty similar to the math that's used in training AI systems
27:46
And so NVIDIA was able to take chips that were made for video games and made for computer games and pivot them to be used in AI systems
27:54
which is why a video game company that was founded in the 1990s has now become not just any AI company
28:01
but the most important AI company in the world. In the 1980s, the South Koreans saw Japan becoming a major player in the chip industry
28:08
and saw Japanese firms rise to the top, both in terms of technology and in terms of the amount of money they were making
28:13
selling both chips and devices that used them. And South Korea wanted to replicate Japan's strategy
28:19
So companies like Samsung and SK Hynix were founded to establish chip industries in Korea
28:28
They replicated the Japanese model. They became very good at manufacturing. They competed very effectively on cost
28:33
They also represented an alternative to Japanese production. Because U.S. firms in the 1980s were very worried that Japan was going to take over the chip industry
28:41
So they were excited to have another option besides Japan and shifted business towards Koreans
28:45
both because the Korean producers were cost competitive, but also because it provided a bit more diversification in the industry
28:51
that would limit the ability of Japanese firms to dominate. One of the biggest European chip makers in the 1960s, 70s, and 80s
28:58
was the Dutch company Philips, which today still exists but doesn't produce any semiconductors
29:03
They got out of the semiconductor business several decades ago. But one of the legacy units that they'd created
29:08
was a unit that made the tools that make chips. And in particular, they focused on the lithography tools
29:14
that are capable of patterning transistors on a chip. ASML was spun out of Philips several decades ago
29:21
And at the time, most people thought it would likely fail. The Netherlands wasn't a big part of the chip industry
29:28
Silicon Valley was a long way away. But ASML took a series of pretty wild technological bets
29:34
on technologies most people thought would fail. And the best example of this is the current cutting edge of lithography
29:40
called extreme ultraviolet lithography, the tools that cost $350 million a piece to produce
29:46
Everyone else thought that was a technology that would never work. It took three decades to commercialize
29:51
Tens of billions of dollars of research and development money went into it
29:56
But ASML made that bet. And it was a bet that looked like a very bad bet for years until about a decade ago when they first were able to build the initial EUV lithography
30:05
machines. So chip makers have always used lithography to manufacture semiconductors, but as transistors have gotten smaller and smaller, we've needed better and better lithography
30:14
systems to print smaller transistors on silicon chips. And several decades ago, it was clear that
30:21
the cutting edge in lithography at the time was going to be too broad in terms of the wavelength
30:26
of light used to print tiny transistors. The cutting edge used light with a wavelength of
30:33
193 nanometers, which sounds really small, and it is really small. But if your transistors are
30:38
measured in 10 nanometers or 5 nanometers, 193 nanometers is still too broad of a brush with
30:44
which to paint your transistors on the silicon chip. And so ASML bet on a new type of lithography
30:51
system using light with a wavelength of 13.5 nanometers, much more narrow, which sounds
30:56
logical, but it was extraordinarily difficult to produce. Research started in the early 1990s, and it took 25 years before these machines were commercialized
31:06
because it required building a supply chain that involved these extraordinarily complex
31:11
components, the flattest mirrors humans have ever made, the most powerful laser ever in
31:15
a commercial device. All of these had to be invented in the process of making these machines work
31:19
So Taiwan was a major player in electronics assembly and putting together transistor radios, for example, in the 1950s and 60s or assembling televisions
31:30
And they did quite well on that, but there's not much money made in the assembly. The money is made in the manufacturing of the complex components involved
31:38
And so the Taiwanese government realized as early as the 1970s that they needed to move up the value chain and learn to do the more complex parts of electronics manufacturing
31:47
In 1987, there was an American engineer named Morris Chang who was passed over for the CEO job of Texas Instruments where he'd worked for several decades
31:56
And so he left TI and was looking for something else to do. And he'd gotten to know the Taiwanese government for several years because Texas Instruments, his former employer, operated a number of plants in Taiwan
32:08
And so the Taiwanese approached him and said, would you like to build a chip factory in Taiwan
32:12
And he said, yes. And he had an idea, which was to do manufacturing differently than anyone else
32:19
At the time, most chips were manufactured and designed by the same companies
32:23
But Morris Chang realized that manufacturing is getting more and more complex every single year
32:28
That if you specialized on manufacturing, you could manufacture better than your competitors
32:33
And so he established TSMC in Taiwan in 1987 with the aim never of designing chips, only of manufacturing
32:40
His vision was sort of like to do for chips what Gutenberg had done for books
32:45
Gutenberg didn't write any books. He only printed them. Morris Chang didn't want to design any chips
32:49
He only wanted to manufacture them. That's exactly what TSMC has done
32:52
And it's enabled TSMC to win among its customers some of the largest companies in the world
32:58
Apple, NVIDIA, Qualcomm, AMD, they all rely on TSMC to produce its chips, which means
33:03
that TSMC is the largest chip maker in the world by far. And as a result, it's got more scale
33:08
It can drive down its costs and it can hone its technology more than anyone else
33:12
And so TSMC, thanks to this unique business model, is both the largest and the most advanced chipmaker in the world
33:18
Today, China is the world's largest importer of chips. They spend as much money each year importing chips as they spend importing oil
33:25
There's nothing that China is more reliant on the outside world to purchase
33:29
And China imports all of these chips, both for its own use, but also because most of the world's phones and computers and servers are assembled in China
33:39
So there's a flow of chips into China. They're assembled into devices. And many of those devices are re-exported to the U.S. or to Europe or to Japan or to international markets
33:48
And so today, China's primary interface with the chip industry is by buying chips, assembling them, and then shipping them abroad
33:55
But the Chinese government realizes this is not the best place in the industry to be
33:59
They want to do the higher value add parts of the industry, just like Taiwan did, just like Japan did, to move up the value chain
34:05
And so for the past decade, China's been trying to build its own chip industry to manufacture more chips domestically
34:12
And right now, it's having a lot of success when it comes to more low-end chips, the types of commodity chips that are in many different types of devices
34:21
where China is vastly expanding its manufacturing capacity and making real strides towards becoming a lot more self-sufficient
34:27
But at the cutting edge, the types of chips that are inside phones or in AI systems
34:31
China is still meaningfully behind industry leaders like TSMC. Right now, the most advanced Chinese firm, SMIC, is about five years behind TSMC
34:42
which might not sound like a lot, but that's two and a half Moore's laws behind TSMC
34:46
which means that for the most cutting edge applications, you really take a performance hit if you want to use a Chinese manufacturer versus a Taiwanese one
34:54
Until 2020, TSMC's two largest customers were first Apple, the biggest U.S. smartphone maker, and second Huawei, China's largest phone company
35:04
TSMC manufactured chips for both of their phones. But the United States is worried that Huawei is controlled by the Chinese government
35:11
It's worried about the surveillance capabilities that this might enable. And so the U.S. has been trying to limit Huawei's access to advanced technologies
35:18
And since 2020, it's prohibited Huawei from manufacturing advanced chips at TSMC
35:25
And so Huawei has had to turn to domestic suppliers to manufacture many of the chips that it needs
35:30
And this has been a challenge. It's possible to find Chinese domestic suppliers, but they're not as good as TSMC
35:36
The costs are higher. The performance is lower. And it's been a real headwind for Huawei over the past couple of years as they've tried to build their own supply chain to make up for the fact that they've lost access to the cutting edge in Taiwan
35:47
So until recently, India was a very small player in the chip industry. There's a couple of chip companies in India, but they're not at the cutting edge and they're
35:54
not that large. Much of the semiconductor manufacturing, as well as the rest of the supply chain, the
35:59
assembly of phones, for example, or computers takes place in southern India
36:03
Tamil Nadu for example is one of the key hubs for manufacturing And then Bangalore is a major center for chip design inside of India But right now India is the country that changing the most rapidly I think when it
36:17
comes to investment in semiconductors. There's a series of new projects underway in India to put it more on the map of electronics manufacturing
36:26
And I think if you look at India today, you see what China looked like 30 years ago or
36:29
what Taiwan looked like 50 years ago, a country that's on the early stages of a major change
36:34
in the types of manufacturing that happened there. And so I wouldn't be surprised at all if in
36:39
10 or 20 years we looked at India as a really central player in the production of all the
36:44
computing and electronics that we rely on, because they're taking the exact same steps that
36:49
China and Taiwan and Japan before them took when they were becoming major manufacturers
36:54
The irony of the chip industry is that it's simultaneously globalized and yet extraordinarily
36:58
localized for certain types of production. And that's inevitable, I think, because the engineering involved is so complicated
37:06
The dollar values required to spend are so vast that we need specialization
37:10
And specialization implies that we've got to rely on other people to help in the process
37:15
And so I think it's inevitable that US firms will rely on manufacturing in Taiwan and chemicals
37:20
from Japan and the rest of the supply chain for a very long time because no one has the
37:25
the capabilities they need to produce the chips that they require on their own
37:31
What happened during the COVID-19 chip shortages? During the pandemic, the supply and demand dynamics on the chip industry were out of whack
37:41
because a lot of people ordered new computers, for example, to work from home
37:46
And so PC production shot up in ways that weren't expected or people bought fewer cars
37:50
in the early days of the pandemic. And so car production declined and companies couldn't predict what type of chip they would need
37:56
The effect of that was to create shortages of certain types of chips. When demand roared back in the later stages of the pandemic, car companies in particular found they couldn't get the types of chips that they rely on to produce cars
38:08
And that was something they hadn't focused on for a long time. They thought of their supply chain as being about engines and wheels and axles and other parts of the car that you think of when you think of car parts
38:17
But today, contemporary cars require a lot of chips, hundreds or even thousands of chips for the most sophisticated cars
38:25
And the thing about cars, if you're missing just one chip, your car often doesn't work
38:29
And during the pandemic, car companies found themselves often in that situation. Just a single chip, often even the cheapest chips, were causing them to have to leave cars in the factory parking lot as they waited for the right chip to arrive
38:42
And that illustrated a couple of things. First is that complex manufactured devices like cars need a lot of chips
38:48
Second, they don't just need the same type of chip. They need a thousand different types of chips produced by different manufacturers
38:54
And if even one of those is late, the car has to wait until it arrives
38:59
And the third thing it illustrated is that it's not just the tech sector that needs chips. It's actually everything
39:03
It's cars, it's tractors, it's medical devices. All of these face shortages during the pandemic because they couldn't get the types of chips that they needed
39:11
And the really interesting thing about the pandemic that most people don't realize is that we didn't actually produce fewer chips
39:17
We actually produced more chips each year of the pandemic. The problem was that supply couldn't keep up with demand
39:22
And we had demand in segments in the industry that we weren't expecting. That created hundreds of billions of dollars of losses for manufacturers like automakers because they couldn't finish the goods that were sitting in their factory parking lots and therefore couldn't sell them
39:37
And that matters because the shortages we saw in 2021 and 2022 are tiny in comparison to the shortages we would see if something happened to a large scale chip maker like those in Taiwan
39:50
Anything that disrupted chip production in Taiwan would be catastrophic for the world economy, for the United States, for Europe, for Japan, for everyone, because everyone relies on chips made in Taiwan
40:01
Earthquakes are one thing that could cause problems. The reality is that Taiwan's had a lot of earthquakes, so they're pretty well prepared
40:06
and chip facilities, because they have to be extraordinarily safe from vibration
40:12
they're actually among the most earthquake-safe buildings that exist today. So it's not a guarantee, but it means that they've done a lot
40:20
in terms of ensuring themselves from earthquakes. Water is one of the materials that's actually most widely used in chip manufacturing
40:26
for a number of the manufacturing steps. It needs to be ultra-purified water too
40:30
And so chip plants have to draw huge volumes of water from the local water supply
40:35
and then try to recycle that at the end to make sure there aren't any chemicals that are being
40:38
discharged back into the environment. And it's a major challenge for chip makers because the
40:44
volumes that they use are huge. And many of the places where chips are manufactured don't have
40:48
surplus water. So in Taiwan, droughts have been an issue many times in recent years. And it's a
40:54
major limitation on TSMC's ability to expand its manufacturing footprint in Taiwan. The other is
41:00
energy. Electricity is very important for chip making. And as we use more advanced chip making
41:06
tools in factories, they require even more power to operate. And so electricity is a second limiting
41:12
factor as well. And especially as countries try to use more green energy, that creates more
41:18
challenges because you need both more energy, but also you need energy that's perfectly reliable
41:23
And so the sun or wind power can't always be relied on, which means that if you're in Taiwan
41:30
trying to map out your future power supply, you've got a limited number of options to look at
41:35
I think the bigger risk is not seismic, but rather geopolitical. It's that China carries
41:40
through on the threats it regularly makes to use force against Taiwan to take control of the island
41:46
And for a long time, I think people wrote off that risk as unlikely, because for a long time
41:52
China was weak, and the United States was pledging to protect Taiwan. But today
41:56
China is getting stronger every single year. Its military capabilities are growing on a regular basis
42:01
And this has raised questions about whether we need to worry that China might at some point move on Taiwan
42:07
The problem is that even a small move, a small conflict would be disastrous for the chip industry because it not just about the security of the facilities themselves It also about the supply chain Taiwan needs to import energy needs to import chemicals materials tools spare parts many
42:24
of which come from abroad, from Japan, from the United States, from Europe, energy coming
42:29
in from the Middle East. And if any of this is disrupted, chip production could break down
42:34
And if chip production in Taiwan breaks down, that matters for everyone because everyone
42:38
uses Taiwanese-made chips. How would you describe the ubiquity of chips in modern life
42:45
I like to think of cars as a case study in how we rely on chips for almost everything
42:50
If you sit in a new car, it will have on average a thousand chips inside of it
42:54
It's a chip that makes the window move up or down when you press the button. It's a chip that manages the windshield wipers going back and forth
43:01
If you have any sort of autonomous braking features in your car, there's a chip that manages the sensor
43:05
a chip that sends that information to the brakes to step on the brakes if there's an object in front of your vehicle
43:12
If you've got an internal combustion engine, there's a chip that manages fuel injection into your engine to make sure it's operating the right way
43:18
There's, of course, a chip that's attached to your GPS, multiple chips in the display that tells you where to go when you're looking for directions
43:26
I've only mentioned a dozen or so chips, and there are several hundred more that make your car work the way you expect
43:32
And cars are not really unique. Today, everything that we rely on, almost anything with an on-off switch, has at least one and often dozens or hundreds of chips inside
43:41
The other way to think about the ubiquity of chips is just to walk around your apartment or your house and look at the devices
43:47
The dishwasher, the microwave, your coffee maker, your washing machine, any sort of consumer electronic you have, they all require chips
43:56
And it's often not just one chip, it's often a fair number of chips. And the more complex the chip, the harder it is to make, and therefore, generally, the more companies can charge for selling it
44:05
So the chip in your smartphone, for example, that runs the operating system is extraordinarily complex
44:11
Billions of transistors. It has to operate at extraordinary speed, draw on as little power as possible because your battery life is constrained
44:18
And so having perfectly optimized smartphone processors is really important, which is why Apple designs its own smartphone processors in-house
44:26
It doesn't trust anyone else to do it. And so those chips are really expensive compared to many other types of chips that you'd find in a dishwasher or a washing machine, which can cost less than a dollar because they're not required to do anything particularly complex
44:38
And the reality is that as devices get more advanced, as we have more and more things connecting to Wi-Fi and Bluetooth, more sensors, more AI capabilities installed in devices, we're going to be using more and more chips as far as we can see into the future
44:52
Both China and the U.S. see chips as really central to the technology competition between them right now
44:59
China's worried that because it relies on importing chips from Taiwan and from Korea, which are both U.S. allies
45:06
it's going to be cut off in the future from getting the chips that it needs. And right now that's already happening to some degree
45:11
The U.S. is limiting the ability of AI firms like NVIDIA to sell their most cutting-edge chips to China
45:16
because the U.S. wants to keep the most advanced AI capabilities for itself
45:20
And so China's concerns are understandable. The U.S. is worried that if it sells advanced AI chips to China, they're going to be used not for optimizing food delivery apps, but used for military and intelligence use cases
45:32
And the U.S. is not wrong to believe that, because just as companies are trying to figure out how they're going to use AI, it's already the case that militaries and intelligence agencies are deploying AI to optimize their systems, too
45:44
And so both countries recognize that chips will be at the center of the AI race
45:49
And as a result, they're trying to improve their position, become more self-sufficient
45:53
and prevent their technology from benefiting their competitor. As of 2022, the U.S. has made it illegal to transfer the most advanced AI chips made by
46:01
companies like NVIDIA to China. So today, if you're a Chinese firm, you can access a less advanced NVIDIA chip that's
46:09
been specifically downgraded to meet the U.S. restrictions and is now legal to sell to China
46:13
If you're not the cutting edge, you've got to go abroad. And the aim of these regulations is to give U.S. firms an advantage, to make sure that U.S. companies are leaders in AI and that the U.S. gets to write the rules of how AI will play out
46:26
And so Chinese companies in the AI industry face a disadvantage as a result
46:29
They've got worse chips, which means that the cost of training AI systems is higher
46:33
It takes more time. It's more inefficient. And that's the U.S. goal, to kind of throw sand in the gears of China's AI ecosystem and hope that the U.S. can race ahead as a result
46:43
What is the CHIPS Act? And what did it do to boost manufacturing capabilities in the United States
46:52
There were two concerns that prompted the Congress to pass the CHIPS Act. The first was reliance on Taiwan for our most advanced chips
46:59
And the second was a fear that the technological edge that the U.S. has vis-a-vis China was narrowing as China invested more and more
47:07
And so in 2022, Congress put forward around $50 billion to invest in the U.S. chip industry
47:13
Part of that money goes to directly incentivizing companies to build new manufacturing facilities in the United States, which in the past they hadn't been doing much
47:21
They'd been relying on suppliers in Taiwan and Korea instead. And part of the money would go on R&D, building better chips, better chip making equipment, better chemicals used in the chip manufacturing process to help U.S. companies stay ahead of their competitors
47:36
Because the U.S. government believes, and I think they're justified in believing this, that keeping a technological advantage in chips is key for retaining your advantage in a whole set of industries that are downstream of semiconductors
47:48
And as we deploy AI in all sorts of different segments of the economy, you can already see that playing out
47:56
Chapter four, the AI revolution. The biggest change in the past couple of years has been the explosion of investment in AI
48:04
I think the release of ChatGPT in late 2022 encouraged all the big tech firms to spend
48:10
tens of billions of dollars building vast AI infrastructure, which means data centers
48:15
full of the most capable semiconductors. And I think right now we seeing just the early phases of a new wave of investment in an AI industry that is just emerging And if we know one thing it that this industry will require a ton of semiconductors because one of the key trends in the history of AI is that more advanced systems require being
48:36
trained on larger volumes of data. If you want to train a system on more data, you need more computing power, which means
48:41
better chips to train it. And so today, companies like OpenAI or Anthropic are spending millions and millions and soon
48:47
billions of dollars training their AI systems. And most of that budget goes to buying chips, buying ultra-advanced semiconductors from companies like NVIDIA
48:56
So to train a cutting-edge AI system requires tens of thousands of NVIDIA's most cutting-edge chips
49:02
It requires using these chips for days or sometimes months on end
49:06
So you're investing hundreds of millions of dollars, if not billions of dollars, in data center capacity
49:11
and using the data center solely for the purpose of AI training
49:16
And you need the most advanced chips inside because the most advanced chips are twice as good on average than the prior generation due to Moore's law
49:24
And so there's a strong incentive to buy the best chips that NVIDIA has every single year because it actually drives down your training costs, even though the chips themselves are extraordinarily expensive
49:34
One of the key challenges of AI is going to be to drive down the cost of deploying AI systems
49:39
So we know how to train big systems right now. That's what OpenAI and Anthropic and others are doing
49:44
but to make AI really widespread across the economy, we need the cost of using it to be so
49:49
cheap we don't even think about it. It's sort of like Google search today. No one thinks
49:54
what's the price of my Google search? Because it's approximately zero. Google spends a bit of
49:58
money on the data centers, but it's so low you don't have to think about it. Today, AI is actually
50:02
pretty expensive. A single query to chat GPT is an appreciable amount of money, such that sometimes
50:07
OpenAI has to slow the rate at which it rolls out new capabilities because it'd be too expensive
50:12
to actually deploy. There are a lot of companies that are exploring how do you do deployment more
50:18
efficiently. And there are a number of startups that are pioneering new models of chip design
50:23
that are intended to increase the speed and drive down the cost of deploying AI models
50:28
which I think is going to be really important in making AI cheap enough and therefore prolific
50:33
enough to make a major impact on the economy. NVIDIA's chips, which are at the center of the
50:38
AI ecosystem right now are pretty general purpose in their capabilities. They can train many different
50:43
types of models and are useful both for training and also for deployment. But if you design a chip
50:50
for a specific type of model or a specific type of deployment, you can make it perfectly optimized
50:56
for that use case. And so a lot of startups right now are looking at individual workloads or
51:01
individual deployment opportunities and saying, we're going to design a chip that's perfectly
51:05
tweaked for that use case. And if so, it'll run a lot faster and run more efficiently than a sort
51:11
of general purpose chip like an NVIDIA GPU will. Now, this is startups tackling this industry
51:16
but it's also big tech companies, Facebook, Microsoft, Google, they're all designing their
51:21
own in-house chips as well, because they know the specific workloads that are inside their data
51:25
centers. And they've realized if they design chips specifically around those workloads
51:30
they can operate more efficiently in many cases than a general purpose AI chip like NVIDIA's can
51:35
do. On a silicon chip, the transistors flipping on and off are turning on and off electrical
51:40
circuits. And so it's electrons flowing through copper wires that are carved into your silicon
51:45
chip that make all the ones and zeros that chips rely on. And so electricity is at the center of
51:51
how chips work. And one of the things that we've seen over the past several decades is that chips
51:56
get much, much more efficient in terms of how much power they use. But they also get much
52:01
much more capable in terms of computing. And one of the challenges that we face is that we're
52:06
getting better at producing more capable chips at a faster rate than we're getting better at
52:11
producing energy efficiency gains, which means that we're using more power in aggregate every
52:17
single year. When you look at artificial intelligence, which involves some of the
52:21
most power-hungry chips that exist, one of the limiting factors to building vast AI infrastructures
52:26
is going to be the availability of power. Because for big data centers, they require a huge increase in electricity
52:33
relative to smaller data centers that aren't focusing on AI. And there are very smart people in Silicon Valley who think that the biggest limitation to AI
52:41
might actually not be the quality of the chips or the algorithms that are behind AI
52:45
It might be the ability to deliver power to data centers. Because in many cases, this requires bringing new power supplies online
52:52
building new power plants that are capable of delivering electricity to power the chips inside
52:57
of these new data centers. When I look at the surge of investment in AI chips right now, I see
53:03
no reason to doubt that Moore's law won't continue for a very long time. That means more advanced
53:08
chips, which means more computing power that we can apply to all sorts of uses, AI and all sorts
53:14
of devices. And that means we'll be using even more semiconductors because the trend has been
53:19
that as chips get better, they get cheaper and we put them in more and more types of uses. And so
53:25
today, if your car has a thousand chips, I wouldn't be surprised if it has 10x that number in a
53:31
decade. And that basic trend is true of everything we rely on. And that's only made possible because
53:37
chips get better and they provide more computing for a lower price on an annual basis. The biggest
53:42
geopolitical risk by far is that something goes wrong between China and Taiwan and the Taiwan
53:47
Straits because it's not just Taiwan whose fate hangs in the balance. Today, it's our entire
53:52
economy. And if you think of the biggest companies in the United States, Apple, NVIDIA, Microsoft
53:58
Amazon, Google, Facebook, they all rely on chips that today are only made in Taiwan. So it's not
54:05
just a question of geopolitics in East Asia. It's a question of our tech sector. It's a question of
54:11
all the devices we rely on because today, for many of those devices, they rely on chips that
54:16
that in some cases can only be made by one company in a single factory in Taiwan
54:22
And so that illustrates the ways in which chips made in Taiwan are critical for the way we live our lives
#Electronic Components
#Computer Science
#Engineering & Technology


