NVIDIA CEO Jensen Huang AI transcript and summary - episode of podcast Acquired

Go to PodExtra AI's episode page (NVIDIA CEO Jensen Huang) to play and view complete AI-processed content: summary, mindmap, topics, takeaways, transcript, keywords and highlights.

Go to PodExtra AI's podcast page (Acquired) to view the AI-processed content of all episodes of this podcast.

Acquired episodes list: view full AI transcripts and summaries of this podcast on the blog

Episode: NVIDIA CEO Jensen Huang

Author: Ben Gilbert and David Rosenthal
Duration: 01:29:07

Episode Shownotes

We finally sit down with the man himself: Nvidia Cofounder & CEO Jensen Huang. After three parts and seven+ hours of covering the company, we thought we knew everything but — unsurprisingly — Jensen knows more. A couple teasers: we learned that the company’s initial motivation to enter the datacenter

business came from perhaps not where you’d think, and the roots of Nvidia’s platform strategy stretch back beyond CUDA all the way to the origin of the company.We also got a peek into Jensen’s mindset and calculus behind “betting the company” multiple times, and his surprising feelings about whether he’d go on the founder journey again if he could rewind time. We can’t think of any better way to tie a bow on our Nvidia series (for now). Tune in!Sponsors:ServiceNow: https://bit.ly/acqsnaiagentsHuntress: https://bit.ly/acqhuntressVanta: https://bit.ly/acquiredvantaMore Acquired!:Get email updates with hints on next episode and follow-ups from recent episodesJoin the SlackSubscribe to ACQ2Merch Store!‍Note: Acquired hosts and guests may hold assets discussed in this episode. This podcast is not investment advice, and is intended for informational and entertainment purposes only. You should do your own research and make your own independent decisions when considering any financial transactions.

Full Transcript

00:00:00 Speaker_01
I will say, David, I would love to have NVIDIA's full production team every episode. It was nice not having to worry about turning the cameras on and off and making sure that nothing bad happened to myself while we were recording this.

00:00:13 Speaker_03
Yeah, just the gear. I mean, the drives that came out of the camera.

00:00:18 Speaker_01
All right, red cameras for the home studio starting next episode. Yeah, great. All right, let's do it. Welcome to this episode of Acquired, the podcast about great technology companies and the stories and playbooks behind them. I'm Ben Gilbert.

00:00:48 Speaker_03
I'm David Rosenthal.

00:00:49 Speaker_01
And we are your hosts. Listeners, just so we don't bury the lead, this episode was insanely cool for David and I. Yeah.

00:00:58 Speaker_01
After researching NVIDIA for something like 500 hours over the last two years, we flew down to NVIDIA headquarters to sit down with Jensen himself. And Jensen, of course, is the founder and CEO of NVIDIA, the company powering this whole AI explosion.

00:01:13 Speaker_01
At the time of recording, NVIDIA is worth $1.1 trillion and is the sixth most valuable company in the entire world. And right now is a crucible moment for the company. Expectations are set high, I mean sky high.

00:01:29 Speaker_01
They have about the most impressive strategic position and lead against their competitors of any company that we've ever studied. But here's the question that everyone is wondering. Will NVIDIA's insane prosperity continue for years to come?

00:01:44 Speaker_01
Is AI going to be the next trillion-dollar technology wave? How sure are we of that? And if so, can NVIDIA actually maintain their ridiculous dominance as this market comes to take shape?

00:01:56 Speaker_01
So Jensen takes us down memory lane with stories of how they went from graphics to the data center to AI, how they survived multiple near-death experiences.

00:02:05 Speaker_01
He also has plenty of advice for founders, and he shared an emotional side to the founder journey toward the end of the episode.

00:02:12 Speaker_03
Yeah, I got new perspective on the company and on him as a founder and a leader just from doing this despite, you know, we thought we knew everything before we came in advance and it turned out we didn't.

00:02:25 Speaker_01
Turns out the protagonist actually knows more. Yes. All right, well, listeners, join the Slack.

00:02:30 Speaker_01
There is incredible discussion of everything about this company, AI, the whole ecosystem, and a bunch of other episodes that we've done recently going on in there right now. So that is acquired.fm slash Slack. We would love to see you.

00:02:43 Speaker_01
And without further ado, this show is not investment advice. David and I may have investments in the companies we discuss, and this show is for informational and entertainment purposes only. On to Jensen.

00:02:55 Speaker_01
So Jensen, this is acquired, so we want to start with story time. So we want to wind the clock all the way back to, I believe it was 1997.

00:03:03 Speaker_01
You're getting ready to ship the Riva 128, which is one of the largest graphics chips ever created in the history of computing. It is the first fully 3D accelerated graphics pipeline for a computer. And you guys have about six months of cash left.

00:03:23 Speaker_01
And so you decide to do the entire testing in simulation rather than ever receiving a physical prototype. You commission the production run sight unseen with the rest of the company's money. So you're betting it all right here on the Riva 128.

00:03:38 Speaker_01
It comes back and of the 32 DirectX blend modes, it supports eight of them. And you have to convince the market to buy it, and you got to convince developers not to use anything but those eight blend modes. Walk us through what that felt like.

00:03:55 Speaker_01
The other 24 weren't that important.

00:03:58 Speaker_03
Okay, so wait, wait.

00:03:59 Speaker_02
First question.

00:04:01 Speaker_03
Was that the plan all along? When did you realize that it was going to work?

00:04:05 Speaker_02
I realized I didn't learn about it until it was too late. We should have implemented all 32. But we built what we built, and so we had to make the best of it. That was really an extraordinary time. Remember, Revo 120 was NV3.

00:04:19 Speaker_02
NV1 and NV2 were based on forward texture mapping, no triangles but curves, and it tessellated the curves. And because we were rendering higher-level objects, we essentially avoided using Z-buffers.

00:04:34 Speaker_02
And we thought that that was going to be a good rendering approach, and it turns out to have been completely the wrong answer. And so what Revo Run 28 was, was a reset of our company.

00:04:43 Speaker_02
Now remember, at the time that we started the company in 1993, we were the only consumer 3D graphics company ever created. And we were focused on transforming the PC into an accelerated PC because at the time,

00:04:56 Speaker_02
Windows was really a software rendered system. And so anyways, Riva 128 was a reset of our company because by the time that we realized we had gone down the wrong road, Microsoft had already rolled out DirectX.

00:05:10 Speaker_02
It was fundamentally incompatible with NVIDIA's architecture. 30 competitors have already shown up, even though we were the first company at the time that we were founded. So the world was a completely different place.

00:05:22 Speaker_02
The question about what to do as a company strategy, at that point, I would have said that we made a whole bunch of wrong decisions. But on that day that mattered, we made a sequence of extraordinarily good decisions.

00:05:36 Speaker_02
And that time, 1997, was probably NVIDIA's best moment. And the reason for that was our backs were up against the wall. We were running out of time. We were running out of money. for a lot of employees running out of hope.

00:05:49 Speaker_02
And the question is, what do we do? Well, the first thing that we did was we decided that, look, DirectX is now here. We're not going to fight it. Let's go figure out a way to build the best thing in the world for it.

00:05:59 Speaker_02
And Revo 128 is the world's first fully accelerated hardware accelerated pipeline for rendering 3D. And so the transform, the projection, every single element all the way down to the frame buffer was completely hardware accelerated.

00:06:16 Speaker_02
We implemented a texture cache. We took the bus limit, the frame buffer limit, to as big as physics could afford at the time. We made the biggest chip that anybody had ever imagined building. We used the fastest memories.

00:06:31 Speaker_02
Basically, if we built that chip, there could be nothing that could be faster. And we also chose a cost point that is substantially higher than the highest price that we think that any of our competitors would be willing to go.

00:06:47 Speaker_02
If we built it right, we accelerated everything, we implement everything in DirectX that we knew of, and we build it as large as we possibly could, then obviously nobody can build something faster than that.

00:06:59 Speaker_03
Today, in a way, you kind of do that here at NVIDIA, too. You were a consumer products company back then, right? It was end consumers who were going to have to pay the money to buy that.

00:07:08 Speaker_02
That's right. But we observed that there was a segment of the market where people were, because at the time, the PC industry was still coming up, and it wasn't good enough. Everybody was clamoring for the next fastest thing.

00:07:20 Speaker_02
And so if your performance was 10 times higher this year than what was available, there's a whole large market of enthusiasts who we believe would have gone after it.

00:07:30 Speaker_02
And we were absolutely right that the PC industry had a substantially large enthusiast market that would buy the best of everything. To this day, it kind of remains true.

00:07:42 Speaker_02
And for certain segments of the market where the technology is never good enough, like 3D graphics, when we chose the right technology, 3D graphics is never good enough.

00:07:49 Speaker_02
And we call it back then, 3D gives us sustainable technology opportunity because it's never good enough. And so your technology can keep getting better. We chose that. We also made the decision to use this technology called emulation.

00:08:02 Speaker_02
There was a company called Icos. And on the day that I called them, they were just shutting the company down because they had no customers. And I said, hey, look, I'll buy what you have inventory. And, you know, no promises are necessary.

00:08:17 Speaker_02
And the reason why we needed that emulator is because if you figure out how much money that we have, if we taped out a chip and we got it back from the fab and we started working on our software,

00:08:30 Speaker_02
By the time that we found all the bugs, because we did the software, then we taped out the chip again, well, we would have been out of business already. And your competitors would have caught up.

00:08:40 Speaker_02
Well, not to mention we would have been out of business.

00:08:43 Speaker_03
Who cares?

00:08:44 Speaker_04
Exactly.

00:08:45 Speaker_02
So, if you're going to be out of business anyways, that plan obviously wasn't the plan.

00:08:50 Speaker_02
The plan that companies normally go through, which is build a chip, write the software, fix the bugs, tape out the new chip, so on and so forth, that method wasn't going to work.

00:09:01 Speaker_02
And so the question is, if we only had six months and you get to tape out just one time, then obviously you're going to tape out a perfect chip.

00:09:09 Speaker_02
So I remember having a conversation with our leaders and they said, but Jen said, how do you know it's going to be perfect? I said, I know it's going to be perfect because if it's not, we'll be out of business. And so let's make it perfect.

00:09:20 Speaker_02
We get one shot. We essentially virtually prototyped the chip by buying this emulator. And Dwight and the software team wrote our software, the entire stack, and ran it on this emulator and just sat in the lab waiting for Windows to paint.

00:09:36 Speaker_02
It was like 60 seconds per frame or something like that. Oh, easily. I actually think that was an hour per frame, something like that. And so we would just sit there and watch it paint.

00:09:45 Speaker_02
And so on the day that we decided to tape out, I assumed that the chip was perfect. And everything that we could have tested, we tested in advance and told everybody, this is it, we're going to tape out the chip, it's going to be perfect.

00:09:57 Speaker_02
Well, if you're going to tape out a chip and you know it's perfect, then what else would you do? That's actually the good question.

00:10:03 Speaker_02
If you knew that you hit enter, you taped out a chip and you knew it was going to be perfect, then what else would you do? Well, the answer, obviously, go to production. And marketing blitz.

00:10:12 Speaker_01
Yeah, yeah. And developer relations.

00:10:13 Speaker_02
Just kick everything off. Kick everything off. Because you got a perfect chip. And so we got it in our head that we have a perfect chip.

00:10:20 Speaker_03
How much of this was you and how much of this was like your co-founders, the rest of the company, the board? Was everybody telling you you were crazy?

00:10:26 Speaker_02
No, everybody was clear we had no shot. Not doing it would be crazy. Because otherwise, you're going to be out of business anyways. So anything aside from that is crazy. So it seemed like a fairly logical thing.

00:10:41 Speaker_02
And quite frankly, right now, as I'm describing it, you're probably thinking, yeah, it's pretty sensible.

00:10:46 Speaker_03
Well, it worked.

00:10:47 Speaker_02
Yeah. And so we take that out and went directly to production.

00:10:50 Speaker_01
So is the lesson for founders out there, when you have conviction on something like the Revo 128 or CUDA, go bet the company on it. And this keeps working for you.

00:11:02 Speaker_01
So it seems like your lesson learned from this is, yes, keep pushing all the chips in because so far it's worked every time.

00:11:09 Speaker_02
No. How do you think about that? No, no. When you push your chips in, I know it's going to work. Notice, we assume that we taped out a perfect chip. The reason why we taped out a perfect chip is because we emulated the whole chip before we taped it out.

00:11:25 Speaker_02
We developed the entire software stack. We ran QA on all the drivers and all the software. We ran all the games we had. We ran every VGA application we had.

00:11:34 Speaker_02
And so when you push your chips in, what you're really doing is when you bet the farm, you're saying, I'm going to take everything in the future, all the risky things, and I'm going to pull it in advance. And that is probably the lesson.

00:11:45 Speaker_02
And to this day, everything that we can prefetch, everything in the future that we can simulate today, we prefetch it.

00:11:54 Speaker_03
We talk about this a lot. We were just talking about this on our Costco episode. You want to push your chips in when you know it's going to work.

00:12:01 Speaker_01
So every time we see you make a bet the company move, you've already simulated it, you know. Yeah, yeah, yeah. Do you feel like that was the case with CUDA?

00:12:09 Speaker_02
Yeah. In fact, before there was CUDA, there was CG. And so we were already playing with the concept of how do we create an abstraction layer above our chip that is expressible in a higher level language and higher level expression.

00:12:26 Speaker_02
And how can we use our GPU for things like CT reconstruction, image processing, we were already down that path.

00:12:33 Speaker_02
And so there were some positive feedback and some intuitive positive feedback that we think that general purpose computing could be possible.

00:12:42 Speaker_02
If you just looked at the pipeline of a programmable shader, it is a processor and is highly parallel and it is massively threaded and it is the only processor in the world that does that.

00:12:52 Speaker_02
And so there were a lot of characteristics about programmable shading that would suggest that CUDA has a great opportunity to succeed.

00:12:59 Speaker_01
And that is true if there was a large market of machine learning practitioners who would eventually show up and want to do all this great scientific computing and accelerated computing.

00:13:11 Speaker_01
But at the time when you were starting to invest what is now something like 10,000 person years in building that platform, did you ever feel like, oh man, we might have invested ahead of the demand for machine learning since we're like a decade before the whole world is realizing it?

00:13:29 Speaker_02
I guess yes and no.

00:13:30 Speaker_02
You know, when we saw deep learning, when we saw AlexNet and realized its incredible effectiveness in computer vision, we had the good sense, if you will, to go back to first principles and ask, you know, what is it about this thing that made it so successful?

00:13:48 Speaker_02
When a new software technology, a new algorithm comes along and somehow leapfrogs 30 years of computer vision work, you have to take a step back and ask yourself, but why? And fundamentally, is it scalable?

00:14:01 Speaker_02
And if it's scalable, what other problems can it solve? And there were several observations that we made. The first observation, of course, is that if you have a whole lot of example data, you could teach this function to make predictions.

00:14:15 Speaker_02
Well, what we've basically done is discovered a universal function approximator, because the dimensionality could be as high as you want it to be.

00:14:22 Speaker_02
And because each layer is trained one layer at a time, there's no reason why you can't make very, very deep neural networks. Okay, so now you just reasoned your way through, right? Okay, so now I go back to 12 years ago.

00:14:36 Speaker_02
You can just imagine the reasoning I'm going through in my head, that we've discovered a universal function approximator. In fact, we might have discovered, with a couple more technologies, a universal computer.

00:14:46 Speaker_03
Are you paying attention to the ImageNet competition every year leading up to this?

00:14:50 Speaker_02
Yeah. And the reason for that is because we were already working on computer vision at the time, and we were trying to get CUDA to be a good computer vision system.

00:14:57 Speaker_02
Or most of the algorithms that were created for computer vision aren't a good fit for CUDA. And so we were sitting there trying to figure it out. All of a sudden AlexNet shows up. And so that was incredibly intriguing.

00:15:08 Speaker_02
It's so effective that it makes you take a step back and ask yourself, why is that happening?

00:15:13 Speaker_02
So by the time that you reason your way through this, you go, well, what are the kind of problems in a world where a universal function approximator can solve, right? Well, we know that most of our algorithms start from principled sciences.

00:15:29 Speaker_02
You want to understand the causality, and from the causality, you create a simulation algorithm that allows us to scale. Well, for a lot of problems, we kind of don't care about the causality. We just care about the predictability of it.

00:15:42 Speaker_02
Like, do I really care for what reason you prefer this toothpaste over that? I don't really care the causality. I just want to know that this is the one you would have predicted.

00:15:53 Speaker_02
Do I really care that the fundamental cause of somebody who buys a hot dog buys ketchup and mustard? It doesn't really matter. It only matters that I can predict it. It applies to predicting movies, predicting music.

00:16:07 Speaker_02
It applies to predicting, quite frankly, weather. We understand thermodynamics. We understand radiation from the sun. We understand cloud effects. We understand oceanic effects. We understand all these different things.

00:16:20 Speaker_02
We just want to know whether we should wear a sweater or not. Isn't that right? And so causality for a lot of problems in the world doesn't matter. We just want to emulate the system and predict the outcome.

00:16:30 Speaker_01
It can be an incredibly lucrative market. If you can predict what the next best performing feed item to serve into a social media feed, turns out that's a hugely valuable market.

00:16:40 Speaker_03
This is where I was going to go with that. I love the examples you pulled. Toothpaste, ketchup, music, movies.

00:16:45 Speaker_02
When you realize this, you realize, hang on a second, a universal functional approximator, a machine learning system, something that learns from examples, could have tremendous opportunities because just the number of applications is quite enormous.

00:17:00 Speaker_02
And everything from, obviously, we're just talking about commerce all the way to science. And so you realize that maybe this could affect a very large part of the world's industries.

00:17:11 Speaker_02
Almost every piece of software in the world would eventually be programmed this way. And if that's the case, then how you build a computer and how you build a chip, in fact, can be completely changed.

00:17:21 Speaker_02
And realizing that, the rest of it just comes with, you know, do you have the courage to put your chips behind it?

00:17:27 Speaker_03
So that's where we are today. And that's where NVIDIA is today. But I'm curious in that, you know, there's a couple of years after AlexNet. And this is when Ben and I were getting into the technology industry and the venture industry ourselves.

00:17:40 Speaker_01
I started at Microsoft in 2012. So right after AlexNet, but before anyone was talking about machine learning and even the mainstream engineering community.

00:17:49 Speaker_03
There were those couple of years there where to a lot of the rest of the world, these looked like science projects. Yeah.

00:17:58 Speaker_03
The technology companies here in Silicon Valley, particularly the social media companies, they were just realizing huge economic value out of this. The Googles, the Facebooks, the Netflixes, et cetera.

00:18:10 Speaker_03
And obviously that led to lots of things, including open AI a couple of years later. But during those couple of years, when you saw just that huge economic value unlock here in Silicon Valley, how were you feeling during those times?

00:18:22 Speaker_02
The first thought was, of course, reasoning about how we should change our computing stack. The second thought is where can we find earliest possibilities of use? If we were to go build this computer, what would people use it to do?

00:18:37 Speaker_02
And we were fortunate that working with the world's universities and researchers was innate in our company because we were already working on CUDA and CUDA's early adopters were researchers because we democratized supercomputing.

00:18:51 Speaker_02
CUDA is not just used, as you know, for AI. CUDA is used for almost all fields of science. Everything from molecular dynamics to imaging, CT reconstruction, to seismic processing, to weather simulations, quantum chemistry, the list goes on, right?

00:19:08 Speaker_02
And so the number of applications of CUDA in research was very high. And so when the time came and we realized that deep learning could be really interesting, it was natural for us to go back to the researchers.

00:19:19 Speaker_02
and find every single AI researcher on the planet and say, how can we help you advance your work? And that included Yann LeCun, and Andrew Ng, and Geoff Hinton. And that's how I met all these people.

00:19:31 Speaker_02
And I used to go to all the AI conferences, and that's where I met Ilya Suskov there for the first time.

00:19:39 Speaker_02
And so it was really about, at that point, what are the systems that we can build and the software stacks we can build to help you be more successful to advance the research? Because at the time, it looked like a toy.

00:19:49 Speaker_02
But we had confidence that even GAN, the first time I met Goodfellow, the GAN was like 32 by 32. And it was just a blurry image of a cat, you know? But how far can it go? And so we believed in it.

00:20:04 Speaker_02
We believed that one, you could scale deep learning because obviously it's trained layer by layer and you could make the data sets larger and you could make the models larger.

00:20:13 Speaker_02
And we believe that if you made that larger and larger, it would get better and better. Kind of sensible. I think the discussions and the engagements with the researchers was the exact positive feedback system that we needed.

00:20:26 Speaker_02
I would go back to research. That's where it all happened.

00:20:30 Speaker_03
When OpenAI was founded in 2015, that was such an important moment. That's obvious today now, but at the time, I think most people, even people in tech, were like, What is this? Were you involved in it at all?

00:20:46 Speaker_03
Because you were so connected to the researchers, to Ilya, taking that talent out of Google and Facebook, to be blunt, but reseeding the research community and opening it up was such an important moment. Were you involved in it at all?

00:21:00 Speaker_02
I wasn't involved in the founding of it, but I knew a lot of the people there, and Elon, of course, I knew, and Peter Beal was there, and Ilya was there, and we have some great employees today that were there in the beginning.

00:21:15 Speaker_02
I knew that they needed this amazing computer that we were building, and we were building the first version of the DGX, which today, when you see a hopper, it's 70 pounds, 35,000 parts, 10,000 amps.

00:21:27 Speaker_02
But DGX, the first version that we built, was used internally, and I delivered the first one to OpenAI, and that was a fun day. Most of our success was aligned around, in the beginning, just about helping the researchers get to the next level.

00:21:45 Speaker_02
I knew it wasn't very useful in its current state, but I also believed that in a few clicks, it could be really remarkable.

00:21:53 Speaker_02
And that belief system came from the interactions with all these amazing researchers, and it came from just seeing the incremental progress.

00:22:01 Speaker_02
At first, the papers were coming out every three months, and then papers today are coming out every day, right?

00:22:06 Speaker_02
So you could just monitor the archive papers, and I took an interest in learning about the progress of deep learning, and to the best of my ability, read these papers.

00:22:16 Speaker_02
And you could just see the progress happening in real time, exponentially real time.

00:22:21 Speaker_01
It even seems like within the industry, from some researchers we spoke with, it seemed like no one predicted how useful language models would become when you just increase the size of the models.

00:22:35 Speaker_01
They thought, oh, there has to be some algorithmic change that needs to happen.

00:22:38 Speaker_01
But once you cross that 10 billion parameter mark, and certainly once you cross the 100 billion, they just magically got much more accurate, much more useful, much more lifelike,

00:22:47 Speaker_01
Were you shocked by that the first time you saw a truly large language model? And do you remember that feeling?

00:22:54 Speaker_02
Well, my first feeling about the language model was how clever it was to just mask out words and make it predict the next word. It's self-supervised learning at its best. We have all this text, you know, I know what the answer is.

00:23:08 Speaker_02
I'll just make you guess it. And so my first impression of BERT was really how clever it was. And now the question is, how can you scale that?

00:23:16 Speaker_02
the first observation on almost everything is interesting, and then try to understand intuitively why it works. And then the next step, of course, is from first principles, how would you extrapolate that?

00:23:26 Speaker_02
And so obviously, we knew that BERT was going to be a lot larger. Now, one of the things about these language models is it's encoding information, isn't that right? It's compressing information.

00:23:35 Speaker_02
And so within the world's languages and text, there's a fair amount of reasoning that's encoded in it. We describe a lot of reasoning things. And so if you were

00:23:45 Speaker_02
to say that few-step reasoning is somehow learnable from just reading things, I wouldn't be surprised. You know, for a lot of us, we get our common sense and we get our reasoning ability by reading.

00:23:58 Speaker_02
And so why wouldn't a machine learning model also learn some of the reasoning capabilities from that, and from reasoning capabilities you could have emergent capabilities, right?

00:24:08 Speaker_02
Emergent abilities are consistent with intuitively from reasoning, and so some of it could be predictable, but still, it's still amazing. The fact that it's sensible doesn't make it any less amazing.

00:24:23 Speaker_02
I could visualize literally the entire computer and all the modules in a self-driving car. And the fact that it's still keeping lanes makes me insanely happy.

00:24:35 Speaker_01
I even remember that from my first operating systems class in college when I finally figured out all the way from programming language to the electrical engineering classes bridged in the middle by that OS class.

00:24:44 Speaker_01
I'm like, oh, I think I understand how the von Neumann computer works soup to nuts. And it's still a miracle. Yeah. Yeah.

00:24:51 Speaker_02
Yeah. Exactly. Yeah. Yeah. When you put it all together, it's still a miracle. Yeah.

00:24:56 Speaker_01
Okay listeners, now is a great time to tell you about longtime friend of the show, ServiceNow.

00:25:02 Speaker_03
Yes, as you know, ServiceNow is the AI platform for business transformation. And they have some new news to share. ServiceNow is introducing AI agents. So only the ServiceNow platform puts AI agents to work across every corner of your business.

00:25:18 Speaker_01
Yep. And as you know from listening to us all year, ServiceNow is pretty remarkable about embracing the latest AI developments and building them into products for their customers. AI agents are the next phase of this.

00:25:30 Speaker_03
So what are AI agents? AI agents can think, learn, solve problems, and make decisions autonomously. They work on behalf of your teams, elevating their productivity and potential.

00:25:42 Speaker_03
And while you get incredible productivity enhancements, you also get to stay in full control.

00:25:47 Speaker_01
Yep. With ServiceNow, AI agents proactively solve challenges from IT to HR, customer service, software development, you name it.

00:25:55 Speaker_01
These agents collaborate, they learn from each other, and they continuously improve, handling the busy work across your business so that your teams can actually focus on what truly matters.

00:26:05 Speaker_03
Ultimately, ServiceNow and agentic AI is the way to deploy AI across every corner of your enterprise. They boost productivity for employees, enrich customer experiences, and make work better for everyone.

00:26:17 Speaker_01
Yep. So learn how you can put AI agents to work for your people by clicking the link in the show notes or going to servicenow.com slash ai-agents. We have some questions we want to ask you.

00:26:31 Speaker_01
Some are cultural about NVIDIA, but others are generalizable to company building broadly.

00:26:37 Speaker_01
And the first one that we wanted to ask is, we've heard that you have 40 plus direct reports, and that this org chart works a lot differently than a traditional company org chart.

00:26:49 Speaker_01
Do you think there's something special about NVIDIA that makes you able to have so many direct reports, not worry about coddling or focusing on career growth of your executives?

00:27:01 Speaker_01
And you're like, no, you're just here to do your fricking best work and the most important thing in the world, now go. A, is that correct? And B, is there something special about NVIDIA that enables that?

00:27:12 Speaker_02
I don't think it's something special with NVIDIA. I think that we had the courage to build a system like this. NVIDIA's not built like a military. It's not built like the armed forces, where you have generals and colonels. We're not set up like that.

00:27:27 Speaker_02
We're not set up in a command and control and information distribution system from the top down. were really built much more like a computing stack.

00:27:38 Speaker_02
And a computing stack, the lowest layer is our architecture, and then there's our chip, and then there's our software, and on top of it, there are all these different modules, and each one of these layers and modules are people.

00:27:51 Speaker_02
And so the architecture of the company, to me, is a computer with a computing stack with people managing different parts of the system. and who reports to whom, your title is not related to anywhere you are in the stack.

00:28:08 Speaker_02
It just happens to be who's the best at running that module on that function, on that layer, it is in charge, and that person is the pilot in command. So that's one characteristic.

00:28:19 Speaker_03
Have you always thought about the company this way? Even from the earliest days?

00:28:22 Speaker_02
Yes, pretty much. Yeah. And the reason for that is because your organization should be the architecture of the machinery of building the product. Right? That's what a company is.

00:28:34 Speaker_02
And yet, everybody's company look exactly the same, but they all do different things. How does that make any sense? Do you see what I'm saying? Yeah.

00:28:42 Speaker_02
You know, how you make fried chicken versus how you fill burgers versus how you make, you know, Chinese fried rice, it's different. And so why would the machinery, why would the process be exactly the same?

00:28:51 Speaker_02
And so it's not sensible to me that if you look at the org charts of most companies, it all kind of looks like this.

00:28:57 Speaker_02
And then you have one group that's for a business and you have another for another business, you have another for another business, and they're all kind of supposedly autonomous. And so none of that stuff makes any sense to me.

00:29:07 Speaker_02
It just depends on what is it that we're trying to build and what is the architecture of the company that best suits to go build it. So that's number one.

00:29:15 Speaker_02
In terms of information system and how do you enable collaboration, we kind of wire it up like a neural network. And the way that we say is that there's a phrase in the company called mission is the boss.

00:29:26 Speaker_02
And so we figure out what is the mission, and we go wire up the best skills and the best teams and the best resources to achieve that mission.

00:29:35 Speaker_02
And it cuts across the entire organization in a way that doesn't make any sense, but it looks a little bit like a neural network.

00:29:42 Speaker_03
And when you say mission, do you mean mission like NVIDIA's mission is-. Yeah. Okay. So it's not like further accelerated computing. It's like we're shipping DGX Cloud.

00:29:53 Speaker_02
Build Hopper or somebody else's build a system for Hopper. Somebody is build CUDA for Hopper. Somebody's job is build CUDNN for CUDA for Hopper. Somebody's job is the mission, right? So your mission is to do something.

00:30:07 Speaker_01
What are the trade-offs associated with that versus the traditional structure?

00:30:11 Speaker_02
The downside is the pressure on the leaders is fairly high. And the reason for that is because in a command and control system, the person who you report to has more power than you.

00:30:23 Speaker_02
And the reason why they have more power than you is because they're closer to the source of information than you are. In our company, the information is disseminated fairly quickly to a lot of different people, and it's usually at a team level.

00:30:37 Speaker_02
So for example, just now I was in our robotics meeting.

00:30:40 Speaker_02
And we're talking about certain things and we're making some decisions, and there are new college grads in the room, there's three vice presidents in the room, there's two e-staffs in the room, and at the moment that we decided together, we reasoned through some stuff, we made a decision, everybody heard it at exactly the same time.

00:30:55 Speaker_02
So nobody has more power than anybody else. Does that make sense? The new college grad learned at exactly the same time as the e-staff.

00:31:03 Speaker_02
And so the executive staff and the leaders that work for me and myself, you earn the right to have your job based on your ability to reason through problems and helping other people succeed.

00:31:16 Speaker_02
And it's not because you have some privileged information that I knew the answer was 3.7 and only I knew, you know, everybody knew.

00:31:23 Speaker_03
When we did our most recent episode in video part three that we just released,

00:31:28 Speaker_03
We sort of did this thought exercise, especially over the last couple of years, your product shipping cycle has been very impressive, especially given the level of technology that you are working with and the difficulty of this all.

00:31:42 Speaker_03
We sort of said, like, could you imagine Apple shipping two iPhones a year?

00:31:48 Speaker_01
And we said that for illustrative purposes.

00:31:50 Speaker_03
For illustrative purposes, not to pick on Apple or whatnot.

00:31:52 Speaker_01
A large tech company shipping two flagship products or their flagship product twice per year.

00:31:56 Speaker_03
Yeah, or two WWDCs a year.

00:31:58 Speaker_01
Yeah. There seems to be something unique.

00:32:00 Speaker_03
You can't really imagine that whereas that happens here. Are there other companies, either current or historically, that you look up to, admire, maybe took some of this inspiration from?

00:32:15 Speaker_02
In the last 30 years, I've read my fair share of business books. And as in everything you read, you're supposed to first of all enjoy it, right? Enjoy it, be inspired by it. but not to adopt it. That's not the whole point of these books.

00:32:31 Speaker_02
The whole point of these books is to share their experiences. You're supposed to ask, what does it mean to me in my world? What does it mean to me in the context of what I'm going through? What does this mean to me in the environment that I'm in?

00:32:44 Speaker_02
What does this mean to me in what I'm trying to achieve? What does this mean to NVIDIA in the age of our company and the capability of our company? You're supposed to ask yourself, what does it mean to you?

00:32:54 Speaker_02
And then from that point, being informed by all these different things that we're learning, we're supposed to come up with our own strategies. What I just described is kind of how I go about everything.

00:33:04 Speaker_02
You're supposed to be inspired and learn from everybody else. And the education's free. When somebody talks about a new product, you're supposed to go listen to it. You're not supposed to ignore it. You're supposed to go learn from it.

00:33:15 Speaker_02
And it could be a competitor, it could be adjacent industry, it could be nothing to do with us. The more we learn from what's happening out in the world, the better.

00:33:25 Speaker_02
But you're supposed to come back and ask yourself, you know, what does this mean to us?

00:33:29 Speaker_03
Yeah, you don't just want to imitate them.

00:33:30 Speaker_02
That's right. Yeah.

00:33:32 Speaker_03
I love this tee up of learning but not imitating and learning from a wide array of sources. There's this sort of, unbelievable third element, I think, to what NVIDIA has become today, and that's the data center. It's certainly not obvious.

00:33:50 Speaker_03
I can't reason from AlexNet and your engagement with the research community and social media feed recommenders to you deciding and the company deciding we're going to go on a five-year all-in journey on the data center. How did that happen?

00:34:07 Speaker_02
Our journey to the data center happened, I would say, almost 17 years ago. I'm always being asked, I mean, what are the challenges that the company could see someday?

00:34:16 Speaker_02
And I've always felt that the fact that NVIDIA's technology is plugged into a computer, and that computer has to sit next to you because it has to be connected to a monitor, that will limit our opportunity someday.

00:34:33 Speaker_02
because there are only so many desktop PCs that plug a GPU into. And there's only so many CRTs and the time LCDs that we could possibly drive.

00:34:44 Speaker_02
So the question is, wouldn't it be amazing if our computer doesn't have to be connected to the viewing device, that the separation of it made it possible for us to compute somewhere else?

00:34:57 Speaker_02
And one of our engineers came and showed it to me one day, and it was really capturing the frame buffer, encoding it into video, and streaming it to a receiver device, separating computing from the viewing.

00:35:11 Speaker_01
In many ways, that's cloud gaming.

00:35:15 Speaker_02
In fact, that was when we started GFN. We knew that GFN was going to be a journey that would take a long time because you're fighting all kinds of problems, including the speed of light. Latency everywhere you look. That's right.

00:35:30 Speaker_03
GFN, GeForce Now. GeForce Now.

00:35:31 Speaker_02
Yeah, GeForce Now. And we've been working on GeForce Now.

00:35:34 Speaker_03
That's your first cloud product.

00:35:35 Speaker_02
That's right. And look at GeForce Now was NVIDIA's first data center product.

00:35:41 Speaker_02
And our second data center product was remote graphics, putting our GPUs in the world's enterprise data centers, which then led us to our third product, which combined CUDA plus our GPU, which became a supercomputer, which then worked towards more and more and more.

00:35:57 Speaker_02
And the reason why it's so important is because the disconnection between where NVIDIA's computing is done versus where it's enjoyed, if you can separate that, your market opportunity explodes. And it was completely true.

00:36:11 Speaker_02
And so we're no longer limited by the physical constraints of the desktop PC sitting by your desk. And we're not limited by one GPU per person. And so it doesn't matter where it is anymore. And so that was really the great observation.

00:36:26 Speaker_01
It's a good reminder. The data center segment of NVIDIA's business to me has become synonymous with How's AI going? And that's a false equivalence.

00:36:36 Speaker_01
And it's interesting that you were only this ready to sort of explode in AI and the data center because you had three plus previous products where you learned how to build data center computers.

00:36:48 Speaker_01
Even though those markets weren't these like gigantic world-changing technology shifts the way that AI is, that's how you learned.

00:36:56 Speaker_02
Yeah, that's right. You want to pave the way to future opportunities. You can't wait until the opportunity is sitting in front of you for you to reach out for it.

00:37:06 Speaker_02
And so you have to anticipate, you know, our job as CEOs to look around corners and anticipate where will opportunities be someday? And even if I'm not exactly sure what and when, how do I position the company to be near it?

00:37:20 Speaker_02
to be just standing kind of near under the tree. And we can do a diving catch when the apple falls, you guys know what I'm saying? But you've got to be close enough to do the diving catch.

00:37:30 Speaker_03
Rewind to 2015 and open AI. If you hadn't been laying this groundwork in the data center, you wouldn't be powering open AI right now.

00:37:40 Speaker_02
But the idea that computing will be mostly done away from the viewing device. that the vast majority of computing would be done away from the computer itself. That insight was good.

00:37:53 Speaker_02
In fact, cloud computing, everything about today's computing is about separation of that. And by putting it in a data center, we can overcome this latency problem, meaning you're not going to overcome speed of light.

00:38:04 Speaker_02
Speed of light end-to-end is only 120 milliseconds or something like that. It's not that long.

00:38:08 Speaker_01
From a data center to a- Anywhere on the planet.

00:38:10 Speaker_02
Yeah. Oh, I see.

00:38:12 Speaker_01
And literally across the planet.

00:38:13 Speaker_02
Yeah, right. So if you could solve that problem, approximately something like that, I forget the number, but it's 70 milliseconds, 100 milliseconds, but it's not that long. And so my point is, if you could remove the obstacles everywhere else,

00:38:27 Speaker_02
then speed of light should be perfectly fine. And you could build data centers as large as you like, and you can do amazing things.

00:38:34 Speaker_02
And this little tiny device that we use as a computer, or your TV as a computer, whatever computer, they can all instantly become amazing. And so that insight 15 years ago was a good one.

00:38:47 Speaker_01
So speaking of the speed of light, InfiniBand. Yeah. David's begging me to go here. I can feel it. I was at the same time. You totally saw that InfiniBand would be way more useful way sooner than anyone else realized.

00:39:00 Speaker_01
Acquiring Mellanox, I think you uniquely saw that this was required to train large language models and you were super aggressive in acquiring that company. Why did you see that when no one else saw that?

00:39:15 Speaker_02
Well, there are several reasons for that. First, if you want to be a data center company, building the processing chip isn't the way to do it. A data center is distinguished from a desktop computer versus a cell phone, not by the processor in it.

00:39:30 Speaker_02
A desktop computer in a data center uses the same CPUs, uses the same GPUs apparently, right? Very close.

00:39:36 Speaker_02
And so it's not the chip, it's not the processing chip that describes it, but it's the networking of it, it's the infrastructure of it, it's how the computing is distributed.

00:39:46 Speaker_02
how security is provided, how networking is done, you know, so on and so forth. And so those characteristics are associated with Mellanox, not NVIDIA.

00:39:57 Speaker_02
And so the day that I concluded that really NVIDIA wants to build computers of the future, and computers of the future are going to be data centers, embodied in data centers,

00:40:07 Speaker_02
and we want to be data center oriented company, then we really need to get into networking. And so that was one.

00:40:12 Speaker_02
The second thing is observation that whereas cloud computing started in the hyperscale, which is about taking commodity components, a lot of users and virtualizing many users on top of one computer.

00:40:27 Speaker_02
AI is really about distributed computing where one job, one training job is orchestrated across millions of processors. And so it's the inverse of hyperscale almost.

00:40:39 Speaker_02
And the way that you design a hyperscale computer with off-the-shelf commodity Ethernet, which is just fine for Hadoop, it's just fine for search queries, it's just fine for all of those things.

00:40:49 Speaker_02
But not when you're sharding a model across multiple networks. Not when you're sharding a model across, right. And so that observation says that the type of networking you want to do is not exactly Ethernet.

00:41:00 Speaker_02
And the way that we do networking for supercomputing is really quite ideal.

00:41:04 Speaker_02
And so the combination of those two ideas convinced me that Mellanox is absolutely the right company, because they're the world's leading high-performance networking company, and we worked with them in so many different areas in high-performance computing already.

00:41:20 Speaker_02
Plus, I really like the people. The Israel team is world-class. We have some 3,200 people there now, and it was one of the best strategic decisions I ever made.

00:41:31 Speaker_03
When we were researching, particularly part three of our NVIDIA series, we talked to a lot of people, and many people told us the Mellanox acquisition is one of, if not the best of all time by any technology company.

00:41:44 Speaker_02
I think so too, yeah. And it's so disconnected from the work that we normally do, it was surprising to everybody.

00:41:50 Speaker_01
But framed this way, you were standing near where the action was so you could figure out as soon as that Apple sort of becomes available to purchase, like, oh, LLMs are about to blow up. I'm going to need that. Everyone's going to need that.

00:42:03 Speaker_01
I think I know that before anyone else does.

00:42:05 Speaker_02
Yeah. You want to position yourself near opportunities. You don't have to be that perfect, you know. You want to position yourself near the tree.

00:42:15 Speaker_02
And even if you don't catch the apple before it hits the ground, so long as you're the first one to pick it up. You want to position yourself close to the opportunity. And so that's kind of a lot of my work.

00:42:31 Speaker_02
is positioning the company near opportunities and having the company having the skills to monetize each one of the steps along the way so that we can be sustainable.

00:42:45 Speaker_01
What you just said reminds me of a great aphorism from Buffett and Munger, which is, it's better to be approximately right than exactly wrong.

00:42:52 Speaker_02
Yeah, there you go. Yeah, that's a good one.

00:42:54 Speaker_01
That's a good one, yeah.

00:42:57 Speaker_03
All right, listeners, our next sponsor is a new friend of the show, Huntress. Huntress is one of the fastest growing and most loved cybersecurity companies today.

00:43:07 Speaker_03
It's purpose-built for small to mid-sized businesses and provides enterprise-grade security with the technology, services, and expertise needed to protect you.

00:43:16 Speaker_01
They offer a revolutionary approach to managed cybersecurity that isn't only about tech, it's about real people providing real defense around the clock.

00:43:26 Speaker_03
So how does it work? Well, you probably already know this, but it has become pretty trivial for an entry-level hacker to buy access and data about compromised businesses.

00:43:36 Speaker_03
This means cybercriminal activity towards small and medium businesses is at an all-time high.

00:43:41 Speaker_01
So Huntress created a full managed security platform for their customers to guard from these threats.

00:43:48 Speaker_01
This includes endpoint detection and response, identity threat detection response, security awareness training, and a revolutionary security information and event management product that actually just got launched.

00:44:00 Speaker_01
Essentially, it is the full suite of great software that you need to secure your business

00:44:05 Speaker_01
plus 24-7 monitoring by an elite team of human threat hunters in a security operations center to stop attacks that really software-only solutions could sometimes miss.

00:44:16 Speaker_01
Huntress is democratizing security, particularly cybersecurity, by taking security techniques that were historically only available to large enterprises and bringing them to businesses with as few as 10, 100, or 1,000 employees at price points that make sense for them.

00:44:32 Speaker_03
In fact, it's pretty wild. There are over 125,000 businesses now using Huntress, and they rave about it from the hilltops.

00:44:41 Speaker_03
They were voted by customers in the G2 rankings as the industry leader in endpoint detection and response for the eighth consecutive season, and the industry leader in managed detection and response again this summer.

00:44:54 Speaker_01
Yep. So if you want cutting-edge cybersecurity solutions backed by a 24-7 team of experts who monitor, investigate, and respond to threats with unmatched precision, head on over to huntress.com slash acquired or click the link in the show notes.

00:45:08 Speaker_01
Our huge thanks to Huntress. I want to move away from NVIDIA, if you're okay with it, and ask you some questions, since we have a lot of founders that listen to this show, sort of advice for company building.

00:45:20 Speaker_01
The first one is, when you're starting a startup in the earliest days, your biggest competitor is you don't make anything people want.

00:45:29 Speaker_01
Like, your company is likely to die just because people don't actually care as much as you do about what they're doing. In the later days, you actually have to be very thoughtful about competitive strategy.

00:45:38 Speaker_01
And I'm curious, what would be your advice to companies that have product market fit, that are starting to grow, they're in interesting growing markets, where should they look for competition and how should they handle it?

00:45:52 Speaker_02
while there are all kinds of ways to think about competition, we prefer to position ourselves in a way that serves a need that usually hasn't emerged.

00:46:05 Speaker_03
I've heard you or others in NVIDIA, I think, use the phrase $0 billion markets.

00:46:08 Speaker_02
Yeah, that's exactly right. It's our way of saying, there's no market yet, but we believe there will be one. And usually, when you're positioned there, everybody's trying to figure out, why are you here?

00:46:22 Speaker_02
Because when we first got into automotive, because we believed that in the future the car is going to be largely software. And if it's going to be largely software, a really incredible computer is necessary.

00:46:33 Speaker_02
And so when we positioned ourselves there, most people, I still remember one of the CTOs told me, you know what, cars cannot tolerate the blue screen of death.

00:46:43 Speaker_02
I don't think anybody can tolerate that, but it doesn't change the fact that someday every car will be a software-defined car. And I think 15 years later, we're largely right.

00:46:56 Speaker_02
So oftentimes there's non-consumption, and we like to navigate our company there. And by doing that, by the time that the market emerges, it's very likely there aren't that many competitors shaped that way.

00:47:12 Speaker_02
And so we were early in PC gaming, and today NVIDIA is very large in PC gaming. We reimagined what a design workstation would be like, and today just about every workstation on the planet uses NVIDIA's technology.

00:47:28 Speaker_02
We reimagined how supercomputing ought to be done and who should benefit from supercomputing, that we would democratize it. And look today, NVIDIA's in accelerated computing is quite large. And we reimagined how software would be done.

00:47:42 Speaker_02
And today it's called machine learning and how computing would be done, we call it AI. And so we reimagined these kind of things, try to do that about a decade in advance. And so we spent about a decade in $0 billion markets.

00:47:57 Speaker_02
Today I spent a lot of time on Omniverse, and Omniverse is a classic example of a $0 billion business.

00:48:04 Speaker_01
There's like 40 customers now or something like that.

00:48:07 Speaker_03
Amazon, BMW.

00:48:08 Speaker_01
Yeah, no, it's cool. It's cool. So let's say you do get this great 10-year lead, but then other people figure it out and you got people nipping at your heels. What are some structural things that someone who's building a business can do to sort of

00:48:20 Speaker_01
stay ahead and you can just keep your pedal to the metal and say, we're going to outwork them and we're going to be smarter. And like that works to some extent, but those are tactics.

00:48:28 Speaker_01
What strategically can you do to sort of make sure that you can maintain that lead?

00:48:32 Speaker_02
Oftentimes, if you created the market, you ended up having, you know, what people describe as moats.

00:48:39 Speaker_02
Because if you build your product right, and it's enabled an entire ecosystem around you to help serve that end market, you've essentially created a platform.

00:48:51 Speaker_02
Sometimes it's a product-based platform, sometimes it's a service-based platform, sometimes it's a technology-based platform. But if you were early there and you were mindful about helping the ecosystem succeed with you,

00:49:06 Speaker_02
You ended up having this network of networks and all these developers and all these customers who are built around you. And that network is essentially your moat. And so I don't love thinking about it in the context of a moat.

00:49:22 Speaker_02
And the reason for that is because you're now focused on building stuff around your castle.

00:49:27 Speaker_02
I tend to like thinking about things in the context of building a network, and that network is about enabling other people to enjoy the success of the final market.

00:49:39 Speaker_02
You know, that you're not the only company that enjoys it, but you're enjoying it with a whole bunch of other people, including me.

00:49:45 Speaker_03
I'm so glad you brought this up because I wanted to ask you, in my mind at least, and it sounds like in yours too, NVIDIA is absolutely a platform company, of which there are very few meaningful platform companies in the world.

00:49:58 Speaker_03
I think it's also fair to say that when you started for the first few years, you were a technology company and not a platform company. Every example I can think of, of a company that tried to start as a platform company, fails.

00:50:10 Speaker_03
You've got to start as a technology first. When did you think about making that transition to being a platform? Like, your first graphics cards were technology. There was no CUDA, there was no platform.

00:50:19 Speaker_02
Yeah. What you observed is not wrong. However, inside our company, we were always a platform company. And the reason for that is because from the very first day of our company, we had this architecture called UDA. It's the UDA of CUDA.

00:50:34 Speaker_03
CUDA is Compute Unified Device Architecture?

00:50:37 Speaker_02
That's right. And the reason for that is because what we've done, what we essentially did in the beginning, even though Riva 128 only had computer graphics, The architecture described accelerators of all kinds.

00:50:52 Speaker_02
And we would take that architecture and developers would program to it. In fact, NVIDIA's first strategy, business strategy, was we were going to be a game console inside the PC.

00:51:06 Speaker_02
And a game console needs developers, which is the reason why NVIDIA, a long time ago, one of our first employees was a developer relations person.

00:51:15 Speaker_02
And so it's the reason why we knew all the game developers and all the 3D developers and we knew everyone.

00:51:20 Speaker_03
So was the original business plan to like,

00:51:23 Speaker_01
Sort of like to build DirectX.

00:51:24 Speaker_02
Yeah, compete with Nintendo and Sega as like PCs. The original NVIDIA architecture was called DirectNV. Direct NVIDIA, yeah. And DirectX was an API that made it possible for operating system to directly connect hardware.

00:51:43 Speaker_03
But DirectX didn't exist when you started NVIDIA, right? And that's what made your strategy wrong for the first couple of years.

00:51:49 Speaker_02
In 1993, we had Direct NVIDIA. And which in 1995 became, you know, well, DirectX came out.

00:51:56 Speaker_01
So this is an important lesson.

00:51:57 Speaker_02
We were always a developer-oriented company.

00:52:01 Speaker_01
The initial attempt was we will get the developers to build on DirectNV, and then they'll build for our chips, and then we'll have a platform. And what played out is Microsoft already had all these developer relationships.

00:52:13 Speaker_01
So you learned the lesson the hard way of like,

00:52:15 Speaker_03
Yikes, we just got to slide into that. I mean, that's what Microsoft did back in the day. They're like, oh, that could be a developer platform. We'll take that. Thank you.

00:52:21 Speaker_02
No, but they had a lot. They did it very differently, and they did a lot of things right. We did a lot of things wrong.

00:52:26 Speaker_03
But having said that- You were competing against Microsoft in the 90s.

00:52:30 Speaker_02
I mean, that's- It's like trying to compete against NVIDIA today. No, it's a lot different. But I appreciate that. But we were nowhere near competing with them.

00:52:39 Speaker_02
If you look now, when CUDA came along, there was OpenGL, there was DirectX, but there's still another extension, if you will, and that extension is CUDA.

00:52:48 Speaker_02
And that CUDA extension allows a chip that got paid for running DirectX and OpenGL to create an install base for CUDA. And so that's the strategy.

00:53:03 Speaker_03
Militant, and I think from our research it really was you being militant that every NVIDIA chip will run CUDA.

00:53:10 Speaker_02
Yeah, if you're a computing platform, everything's got to be compatible. We are the only accelerator on the planet where every single accelerator is architecturally compatible with the others. None has ever existed.

00:53:23 Speaker_02
There are literally a couple of hundred million, right? 250 million, 300 million installed base of active CUDA GPUs being used in the world today. And they're all architecturally compatible.

00:53:35 Speaker_02
How would you have a computing platform if, you know, NV30 and NV35 or 39 and NV40, they're all different? Right? At 30 years, it's all completely compatible. And so, that's the only un-negotiable rule in our company. Everything else is negotiable.

00:53:54 Speaker_03
I mean, and I guess Kudo was a rebirth of UDA, but understanding this now, UDA going all the way back, it really is all the way back to all the chips you've ever made.

00:54:03 Speaker_02
Yeah, yeah, yeah. In fact, UDA goes all the way back to all of our chips today. For the record, I didn't help any of the founding CEOs that are listening. I gotta tell you, while you were asking that question, what lessons would I impart? I don't know.

00:54:18 Speaker_02
I mean, the characteristics of successful companies and successful CEOs, I think, are fairly well described. There are a whole bunch of them. I just think starting successful companies are insanely hard. It's just insanely hard.

00:54:32 Speaker_02
And when I see these amazing companies get built, I have nothing but admiration and respect because I just know that it's insanely hard. And I think that everybody did many similar things. There are some good, smart things that people do.

00:54:47 Speaker_02
There are some dumb things that you can do. But you could do all the right smart things and still fail. You could do a whole bunch of dumb things, and I did many of them, and still succeed. So obviously, that's not exactly right.

00:55:01 Speaker_02
I think skills are the things that you can learn along the way. But at important moments, certain circumstances have to come together. And I do think that the market has to be one of the agents to help you succeed.

00:55:17 Speaker_02
It's not enough, obviously, because a lot of people still fail.

00:55:20 Speaker_01
Do you remember any moments in NVIDIA's history where you're like, oh, we made a bunch of wrong decisions, but somehow we got saved because, you know, it takes the sum of all the luck and all the skill in order to succeed.

00:55:32 Speaker_02
Do you remember any moments where you're like- I actually thought that you starting with Revo 128 was spot on. Revo 128, as I mentioned, the number of smart decisions we made, which are smart to this day,

00:55:45 Speaker_02
How we design ships is exactly the same to this day. Because, gosh, you know, nobody's ever done it back then. And we pulled every trick in the book in a desperation because we had no other choice. Well, guess what?

00:55:59 Speaker_02
That's the way things ought to be done. And now everybody does it that way. Right. Everybody does it. Because why should you do things twice if you can do it once? Why tape out a chip seven times if you could tape it out one time? Right?

00:56:11 Speaker_02
And so the most efficient, the most cost effective, the most competitive, speed is technology, right? Speed is performance. Time to market is performance. All of those things apply. So why do things twice if you could do it once?

00:56:26 Speaker_02
And so REBA 128 made a lot of great decisions in how we spec products, how we think about market needs and lack of, and how do we judge markets, and all of this. We made some amazingly good decisions. Yeah, we were back against the wall.

00:56:43 Speaker_02
We only had one more shot to do it.

00:56:46 Speaker_01
Once you pull out all the stops and you see what you're capable of, why would you put stops in next time? You're like, let's keep the stops out all the time, every time.

00:56:53 Speaker_03
Is it fair to say, though, maybe on the luck side of the equation, thinking back to 1997, that that was the moment where consumers tip to really, really valuing 3D graphical performance in games?

00:57:06 Speaker_02
Oh, yeah. So, for example, luck. Let's talk about luck.

00:57:10 Speaker_02
If Carmack hadn't decided to use acceleration, because remember, Doom was completely software rendered, and the NVIDIA philosophy was that although general purpose computing is a fabulous thing, it's going to enable software and IT and everything, we felt that there were applications that wouldn't be possible

00:57:30 Speaker_02
or it would be costly if it wasn't accelerated. It should be accelerated. And 3D graphics was one of them, but it wasn't the only one. And it just happens to be the first one, and a really great one.

00:57:40 Speaker_02
And I still remember the first times we met John, he was quite emphatic about using CPUs and the software render was really good.

00:57:47 Speaker_02
I mean, quite frankly, if you look at Doom, the performance of Doom was really hard to achieve, even with accelerators at the time. You know, if you didn't filter, if you didn't have to do bilinear filtering, it did a pretty good job.

00:58:01 Speaker_03
The problem with Doom, though, was you needed Carmack to program it.

00:58:04 Speaker_02
Yeah, you needed Carmack to program it. Exactly. It was a genius piece of code. But nonetheless, software renders did a really good job.

00:58:11 Speaker_02
And if he hadn't decided to go to OpenGL and accelerate for Quake, frankly, what would be the killer app that put us here?

00:58:21 Speaker_04
Right.

00:58:21 Speaker_02
And so Carmack and Sweeney, both between Unreal and Quake, created the first two killer applications for consumer 3D. Yeah, and so I owe them a great deal.

00:58:35 Speaker_03
I want to come back real quick to, you know, you said you told these stories and you're like, well, I don't know what founders can take from that.

00:58:40 Speaker_03
I actually do think, you know, if you look at all the big tech companies today, perhaps with the exception of Google, they did all start, and understanding this now about you, by addressing developers, planning to build a platform and tools for developers.

00:58:56 Speaker_03
You know, all of them. Apple, Amazon. Well, I guess with AWS, that's how AWS started. So I think that actually is a lesson to your point of like, that won't guarantee success by any means, but that'll get you hanging around a tree if the apple falls.

00:59:09 Speaker_02
Yeah. As many good ideas as we have, you don't have all the world's good ideas. And the benefit of having developers is you get to see a lot of good ideas. Yeah.

00:59:20 Speaker_01
Well, as we start to drift toward the end here, we spent a lot of time on the past, and I want to think about the future a little bit. I'm sure you spend a lot of time on this being on the cutting edge of AI.

00:59:31 Speaker_01
You know, we're moving into an era where the productivity that software can accomplish when a person is using software can massively amplify the impact and the value that they're creating, has to be amazing for humanity in the long run.

00:59:44 Speaker_01
In the short term, it's going to be inevitably bumpy as we sort of figure out what that means.

00:59:48 Speaker_01
What do you think some of the solutions are as AI gets more and more powerful and better at accelerating productivity for all the displaced jobs that are going to come from it?

01:00:00 Speaker_02
Well, first of all, we have to keep AI safe, and there's a couple of different areas of AI safety that's really important.

01:00:07 Speaker_02
Obviously, in robotics and self-driving car, there's a whole field of AI safety, and we've dedicated ourselves to functional safety and active safety and all kinds of different areas of safety.

01:00:19 Speaker_02
when to apply human in the loop, when is it okay for human not to be in the loop, how do you get to a point where increasingly human doesn't have to be in the loop, but human largely in the loop.

01:00:31 Speaker_02
In the case of information safety, obviously bias, false information, and appreciating the rights of artists and creators, that whole area deserves a lot of attention. and you've seen some of the work that we've done.

01:00:45 Speaker_02
Instead of scraping the Internet, we partnered with Getty and Shutterstock to create commercially fair way of applying artificial intelligence sharing to the AI.

01:00:55 Speaker_02
In the area of large language models and the future of increasingly greater agency, AI, clearly the answer is for as long as it's sensible, and I think it's going to be sensible for a long time, is human in the loop.

01:01:10 Speaker_02
The ability for an AI to self-learn and improve and change out in the wild in a digital form should be avoided.

01:01:22 Speaker_02
We should collect data, we should carry the data, we should train the model, we should test the model, validate the model before we release it out in the wild again, so human is in the loop.

01:01:31 Speaker_02
There are a lot of different industries that have already demonstrated how to build systems that are safe and good for humanity and obviously the way autopilot works for a plane and two-pilot system and air traffic control.

01:01:47 Speaker_02
redundancy and diversity, and all of the basic philosophies of designing safe systems apply as well in self-driving cars and so on and so forth. And so I think there's a lot of models of creating safe AI, and I think we need to apply them.

01:02:03 Speaker_02
With respect to automation, my feeling is that, and we'll see, but it is more likely that AI is going to create more jobs in the near term. The question is, what's the definition of near term?

01:02:15 Speaker_02
And the reason for that is the first thing that happens with productivity is prosperity. and prosperity, when the companies get more successful, they hire more people because they want to expand into more areas.

01:02:28 Speaker_02
And so the question is, if you think about a company and say, okay, if we improve the productivity, then they need fewer people. Well, that's because the company has no more ideas, but that's not true for most companies.

01:02:41 Speaker_02
If you become more productive and the company becomes more profitable, usually they hire more people to expand into new areas.

01:02:48 Speaker_02
And so long as we believe that there are more areas to expand into, that there are more ideas in drugs, there's drug discovery, there are more ideas in transportation, there are more ideas in retail, there are more ideas in entertainment, that there's more ideas in technology.

01:03:04 Speaker_02
So long as we believe that there are more ideas, the prosperity of the industry, which comes from improved productivity, results in hiring more people, more ideas.

01:03:13 Speaker_02
Now, you go back in history, we can fairly say that today's industry is larger than the world's industries 1,000 years ago. And the reason for that is because, obviously, humans have a lot of ideas.

01:03:25 Speaker_02
And I think that there's plenty of ideas yet for prosperity and plenty of ideas that can begat from productivity improvements. But my sense is that it's likely to generate jobs. Now, obviously,

01:03:40 Speaker_02
Net generation of jobs doesn't guarantee that any one human doesn't get fired. I mean, that's obviously true. And it's more likely that someone will lose a job to someone else, some other human that uses an AI.

01:03:56 Speaker_02
And not likely to an AI, but to some other human that uses an AI. And so I think the first thing that everybody should do is learn how to use AI so that they can augment their own productivity

01:04:07 Speaker_02
And every company should augment their own productivity to be more productive so that they can have more prosperity, hire more people. And so I think jobs will change. My guess is that we'll actually have higher employment. We'll create more jobs.

01:04:21 Speaker_02
I think industries will be more productive. And many of the industries that are currently suffering from lack of labor, workforce is likely to use AI to get themselves off their feet and get back to growth and prosperity.

01:04:37 Speaker_02
So I see it a little bit differently, but I do think that jobs will be affected, and I'd encourage everybody just to learn AI.

01:04:45 Speaker_03
This is appropriate, there's a version of something we talk about a lot on Acquired, we call it the Moritz Corollary to Moore's Law, after Mike Moritz from Sequoia.

01:04:56 Speaker_02
Sequoia was the first investor in our company. Yeah, of course.

01:05:00 Speaker_03
The great story behind it is that when Mike was taking over for Don Valentine with Doug, he was sitting and looking at Sequoia's returns, and he was looking at fund three or four, I think it was four maybe that had Cisco in it, and he was like,

01:05:11 Speaker_03
How are we ever going to top that? I can't. Don's going to have us beat. We're never going to beat that.

01:05:16 Speaker_03
He thought about it and he realized that, well, as compute gets cheaper and it can access more areas of the economy because it gets cheaper and can get adopted more widely. Well, then the markets that we can address should get bigger.

01:05:32 Speaker_03
And AI, your argument is basically AI will do the same thing.

01:05:35 Speaker_02
Exactly. I just gave you exactly the same example. That in fact, productivity doesn't result in us doing less. Productivity usually results in us doing more. Everything we do will be easier. but we'll end up doing more. Because we have infinite ambition.

01:05:54 Speaker_02
The world has infinite ambition, and so if a company is more profitable, they tend to hire more people to do more.

01:06:01 Speaker_01
That's true. Technology is a lever, and the place where the idea kind of falls down is that we would be satisfied.

01:06:10 Speaker_03
Humans have never-ending ambition.

01:06:12 Speaker_01
No, humans will always expand and consume more energy and attempt to pursue more ideas. That has always been true of every version of our species. Yeah. Over time.

01:06:22 Speaker_01
We want to thank our longtime friend of the show, Vanta, the leading trust management platform. Vanta, of course, automates your security reviews and compliance efforts.

01:06:32 Speaker_01
So frameworks like SOC 2, ISO 2701, GDPR, and HIPAA compliance and monitoring, Vanta takes care of these otherwise incredibly time and resource draining efforts for your organization and makes them fast and simple.

01:06:45 Speaker_03
Yep, Fanta is the perfect example of the quote that we talk about all the time here on Acquired, Jeff Bezos, his idea that a company should only focus on what actually makes your beer taste better, i.e.

01:06:56 Speaker_03
spend your time and resources only on what's actually gonna move the needle for your product and your customers and outsource everything else that doesn't. Every company needs compliance and trust with their vendors and customers.

01:07:06 Speaker_03
It plays a major role in enabling revenue because customers and partners demand it, but yet it adds zero flavor to your actual product.

01:07:14 Speaker_01
Vanta takes care of all of it for you. No more spreadsheets, no fragmented tools, no manual reviews to cobble together your security and compliance requirements.

01:07:21 Speaker_01
It is one single software pane of glass that connects to all of your services via APIs and eliminates countless hours of work for your organization.

01:07:30 Speaker_01
There are now AI capabilities to make this even more powerful, and they even integrate with over 300 external tools. Plus, they let customers build private integrations with their internal systems.

01:07:40 Speaker_03
And perhaps most importantly, your security reviews are now real-time instead of static, so you can monitor and share with your customers and partners to give them added confidence.

01:07:49 Speaker_01
So whether you're a startup or a large enterprise, and your company is ready to automate compliance and streamline security reviews like Vanta's 7,000 customers around the globe, and go back to making your beer taste better, head on over to vanta.com slash acquired and just tell them that Ben and David sent you.

01:08:04 Speaker_01
And thanks to friend of the show, Christina, Vanta's CEO, all Acquired listeners get $1,000 of free credit. Vanta.com slash Acquired.

01:08:29 Speaker_02
I've never read a sci-fi book before.

01:08:31 Speaker_01
No, come on! What's the obsession with Star Trek?

01:08:36 Speaker_02
I watch the TV show. Favorite sci-fi TV series? Star Trek's my favorite.

01:08:44 Speaker_01
I saw V'ger out there on the way in. It's a good conference room name.

01:08:48 Speaker_02
V'ger's an excellent one, yeah.

01:08:51 Speaker_03
What car is your daily driver these days? And related question, do you still have the Supra?

01:08:56 Speaker_02
Oh, it's one of my favorite cars, and also favorite memories. You guys might not know this, but Lori and I got engaged Christmas one year, and we drove back in my brand new Supra, and we totaled it. We were this close to the end. Thank God you didn't.

01:09:16 Speaker_02
But nonetheless, it wasn't my fault. It wasn't the Supra's fault.

01:09:19 Speaker_03
The one time when it wasn't the Supra's fault.

01:09:24 Speaker_02
I love that car. I'm driven these days for security reasons and others, but I'm driven in the Mercedes EQS. It's a great car. Nice. Yeah, great car.

01:09:36 Speaker_03
Using NVIDIA technology?

01:09:38 Speaker_02
Yeah, we're in the central computer.

01:09:44 Speaker_01
Sweet. I know we already talked a little bit about business books, but one or two favorites that you've taken something from?

01:09:52 Speaker_02
Clay Christensen, I think, the series is the best. I mean, there's just no two ways about it. And the reason for that is because it's so intuitive and so sensible, it's approachable. But I read a whole bunch of them, and I read just about all of them.

01:10:07 Speaker_02
I really enjoyed Andy Grove's books. They're all really good.

01:10:11 Speaker_01
Awesome. favorite characteristic of Don Valentine?

01:10:18 Speaker_02
Grumpy, but endearing. And what he said to me the last time as he decided to invest in our company, he says, if you lose my money, I'll kill you.

01:10:27 Speaker_04
Of course he did.

01:10:30 Speaker_02
And then over the course of the decades, the years that followed, When something is nice written about us in Mercury News, it seems like he wrote it in a crayon. You know, he'll say, he'll say, good job, Don.

01:10:44 Speaker_02
You know, just right, right over the newspaper and just, good job, Don. And he mails it to me. And I hope I've kept them. But anyways, you could tell he's a, he's a real sweetheart. And, and, but, but he cares about the companies.

01:11:00 Speaker_02
He's a special character. Yeah, he's incredible.

01:11:02 Speaker_01
What is something that you believe today that 40-year-old Jensen would have pushed back on and said, no, I disagree?

01:11:12 Speaker_02
There's plenty of time. Yeah. There's plenty of time. If you prioritize yourself properly and you make sure that you don't let Outlook be the controller of your time, there's plenty of time.

01:11:26 Speaker_03
Plenty of time in the day, plenty of time to achieve things.

01:11:32 Speaker_02
Just don't do everything. Prioritize your life. Make sacrifices. Don't let outlook control what you do every day. Notice I was late to our meeting.

01:11:41 Speaker_02
And the reason for that, by the time I looked up, I, oh my gosh, you know, Ben and Dave are waiting, you know, it's already. We got time. Yeah, exactly.

01:11:51 Speaker_03
Didn't stop this from being a great job.

01:11:52 Speaker_02
No, but you have to prioritize your time really carefully and don't let outlook determine that.

01:11:58 Speaker_01
Love that. What are you afraid of, if anything?

01:12:02 Speaker_02
I'm afraid of the same things today that I was in the very beginning of this company, which is letting the employees down.

01:12:12 Speaker_02
You have a lot of people who joined your company because they believe in your hopes and dreams and they've adopted it as their hopes and dreams and you want to be right for them. You want to be successful for them.

01:12:23 Speaker_02
You want them to be able to build a great life as well as help you build a great company and be able to build a great career. You want them to have to enjoy all of that.

01:12:33 Speaker_02
And these days I want them to be able to enjoy the things I've had the benefit of enjoying and all the great success I've enjoyed. I want them to be able to enjoy all of that. And so I think the greatest fear is that you let them down.

01:12:48 Speaker_03
What point did you realize that you weren't going to have another job? That like, this was it?

01:12:57 Speaker_02
I just, I don't change jobs. You know, if it wasn't because of Chris and Curtis convincing me to do NVIDIA, I would still be at LSI Logic today, I'm certain of it. Wow, really? Yeah, yeah. I would keep doing what I'm doing.

01:13:15 Speaker_02
And at the time that I was there, I was completely dedicated and focused on helping LSI Logic be the best company it could be. And I was LSI Logic's best ambassador. I've got great friends to this day that I've known from LSI Logic.

01:13:30 Speaker_02
It's a company I loved then, I love dearly today. I know exactly why I went. the revolutionary impact it had on chip design, and system design, and computer design.

01:13:41 Speaker_02
In my estimation, one of the most important companies that ever came to Silicon Valley and changed everything about how computers were made. It put me in the epicenter of some of the most important events in computer industry.

01:13:53 Speaker_02
It led me to meeting Chris and Curtis, and Andy Bechtolsheim, and John Rubinstein, and some of the most important people in the world. Frank that I was with the other day and just, I mean, the list goes on.

01:14:05 Speaker_02
So LSI logic was really important to me and I would still be there. Who knows what LSI logic would have become if I were still there, right? So that's how my mind works.

01:14:19 Speaker_03
Powering the AI of the world.

01:14:20 Speaker_02
Yeah, exactly. I mean, I might be doing the same thing I'm doing today.

01:14:23 Speaker_03
I got the sense from Remembering back to part one of our series on NVIDIA.

01:14:27 Speaker_02
But until I'm fired, this is my last job.

01:14:33 Speaker_03
I got the sense that LSI Logic might have also changed your... perspective and philosophy about computing too. The sense we got from the research was that when right out of school and when you first went to AMD first, right?

01:14:47 Speaker_02
Yeah.

01:14:48 Speaker_03
You believed that like kind of a version of that wasn't the Jerry Sanders real men have fabs like you need to do the whole stack like you got to do everything and that LSI logic changed you.

01:14:59 Speaker_02
What LSI logic did was realized that you can express transistors and logical gates and chip functionality in high-level languages.

01:15:11 Speaker_02
that by raising the level of abstraction and what is now called high-level design, it was coined by Harvey Jones who's on NVIDIA's board and I met him way back in the early days of Synopsys.

01:15:25 Speaker_02
But during that time, there was this belief that you can express chip design in high-level languages. By doing so, you could take advantage of optimizing compilers and optimization logic and tools and be a lot more productive.

01:15:41 Speaker_02
That logic was so sensible to me, and I was 21 years old at the time, and I wanted to pursue that vision.

01:15:50 Speaker_02
Now, frankly, that idea happened in machine learning, it happened in software programming, and I want to see it happen in digital biology so that we can think about biology in a much higher level language.

01:16:05 Speaker_02
Probably a large language model would be the way to make it representable. That transition was so revolutionary, I thought that was the best thing that ever happened to the industry, and I was really happy to be part of it, and I was at ground zero.

01:16:18 Speaker_02
And so I saw one industry change, revolutionize another industry. And if not for LSI Logic doing the work that it did, Synopsys shortly after, then why would the computer industry be where it is today? Yeah. It's really, really terrific.

01:16:37 Speaker_02
I was at the right place at the right time to see all that.

01:16:40 Speaker_03
That's super cool.

01:16:41 Speaker_02
Yeah.

01:16:42 Speaker_03
And it sounded like the CEO of LSI Logic put a good word in for you with Don Valentine too.

01:16:47 Speaker_02
I didn't know how to write a business plan.

01:16:51 Speaker_01
Which it turns out is not actually important.

01:16:53 Speaker_02
No. It turns out that making a financial forecast that nobody knows is going to be right or wrong turns out not to be that important.

01:17:03 Speaker_02
But the important things that a business plan probably could have teased out, I think that the art of writing a business plan ought to be much, much shorter. and it forces you to condense, you know, what is the true problem you're trying to solve?

01:17:16 Speaker_02
What is the unmet need that you believe will emerge? And what is it that you're going to do that is sufficiently hard that when everybody else finds out it's a good idea, they're not going to swarm it and, you know, make you obsolete?

01:17:28 Speaker_02
And so it has to be sufficiently hard to do. There are a whole bunch of other skills that are involved in just, you know, product and positioning and pricing and go to market and all that kind of stuff.

01:17:40 Speaker_02
But those are skills and you can learn those things easily. The stuff that is really, really hard is the essence of what I described. I did that okay, but I had no idea how to write the business plan and I was fortunate that Wolf Corrigan

01:17:54 Speaker_02
was so pleased with me and the work that I did when I was at Ellis Logic, he called up Don Valentine and told Don, you know, invest in this kid and he's going to come your way.

01:18:05 Speaker_02
And so I was, you know, I was set up for success from that moment and got us on the ground. As long as he didn't lose the money. I think Sequoia did okay. I think we probably are one of the best investments they've ever made.

01:18:24 Speaker_01
Have they held through today?

01:18:25 Speaker_02
The VC partner is still on the board, Mark Stevens.

01:18:28 Speaker_01
Yeah, Mark Hill.

01:18:28 Speaker_02
Yeah, yeah. All these years. The two founding VCs are still on the board. Sutter Hill and Sequoia? Yeah, Ted Cox and Mark Stevens. I don't think that ever happens. We are singular in that circumstance, I believe.

01:18:41 Speaker_02
They've added value this whole time, been inspiring this whole time, gave great wisdom and great support. But they also were so entertained. They haven't killed you yet. No, not yet.

01:18:54 Speaker_02
But they've been entertained by the company, inspired by the company, and enriched by the company. And so they stayed with it. And I'm really grateful.

01:19:01 Speaker_03
Well, in that vein, our final question for you. It's 2023, 30 years anniversary of the founding of NVIDIA.

01:19:10 Speaker_03
If you were magically 30 years old again today in 2023, and you were going to Denny's with your two best friends who are the two smartest people you know, and you're talking about starting a company, what are you talking about starting?

01:19:23 Speaker_02
I wouldn't do it. I know. And the reason for that is really quite simple. Ignoring the company that we would start. First of all, I'm not exactly sure.

01:19:34 Speaker_02
The reason why I wouldn't do it, and it goes back to why it's so hard, is building a company and building a video turned out to have been a million times harder than I expected it to be, any of us expected it to be.

01:19:47 Speaker_02
And at that time, if we realized the pain and suffering and just how vulnerable you're going to feel, and the challenges that you're going to endure, the embarrassment and the shame and the list of all the things that go wrong.

01:20:03 Speaker_02
I don't think anybody would start a company, nobody in their right mind would do it. I think that that's the superpower of a entrepreneur. They don't know how hard it is. And they only ask themselves, how hard can it be?

01:20:19 Speaker_02
And to this day, I trick my brain into thinking, how hard can it be? Because you have to. Still, when you wake up in the morning. How hard can it be? Everything that we're doing, how hard can it be? Omniverse, how hard can it be?

01:20:33 Speaker_03
I don't get the sense, though, that you're planning to retire anytime soon, though. No, I'm still young. You could choose to say, like, whoa, this is too hard. The trick is still working.

01:20:42 Speaker_02
The trick is still working. I'm still enjoying myself immensely, and I'm adding a little bit of value, but that's really the trick of an entrepreneur. You have to get yourself to believe that it's not that hard. because it's way harder than you think.

01:20:59 Speaker_02
And so if I go taking all of my knowledge now and I go back and I said, I'm going to endure that whole journey again, I think it's too much. It is just too much.

01:21:09 Speaker_01
Do you have any suggestions on any kind of support system or a way to get through the emotional trauma that comes with building something like this?

01:21:18 Speaker_02
Family and friends and all the colleagues we have here. I'm surrounded by people who've been here for 30 years. Right?

01:21:24 Speaker_02
Chris has been here for 30 years, and Jeff Fisher has been here 30 years, Dwight's been here 30 years, and Jonah and Brian have been here, you know, 25 some years. probably longer than that, and Joe Greco's been here 30 years.

01:21:37 Speaker_02
I'm surrounded by these people that never one time gave up, and they never one time gave up on me. And that's the entire ball of wax.

01:21:45 Speaker_02
And to be able to go home and have your family be fully committed to everything that you're trying to do, thick or thin, they're proud of you and proud of the company. You kind of need that. You need the unwavering support of people around you.

01:22:02 Speaker_02
You know, Jim Gaithers, and the Tench Coxes, and the Mark Stevens, and Harvey Jones, and all the early people of our company, the Bill Millers, they not one time gave up on the company and us. And you kind of, you need that.

01:22:18 Speaker_02
Not kind of need that, you need that. And I'm pretty sure that almost every successful company and entrepreneurs that have gone through some difficult challenges they had that support system around them.

01:22:31 Speaker_03
I can only imagine how meaningful that, I mean, I know how meaningful that is in any company, but for you, I feel like the NVIDIA journey is particularly amplified on these dimensions, right?

01:22:44 Speaker_02
Not normal.

01:22:44 Speaker_03
You went through two, if not three, 80 percent plus drawdowns in the public markets. To have investors who've stuck with you from day one through that must be just like, so much support.

01:23:12 Speaker_02
It's an extraordinary thing no matter how you look at it. I forget exactly, but we traded down at about a couple of two, three billion dollars in market value for a while because of the decision we made in going into CUDA and all that work.

01:23:29 Speaker_02
Your belief system has to be really, really strong. You have to really, really believe it and really, really want it. Otherwise, it's just too much to endure.

01:23:39 Speaker_02
I mean, because, you know, everybody's questioning you, and employees aren't questioning you, but employees have questions. People outside are questioning you. And it's a little embarrassing.

01:23:51 Speaker_02
It's like, you know, when your stock price gets hit, it's embarrassing no matter how you think about it, and it's hard to explain, you know? There's no good answers to any of that stuff.

01:24:01 Speaker_02
CEOs are human and companies are built of humans and these challenges are hard to endure.

01:24:07 Speaker_03
Ben had an appropriate comment on our most recent episode on you all where we were talking about the current situation in NVIDIA. I think you said, for any other company, this would be a precarious spot to be in, but for NVIDIA.

01:24:21 Speaker_01
This is kind of old hat. You guys are familiar with these large swings in amplitude.

01:24:27 Speaker_02
Yeah, the thing to keep in mind is at all times, what is the market opportunity that you're engaging? And that informs your size. I was told a long time ago that NVIDIA can never be larger than a billion dollars.

01:24:44 Speaker_02
obviously is an underestimation under imagination of the size of the opportunity. It is the case that no chip company can ever be so big. But if you're not a chip company, then why is that applied to you?

01:25:00 Speaker_02
This is the extraordinary thing about technology right now, is technology is a tool and it's only so large. What's unique about our current circumstance today, is that we're in the manufacturing of intelligence.

01:25:14 Speaker_02
We're in the manufacturing of work world. That's AI. And the world of tasks, doing work, productive, generative AI work, generative intelligent work, that market size is enormous. It's measured in trillions.

01:25:31 Speaker_02
One way to think about that is if you built a chip for a car, how many cars are there and how many chips would they consume? That's one way to think about that.

01:25:41 Speaker_02
However, if you build a system that, whenever needed, assist it in the driving of the car, what's the value of an autonomous chauffeur every now and then?

01:25:57 Speaker_02
And so now the market, obviously, the problem becomes much larger, the opportunity becomes larger. What would it be like if we were to magically conjure up a chauffeur for everybody who has a car. And you know, how big is that market?

01:26:13 Speaker_02
And obviously, that's a much, much larger market.

01:26:16 Speaker_02
And so, the technology industry is at the, you know, where what we've discovered, what NVIDIA has discovered, and what some of them discovered, is that by separating ourselves from being a chip company,

01:26:28 Speaker_02
But building on top of a chip and you're now in the ag company, the market opportunity has grown by probably 1,000 times.

01:26:36 Speaker_02
Don't be surprised if technology companies become much larger in the future because what you produce is something very different. That's the way to think about how large can your opportunity, how large can you be.

01:26:53 Speaker_02
It has everything to do with the size of the opportunity.

01:26:57 Speaker_01
Well, Jensen, thank you so much. Thank you. Woo, David, that was awesome.

01:27:03 Speaker_03
So fun.

01:27:04 Speaker_01
Well, listeners, we want to tell you that you should totally sign up for our email list. Of course, it is notifications when we drop a new email, but we've added something new.

01:27:14 Speaker_01
We're including little tidbits that we learn after releasing the episode, including listener corrections. And we also have been sort of teasing what the next episode will be.

01:27:23 Speaker_01
So if you want to play the little guessing game along with the rest of the Acquired community, sign up at acquired.fm slash email.

01:27:31 Speaker_01
you should check out ACQ2, which is available at any podcast player, as these main acquired episodes get longer and come out, you know, once a month instead of once every couple weeks. It's a little bit more of a rarity these days.

01:27:43 Speaker_01
We've been up-leveling our production process, and that takes time. Yes. ACQ2 has become the place to get more from David and I, and we've just got some awesome episodes coming up that we are excited about.

01:27:53 Speaker_01
If you want to come deeper into the Acquired kitchen, become an LP. Acquired.fm slash LP.

01:27:59 Speaker_01
Once every couple months or so, we'll be doing a call with all of you on Zoom just for LPs to get the inside scoop of what's going on in Acquired land and get to know David and I a little bit better.

01:28:08 Speaker_01
And once a season, you'll get to help us pick a future episode. So that's Acquired.fm slash LP. Anyone should join the Slack. Acquire.fm slash Slack. God, we've got a lot of things now, David.

01:28:20 Speaker_03
I know.

01:28:20 Speaker_01
The hamburger bar on our website is expanding. Expanding. I know. That's how you know we're becoming enterprise. We have a mega menu, a menu of menus, if you will. What is the acquired solution that we can sell?

01:28:31 Speaker_03
That's true. We got to find that.

01:28:32 Speaker_01
All right, with that, listeners, acquire.fm slash slack to join the slack and discuss this episode. Acquire.fm slash store to get some of that sweet merch that everyone is talking about. And with that, listeners, we will see you next time.

01:28:45 Speaker_03
We'll see you next time.

01:28:47 Speaker_00
Who got the truth? Is it you? Is it you? Is it you? Who got the truth now?