Annotating Driverless Dilemma (direct link)
00:00:46
I'm Robert Krulwich. And you know what this is.
00:01:39
Yeah.
00:03:06
Yeah, we were very worried about a lot of fake news—a lot of people are. But in the middle of doing that reporting, we were talking with a fellow from Vanity Fair.
00:03:10
And in the course of our conversation, Nick—and this had nothing to do with what we were talking about, by the way—Nick just got into a sort of a—well, he went into a kind of nervous reverie, I'd say.
00:03:21
[laughs]
00:04:02
This is not good. This is not good.
00:04:42
So that's a fairly compelling description of a—of a very dangerous future.
00:06:17
Right.
00:06:26
It may be that what Nick is worried about and what we were worried about 10 years ago have now come dangerously close together.
00:06:51
Well, you don't have to apologize for it. Those were great sound effects.
00:07:08
[laughs]
00:07:32
Yeah.
00:07:45
Okay.
00:08:18
You mean they're repairing the tracks?
00:08:31
This is unbeknownst to them, the trolley is approaching?
00:08:42
Okay.
00:08:59
Oh my God! [laughs] I—that was a horrible experience. I don't want that to happen to them.
00:09:09
So if the—so if the trolley goes on the second track, it will kill the one guy.
00:09:15
Well, I'm gonna pull the lever.
00:09:17
I hear the train coming in the—same five guys are working on the track?
00:09:21
Backs to the train, they can't see anything?
00:09:25
What do you mean, "there's a guy?"
00:09:30
[laughs]
00:09:41
And he stops the train.
00:10:04
Oh, yeah, I'm not gonna do that. I'm not gonna do that.
00:10:22
You mean, I'll save four people this way?
00:10:34
Yeah, but I'm—this time I'm pushing the guy. Are you insane? No.
00:12:41
And if having a moral sense is a unique and special human quality then maybe we—us two humans anyway, you and me ...
00:12:55
... should at least inquire as to why this happens. And I happen to have met somebody who has a hunch. He's a young guy at Princeton University. Wild curly hair, bit of mischief in his eye. His name is Josh Greene.
00:13:11
And he spent the last few years trying to figure out where this inconsistency comes from.
00:13:22
Josh is, by the way, a philosopher and a neuroscientist, so this gives him special powers. He doesn't sort of sit back in a chair, smoke a pipe and think, "Now why do you have these differences?" He says, "No, I would like to look inside people's heads, because in our heads we may find clues as to where these feelings of revulsion or acceptance come from." In our brains.
00:13:30
And it just so happens that in the basement of Princeton, there was this, well ...
00:13:37
A big circular thing.
00:13:43
180,000-pound brain scanner.
00:14:01
Have you ever worked with metal?
00:14:12
Anyhow, what Josh does is he invites people into this room, has them lie down on what is essentially a cot on rollers, and he rolls them into the machine. Their heads are braced, so they're sort of stuck in there.
00:14:14
Have you ever done this?
00:14:24
And then he tells them stories. He tells them the same two, you know, trolley tales that you told before.
00:14:28
And then at the very instant that they're deciding whether I should push the lever or whether I should push the man, at that instant, the scanner snaps pictures of their brains. And what he found in those pictures was frankly, a little startling. He showed us some.
00:14:32
The picture that I'm looking at is a sort of a—it's a brain looked at, I guess, from the top down?
00:14:45
And the first slide that he showed me was a human brain being asked the question, "Would you pull the lever?" And the answer in most cases was, "Yes."
00:14:53
When the brain's saying, "Yes," you'd see little kind of peanut-shaped spots of yellow.
00:15:03
The brain was being active in these places. And oddly enough whenever people said yes ...
00:15:12
... to the lever question, the very same pattern lit up. Then he showed me another slide. This is a slide of a brain saying, "No."
00:15:22
"I will not push the large man." And in this picture ...
00:15:39
... it was a totally different constellation of regions that lit up.
00:15:48
This is the "No, no, no" crowd.
00:16:21
Right. But when they answer, "No, I will not push the man," then you get a completely different part of the brain lighting up.
00:17:10
Mm-hmm.
00:17:20
Well he has a theory about this.
00:17:26
He suggests that the human brain doesn't hum along like one big, unified system. Instead, he says, maybe in your brain, every brain, you'll find little warring tribes, little subgroups. One that is sort of doing the logical sort of accounting kind of thing.
00:17:29
And that's the part that would glow when you answer, "Yes, I'd pull the lever."
00:18:15
But there's this other part of the brain which really, really doesn't like personally killing another human being, and gets very upset at the fat man case, and shouts, in effect ...
00:20:19
This is not a trivial discovery, that you struggle to find right and wrong depending upon what part of your brain is shouting the loudest. This is—it's like bleachers morality.
00:20:30
Hmm. You know, I just don't know.
00:20:36
I've always kind of suspected that a sense of right and wrong is mostly stuff that you get from your mom and your dad and from experience, that it's culturally learned for the most part. Josh is kind of a radical in this respect. He thinks it's biological. I mean, deeply biological. That somehow we inherit from the deep past a sense of right and wrong that's already in our brains from the get-go, before Mom and Dad.
00:20:43
Oh, so you're thinking then that the man on the bridge, that I'm on the bridge next to the large man, and I have hundreds of thousands of years of training in my brain that says, "Don't murder the large man."
00:21:01
And even if I'm thinking, "If I murder the large man, I'm gonna save five lives and only kill the one man," but there's something deeper down that says, "Don't murder the large man."
00:21:12
The "inner chimp" is your unfortunate way of describing an act of deep goodness.
00:21:28
It's the 10 Commandments, for God's sake! Inner chimp!
00:21:38
But something as basic as, "Thou shalt not kill," which many people think was handed down in tablet form from a mountaintop from God directly to humans, no chimps involved ...
00:22:56
... you're suggesting that hundreds of thousands of years of on-the-ground training have gotten our brains to think, "Don't kill your kin. Don't kill your ..."
00:23:09
So now we're getting to the rub of it. You think that profound moral positions may be somehow embedded in brain chemistry.
00:23:57
So there you are, you're huddled in the basement. All around you are enemy troops, and you're holding your baby in your arms, your baby with a cold, a bit of a sniffle. And you know that your baby could cough at any moment.
00:24:05
And you have the choice. Would you smother your own baby to save the village, or would you let your baby cough, knowing the consequences?
00:25:56
In the final M*A*S*H episode, the Korean woman who's a character in this piece, she murders her baby.
00:26:10
What Josh did is he asked people the question, "Would you murder your own child?" while they were in the brain scanner. And at just the moment when they were trying to decide what they would do, he took pictures of their brains. And what he saw, the contest we described before, was global in the brain. It was like a world war. That gang of accountants, that part of the brain was busy calculating, calculating. "A whole village could die. A whole village could die."
00:26:12
But the older and deeper reflex also was lit up, shouting, "Don't kill the baby! No, no! Don't kill the baby!"
00:26:16
Inside, the brain was literally divided: do the calculations, don't kill the baby. Do the calculations, don't kill the baby. Two different tribes in the brain literally trying to shout each other out. And Jad, this was a different kind of contest than the ones we talked about before. Remember before, when people were pushing a man off a bridge, overwhelmingly their brains yelled, "No, no! Don't push the man!" And when people were pulling the lever, overwhelmingly, "Yeah, yeah, pull the lever!"
00:26:24
There it was distinct. Here, I don't think really anybody wins.
00:26:50
[laughs] Well, that's a good question!
00:26:51
And now, is there a—what happens? Is it just two cries that fight each other out or is there a judge?
00:27:17
When you are in this moment, with parts of your brain contesting, there are two brain regions ...
00:27:36
... right behind your eyebrows—left and right—that light up. And this is particular to us. He showed me a slide.
00:27:38
So when we have a problem that we need to deliberate over, the light—the front of the brain, this is above my eyebrow, sort of?
00:28:21
And there's two of them, one on the left and one on the right.
00:28:31
And they are the things that monkeys don't have as much of that we have?
00:28:37
So looking at these two flashes of light at the front of a human brain, you could say we are looking at what makes us special.
00:28:42
A human being wrestling with a problem, that's what that is.
00:28:56
Well, he doesn't know for sure, but what he found is in these close contests, whenever those nodes are very, very active, it appears that the calculating section of the brain gets a bit of a boost, and the visceral "inner chimp" section of the brain is kind of muffled.
00:29:09
The people who chose to kill their children, who made what is essentially a logical decision, over and over, those subjects had brighter glows in these two areas and longer glows in these two areas. So there is a definite association between these two dots above the eyebrow and the power of the logical brain over the "inner chimp" or the visceral brain.
00:29:34
So in the long, long stream of time, I assume now you have three giraffes, two bobcats, and children?
00:29:46
Did you ever write the story differently?
00:29:53
Ooh!
00:39:35
Yeah.
00:45:10
I was thinking actually of a different thing. I was thinking even though you dramatically bring down the number of bad things that happen on roads, you dramatically bring down the collisions, you dramatically bring down the mortality, you dramatically lower the number of people who are drunk coming home from a party and just ram someone sideways and killing three of them and injuring two of them for the rest of their lives. Those kinds of things go way down, but the ones that remain are engineered. Like, they are calculated, almost with foresight.
00:45:47
So here's the difference—and this is such an interesting difference. Like, "Ah, damn, that's so sad that happened, that that guy got drunk and da da da, and maybe he should go to jail." But, "You mean that the society engineered this in?"
00:46:14
That is a big difference. One is operatic and seems like the forces of destiny, and the other seems mechanical and pre-thought through.
00:46:32
And there's something dark about a premeditated expected death. And I don't know what you do about that.
00:46:45
Everybody's on the hook for that.
00:47:00
Right.
00:47:19
Yeah, but you know how humans are. If you argue back that yes, a bunch of smarty-pantses concocted a mathematical formula which meant that some people had to die and here they are. There are many fewer than before! A human being, just like Josh would tell you, would have a roar of feeling and of anger and saying, "How dare you engineer this in! No, no, no, no, no!"
00:48:02
Yes and no. And that may be impossible unless you're a monk, for God's sake. [laughs]
00:48:22
Jad, you have to thank some people, no?
00:49:01
Yeah. I'll um ...
00:49:06
I'm not getting into your car.
00:49:13
If you don't mind. Just take my own.
00:49:24
[laughs]
00:49:34
[laughs] No you won't.
00:49:42
Yeah.
00:49:47
I'm Robert Krulwich.
Annotating Radiolab's "Driverless Dilemma"
00:00:46
I'm Robert Krulwich. And you know what this is.
00:01:39
Yeah.
00:03:06
Yeah, we were very worried about a lot of fake news—a lot of people are. But in the middle of doing that reporting, we were talking with a fellow from Vanity Fair.
00:03:10
And in the course of our conversation, Nick—and this had nothing to do with what we were talking about, by the way—Nick just got into a sort of a—well, he went into a kind of nervous reverie, I'd say.
00:03:21
[laughs]
00:04:02
This is not good. This is not good.
00:04:42
So that's a fairly compelling description of a—of a very dangerous future.
00:06:17
Right.
00:06:26
It may be that what Nick is worried about and what we were worried about 10 years ago have now come dangerously close together.
00:06:51
Well, you don't have to apologize for it. Those were great sound effects.
00:07:08
[laughs]
00:07:32
Yeah.
00:07:45
Okay.
00:08:18
You mean they're repairing the tracks?
00:08:31
This is unbeknownst to them, the trolley is approaching?
00:08:42
Okay.
00:08:59
Oh my God! [laughs] I—that was a horrible experience. I don't want that to happen to them.
00:09:09
So if the—so if the trolley goes on the second track, it will kill the one guy.
00:09:15
Well, I'm gonna pull the lever.
00:09:17
I hear the train coming in the—same five guys are working on the track?
00:09:21
Backs to the train, they can't see anything?
00:09:25
What do you mean, "there's a guy?"
00:09:30
[laughs]
00:09:41
And he stops the train.
00:10:04
Oh, yeah, I'm not gonna do that. I'm not gonna do that.
00:10:22
You mean, I'll save four people this way?
00:10:34
Yeah, but I'm—this time I'm pushing the guy. Are you insane? No.
00:12:41
And if having a moral sense is a unique and special human quality then maybe we—us two humans anyway, you and me ...
00:12:55
... should at least inquire as to why this happens. And I happen to have met somebody who has a hunch. He's a young guy at Princeton University. Wild curly hair, bit of mischief in his eye. His name is Josh Greene.
00:13:11
And he spent the last few years trying to figure out where this inconsistency comes from.
00:13:22
Josh is, by the way, a philosopher and a neuroscientist, so this gives him special powers. He doesn't sort of sit back in a chair, smoke a pipe and think, "Now why do you have these differences?" He says, "No, I would like to look inside people's heads, because in our heads we may find clues as to where these feelings of revulsion or acceptance come from." In our brains.
00:13:30
And it just so happens that in the basement of Princeton, there was this, well ...
00:13:37
A big circular thing.
00:13:43
180,000-pound brain scanner.
00:14:01
Have you ever worked with metal?
00:14:12
Anyhow, what Josh does is he invites people into this room, has them lie down on what is essentially a cot on rollers, and he rolls them into the machine. Their heads are braced, so they're sort of stuck in there.
00:14:14
Have you ever done this?
00:14:24
And then he tells them stories. He tells them the same two, you know, trolley tales that you told before.
00:14:28
And then at the very instant that they're deciding whether I should push the lever or whether I should push the man, at that instant, the scanner snaps pictures of their brains. And what he found in those pictures was frankly, a little startling. He showed us some.
00:14:32
The picture that I'm looking at is a sort of a—it's a brain looked at, I guess, from the top down?
00:14:45
And the first slide that he showed me was a human brain being asked the question, "Would you pull the lever?" And the answer in most cases was, "Yes."
00:14:53
When the brain's saying, "Yes," you'd see little kind of peanut-shaped spots of yellow.
00:15:03
The brain was being active in these places. And oddly enough whenever people said yes ...
00:15:12
... to the lever question, the very same pattern lit up. Then he showed me another slide. This is a slide of a brain saying, "No."
00:15:22
"I will not push the large man." And in this picture ...
00:15:39
... it was a totally different constellation of regions that lit up.
00:15:48
This is the "No, no, no" crowd.
00:16:21
Right. But when they answer, "No, I will not push the man," then you get a completely different part of the brain lighting up.
00:17:10
Mm-hmm.
00:17:20
Well he has a theory about this.
00:17:26
He suggests that the human brain doesn't hum along like one big, unified system. Instead, he says, maybe in your brain, every brain, you'll find little warring tribes, little subgroups. One that is sort of doing the logical sort of accounting kind of thing.
00:17:29
And that's the part that would glow when you answer, "Yes, I'd pull the lever."
00:18:15
But there's this other part of the brain which really, really doesn't like personally killing another human being, and gets very upset at the fat man case, and shouts, in effect ...
00:20:19
This is not a trivial discovery, that you struggle to find right and wrong depending upon what part of your brain is shouting the loudest. This is—it's like bleachers morality.
00:20:30
Hmm. You know, I just don't know.
00:20:36
I've always kind of suspected that a sense of right and wrong is mostly stuff that you get from your mom and your dad and from experience, that it's culturally learned for the most part. Josh is kind of a radical in this respect. He thinks it's biological. I mean, deeply biological. That somehow we inherit from the deep past a sense of right and wrong that's already in our brains from the get-go, before Mom and Dad.
00:20:43
Oh, so you're thinking then that the man on the bridge, that I'm on the bridge next to the large man, and I have hundreds of thousands of years of training in my brain that says, "Don't murder the large man."
00:21:01
And even if I'm thinking, "If I murder the large man, I'm gonna save five lives and only kill the one man," but there's something deeper down that says, "Don't murder the large man."
00:21:12
The "inner chimp" is your unfortunate way of describing an act of deep goodness.
00:21:28
It's the 10 Commandments, for God's sake! Inner chimp!
00:21:38
But something as basic as, "Thou shalt not kill," which many people think was handed down in tablet form from a mountaintop from God directly to humans, no chimps involved ...
00:22:56
... you're suggesting that hundreds of thousands of years of on-the-ground training have gotten our brains to think, "Don't kill your kin. Don't kill your ..."
00:23:09
So now we're getting to the rub of it. You think that profound moral positions may be somehow embedded in brain chemistry.
00:23:57
So there you are, you're huddled in the basement. All around you are enemy troops, and you're holding your baby in your arms, your baby with a cold, a bit of a sniffle. And you know that your baby could cough at any moment.
00:24:05
And you have the choice. Would you smother your own baby to save the village, or would you let your baby cough, knowing the consequences?
00:25:56
In the final M*A*S*H episode, the Korean woman who's a character in this piece, she murders her baby.
00:26:10
What Josh did is he asked people the question, "Would you murder your own child?" while they were in the brain scanner. And at just the moment when they were trying to decide what they would do, he took pictures of their brains. And what he saw, the contest we described before, was global in the brain. It was like a world war. That gang of accountants, that part of the brain was busy calculating, calculating. "A whole village could die. A whole village could die."
00:26:12
But the older and deeper reflex also was lit up, shouting, "Don't kill the baby! No, no! Don't kill the baby!"
00:26:16
Inside, the brain was literally divided: do the calculations, don't kill the baby. Do the calculations, don't kill the baby. Two different tribes in the brain literally trying to shout each other out. And Jad, this was a different kind of contest than the ones we talked about before. Remember before, when people were pushing a man off a bridge, overwhelmingly their brains yelled, "No, no! Don't push the man!" And when people were pulling the lever, overwhelmingly, "Yeah, yeah, pull the lever!"
00:26:24
There it was distinct. Here, I don't think really anybody wins.
00:26:50
[laughs] Well, that's a good question!
00:26:51
And now, is there a—what happens? Is it just two cries that fight each other out or is there a judge?
00:27:17
When you are in this moment, with parts of your brain contesting, there are two brain regions ...
00:27:36
... right behind your eyebrows—left and right—that light up. And this is particular to us. He showed me a slide.
00:27:38
So when we have a problem that we need to deliberate over, the light—the front of the brain, this is above my eyebrow, sort of?
00:28:21
And there's two of them, one on the left and one on the right.
00:28:31
And they are the things that monkeys don't have as much of that we have?
00:28:37
So looking at these two flashes of light at the front of a human brain, you could say we are looking at what makes us special.
00:28:42
A human being wrestling with a problem, that's what that is.
00:28:56
Well, he doesn't know for sure, but what he found is in these close contests, whenever those nodes are very, very active, it appears that the calculating section of the brain gets a bit of a boost, and the visceral "inner chimp" section of the brain is kind of muffled.
00:29:09
The people who chose to kill their children, who made what is essentially a logical decision, over and over, those subjects had brighter glows in these two areas and longer glows in these two areas. So there is a definite association between these two dots above the eyebrow and the power of the logical brain over the "inner chimp" or the visceral brain.
00:29:34
So in the long, long stream of time, I assume now you have three giraffes, two bobcats, and children?
00:29:46
Did you ever write the story differently?
00:29:53
Ooh!
00:39:35
Yeah.
00:45:10
I was thinking actually of a different thing. I was thinking even though you dramatically bring down the number of bad things that happen on roads, you dramatically bring down the collisions, you dramatically bring down the mortality, you dramatically lower the number of people who are drunk coming home from a party and just ram someone sideways and killing three of them and injuring two of them for the rest of their lives. Those kinds of things go way down, but the ones that remain are engineered. Like, they are calculated, almost with foresight.
00:45:47
So here's the difference—and this is such an interesting difference. Like, "Ah, damn, that's so sad that happened, that that guy got drunk and da da da, and maybe he should go to jail." But, "You mean that the society engineered this in?"
00:46:14
That is a big difference. One is operatic and seems like the forces of destiny, and the other seems mechanical and pre-thought through.
00:46:32
And there's something dark about a premeditated expected death. And I don't know what you do about that.
00:46:45
Everybody's on the hook for that.
00:47:00
Right.
00:47:19
Yeah, but you know how humans are. If you argue back that yes, a bunch of smarty-pantses concocted a mathematical formula which meant that some people had to die and here they are. There are many fewer than before! A human being, just like Josh would tell you, would have a roar of feeling and of anger and saying, "How dare you engineer this in! No, no, no, no, no!"
00:48:02
Yes and no. And that may be impossible unless you're a monk, for God's sake. [laughs]
00:48:22
Jad, you have to thank some people, no?
00:49:01
Yeah. I'll um ...
00:49:06
I'm not getting into your car.
00:49:13
If you don't mind. Just take my own.
00:49:24
[laughs]
00:49:34
[laughs] No you won't.
00:49:42
Yeah.
00:49:47
I'm Robert Krulwich.
Radiolab Driverless Dilemma
00:00:46 - 00:00:46
I'm Robert Krulwich. And you know what this is.
00:01:39 - 00:01:39
Yeah.
00:03:06 - 00:03:06
Yeah, we were very worried about a lot of fake news—a lot of people are. But in the middle of doing that reporting, we were talking with a fellow from Vanity Fair.
00:03:10 - 00:03:10
And in the course of our conversation, Nick—and this had nothing to do with what we were talking about, by the way—Nick just got into a sort of a—well, he went into a kind of nervous reverie, I'd say.
00:03:21 - 00:03:21
[laughs]
00:04:02 - 00:04:02
This is not good. This is not good.
00:04:42 - 00:04:42
So that's a fairly compelling description of a—of a very dangerous future.
00:06:17 - 00:06:17
Right.
00:06:26 - 00:06:26
It may be that what Nick is worried about and what we were worried about 10 years ago have now come dangerously close together.
00:06:51 - 00:06:51
Well, you don't have to apologize for it. Those were great sound effects.
00:07:08 - 00:07:08
[laughs]
00:07:32 - 00:07:32
Yeah.
00:07:45 - 00:07:45
Okay.
00:08:18 - 00:08:18
You mean they're repairing the tracks?
00:08:31 - 00:08:31
This is unbeknownst to them, the trolley is approaching?
00:08:42 - 00:08:42
Okay.
00:08:59 - 00:08:59
Oh my God! [laughs] I—that was a horrible experience. I don't want that to happen to them.
00:09:09 - 00:09:09
So if the—so if the trolley goes on the second track, it will kill the one guy.
00:09:15 - 00:09:15
Well, I'm gonna pull the lever.
00:09:17 - 00:09:17
I hear the train coming in the—same five guys are working on the track?
00:09:21 - 00:09:21
Backs to the train, they can't see anything?
00:09:25 - 00:09:25
What do you mean, "there's a guy?"
00:09:30 - 00:09:30
[laughs]
00:09:41 - 00:09:41
And he stops the train.
00:10:04 - 00:10:04
Oh, yeah, I'm not gonna do that. I'm not gonna do that.
00:10:22 - 00:10:22
You mean, I'll save four people this way?
00:10:34 - 00:10:34
Yeah, but I'm—this time I'm pushing the guy. Are you insane? No.
00:12:41 - 00:12:41
And if having a moral sense is a unique and special human quality then maybe we—us two humans anyway, you and me ...
00:12:55 - 00:12:55
... should at least inquire as to why this happens. And I happen to have met somebody who has a hunch. He's a young guy at Princeton University. Wild curly hair, bit of mischief in his eye. His name is Josh Greene.
00:13:11 - 00:13:11
And he spent the last few years trying to figure out where this inconsistency comes from.
00:13:22 - 00:13:22
Josh is, by the way, a philosopher and a neuroscientist, so this gives him special powers. He doesn't sort of sit back in a chair, smoke a pipe and think, "Now why do you have these differences?" He says, "No, I would like to look inside people's heads, because in our heads we may find clues as to where these feelings of revulsion or acceptance come from." In our brains.
00:13:30 - 00:13:30
And it just so happens that in the basement of Princeton, there was this, well ...
00:13:37 - 00:13:37
A big circular thing.
00:13:43 - 00:13:43
180,000-pound brain scanner.
00:14:01 - 00:14:01
Have you ever worked with metal?
00:14:12 - 00:14:12
Anyhow, what Josh does is he invites people into this room, has them lie down on what is essentially a cot on rollers, and he rolls them into the machine. Their heads are braced, so they're sort of stuck in there.
00:14:14 - 00:14:14
Have you ever done this?
00:14:24 - 00:14:24
And then he tells them stories. He tells them the same two, you know, trolley tales that you told before.
00:14:28 - 00:14:28
And then at the very instant that they're deciding whether I should push the lever or whether I should push the man, at that instant, the scanner snaps pictures of their brains. And what he found in those pictures was frankly, a little startling. He showed us some.
00:14:32 - 00:14:32
The picture that I'm looking at is a sort of a—it's a brain looked at, I guess, from the top down?
00:14:45 - 00:14:45
And the first slide that he showed me was a human brain being asked the question, "Would you pull the lever?" And the answer in most cases was, "Yes."
00:14:53 - 00:14:53
When the brain's saying, "Yes," you'd see little kind of peanut-shaped spots of yellow.
00:15:03 - 00:15:03
The brain was being active in these places. And oddly enough whenever people said yes ...
00:15:12 - 00:15:12
... to the lever question, the very same pattern lit up. Then he showed me another slide. This is a slide of a brain saying, "No."
00:15:22 - 00:15:22
"I will not push the large man." And in this picture ...
00:15:39 - 00:15:39
... it was a totally different constellation of regions that lit up.
00:15:48 - 00:15:48
This is the "No, no, no" crowd.
00:16:21 - 00:16:21
Right. But when they answer, "No, I will not push the man," then you get a completely different part of the brain lighting up.
00:17:10 - 00:17:10
Mm-hmm.
00:17:20 - 00:17:20
Well he has a theory about this.
00:17:26 - 00:17:26
He suggests that the human brain doesn't hum along like one big, unified system. Instead, he says, maybe in your brain, every brain, you'll find little warring tribes, little subgroups. One that is sort of doing the logical sort of accounting kind of thing.
00:17:29 - 00:17:29
And that's the part that would glow when you answer, "Yes, I'd pull the lever."
00:18:15 - 00:18:15
But there's this other part of the brain which really, really doesn't like personally killing another human being, and gets very upset at the fat man case, and shouts, in effect ...
00:20:19 - 00:20:19
This is not a trivial discovery, that you struggle to find right and wrong depending upon what part of your brain is shouting the loudest. This is—it's like bleachers morality.
00:20:30 - 00:20:30
Hmm. You know, I just don't know.
00:20:36 - 00:20:36
I've always kind of suspected that a sense of right and wrong is mostly stuff that you get from your mom and your dad and from experience, that it's culturally learned for the most part. Josh is kind of a radical in this respect. He thinks it's biological. I mean, deeply biological. That somehow we inherit from the deep past a sense of right and wrong that's already in our brains from the get-go, before Mom and Dad.
00:20:43 - 00:20:43
Oh, so you're thinking then that the man on the bridge, that I'm on the bridge next to the large man, and I have hundreds of thousands of years of training in my brain that says, "Don't murder the large man."
00:21:01 - 00:21:01
And even if I'm thinking, "If I murder the large man, I'm gonna save five lives and only kill the one man," but there's something deeper down that says, "Don't murder the large man."
00:21:12 - 00:21:12
The "inner chimp" is your unfortunate way of describing an act of deep goodness.
00:21:28 - 00:21:28
It's the 10 Commandments, for God's sake! Inner chimp!
00:21:38 - 00:21:38
But something as basic as, "Thou shalt not kill," which many people think was handed down in tablet form from a mountaintop from God directly to humans, no chimps involved ...
00:22:56 - 00:22:56
... you're suggesting that hundreds of thousands of years of on-the-ground training have gotten our brains to think, "Don't kill your kin. Don't kill your ..."
00:23:09 - 00:23:09
So now we're getting to the rub of it. You think that profound moral positions may be somehow embedded in brain chemistry.
00:23:57 - 00:23:57
So there you are, you're huddled in the basement. All around you are enemy troops, and you're holding your baby in your arms, your baby with a cold, a bit of a sniffle. And you know that your baby could cough at any moment.
00:24:05 - 00:24:05
And you have the choice. Would you smother your own baby to save the village, or would you let your baby cough, knowing the consequences?
00:25:56 - 00:25:56
In the final M*A*S*H episode, the Korean woman who's a character in this piece, she murders her baby.
00:26:10 - 00:26:10
What Josh did is he asked people the question, "Would you murder your own child?" while they were in the brain scanner. And at just the moment when they were trying to decide what they would do, he took pictures of their brains. And what he saw, the contest we described before, was global in the brain. It was like a world war. That gang of accountants, that part of the brain was busy calculating, calculating. "A whole village could die. A whole village could die."
00:26:12 - 00:26:12
But the older and deeper reflex also was lit up, shouting, "Don't kill the baby! No, no! Don't kill the baby!"
00:26:16 - 00:26:16
Inside, the brain was literally divided: do the calculations, don't kill the baby. Do the calculations, don't kill the baby. Two different tribes in the brain literally trying to shout each other out. And Jad, this was a different kind of contest than the ones we talked about before. Remember before, when people were pushing a man off a bridge, overwhelmingly their brains yelled, "No, no! Don't push the man!" And when people were pulling the lever, overwhelmingly, "Yeah, yeah, pull the lever!"
00:26:24 - 00:26:24
There it was distinct. Here, I don't think really anybody wins.
00:26:50 - 00:26:50
[laughs] Well, that's a good question!
00:26:51 - 00:26:51
And now, is there a—what happens? Is it just two cries that fight each other out or is there a judge?
00:27:17 - 00:27:17
When you are in this moment, with parts of your brain contesting, there are two brain regions ...
00:27:36 - 00:27:36
... right behind your eyebrows—left and right—that light up. And this is particular to us. He showed me a slide.
00:27:38 - 00:27:38
So when we have a problem that we need to deliberate over, the light—the front of the brain, this is above my eyebrow, sort of?
00:28:21 - 00:28:21
And there's two of them, one on the left and one on the right.
00:28:31 - 00:28:31
And they are the things that monkeys don't have as much of that we have?
00:28:37 - 00:28:37
So looking at these two flashes of light at the front of a human brain, you could say we are looking at what makes us special.
00:28:42 - 00:28:42
A human being wrestling with a problem, that's what that is.
00:28:56 - 00:28:56
Well, he doesn't know for sure, but what he found is in these close contests, whenever those nodes are very, very active, it appears that the calculating section of the brain gets a bit of a boost, and the visceral "inner chimp" section of the brain is kind of muffled.
00:29:09 - 00:29:09
The people who chose to kill their children, who made what is essentially a logical decision, over and over, those subjects had brighter glows in these two areas and longer glows in these two areas. So there is a definite association between these two dots above the eyebrow and the power of the logical brain over the "inner chimp" or the visceral brain.
00:29:34 - 00:29:34
So in the long, long stream of time, I assume now you have three giraffes, two bobcats, and children?
00:29:46 - 00:29:46
Did you ever write the story differently?
00:29:53 - 00:29:53
Ooh!
00:39:35 - 00:39:35
Yeah.
00:45:10 - 00:45:10
I was thinking actually of a different thing. I was thinking even though you dramatically bring down the number of bad things that happen on roads, you dramatically bring down the collisions, you dramatically bring down the mortality, you dramatically lower the number of people who are drunk coming home from a party and just ram someone sideways and killing three of them and injuring two of them for the rest of their lives. Those kinds of things go way down, but the ones that remain are engineered. Like, they are calculated, almost with foresight.
00:45:47 - 00:45:47
So here's the difference—and this is such an interesting difference. Like, "Ah, damn, that's so sad that happened, that that guy got drunk and da da da, and maybe he should go to jail." But, "You mean that the society engineered this in?"
00:46:14 - 00:46:14
That is a big difference. One is operatic and seems like the forces of destiny, and the other seems mechanical and pre-thought through.
00:46:32 - 00:46:32
And there's something dark about a premeditated expected death. And I don't know what you do about that.
00:46:45 - 00:46:45
Everybody's on the hook for that.
00:47:00 - 00:47:00
Right.
00:47:19 - 00:47:19
Yeah, but you know how humans are. If you argue back that yes, a bunch of smarty-pantses concocted a mathematical formula which meant that some people had to die and here they are. There are many fewer than before! A human being, just like Josh would tell you, would have a roar of feeling and of anger and saying, "How dare you engineer this in! No, no, no, no, no!"
00:48:02 - 00:48:02
Yes and no. And that may be impossible unless you're a monk, for God's sake. [laughs]
00:48:22 - 00:48:22
Jad, you have to thank some people, no?
00:49:01 - 00:49:01
Yeah. I'll um ...
00:49:06 - 00:49:06
I'm not getting into your car.
00:49:13 - 00:49:13
If you don't mind. Just take my own.
00:49:24 - 00:49:24
[laughs]
00:49:34 - 00:49:34
[laughs] No you won't.
00:49:42 - 00:49:42
Yeah.
00:49:47 - 00:49:47
I'm Robert Krulwich.
Radiolab Driverless Dilemma
00:00:46 - 00:00:46
I'm Robert Krulwich. And you know what this is.
00:01:39 - 00:01:39
Yeah.
00:03:06 - 00:03:06
Yeah, we were very worried about a lot of fake news—a lot of people are. But in the middle of doing that reporting, we were talking with a fellow from Vanity Fair.
00:03:10 - 00:03:10
And in the course of our conversation, Nick—and this had nothing to do with what we were talking about, by the way—Nick just got into a sort of a—well, he went into a kind of nervous reverie, I'd say.
00:03:21 - 00:03:21
[laughs]
00:04:02 - 00:04:02
This is not good. This is not good.
00:04:42 - 00:04:42
So that's a fairly compelling description of a—of a very dangerous future.
00:06:17 - 00:06:17
Right.
00:06:26 - 00:06:26
It may be that what Nick is worried about and what we were worried about 10 years ago have now come dangerously close together.
00:06:51 - 00:06:51
Well, you don't have to apologize for it. Those were great sound effects.
00:07:08 - 00:07:08
[laughs]
00:07:32 - 00:07:32
Yeah.
00:07:45 - 00:07:45
Okay.
00:08:18 - 00:08:18
You mean they're repairing the tracks?
00:08:31 - 00:08:31
This is unbeknownst to them, the trolley is approaching?
00:08:42 - 00:08:42
Okay.
00:08:59 - 00:08:59
Oh my God! [laughs] I—that was a horrible experience. I don't want that to happen to them.
00:09:09 - 00:09:09
So if the—so if the trolley goes on the second track, it will kill the one guy.
00:09:15 - 00:09:15
Well, I'm gonna pull the lever.
00:09:17 - 00:09:17
I hear the train coming in the—same five guys are working on the track?
00:09:21 - 00:09:21
Backs to the train, they can't see anything?
00:09:25 - 00:09:25
What do you mean, "there's a guy?"
00:09:30 - 00:09:30
[laughs]
00:09:41 - 00:09:41
And he stops the train.
00:10:04 - 00:10:04
Oh, yeah, I'm not gonna do that. I'm not gonna do that.
00:10:22 - 00:10:22
You mean, I'll save four people this way?
00:10:34 - 00:10:34
Yeah, but I'm—this time I'm pushing the guy. Are you insane? No.
00:12:41 - 00:12:41
And if having a moral sense is a unique and special human quality then maybe we—us two humans anyway, you and me ...
00:12:55 - 00:12:55
... should at least inquire as to why this happens. And I happen to have met somebody who has a hunch. He's a young guy at Princeton University. Wild curly hair, bit of mischief in his eye. His name is Josh Greene.
00:13:11 - 00:13:11
And he spent the last few years trying to figure out where this inconsistency comes from.
00:13:22 - 00:13:22
Josh is, by the way, a philosopher and a neuroscientist, so this gives him special powers. He doesn't sort of sit back in a chair, smoke a pipe and think, "Now why do you have these differences?" He says, "No, I would like to look inside people's heads, because in our heads we may find clues as to where these feelings of revulsion or acceptance come from." In our brains.
00:13:30 - 00:13:30
And it just so happens that in the basement of Princeton, there was this, well ...
00:13:37 - 00:13:37
A big circular thing.
00:13:43 - 00:13:43
180,000-pound brain scanner.
00:14:01 - 00:14:01
Have you ever worked with metal?
00:14:12 - 00:14:12
Anyhow, what Josh does is he invites people into this room, has them lie down on what is essentially a cot on rollers, and he rolls them into the machine. Their heads are braced, so they're sort of stuck in there.
00:14:14 - 00:14:14
Have you ever done this?
00:14:24 - 00:14:24
And then he tells them stories. He tells them the same two, you know, trolley tales that you told before.
00:14:28 - 00:14:28
And then at the very instant that they're deciding whether I should push the lever or whether I should push the man, at that instant, the scanner snaps pictures of their brains. And what he found in those pictures was frankly, a little startling. He showed us some.
00:14:32 - 00:14:32
The picture that I'm looking at is a sort of a—it's a brain looked at, I guess, from the top down?
00:14:45 - 00:14:45
And the first slide that he showed me was a human brain being asked the question, "Would you pull the lever?" And the answer in most cases was, "Yes."
00:14:53 - 00:14:53
When the brain's saying, "Yes," you'd see little kind of peanut-shaped spots of yellow.
00:15:03 - 00:15:03
The brain was being active in these places. And oddly enough whenever people said yes ...
00:15:12 - 00:15:12
... to the lever question, the very same pattern lit up. Then he showed me another slide. This is a slide of a brain saying, "No."
00:15:22 - 00:15:22
"I will not push the large man." And in this picture ...
00:15:39 - 00:15:39
... it was a totally different constellation of regions that lit up.
00:15:48 - 00:15:48
This is the "No, no, no" crowd.
00:16:21 - 00:16:21
Right. But when they answer, "No, I will not push the man," then you get a completely different part of the brain lighting up.
00:17:10 - 00:17:10
Mm-hmm.
00:17:20 - 00:17:20
Well he has a theory about this.
00:17:26 - 00:17:26
He suggests that the human brain doesn't hum along like one big, unified system. Instead, he says, maybe in your brain, every brain, you'll find little warring tribes, little subgroups. One that is sort of doing the logical sort of accounting kind of thing.
00:17:29 - 00:17:29
And that's the part that would glow when you answer, "Yes, I'd pull the lever."
00:18:15 - 00:18:15
But there's this other part of the brain which really, really doesn't like personally killing another human being, and gets very upset at the fat man case, and shouts, in effect ...
00:20:19 - 00:20:19
This is not a trivial discovery, that you struggle to find right and wrong depending upon what part of your brain is shouting the loudest. This is—it's like bleachers morality.
00:20:30 - 00:20:30
Hmm. You know, I just don't know.
00:20:36 - 00:20:36
I've always kind of suspected that a sense of right and wrong is mostly stuff that you get from your mom and your dad and from experience, that it's culturally learned for the most part. Josh is kind of a radical in this respect. He thinks it's biological. I mean, deeply biological. That somehow we inherit from the deep past a sense of right and wrong that's already in our brains from the get-go, before Mom and Dad.
00:20:43 - 00:20:43
Oh, so you're thinking then that the man on the bridge, that I'm on the bridge next to the large man, and I have hundreds of thousands of years of training in my brain that says, "Don't murder the large man."
00:21:01 - 00:21:01
And even if I'm thinking, "If I murder the large man, I'm gonna save five lives and only kill the one man," but there's something deeper down that says, "Don't murder the large man."
00:21:12 - 00:21:12
The "inner chimp" is your unfortunate way of describing an act of deep goodness.
00:21:28 - 00:21:28
It's the 10 Commandments, for God's sake! Inner chimp!
00:21:38 - 00:21:38
But something as basic as, "Thou shalt not kill," which many people think was handed down in tablet form from a mountaintop from God directly to humans, no chimps involved ...
00:22:56 - 00:22:56
... you're suggesting that hundreds of thousands of years of on-the-ground training have gotten our brains to think, "Don't kill your kin. Don't kill your ..."
00:23:09 - 00:23:09
So now we're getting to the rub of it. You think that profound moral positions may be somehow embedded in brain chemistry.
00:23:57 - 00:23:57
So there you are, you're huddled in the basement. All around you are enemy troops, and you're holding your baby in your arms, your baby with a cold, a bit of a sniffle. And you know that your baby could cough at any moment.
00:24:05 - 00:24:05
And you have the choice. Would you smother your own baby to save the village, or would you let your baby cough, knowing the consequences?
00:25:56 - 00:25:56
In the final M*A*S*H episode, the Korean woman who's a character in this piece, she murders her baby.
00:26:10 - 00:26:10
What Josh did is he asked people the question, "Would you murder your own child?" while they were in the brain scanner. And at just the moment when they were trying to decide what they would do, he took pictures of their brains. And what he saw, the contest we described before, was global in the brain. It was like a world war. That gang of accountants, that part of the brain was busy calculating, calculating. "A whole village could die. A whole village could die."
00:26:12 - 00:26:12
But the older and deeper reflex also was lit up, shouting, "Don't kill the baby! No, no! Don't kill the baby!"
00:26:16 - 00:26:16
Inside, the brain was literally divided: do the calculations, don't kill the baby. Do the calculations, don't kill the baby. Two different tribes in the brain literally trying to shout each other out. And Jad, this was a different kind of contest than the ones we talked about before. Remember before, when people were pushing a man off a bridge, overwhelmingly their brains yelled, "No, no! Don't push the man!" And when people were pulling the lever, overwhelmingly, "Yeah, yeah, pull the lever!"
00:26:24 - 00:26:24
There it was distinct. Here, I don't think really anybody wins.
00:26:50 - 00:26:50
[laughs] Well, that's a good question!
00:26:51 - 00:26:51
And now, is there a—what happens? Is it just two cries that fight each other out or is there a judge?
00:27:17 - 00:27:17
When you are in this moment, with parts of your brain contesting, there are two brain regions ...
00:27:36 - 00:27:36
... right behind your eyebrows—left and right—that light up. And this is particular to us. He showed me a slide.
00:27:38 - 00:27:38
So when we have a problem that we need to deliberate over, the light—the front of the brain, this is above my eyebrow, sort of?
00:28:21 - 00:28:21
And there's two of them, one on the left and one on the right.
00:28:31 - 00:28:31
And they are the things that monkeys don't have as much of that we have?
00:28:37 - 00:28:37
So looking at these two flashes of light at the front of a human brain, you could say we are looking at what makes us special.
00:28:42 - 00:28:42
A human being wrestling with a problem, that's what that is.
00:28:56 - 00:28:56
Well, he doesn't know for sure, but what he found is in these close contests, whenever those nodes are very, very active, it appears that the calculating section of the brain gets a bit of a boost, and the visceral "inner chimp" section of the brain is kind of muffled.
00:29:09 - 00:29:09
The people who chose to kill their children, who made what is essentially a logical decision, over and over, those subjects had brighter glows in these two areas and longer glows in these two areas. So there is a definite association between these two dots above the eyebrow and the power of the logical brain over the "inner chimp" or the visceral brain.
00:29:34 - 00:29:34
So in the long, long stream of time, I assume now you have three giraffes, two bobcats, and children?
00:29:46 - 00:29:46
Did you ever write the story differently?
00:29:53 - 00:29:53
Ooh!
00:39:35 - 00:39:35
Yeah.
00:45:10 - 00:45:10
I was thinking actually of a different thing. I was thinking even though you dramatically bring down the number of bad things that happen on roads, you dramatically bring down the collisions, you dramatically bring down the mortality, you dramatically lower the number of people who are drunk coming home from a party and just ram someone sideways and killing three of them and injuring two of them for the rest of their lives. Those kinds of things go way down, but the ones that remain are engineered. Like, they are calculated, almost with foresight.
00:45:47 - 00:45:47
So here's the difference—and this is such an interesting difference. Like, "Ah, damn, that's so sad that happened, that that guy got drunk and da da da, and maybe he should go to jail." But, "You mean that the society engineered this in?"
00:46:14 - 00:46:14
That is a big difference. One is operatic and seems like the forces of destiny, and the other seems mechanical and pre-thought through.
00:46:32 - 00:46:32
And there's something dark about a premeditated expected death. And I don't know what you do about that.
00:46:45 - 00:46:45
Everybody's on the hook for that.
00:47:00 - 00:47:00
Right.
00:47:19 - 00:47:19
Yeah, but you know how humans are. If you argue back that yes, a bunch of smarty-pantses concocted a mathematical formula which meant that some people had to die and here they are. There are many fewer than before! A human being, just like Josh would tell you, would have a roar of feeling and of anger and saying, "How dare you engineer this in! No, no, no, no, no!"
00:48:02 - 00:48:02
Yes and no. And that may be impossible unless you're a monk, for God's sake. [laughs]
00:48:22 - 00:48:22
Jad, you have to thank some people, no?
00:49:01 - 00:49:01
Yeah. I'll um ...
00:49:06 - 00:49:06
I'm not getting into your car.
00:49:13 - 00:49:13
If you don't mind. Just take my own.
00:49:24 - 00:49:24
[laughs]
00:49:34 - 00:49:34
[laughs] No you won't.
00:49:42 - 00:49:42
Yeah.
00:49:47 - 00:49:47
I'm Robert Krulwich.