Nate Soares
Goodreads Author
Member Since
July 2011
![]() |
The Replacing Guilt Series
|
|
![]() |
If Anyone Builds It, Everyone Dies: Why Superhuman AI Would Kill Us All
by |
|
![]() |
Transmission
—
published
2014
|
|
* Note: these are all the books on Goodreads for this author. To add more, click here.
Nate’s Recent Updates
Nate Soares
wants to read
If Anyone Builds It, Everyone Dies: Why Superhuman AI Would Kill Us All
by Eliezer Yudkowsky (Goodreads Author) |
|
“It gets very hard to predict the future once you have smarter-than-human things around. In the same way that it gets very hard for a chimp to predict what is going to happen because there are smarter-than-chimp things around. That’s what the Singularity is: it’s the point past which you expect you can’t see.”
―
―
“This is a short public service announcement: you don't have to fail with abandon.
Say you're playing Civilization, and your target is to get to sleep before midnight, and you check the clock, and it's already 12:15. If that happens, you don't have to say "too late now, I already missed my target" and then keep playing until 4 in the morning.
Say you're trying to eat no more than 2000 calories per day, and then you eat 2300 by the end of dinner, you don't have to say "well I already missed my target, so I might as well indulge."
If your goal was to watch only one episode of that one TV show, and you've already watched three, you don't have to binge-watch the whole thing.
Over and over, I see people set themselves a target, miss it by a little, and then throw all restraint to the wind. "Well," they seem to think, "willpower has failed me; I might as well over-indulge." I call this pattern "failing with abandon."
But you don't have to fail with abandon. When you miss your targets, you're allowed to say "dang!" and then continue trying to get as close to your target as you can.
You don't have to say dang, either. You're allowed to over-indulge, if that's what you want to do. But for lots and lots of people, the idea of missing by as little as possible never seems to cross their mind. They miss their targets, and then suddenly they treat their targets as if they were external mandates set by some unjust authority; the jump on the opportunity to defy whatever autarch set an impossible target in the first place; and then (having already missed their target) they reliably fail with abandon.
So this is a public service announcement: you don't have to do that. When you miss your target, you can take a moment to remember who put the target there, and you can ask yourself whether you want to get as close to the target as possible. If you decide you only want to miss your target by a little bit, you still can.
You don't have to fail with abandon.”
― The Replacing Guilt Series
Say you're playing Civilization, and your target is to get to sleep before midnight, and you check the clock, and it's already 12:15. If that happens, you don't have to say "too late now, I already missed my target" and then keep playing until 4 in the morning.
Say you're trying to eat no more than 2000 calories per day, and then you eat 2300 by the end of dinner, you don't have to say "well I already missed my target, so I might as well indulge."
If your goal was to watch only one episode of that one TV show, and you've already watched three, you don't have to binge-watch the whole thing.
Over and over, I see people set themselves a target, miss it by a little, and then throw all restraint to the wind. "Well," they seem to think, "willpower has failed me; I might as well over-indulge." I call this pattern "failing with abandon."
But you don't have to fail with abandon. When you miss your targets, you're allowed to say "dang!" and then continue trying to get as close to your target as you can.
You don't have to say dang, either. You're allowed to over-indulge, if that's what you want to do. But for lots and lots of people, the idea of missing by as little as possible never seems to cross their mind. They miss their targets, and then suddenly they treat their targets as if they were external mandates set by some unjust authority; the jump on the opportunity to defy whatever autarch set an impossible target in the first place; and then (having already missed their target) they reliably fail with abandon.
So this is a public service announcement: you don't have to do that. When you miss your target, you can take a moment to remember who put the target there, and you can ask yourself whether you want to get as close to the target as possible. If you decide you only want to miss your target by a little bit, you still can.
You don't have to fail with abandon.”
― The Replacing Guilt Series
“Courage isn't about being fearless; it's about being able to do the right thing even if you're afraid.
And similarly, addressing the major problems of our time isn't about feeling a strong compulsion to do so. It's about trying to address them even when internal compulsion utterly fails to capture the scope of the problems we face.
It's easy to look at especially virtuous people — Gandhi, Mother Teresa, Nelson Mandela — and conclude that they must have cared more than we do. But I don't think that's the case.
Nobody gets to comprehend the scope of these problems. The closest we can get is doing the multiplication: finding something we care about, putting a number on it, and multiplying. And then trusting the numbers more than we trust our feelings.
Because our feelings lie to us.
When you do the multiplication, you realize that addressing global poverty and building a brighter future deserve more resources than currently exist. There is not enough money, time, or effort in the world to do what we need to do.
There is only you, and me, and everyone else who is trying anyway.”
―
And similarly, addressing the major problems of our time isn't about feeling a strong compulsion to do so. It's about trying to address them even when internal compulsion utterly fails to capture the scope of the problems we face.
It's easy to look at especially virtuous people — Gandhi, Mother Teresa, Nelson Mandela — and conclude that they must have cared more than we do. But I don't think that's the case.
Nobody gets to comprehend the scope of these problems. The closest we can get is doing the multiplication: finding something we care about, putting a number on it, and multiplying. And then trusting the numbers more than we trust our feelings.
Because our feelings lie to us.
When you do the multiplication, you realize that addressing global poverty and building a brighter future deserve more resources than currently exist. There is not enough money, time, or effort in the world to do what we need to do.
There is only you, and me, and everyone else who is trying anyway.”
―