By Nick Bostrom.

Abstract:
Within a utilitarian context, one can perhaps try to explicate [crucial considerations] as follows: a crucial consideration is a consideration that radically changes the expected value of pursuing some high-level subgoal. The idea here is that you have some evaluation standard that is fixed, and you form some overall plan to achieve some high-level subgoal. This is your idea of how to maximize this evaluation standard. A crucial consideration, then, would be a consideration that radically changes the expected value of achieving this subgoal, and we will see some examples of this. Now if you stop limiting your view to some utilitarian context, then you might want to retreat to these earlier more informal formulations, because one of the things that could be questioned is utilitarianism itself. But for most of this talk we will be thinking about that component.

Read the full paper:
https://www.effectivealtruism.org/articles/crucial-considerations-and-wise-philanthropy-nick-bostrom

More episodes at:
https://radiobostrom.com/

---

Outline:

(00:14) What is a crucial consideration?

(04:27) Should I vote in the national election?

(08:18) Should we favor more funding for x-risk tech research?

(14:32) Crucial considerations and utilitarianism

(18:52) Evaluation Functions

(19:03) Some tentative signposts

(20:35) (Text resumes)

(27:28) Possible areas with additional crucial considerations

(30:03) Some partial remedies

---