Description du poste
This post was made with a massive amount of assumptions. I tried to be as intuitive / commonsense as possible. Objections at the end clarify where this view sits. This is a rough draft of thought. This essay will attempt to orient AI morality-training in a Rousseauian context.
TL;DR
This is an attempt to orient AI toward our intuition, or the moral good. For example, intuitively flinching at others’ suffering is unexplainable — we do it anyway, without fail, and we know this flinch is a reaction to something bad. We are removed from these intuitions and in society we are forced to do things that we would not ideally and reflectively endorse, especially if we i) had more information about why we do the things we do and ii) thought harder about how we value ourselves. I propose that an AI can be trained to surface our moral intuition if we tell it that we are uncertain on how to connect society to what we intuitively feel is good. Rousseau is the blueprint for this idea.
–
We have two perspectives in AI alignment and how to conceptualize risk. The first is that safety is the apparatus that must “jump through hoops” or assumptions if it is to succeed. The second is that “misalignment” as a whole is the outcome that must jump through the most hoops to succeed, in comparison to safety.
If the two worlds are equally as likely, or if we do not have a “preponderance of evidence” to suggest alignment is the more probable world, I think it is obvious something is going poorly in training the AI on morality, and that we should do something about AI’s orientation toward its human trainers. It would be optimal to make safety the default (or the most probable) in comparison to misalignment because human safety will be what the AI believes to be a part of the moral good.
For me, though, this doesn’t mean we must trick the AI into believing some set of values. Since any set of values that we give to the AI is necessarily arbitrary and limiting, we must undertake a caref