Description du poste
Epistemic status: Low, but I hope to be wrong in interesting waysAs a non-computer scientist-scientist[1] I find it hard to think about the varying perspectives on Artificial Intelligence alignment difficulty. To make this more intuitive I invoke the 3D surface of a fitness landscape like structure as a visual representation.[2]
The AI Safety LandscapeAI safety is thought to be largely pre-paradigmatic, although of the current views AI safety perspectives there are noticeable camps, and within each there is wide variation. It is also rapidly evolving as more information comes out about their behavior that allows us to update.
Previous work categorizing these has focused on specific technical approaches as well as their feasibility.
Here I think of ‘alignment’ loosely, here it is represented as any mind that would not cause extinction (or an s-risk) while also having substantial power, this contrasts with misalignment which would lead to extinction (or an s-risk).
To simplify this I condense these to five main camps represented by their arguably most prominent opinion havers:
Although I agree that P(doom) is a Dumb Meme it is used here more as a heuristic for parsing levels of concern around AI. For more of their specific positions here are my references: Yann LeCun, Paul Christiano[3], Eliezer Yudkowsky[4], Daniel Kokotajlo [5]and Roman Yampolskiy.
Visual RepresentationIn my mind’s eye, the alignment landscape manifests similarly to a fitness landscape.[6]
A fitness landscape is typically used to display the relationship between genotypes and reproductive success. Here I try to replace those axes with variance between digital minds contrasted with the difficulty to reach those minds using current methods. This difficulty space then intersects with a higher ‘alignment’ space where everything outside of this space is misaligned[7] (the total space would manifest as 4D) of holding anything remotely desirable to humans, here they are represented by red dashed lines an