Description du poste
This post:
• Summarizes Dean Ball's new post "The Silent Consensus"• Claims that he has misunderstood one of the primary arguments against his position, and elaborates on what I believe the actual argument to be.• Provides a list of suggestions I believe OAI Strategic Futures should follow as they work on pitching a "positive institutional future" based on the aforementioned argument.The essayRecently Dean Ball, Head of Strategic Futures at OpenAI and ex Senior Policy Advisor for Artificial Intelligence and Emerging Technology at the White House, posted an essay called The Silent Consensus.
The "consensus" that Ball refers to is the idea that gradual disempowerment is inevitable:
The consensus is simply that the forfeiture of human primacy over world affairs is inevitable [...]
Even if we make extraordinary progress on the bedeviling questions of AI safety and alignment, we could still find ourselves having submitted to a new kind of machine entity. [...]
To these machines, the silent consensus tells us, we will hand over the keys to our companies, and more and more, our institutions of governance. [...] We will be like passengers in a car—a very nice car, perhaps a materially nicer car than we can dream of today—but passengers nonetheless, lacking control over where the vehicle is headed.
In addition to naming the "Silent Consensus" building around the inevitability of human disempowerment at a governance level, Ball also uses his essay as a call to action for a greater effort put towards building a "a positive vision of our institutional future". Ball offers some concrete suggestions to that effect:
• Stronger accountability and liability for developers and model users: "AI developers should be accountable when they engage in unsafe development practices, but it also means that people and firms using AI should be held accountable when it is their misuse or lack of oversight that causes harm"• KYC and agent registration of some sort: "People must be tied to the ac