Description du poste
I was just at Takeoff last weekend, and one of my takeaways is that I and many people I talk to in the Bay put DC out of our locus of control.
Our day jobs in AI safety focus on demonstrating potential avenues of misalignment, and when the topic comes to social problems like competitive pressures between the labs, our conversations end with “well I guess we need more regulation.”
I think this sentence is a Semantic Stopsign, because it carries the assumption that any bill that passes is completely out of our control.
It looks like Congress might pass a bipartisan AI safety bill next session. There are already proposed bills, most of which are more modest than pacing or pausing. The FRONTIER Act, the Senate frontier AI draft bill, the AI Incident Reporting Act, the AI Kill Switch Act, the Artificial Intelligence Risk Management and Security Act, and the TRUMP AMERICA AI Act (this last one is an anti-AI safety bill that preempts state laws). Only the Sanders-Casar superintelligence ban is substantially higher in ambition.
These bills are low salience and low polarization compared to most other issues, so any bill’s final text is very much still in the air.
Additionally, in the wake of a large enough warning shot, USG and the state govts may have the political will to pass something larger. It’s important to have something ambitious ready for when that happens — something like a PATRIOT or CARES Act. It seems that different people have different ideas on pause versus pace (e.g. CAIP’s Responsible AI Act, ControlAI’s draft, and MIRI’s treaty), and I’m excited to see more public debate between different proposals.
Regardless of a bill’s ambition, the text does matter a lot, and there are some smaller bills that might increase p(doom).
For example, some bills want to create independent verification organizations (IVOs), which are USG-licensed evaluators. Importantly, draft language that was pitched to me by people involved with the bill-writing process may block e.g.