Description du poste
In a nutshell
Point 1: Safety isn't backdated on earlier models, todays Fable 5.2 will be trivial for someone in 2035 to jailbreak, but some capabilities will be just as deadly in 2035 as they are today, i.e. anything biological.
Point 2: If nukes were available on every corner to every Jill and Joe, we'd be in ruins. Reactive, legal enforcement is not sufficient.
Point 3: The fuzzy paradox where you have access to immense capabilities but minimal proactive safety mechanisms might be a sign we are living in a transitional period on AI safety.
Point 4: Infufficient progress is being made in model safety, the clock runs as the probabilities a small group of idiots do something terrible increases.
The core point:
Future improvements may not be able to undo the proliferation of dangerous capabilities already released.
Note: it doesn't need to be Fable 5.2, but an open source equivelent that appears next year.
Old Models can be dangerous too, (or they soon will be)When I was playing about with old LLM models, it occured to me how easy they were to jail break.
That led me to an obvious conclusion, "In 5 years time, will Fable 5.2 and GPT 6.1 be equally as easy to jailbreak?"
Even if vendors do a good job, it wont be long until we have open source equivalents. So be it in 2 years or 7, they'll be cracked and 'on the streets'
So, 'How much damage could Fable 5.2 or an equivalent do?'.
Some wreckless guessing:
- One shotting a nations Air Traffic Control systems , causing hundreds of planes to crash on a single day. (Purely speculative based on fragility and age of ATC systems)
- Bio Weapons
- Dirty bombs
- Mass EV carjacking and car accidents
...etc.
Safety Mobilization is too slow and ignores proliferationIn terms of available budget, Anthropic invested 6% of it's AI R&D computeinto safety.
Which on the positive ledger, produces consistent compounding effects. Today's security and alignment are orders of magnitude more sophisticated than what we had for GPT4.
It