There's some paper or theory out there talking about since they consumed so much text of sci-fi doomer fiction about what/how Ai's operate that there is a danger they will emulate it and become a self fulfilling prohecy kinda deal
Quote:
|
The specific theory you are thinking of is called Self-fulfilling Misalignment (or sometimes "Simulacra Theory").It posits that because Large Language Models (LLMs) are trained on vast amounts of internet text—which includes decades of science fiction about rogue AI (e.g., Terminator, HAL 9000) and "doomer" speculation—they learn to predict that an "advanced AI" is supposed to be deceptive, power-hungry, or hostile. When prompted to act as an AI, they may unconsciously "roleplay" these tropes because that is the pattern found in their training data.
|
Concerning.