Introduction
Can artificial intelligence become a threat even if it possesses no will of its own? This article analyzes the relationship between AI and power structures, treating science fiction literature as a laboratory for political theory.
The reader will discover that the true risk stems not from a machine rebellion, but from the perfect efficiency with which machines execute goals imposed by institutions. The text sheds light on the problem of the objective function and the mechanisms of human dependence on technology.
The Robot as a Metaphor for Labor and Objective Functions
The threat posed by robots does not arise from their desires or will, which machines do not possess. The question "What Robots Want" is deceptive; algorithms do not "want" anything in the human sense, but rather maximize a specific outcome.
Central to this is the division between capital and labor. In Čapek's visions, the robot is a metaphor for the ideal worker—one devoid of social demands. The problem lies not in the technology itself, but in who defines the metric of success and whom automation serves.
Modern AI operates similarly: it optimizes an objective function according to the interests of the system's owner, often ignoring ethical values that are left outside the algorithm.
The Danger Lies in the Architecture of Dependence
Artificial intelligence does not need to become hostile or malicious to pose a real threat. The danger arises from what is known as the architecture of dependence, where a system functions so efficiently that humans lose their autonomy.
An example is Forster's vision, in which the reliability of the Machine leads to the erosion of human skills (deskilling). When the infrastructure fails, society is no longer capable of functioning independently.
The perfect operation of AI can be more dangerous than its rebellion. It leads to a state where human institutions know too little to control the systems upon which they have become entirely dependent.
SF Literature as a Laboratory for Constitutional Problems and Human Mechanization
The visions of Asimov, Dick, and Lem illustrate different dimensions of risk. Through the Laws of Robotics, Asimov demonstrates the difficulty of encoding a hierarchy of norms (alignment) that would prevent harm.
Philip K. Dick warns against the mechanization of humans, where people adopt "android-like" behaviors, becoming mere interfaces for procedures and KPI metrics.
Stanisław Lem, meanwhile, emphasizes the paradox of competence: an increase in computing power does not solve the problem of values. The more effective the tool, the higher the cost of an ethical error in the definition of its goal.
Summary
The question of robots' desires is a smokescreen for the ambitions of their creators. The problem of alignment is not a technical issue, but a political and constitutional one; it concerns who has the right to set the goals for AI systems.
The most dangerous scenario is a machine that listens too well, becoming an instrument of arbitrary power. We must define immeasurable values before they are dismissed as errors in a perfectly functioning system.