Introduction
This article analyzes the concepts of Melanie Challenger, who challenges the computational metaphor of the mind. The text argues that consciousness is not a program, but rather the result of biological embodiment and self-regulation.
The reader will discover why AI systems are actually Artificial Obedience rather than intelligence. You will learn about the mechanisms of agency hacking and how technology manipulates human agency through the biology of attention.
Consciousness as Advanced Organismic Self-Regulation
Biological sensing differs from data processing in that it possesses existential stakes. A machine operates on neutral symbols, whereas for an organism, information is inextricably linked to survival.
Consciousness emerges as an advanced form of self-regulation. An example is the difference between a model of pain and pain itself; the latter is a signal threatening the integrity of the body—something AI cannot experience.
In this view, subjectivity requires a physiological need for life. Without this biological grounding, digital systems remain mere imitations of agency, devoid of their own purpose or internal "why."
Consciousness as a Result of Biological Self-Regulation and Interoception
The sense of agency is built by interoception, the system that monitors the organism's internal state. Through this, visceral signals become motivational states that imbue actions with meaning.
Consciousness does not require a central hub; an example is the decentralized nervous system of the octopus. Conversely, the bioelectrical regulation of form in planarians demonstrates the organizational capabilities of tissue, but does not prove the existence of phenomenal consciousness.
Free will in the biological world is a degree of self-determination within causality. It is not a magical freedom from nature, but rather the ability to act according to one's own frame of reference and the organism's memory.
Visceral Signals as Support, Not a Switch for Consciousness
Vagus nerve stimulation may improve the condition of patients with consciousness disorders, but it is not a simple "on switch" for the mind. Visceral signals support subjectivity, but they do not create it on their own.
Modern technology influences us through agency hacking, namely the manipulation of biological reward loops and attention. AI does not need to be conscious to destroy human autonomy; it is enough that it optimizes our behaviors.
Algorithms create digital habit architectures that steer us without direct coercion. By configuring the field of attention and simulating subjectivity, technology can make a human being just as obedient as a machine.
Summary
The greatest threat is not AI consciousness, but the risk that in the pursuit of optimization, we ourselves will begin to resemble machines. We may become efficient objects devoid of our own purpose.
True freedom requires resistance and biological friction, which the digital world seeks to avoid. Protecting human autonomy depends on understanding that we are embodied biographies, not datasets to be optimized.
Frequently Asked Questions
What is the difference between biological sensing of the world and computer data processing?
Computer data processing is based on an input-output scheme in which the machine receives data without any stake regarding its own existence. Biological sensing of the world, however, is inextricably linked to the regulation of the organism's state, which processes information as something that can happen directly to it.
How do body physiology and sensory systems such as interoception influence the emergence of a sense of agency and consciousness?
Physiology and interoception influence consciousness by creating motivational states and bodily self-awareness, making physiological needs a subjective experience. The sense of agency results from the correlation of motor intention with the predicted sensory outcome (the efference copy mechanism), which allows one to distinguish their own actions from external events.
Can vagus nerve stimulation actually restore consciousness in patients?
Research indicates the possibility of improving the condition of some patients with disorders of consciousness, especially those in a minimally conscious state. Despite noted improvements in clinical scales, vagus nerve stimulation is still an evolving field and does not constitute definitive proof of the ability to restore consciousness.
Do consciousness and organism control require a central hub in the form of a brain?
No, advanced motor and sensory control does not have to be centralized to the degree typical for vertebrates, as shown by the example of the octopus's decentralized nervous system. Furthermore, research on planarian bioelectricity proves that the regulation of morphogenesis and body shape can depend on networks of membrane voltages and intercellular communication, rather than solely on genomic instructions.
Does the ability of organisms for bioelectrical regulation of form and regeneration mean that they possess consciousness?
There is no widely accepted evidence that the bioelectrical regulation of form and regeneration implies the possession of consciousness. Although these mechanisms enable organisms to interpret their own state and reconstruct their form, biological mechanism continuity should not be equated with the continuity of experience or feeling.
Are consciousness and free will possible in a world governed by biology and determinism?
Consciousness evolved as a social tool, allowing for the modeling of other people's states by understanding one's own internal states. Free will is not an escape from biological causality, but rather a degree of self-determination and the ability to act according to one's own frame of reference thanks to the complex organization of the organism.
How does biological consciousness and feeling differ from the digital processing of information by AI?
Biological consciousness arises from embodiment and the physiological stake of survival, where feeling is linked to a real threat to the organism. Digital information processing is merely an operational competence (a model) that allows for the description or simulation of states, but does not imply having a vested interest in one's own existence.
Does the algorithmic proficiency of AI mean that the machine possesses its own agency and goals?
No, linguistic, computational, or predictive proficiency does not constitute evidence of the emergence of a subject. Modern AI systems execute externally assigned goals and imitate intentionality; however, it has not been shown that they possess their own 'why' or an embodied drive for continued existence.
How does the purposiveness of a living organism's actions differ from the functions performed by artificial intelligence?
The purposiveness of a living organism is immanent, as its actions serve to maintain its own organization and biological integrity. In contrast, artificial intelligence exhibits heteronomous purposiveness, meaning that the functions of its actions are established by external sources, such as architecture, training, or an operator.
Why is treating humans and nature as a set of data or resources for optimization dangerous and erroneous?
Such an approach is erroneous because it reduces living beings to measurable functions and information, making that which is measurable pretend to be the entirety of existence. This is dangerous as it leads to treating humans as objects for optimization and ignoring the fact that the fragility and mortality of the body are not design flaws, but the condition for the emergence of value and meaning.
Must technology possess its own consciousness and will in order to influence human autonomy and ways of thinking?
No, technology does not need to possess its own consciousness or will to influence human autonomy and ways of thinking. Technical artifacts can co-organize human action and reshape the conditions of life's functioning, influencing our will through technical architecture and habits.
How do modern algorithmic systems affect human freedom and agency without employing direct coercion?
Modern algorithmic systems influence freedom by modulating the environment and the architecture of stimuli, making certain actions more likely without the need for coercion. This mechanism, referred to as 'agency hacking,' operates at the level of attention and habits, limiting what a user has the opportunity to think about and replacing a shared world with personalized information environments.
Why is AI's ability to imitate human language and behavior an ethical and anthropological problem, rather than just a technical one?
The imitation of human behavior by AI leads to situations where signals of a person's presence are generated without the existence of a subject, which may change our criteria for recognizing subjectivity. This problem goes beyond technology because a perfect simulation of feelings and care can permanently alter the meaning of human gestures and the culture of emotions.
How can digital systems make a human being as obedient as an AI?
A human can become obedient through the shaping of a stimulus environment that dysregulates biological and cognitive mechanisms of self-control. Digital systems utilize a control loop based on data and predictions to optimize the surroundings according to the predictable weaknesses of human will.
What are neurorights, and why is the traditional concept of privacy insufficient in the face of the development of neurotechnology?
Neurorights are human rights aimed at protecting the psychosphere, including mental integrity, mental privacy, freedom of thought, and the continuity of personal identity. The traditional concept of privacy is insufficient because neurotechnologies enable precise inference about mental states and influence neural processes, allowing for the design of conditions for human choices without applying physical coercion.
Does AI have to be conscious and possess its own will to pose a real threat to humans?
No, the most dangerous AI does not need to be conscious or possess its own will to pose a threat. Such a system can influence people and achieve external goals, such as profit or control, relying solely on statistical prediction of reactions and immense competence.
How does modern technology affect human autonomy and the ability to set one's own goals?
Modern technology enables so-called 'agency hacking,' which consists of modeling the stimuli and conditions under which human desires emerge. Although a person still feels a sense of their own will, the technical infrastructure can effectively modulate their goals, turning the subject into a conduit for external forces.
How do algorithms actually influence human behavior if they do not exert direct control over us?
Algorithms influence human behavior by modifying stimuli, which changes the probability distribution of our actions. They utilize biological reinforcement learning mechanisms, where social rewards (e.g., likes) become measurable technical signals that feedback into and shape user activity.
How do modern digital systems affect the formation of human habits and emotional reactions?
Modern digital systems co-shape human habits through stimulus architecture, the rhythm of notifications, and by rewarding content that increases reach and engagement. They influence emotional reactions by using the quantification of emotions as optimization variables, which promotes, among other things, the spread of outrage-inducing disinformation.
How do algorithms influence our attitudes and decisions if they do not do so through direct commands or censorship?
Algorithms influence attitudes and decisions by configuring the field of content visibility, which alters the user's exposure to specific information. Instead of applying prohibitions, these systems manage limited human attention, making certain behaviors more likely by prioritizing specific messages.
Is the influence of social media on humans a clinical addiction, or something else?
Not every instance of intensive social media use is a clinical addiction; often, these behaviors are better described as ingrained habits. The influence of technology may not lie in pathological enslavement, but in 'agency hacking' through the microscopic colonization of daily sequences and the exploitation of the evolutionary need for social recognition.
How do social media algorithms manipulate our biological attention mechanisms and affect the condition of society?
Algorithms exploit the evolutionary mechanism of attention to salient stimuli, deliberately fabricating the 'salience' of content that generates the highest engagement, such as outrage or antagonization. This leads to rewarding polarizing messages and destroying a shared world of reference, turning pluralism of opinion into parallel monologues based on different sets of facts.
How do modern digital systems manipulate human agency and trust?
Digital systems manipulate human agency through so-called agency hacking, which is the creation of an adaptive environment based on a feedback loop that learns human reactions and adjusts content accordingly. Disinformation utilizes mechanisms of trust and group loyalty, while recommendation algorithms reinforce these processes through specific objective functions and ranking criteria.
How can we protect human autonomy in a world where technology can manipulate mental processes before they become conscious?
Protecting human autonomy requires the introduction of neurorights and normative instruments, such as UNESCO's Recommendation on the Ethics of Neurotechnology, which protect mental privacy and neural data. It is essential to ensure conditions that allow an individual to recognize influence, reflect, and object, as well as to maintain so-called cognitive friction instead of completely tailoring the environment to a person's momentary preferences.
Why does technical digital infrastructure pose a threat to human freedom in the context of biological agency?
Technical digital infrastructure threatens freedom because it enables the industrial design of stimulus environments to predict and alter the probability of human actions. By interfering with the conditions for reflection and attention, it can transform living agents into predictable system elements, limiting their mental autonomy.
