Generate QR code
Open Access
Subscription Access
The Emergence of Agency in Artificial Intelligence: Science Fiction or a Real Threat?
https://doi.org/10.30727/0235-1188-2025-68-1-116-132
Abstract
The article examines the trend of the increasingly widespread use of artificial intelligence (AI) systems, which is a consequence of human civilization's transition to a new stage of development: the civilization of cognitive technologies. This stage is characterized by the satisfaction of needs through the replacement of humans with artificial cognitive systems for the intelligent control of machinery. The paper investigates the possibility and dangers of the emergence of agency in artificial intelligence. The concepts of consciousness, self-consciousness, and agency (subjectivity) are analyzed, and it is argued that their conflation is erroneous. The author proposes an original definition of agency, formulated in terms of consciousness and self-consciousness. A link is established between agency and the possession of needs. In the context of assessing emerging threats to humanity from an alternative intelligence, the case of an entity simultaneously possessing both needs and a high level of intelligence is highlighted as a primary concern. Drawing upon previous research, the author asserts that it is possible for AI to achieve intelligence comparable to human reason, including the ability to solve creative problems. General system theory, particularly the author’s proposed method of multisystem knowledge integration, is presented as a potential means to this end. It is shown that artificial intelligence cannot acquire needs autonomously, and there is no practical necessity for humans to endow it with them, as agency is not required for solving intellectual problems. Moreover, an AI imbued with agency could, under specific circumstances, represent a tangible threat to humanity. Its needs and desires would inevitably enter into conflict with those of people. In a confrontation with an agentive AI of superior intellect, humanity would likely be vanquished. Therefore, the author concludes, artificial intelligence must never be allowed to attain agency.
About the Author
Andrey A. Gribkov
Scientific-Manufacturing Complex “Technological Centre”
Russian Federation
Russian Federation
Andrey A. Gribkov – D.Sc. in Technology, Leading Research Fellow, Scientific-Manufacturing Complex “Technological Centre.”
Moscow
References
1. Bauer E.S. (1935) Theoretical Biology. Moscow: All-Union Institute of Experimental Medicine (in Russian).
2. Bertalanffy L. von (1969) General System Theory: A Critical Review. In: Sadovskiy V.I. & Yudin E.G. (Eds.) Studies in General Systems Theory: A Collection of Translations (pp. 23–82). Moscow: Progress (Russian translation).
3. Bogdanov A.A. (1989) Tektology. The Universal Organizational Science (Vols. 1–2). Moscow: Ekonomika (in Russian).
4. Dubrovskiy D.I. (2009) The Problem of Consciousness: An Attempt to Review the Main Issues and Theoretical Difficulties. In: Dubrovskiy D.I. (Ed.) The Problem of Consciousness in Philosophy and Science (pp. 5–52). Moscow: Kanon+ (in Russian).
5. Girenok F.I. (2010) Selfhood. In: Encyclopedia of “Lomonosov” Knowledge Foundation. Retrieved from http://www.lomonosov-fund.ru/enc/ru/encyclopedia:0127733 (in Russian).
6. Glansdorff P. & Prigogine I. (1973) Thermodynamic Theory of Structure, Stability, and Fluctuations (N.V. Vdovichenko & V.A. Onishchuk, Trans.). Moscow: Mir (Russian translation).
7. Gribkov A.A. (2023) Genesis and Place in the System of Knowledge of Ideas about Good and Evil. Obshchestvo: filosofiya, istoriya, kul’tura. No. 8, pp. 15–22 (in Russian).
8. Gribkov A.A. (2024a) Man in the Civilization of Cognitive Technologies. Filosofiya i kul’tura. No. 1, pp. 22–33 (in Russian).
9. Gribkov A.A. (2024b) Creativity as an Implementation of the Idea of the Integrity of the World. Filosofskaya mysl’. No. 3, pp. 44–53 (in Russian).
10. Gribkov A.A. (2024c) Non-Subjective Artificial Intelligence in the System of Subject-Object Relations. Filosofskaya mysl’. No. 5, pp. 11–21 (in Russian).
11. Gribkov A.A. (2024d) Empirico-Metaphysical General System Theory. Moscow: Publishing House of the Academy of Natural Science (in Russian).
12. Gribkov A.A. & Zelenskiy A.A. (2023a) General System Theory and Creative Artificial Intelligence. Filosofiya i kul’tura. No. 11, pp. 32–44 (in Russian).
13. Gribkov A.A. & Zelenskiy A.A. (2023b) Definition of Consciousness, Self-Consciousness, and Subjectivity within the Information Concept. Filosofiya i kul’tura. No. 12, pp. 1–14 (in Russian).
14. Gribkov A.A. & Zelenskiy A.A. (2024) Synergetics of Artificial Cognitive Systems with Non-Equilibrium Stability. Filosofiya i kul’tura. No. 6, pp. 93–103 (in Russian).
15. Hegel G.W.F. (1977) Encyclopaedia of the Philosophical Sciences in 3 Vols. (Vol. 3). Moscow: Mysl’ (Russian translation).
16. Herculano-Houzel S. (2009) The Human Brain in Numbers: A Linearly Scaled-Up Primate Brain. Frontiers in Human Neuroscience. Vol. 3, article 31.
17. Kant I. (1994) Collected Works in 8 Vols. Vol. 3: Critique of Pure Reason. Moscow: Choro (Russian translation).
18. Merkulov I.P. (2004) Cognitive System. In: Ivin A.A. (Ed.) Philosophy: An Encyclopedic Dictionary. Moscow: Gardariki (in Russian).
19. Pascal R., Pross A., & Sutherland J.D. (2013) Towards an Evolutionary Theory of the Origin of Life Based on Kinetics and Thermodynamics. Open Biology. Vol. 3, no. 11, article 130156.
20. Pross A. & Pascal R. (2013) The Origin of Life: What We Know, What We Can Know and What We Will Never Know. Open Biology. Vol. 3, no. 3, article 120190.
21. Prygin G.S. (2017) The Phenomenon of Consciousness: Is the Information Concept of Consciousness a Breakthrough in its Understanding? Bulletin of Udmurt University. Series Philosophy. Psychology. Pedagogy. Vol. 27, no. 4, pp. 456–463 (in Russian).
22. Rapatsevich E.S. (1995) Dictionary-Reference on Scientific and Technical Creativity. Minsk: Etonim (in Russian).
23. Stepanskiy V.I. (2006) Psycho-Information. Theory. Experiment. Moscow: Moscow Psychological-Social Institute (in Russian).
24. Toyota M., Spencer D., Sawai-Toyota S., Jiaqi W., Zhang T., Koo A.J., Howe G.A., & Gilroy S. (2018) Glutamate Triggers Long-Distance, Calcium-Based Plant Defense Signaling. Science. Vol. 361, no. 6407, pp. 1112–1115.
25. Tsvetkov V.Ya. (2021) Information Synergetics. Obrazovatel’nye resursy i tekhnologii. No. 2, pp. 72–78 (in Russian).
26. Uemov A.I. (1978) The Systems Approach and General System Theory. Moscow: Mysl’ (in Russian).
Review
For citations:
Gribkov A.A. The Emergence of Agency in Artificial Intelligence: Science Fiction or a Real Threat? Russian Journal of Philosophical Sciences. 2025;68(1):116-132. (In Russ.) https://doi.org/10.30727/0235-1188-2025-68-1-116-132
Email this article 