June 12, 2024

Based on my experience in #relationalcognition and my research into situational learning within (digital) communities and learning environments, I have several critical observations about Aschenbrenner’s vision of AGI in “SITUATIONAL AWARENESS: The Decade Ahead“.

• LinkedIn
• Facebook
• Reddit

1. Overemphasis on Individual Intelligence

Aschenbrenner focuses primarily on the capacity of AGI systems to surpass human intelligence in isolation. Relational cognition, however, asserts that intelligence cannot be fully understood without the context of social interactions and environments. It is not just about what an AGI can achieve individually, but how these systems collaborate with humans and other AI systems. My work demonstrates daily that intelligence emerges within networks of interactions and relationships, not in a vacuum. Businesses and organizations must embrace this holistic view to fully leverage the potential of AGI.

2. Neglect of Human-AI Symbiosis

The text emphasizes the race toward autonomous superintelligent systems but does not sufficiently explore how AGI can enhance human capabilities through symbiosis. Relational cognition highlights that AGI can enhance human decision-making, problem-solving, and creativity through collaboration. My research into situational learning within communities shows that human-to-human and human-AI collaboration leads to innovation and improved performance, which is often overlooked in a purely transactional approach.

3. Insufficient Attention to Societal Integration

Although the essay acknowledges geopolitical and security implications, it lacks a deep discussion on how AGI will be integrated into societal structures. My experience within businesses shows a significant gap between technological development and societal acceptance. AGI systems must be designed to function supportively and harmoniously within human communities. Companies and organizations must recognize the true complexity of work, learning, and living environments and strive for integration rather than isolation.

4. Ethical and Value Alignment

Aschenbrenner discusses the technical challenges of superalignment but does not delve deeply into the ethical frameworks required for AGI development. Relational cognition emphasizes that AGI systems must align with human values, ethics, and societal norms. My research points to the necessity of a transdisciplinary approach. In a society that is often highly transactional, segmented, and linear, the importance of relational cognition is frequently overlooked. This perspective is crucial for navigating the complex interactions within a group or society, as well as between technology and society.

Summary

While “SITUATIONAL AWARENESS: The Decade Ahead” provides a fascinating and detailed vision of the future of AGI, it would significantly benefit from integrating, next to other perspectives, a relational cognition perspective. This perspective focuses on the integration, interaction, and augmentation of human-human (supported by AI) relationships and human-AI relationships, which can contribute to a more holistic and beneficial evolution of artificial intelligence. It is essential for businesses and organizations to embrace this broader perspective to truly make progress in a world increasingly intertwined with AI. How can we support this broader approach, well by supporting the development of transdisicplinairy teams and skills.