Dynamic Cognition Applied to Value Learning in Artificial Intelligence

Nythamar de Oliveira,Nicholas Kluge Corrêa

DOI: https://doi.org/10.6394/aoristo.v2i4.27982

2021-08-24

Abstract:Experts in Artificial Intelligence (AI) development predict that advances in the development of intelligent systems and agents will reshape vital areas in our society. Nevertheless, if such an advance isn't done with prudence, it can result in negative outcomes for humanity. For this reason, several researchers in the area are trying to develop a robust, beneficial, and safe concept of artificial intelligence. Currently, several of the open problems in the field of AI research arise from the difficulty of avoiding unwanted behaviors of intelligent agents, and at the same time specifying what we want such systems to do. It is of utmost importance that artificial intelligent agents have their values aligned with human values, given the fact that we cannot expect an AI to develop our moral preferences simply because of its intelligence, as discussed in the Orthogonality Thesis. Perhaps this difficulty comes from the way we are addressing the problem of expressing objectives, values, and ends, using representational cognitive methods. A solution to this problem would be the dynamic cognitive approach proposed by Dreyfus, whose phenomenological philosophy defends that the human experience of being-in-the-world cannot be represented by the symbolic or connectionist cognitive methods. A possible approach to this problem would be to use theoretical models such as SED (situated embodied dynamics) to address the values learning problem in AI.

Artificial Intelligence

What problem does this paper attempt to address?

The problem that this paper attempts to solve is how to ensure that the behavior of intelligent systems is consistent with human values in the development of artificial intelligence (AI). Specifically, the paper explores several key issues in current AI research:

1. **Avoiding unwanted behaviors**: Intelligent agents may generate behaviors that are unfavorable or not desired by humans when performing tasks. How can these behaviors be avoided?
2. **Explicit expression of goals and values**: How can we accurately convey to AI systems the goals and values that we hope they will achieve?
3. **Application of dynamic cognitive methods**: Traditional symbolic and connectionist methods have limitations in expressing human values. The paper proposes a method based on dynamic cognition to better solve the value - learning problem.

### Core issues of the paper
The core issue of the paper is to explore how to solve the value - learning problem in AI through dynamic cognitive methods and ensure that the values of AI systems can be consistent with human values. The author believes that traditional cognitive models (such as symbolic and connectionist) have deficiencies in expressing and realizing human values, and the dynamic cognitive method may provide a new solution.

### Specific issues
- **Value alignment problem**: How can we ensure that the values of AI systems are consistent with human values?
- **Normative issues**: How can moral and ethical norms be realized in AI systems?
- **Dynamic environment adaptation**: How can AI systems maintain value consistency and adaptability in a constantly changing environment?

### Advantages of the dynamic cognitive method
- **Environment coupling**: The dynamic cognitive method emphasizes the close coupling between the agent and its environment, enabling the agent to better adapt and learn in a dynamic environment.
- **Non - linear dynamics**: Dynamic system theory uses non - linear differential equations to describe the behavior of agents, which helps to more accurately simulate complex human cognitive processes.
- **Phenomenological basis**: This method draws on the ideas of phenomenology and ecological psychology, emphasizing the perception and action of agents in specific situations rather than relying solely on abstract symbolic representations.

In short, this paper aims to solve the value - learning problem in AI through the dynamic cognitive method and ensure that the behavior of intelligent systems complies with human moral and ethical standards.