Internal Neural Representations in Task-Switching Guided by Context Biases

Santiago Galella,Salva Ardid

DOI: https://doi.org/10.1101/2023.07.24.550365

2024-08-17

Abstract:Our brain can filter and integrate external information with internal representations to accomplish goal-directed behavior. The ability to switch between tasks effectively in response to context and external stimuli is a hallmark of cognitive control. Task switching occurs rapidly and efficiently, allowing us to perform multiple tasks with ease. Similarly, artificial intelligence can be tailored to exhibit multitask capabilities and achieve high performance across domains. In this study, we delve into neural representations learned by task-switching feedforward networks, which use task-specific biases for multitasking mediated by context inputs. Task-specific biases are learned by alternating the tasks the neural network learns during training. By using two-alternative choice tasks, we find that task-switching networks produce representations that resemble other multitasking paradigms, namely parallel networks in the early stages of processing and independent subnetworks in later stages. This transition in information processing is akin to that in the cortex. We then analyze the impact of inserting task contexts in different stages of processing, and the role of its location in the alignment between the task and the stimulus features. To confirm the generality of results, we display neural representations during task switching for different task and data sets. In summary, the use of context inputs improves the interpretability of feedforward neural networks for multitasking, setting the basis for studying architectures and tasks of higher complexity, including biological microcircuits in the brain carrying out context-dependent decision making.

Neuroscience

What problem does this paper attempt to address?

The paper aims to explore how neural networks guide changes in internal neural representations through contextual bias during task switching and draw an analogy with task switching in cognitive control. Specifically, the researchers constructed task-switching networks that learn the contextual biases of specific tasks during training to achieve multitasking. The study found that these task-switching networks exhibit different behavioral patterns at different stages of the processing: they resemble parallel networks in the early processing stages, while in the later stages, they are more akin to independent subnetworks. In this way, contextual input not only enhances the interpretability of feedforward neural networks in multitasking but also lays the foundation for further research into complex architectures, including biological microcircuits in the brain that execute context-dependent decisions.

Additionally, the study analyzed the impact of the position where context is introduced at different processing stages on the alignment between task and stimulus features and demonstrated neural representations during task switching across different tasks and datasets. The results indicate that task-switching networks can enhance shared internal representations through contextual bias, thereby improving model interpretability. Moreover, when handling multiple tasks, task-switching networks can transition from parallel processing to independent processing, and this transition depends on the position of context allocation. These findings contribute to a better understanding of multitasking mechanisms in more complex network architectures, including context-dependent decision-making in the brain.