Deep Reinforcement Learning and Dempster-Shafer Theory: A Unified Approach to Imbalanced Classification

Yucheng Gan,Zhicheng Dai,Licheng Wu,Wanyu Liu,Lunde Chen
DOI: https://doi.org/10.1109/cei60616.2023.10528127
2023-01-01
Abstract:Imbalanced classification issues arise when there's a significant disparity in the distribution of samples among different classes within the training dataset. This class imbalance presents a substantial hurdle for machine learning models, often causing bias towards the majority class and consequently leading to subpar performance on minority classes. Traditional strategies for tackling imbalanced classification encompass data resampling methods like oversampling or undersampling, cost-sensitive learning, and ensemble techniques. However, these approaches may not consistently yield satisfactory outcomes as they can overlook crucial interclass dependencies and relationships. In recent years, Deep Reinforcement Learning (DRL) has emerged as a promising avenue for addressing imbalanced classification challenges. DRL marries deep neural networks with reinforcement learning algorithms, enabling the learning of effective strategies through interactions with the environment. This approach empowers the model to make more informed decisions by considering long-term rewards. In our proposal, Evidential DQN takes a distinctive route, harnessing evidence theory to model uncertainty and enhance prediction reliability. By integrating evidence computation into the Deep Q-Network (DQN), our model bolsters its capability to classify samples in imbalanced contexts. Simultaneously, it refines the partitioning of decision boundaries, ultimately resulting in improved classification outcomes.
What problem does this paper attempt to address?