Abstract:Post-harvest diseases of apple are one of the major issues in the economical sector of apple production, causing severe economical losses to producers. Thus, we developed DSSApple, a picture-based decision support system able to help users in the diagnosis of apple diseases. Specifically, this paper addresses the problem of sequentially optimizing for the best diagnosis, leveraging past interactions with the system and their contextual information (i.e. the evidence provided by the users). The problem of learning an online model while optimizing for its outcome is commonly addressed in the literature through a stochastic active learning paradigm - i.e. Contextual Multi-Armed Bandit (CMAB). This methodology interactively updates the decision model considering the success of each past interaction with respect to the context provided in each round. However, this information is very often partial and inadequate to handle such complex decision making problems. On the other hand, human decisions implicitly include unobserved factors (referred in the literature as unobserved confounders) that significantly contribute to the human's final decision. In this paper, we take advantage of the information embedded in the observed human decisions to marginalize confounding factors and improve the capability of the CMAB model to identify the correct diagnosis. Specifically, we propose a Counterfactual Contextual Multi-Armed Bandit, a model based on the causal concept of counterfactual. The proposed model is validated with offline experiments based on data collected through a large user study on the application. The results prove that our model is able to outperform both traditional CMAB algorithms and observed user decisions, in real-world tasks of predicting the correct apple disease.

Contextual Decision Trees

Tree Ensembles for Contextual Bandits

Making Contextual Decisions with Low Technical Debt

Selectively Contextual Bandits

Deep Contextual Multi-armed Bandits

Context-Aware Bandits

Contextual Bandit with Adaptive Feature Extraction

Personalized News Recommendation with Context Trees

A Contextual-Bandit Approach to Personalized News Article Recommendation

A Bayesian Approach for Subset Selection in Contextual Bandits.

Contextual Bandit with Herding Effects: Algorithms and Recommendation Applications

Extending Explainable Ensemble Trees (E2Tree) to regression contexts

Counterfactual Contextual Multi-Armed Bandit: a Real-World Application to Diagnose Apple Diseases

Context Aware Recommender Systems: A Novel Approach Based on Matrix Factorization and Contextual Bias

Dynamic Context Management in Context-Aware Recommender Systems.

On Context-Dependent Clustering of Bandits.

BehavDT: A Behavioral Decision Tree Learning to Build User-Centric Context-Aware Predictive Model

Graph Clustering Bandits for Recommendation.

contextual: Evaluating Contextual Multi-Armed Bandit Problems in R

Contextual Dependent Click Bandit Algorithm For Web Recommendation

Causal Feature Selection Method for Contextual Multi-Armed Bandits in Recommender System