Abstract:The recent advancements in artificial intelligence have brought about significant changes in education. In the context of intelligent campus development, target detection technology plays a pivotal role in applications such as campus environment monitoring and the facilitation of classroom behavior surveillance. However, traditional object detection methods face challenges in open and dynamic campus scenarios where unexpected objects and behaviors arise. Open-World Object Detection (OWOD) addresses this issue by enabling detectors to gradually learn and recognize unknown objects. Nevertheless, existing OWOD methods introduce two major uncertainties that limit the detection performance: the unknown discovery uncertainty from the manual generation of pseudo-labels for unknown objects and the known discrimination uncertainty from perturbations that unknown training introduces to the known class features. In this paper, we introduce a Parallel OWOD Framework with Uncertainty Mitigation to alleviate the unknown discovery uncertainty and the known discrimination uncertainty within the OWOD task. To address the unknown discovery uncertainty, we propose an objectness-driven discovery module to focus on capturing the generalized objectness shared among various known classes, driving the framework to discover more potential objects that are distinct from the background, including unknown objects. To mitigate the discrimination uncertainty, we decouple the learning processes for known and unknown classes through a parallel structure to reduce the mutual influence at the feature level and design a collaborative open-world classifier to achieve high-performance collaborative detection of both known and unknown classes. Our framework provides educators with a powerful tool for effective campus monitoring and classroom management. Experimental results on standard benchmarks demonstrate the framework’s superior performance compared to state-of-the-art methods, showcasing its transformative potential in intelligent educational environments.

Two-branch Objectness-centric Open World Detection

KTCN: Enhancing Open-World Object Detection with Knowledge Transfer and Class-Awareness Neutralization

Exploring Orthogonality in Open World Object Detection

Revisiting Open World Object Detection.

Redefining Object Detection for Open-World Settings: A Framework for Simultaneous Identification of Known and Unknown Classes

A Parallel Open-World Object Detection Framework with Uncertainty Mitigation for Campus Monitoring

Detecting the open-world objects with the help of the Brain

Rethinking Open-World Object Detection in Autonomous Driving Scenarios

Open World DETR: Transformer based Open World Object Detection

Open-world object detection: A solution based on reselection mechanism and feature disentanglement

Open World Object Detection: A Survey

Object Detectors in the Open Environment: Challenges, Solutions, and Outlook

Unsupervised Recognition of Unknown Objects for Open-World Object Detection

From Open Vocabulary to Open World: Teaching Vision Language Models to Detect Novel Objects

Open-Set Object Detection Using Classification-free Object Proposal and Instance-level Contrastive Learning

UC-OWOD: Unknown-Classified Open World Object Detection

Detecting Everything in the Open World: Towards Universal Object Detection

Addressing the Challenges of Open-World Object Detection

Object2Scene: Putting Objects in Context for Open-Vocabulary 3D Detection

Text-Guided Unknown Pseudo-Labeling for Open-World Object Detection

Semi-Open Set Object Detection Algorithm Leveraged by Multi-Modal Large Language Models