Semantic Mapping of Events

Fabio Casati,Weimin Du,Ming-chien Shan

1997-01-01

Abstract:abstraction. opportunities offered by such environments, and define a framework that enables a semantic mapping of events, i. e., enables the processing and successive refinement of events at different levels of

What problem does this paper attempt to address?

Using semantic technology to enhance ESB capabilities

Guiyang Jin,Fuzai Lv,Zhanqin Xiang

DOI: https://doi.org/10.4028/www.scientific.net/AMR.849.298

2014-01-01

Advanced Materials Research

Abstract:Modem enterprises consist of complex business systems. These systems need to be integrated to support enterprises operation. The SOA and ESB become an important enterprise integration architecture style for designing and implementing integration systems. But there are some limitations of today's ESB framework, such as only syntactic description of service interface, inability to perform semantic mediation and incapable process knowledge management. Therefore developers need deep and intimate knowledge to develop integration systems. We introduce an ontology-based semantic annotation approach to enrich and reconcile semantics of data, services and process models on ESB that enables data, service and process models interoperability on the semantic level through common domain ontologies.
An Ontology Mapping Architecture To Facilitate Semantic Integration

Yingzi Wang,Deren Chen,Yanyun Wang

DOI: https://doi.org/10.5220/0001264301340140

2007-01-01

Abstract:Mapping between ontologies is the major bottleneck in semantic integration. In this paper, we present MCMA, a mediator-centric mapping architecture that facilitates the integration between ontologies of interrelated companies. In MCMA, different ontologies are mapped through some middle concepts and the Mapping Service acts as a bridge to connect them. As a mediator, the provider of Mapping Service is interested in a specific area and offers some common ontologies for participators to reuse. On the assumption that each individual ontology may reuse or make reference to common definitions, some mapping relations can be defined conveniently. Based on these basic mapping relations, the Mapping Service infers more middle-concept oriented mapping relations and organizes them in a layered manner. We present the idea of combining heuristics or machine-learning techniques with common ontology approach in the mapping discovery.
A Semantic Mapping System for Bridging the Gap between Relational Database and Semantic Web

Linhua Zhou,Huajun Chen,Chunying Zhou,Zhang Yu

2008-01-01

Abstract:Recently, there has been a growing need for integrating legacy relational databases with semantic web ontologies, however, experience in building such applications has re- vealed a gap between semantic web languages and relational data model. We present a formal mapping system to bridge the gap and study the problem of reasoning and query answer- ing using view underlying the mapping system. Particularly, we consider a special mapping called "constraint mapping" between database integrity constraints and OWL axioms. We then propose an approach to incorporating these OWL ax- ioms and description logic reasoning into query rewriting us- ing views to enable the algorithm to answer more types of queries. The approach has been used to develop a pilot data integration application for neuroscience community.
A Unified Semantics Space Model

Juan Ye,Lorcan Coyle,Simon Dobson,Paddy Nixon

DOI: https://doi.org/10.1007/978-3-540-75160-1_7

2007-01-01

Abstract:Location-aware systems provide customised services or applications according to users' locations. While much research has been carried out in developing models to represent location information and spatial relationships, it is usually limited to modelling simple environments (cf. [ 13,19,3]). This paper proposes a unified space model for more complex environments (e.g., city plan or forest). This space model provides a flexible, expressive, and powerful spatial representation. It also proposes a new data structure - an integrated lattice and graph model - to express comprehensive spatial relationships. This structure not only provides multiple graphs at different abstraction levels, but it also collapses the whole map into smaller local graphs. This mechanism is beneficial in reducing the complexity of creating and maintaining a map and improving the efficiency of path finding algorithms.
Semantic mapping with multi-agent systems

Li Li,Baolin Wu,Yun Yang

DOI: https://doi.org/10.1109/EEE.2005.116

2005-01-01

Abstract:This paper introduces a multi-agent system (MAS) architecture and a relevant algorithm for multiple agents to manage and deploy ontologies in a dynamic environment. Firstly, an ontology description is given followed by a three level conceptual model which shows the background of our work. Then a MAS architecture is presented. Finally, we demonstrate how this approach enables ontology evolution and integration by using the JADE platform.
Object-aware Semantic Mapping of Indoor Scenes Using Octomap

Kaijian Liu,Zhen Fan,Meiqin Liu,Senlin Zhang

DOI: https://doi.org/10.23919/chicc.2019.8865848

2019-01-01

Abstract:In order to enable robots to provide high-level services in complex indoor environments, it is necessary to improve the robots' ability to cognize the environments. Most of the existing research is focused on indoor 3D reconstruction and semantic segmentation without the organization and maintenance of object recognition results. In this paper, we present an approach to build a 3D semantic map that includes both voxel-based geometrical demonstrations and object-aware entities with the combination of Simultaneous Localization and Mapping (SLAM) and Mask Region-based Convolutional Network (Mask R-CNN). An extended seeded region growing algorithm is designed for 3D segmentation refinement, and an octree-based framework octomap is used to present 3D map in replacement of point cloud map. We present experiments in a simulated home environment and the experimental results verify the accuracy and efficiency of our method.
Mapping High-level Semantic Regions in Indoor Environments without Object Recognition

Roberto Bigazzi,Lorenzo Baraldi,Shreyas Kousik,Rita Cucchiara,Marco Pavone

2024-03-12

Abstract:Robots require a semantic understanding of their surroundings to operate in an efficient and explainable way in human environments. In the literature, there has been an extensive focus on object labeling and exhaustive scene graph generation; less effort has been focused on the task of purely identifying and mapping large semantic regions. The present work proposes a method for semantic region mapping via embodied navigation in indoor environments, generating a high-level representation of the knowledge of the agent. To enable region identification, the method uses a vision-to-language model to provide scene information for mapping. By projecting egocentric scene understanding into the global frame, the proposed method generates a semantic map as a distribution over possible region labels at each location. This mapping procedure is paired with a trained navigation policy to enable autonomous map generation. The proposed method significantly outperforms a variety of baselines, including an object-based system and a pretrained scene classifier, in experiments in a photorealistic simulator.

Computer Vision and Pattern Recognition,Robotics
SeMap: A Concept for the Visualization of Semantics as Maps

Kawa Nazemi,Matthias Breyer,Christoph Hornung

DOI: https://doi.org/10.1007/978-3-642-02713-0_9

2009-01-01

Abstract:The enhancement of the individual knowledge is a basic need that came up with changes in our society, whereas the process of learning disappears more and more. In the recent past the disappearance of a predefined learning process was named ambient learning, which came up to cope the changing need of every time and everywhere learning. Learning contents get more structure by new technologies like semantics, which specifies and defines more the semantic structure and with it the meaning of information. Users working with information system are confronted with different processes for getting the required information. The following paper introduces a new visualization technique, which uses the everyday processes of information search for imparting knowledge. The visualization technique utilizes the surplus of semantics to encourage the process of ambient learning.
IntelliMove: Enhancing Robotic Planning with Semantic Mapping

Fama Ngom,Huaxi Zhang,Lei Zhang,Karen Godary-Dejean,Marianne Huchard

2024-10-19

Abstract:Semantic navigation enables robots to understand their environments beyond basic geometry, allowing them to reason about objects, their functions, and their interrelationships. In semantic robotic navigation, creating accurate and semantically enriched maps is fundamental. Planning based on semantic maps not only enhances the robot's planning efficiency and computational speed but also makes the planning more meaningful, supporting a broader range of semantic tasks. In this paper, we introduce two core modules of IntelliMove: IntelliMap, a generic hierarchical semantic topometric map framework developed through an analysis of current technologies strengths and weaknesses, and Semantic Planning, which utilizes the semantic maps from IntelliMap. We showcase use cases that highlight IntelliMove's adaptability and effectiveness. Through experiments in simulated environments, we further demonstrate IntelliMove's capability in semantic navigation.

Robotics
Browser-based Semantic Mapping Tool for Linked Data in Semantic Web.

Chunying Zhou,Chengli Xu,Huajun Chen,Kingsley Idehen

2008-01-01

Abstract:With the ever growing need of semantically linking data across different domain, organizational and diplomacy boundaries using RDF and OWL, one of the major obstacles impeding the advancement of Semantic Web is the data availability. This paper presents a browser-based semantic mapping tool for converting linked data on the Web to be available for Semantic Web applications. It is aiming at helping users define semantic mapping from relational databases to RDF schemas. This tool provides much easy-to-use functionality to facilitate users in this definition work, such as drag-and-drop mapping, visualization mapping, data source annotation, database server independent, standard mapping language and shared ontology management.
Lifelong update of semantic maps in dynamic environments

Manjunath Narayana,Andreas Kolling,Lucio Nardelli,Phil Fong

DOI: https://doi.org/10.48550/arXiv.2010.08846

2020-10-18

Abstract:A robot understands its world through the raw information it senses from its surroundings. This raw information is not suitable as a shared representation between the robot and its user. A semantic map, containing high-level information that both the robot and user understand, is better suited to be a shared representation. We use the semantic map as the user-facing interface on our fleet of floor-cleaning robots. Jitter in the robot's sensed raw map, dynamic objects in the environment, and exploration of new space by the robot are common challenges for robots. Solving these challenges effectively in the context of semantic maps is key to enabling semantic maps for lifelong mapping. First, as a robot senses new changes and alters its raw map in successive runs, the semantics must be updated appropriately. We update the map using a spatial transfer of semantics. Second, it is important to keep semantics and their relative constraints consistent even in the presence of dynamic objects. Inconsistencies are automatically determined and resolved through the introduction of a map layer of meta-semantics. Finally, a discovery phase allows the semantic map to be updated with new semantics whenever the robot uncovers new information. Deployed commercially on thousands of floor-cleaning robots in real homes, our user-facing semantic maps provide a intuitive user experience through a lifelong mapping robot.

Robotics,Artificial Intelligence
Semantic Space: an Infrastructure for Smart Spaces

XH Wang,JS Dong,CY Chin,SR Hettiarachchi,DQ Zhang

DOI: https://doi.org/10.1109/mprv.2004.1321026

IF: 1.603

2004-01-01

IEEE Pervasive Computing

Abstract:Semantic Space is a pervasive computing infrastructure that exploits semantic Web technologies to support explicit representation, expressive querying, and flexible reasoning of contexts in smart spaces.
Online Knowledge Integration for 3D Semantic Mapping: A Survey

Felix Igelbrink,Marian Renz,Martin Günther,Piper Powell,Lennart Niecksch,Oscar Lima,Martin Atzmueller,Joachim Hertzberg

2024-11-27

Abstract:Semantic mapping is a key component of robots operating in and interacting with objects in structured environments. Traditionally, geometric and knowledge representations within a semantic map have only been loosely integrated. However, recent advances in deep learning now allow full integration of prior knowledge, represented as knowledge graphs or language concepts, into sensor data processing and semantic mapping pipelines. Semantic scene graphs and language models enable modern semantic mapping approaches to incorporate graph-based prior knowledge or to leverage the rich information in human language both during and after the mapping process. This has sparked substantial advances in semantic mapping, leading to previously impossible novel applications. This survey reviews these recent developments comprehensively, with a focus on online integration of knowledge into semantic mapping. We specifically focus on methods using semantic scene graphs for integrating symbolic prior knowledge and language models for respective capture of implicit common-sense knowledge and natural language concepts

Robotics,Computer Vision and Pattern Recognition,Machine Learning
The Semantic Mapping of Words and Co-Words in Contexts

Loet Leydesdorff,Kasper Welbers

DOI: https://doi.org/10.1016/j.joi.2011.01.008

IF: 3.7

2011-01-01

Journal of Informetrics

Abstract:Meaning can be generated when information is related at a systemic level.Such a system can be an observer, but also a discourse, for example,operationalized as a set of documents. The measurement of semantics assimilarity in patterns (correlations) and latent variables (factor analysis)has been enhanced by computer techniques and the use of statistics; forexample, in "Latent Semantic Analysis". This communication provides anintroduction, an example, pointers to relevant software, and summarizes thechoices that can be made by the analyst. Visualization ("semantic mapping") isthus made more accessible.
Semantic Abstraction: Open-World 3D Scene Understanding from 2D Vision-Language Models

Huy Ha,Shuran Song

DOI: https://doi.org/10.48550/arXiv.2207.11514

2022-07-23

Computer Vision and Pattern Recognition

Abstract:We study open-world 3D scene understanding, a family of tasks that require agents to reason about their 3D environment with an open-set vocabulary and out-of-domain visual inputs - a critical skill for robots to operate in the unstructured 3D world. Towards this end, we propose Semantic Abstraction (SemAbs), a framework that equips 2D Vision-Language Models (VLMs) with new 3D spatial capabilities, while maintaining their zero-shot robustness. We achieve this abstraction using relevancy maps extracted from CLIP, and learn 3D spatial and geometric reasoning skills on top of those abstractions in a semantic-agnostic manner. We demonstrate the usefulness of SemAbs on two open-world 3D scene understanding tasks: 1) completing partially observed objects and 2) localizing hidden objects from language descriptions. Experiments show that SemAbs can generalize to novel vocabulary, materials/lighting, classes, and domains (i.e., real-world scans) from training on limited 3D synthetic data. Code and data is available at https://semantic-abstraction.cs.columbia.edu/
Language-guided Semantic Mapping and Mobile Manipulation in Partially Observable Environments

Siddharth Patki,Ethan Fahnestock,Thomas M. Howard,Matthew R. Walter

DOI: https://doi.org/10.48550/arXiv.1910.10034

IF: 3.7

2019-10-22

Robotics

Abstract:Recent advances in data-driven models for grounded language understanding have enabled robots to interpret increasingly complex instructions. Two fundamental limitations of these methods are that most require a full model of the environment to be known a priori, and they attempt to reason over a world representation that is flat and unnecessarily detailed, which limits scalability. Recent semantic mapping methods address partial observability by exploiting language as a sensor to infer a distribution over topological, metric and semantic properties of the environment. However, maintaining a distribution over highly detailed maps that can support grounding of diverse instructions is computationally expensive and hinders real-time human-robot collaboration. We propose a novel framework that learns to adapt perception according to the task in order to maintain compact distributions over semantic maps. Experiments with a mobile manipulator demonstrate more efficient instruction following in a priori unknown environments.
On the consistency of event processing: A semantic approach.

Meng Ma,Ping Wang

DOI: https://doi.org/10.1016/j.knosys.2017.08.021

IF: 8.139

2017-01-01

Knowledge-Based Systems

Abstract:Event processing is one of the cornerstone technologies in bridging physical world and cyber system together. Although event-based processing system has been widely used in various applications, however, consistency of event processing is still an open issue need further exploration. The inconsistency problem produces inaccurate detection result and corrupts the system correctness. In this paper, we propose a semantic approach for event modeling and detection model transformation with a semantic calculus system. Particularly, we first propose a complex event semantic model, OntoEvent, and define several key operators and properties to describe the logic, temporal and attribute relations in complex events. Second, we propose the concept of event constraint and elaborate the occurrence, temporal, and attribute functions to formalize the semantic implications in OntoEvent model. On that basis, we present the extraction rules and establish a calculus mechanism for constraints based on axioms. With these works, an automata-based detection model, named OntoCEP (Ontology-based Complex Event Detection), and a pipelined procedure for the assembly from constraints to OntoCEP model is proposed. The procedure is composed of several sequential phases and the consistency in each assembly phase is proved. Therefore, we establish a semantic-consistent mapping mechanism from event to detection model in the form of constraints. Experiments and evaluations prove that our approach ensure the consistency with event and detection models. Besides, our detection model consumes less computational resources and outperforms other selected benchmarked models in terms of computational efficiency and processing capability.
Semantic Map Construction Method Based on Brain-Inspired SLAM

Fengzhen Tang,Hangpiao Zhao

DOI: https://doi.org/10.1109/CYBER63482.2024.10749279

2024-07-16

Abstract:Simultaneous localization and mapping (SLAM) is one of the core techniques for robots to move autonomously in unknown environments. Rat-SLAM, inspired by the navigation mechanism of the animal brain, provided nice performance in many environments. However, the experience map constructed by RatSLAM excluded semantic information, which is considered to play an important role in human environmental cognition and spatial navigation. In this paper, we propose a method to construct semantic experience map, combining the state-of-the-art deep neural network and RatSLAM. In our method, YOLOv5 is utilized to extract semantic information from the environmental images. The information of static objects, such as road signs, is selected to be incorporated into the experience map, being more closely to the brain navigation. To avoid the same object being repeatedly marked, we propose a semantic dynamic island mechanism, which only marks the center of the island in the experience map. The proposed method is verified on KITTI datasets, showing that it can successfully realize the construction of semantic experience map. The semantic experience maps are more intuitive and understandable by human, facilitating human-robot interaction, i. e. helping robots to fulfil more complex tasks for human.

Computer Science
An Approach for Construct Semantic Map with Scene Classification and Object Semantic Segmentation

Peng Wang,Jun Cheng,Wei Feng

DOI: https://doi.org/10.1109/rcar.2018.8621769

2018-01-01

Abstract:The autonomous navigation system of human beings is more efficient than artificial intelligence technologies, as prior knowledge such as semantic information of the objects and environment is effectively utilized by humans in complicated tasks. Therefore, the ability to build a complete and efficient semantic map system is critical for robot autonomous navigation. In this article, we propose a new framework for building an environment semantic map. Specifically, we construct a 2D semantic map by projecting 3D scene semantic information recognized by convolutional neural network onto a 2D plane. 3D reconstruction of the environment is achieved by RGB-D SLAM 3D space mapping algorithm. We simplify the 3D clustering connectability, using only three cues, to achieve real-time boundary-aware detection of foreground objects. The network trained on the public benchmark dataset is employed to classify the material of the foreground extraction object. Experimental results have demonstrated that the proposed framework is effective in the contraction of semantic map and can be efficiently utilized in the real-time semantic slam system.
Implementation of a Semantic Integrated Framework

YANG Yang,YUE Li-hua,HAN Kai,WANG Qiang

DOI: https://doi.org/10.3969/j.issn.0253-2778.2006.02.016

2006-01-01

Journal of University of Science and Technology of China

Abstract:An ontology-based data integration framework was proposed,that may help solve the problem by decomposing the local schemata,matching them and constructing ontology and the mapping rules between it and local schemata rewritten from DTD path-to-path mapping algorithm.

Semantic Mapping of Events

Using semantic technology to enhance ESB capabilities

An Ontology Mapping Architecture To Facilitate Semantic Integration

A Semantic Mapping System for Bridging the Gap between Relational Database and Semantic Web

A Unified Semantics Space Model

Semantic mapping with multi-agent systems

Object-aware Semantic Mapping of Indoor Scenes Using Octomap

Mapping High-level Semantic Regions in Indoor Environments without Object Recognition

SeMap: A Concept for the Visualization of Semantics as Maps

IntelliMove: Enhancing Robotic Planning with Semantic Mapping

Browser-based Semantic Mapping Tool for Linked Data in Semantic Web.

Lifelong update of semantic maps in dynamic environments

Semantic Space: an Infrastructure for Smart Spaces

Online Knowledge Integration for 3D Semantic Mapping: A Survey

The Semantic Mapping of Words and Co-Words in Contexts

Semantic Abstraction: Open-World 3D Scene Understanding from 2D Vision-Language Models

Language-guided Semantic Mapping and Mobile Manipulation in Partially Observable Environments

On the consistency of event processing: A semantic approach.

Semantic Map Construction Method Based on Brain-Inspired SLAM

An Approach for Construct Semantic Map with Scene Classification and Object Semantic Segmentation

Implementation of a Semantic Integrated Framework