The Video Transmission Scenario Based on Awareness in the Virtual Space Teleconference

李凌,田淑珍,孙立峰,钟玉琢

DOI: https://doi.org/10.3969/j.issn.1001-3695.2004.04.074

2004-01-01

Abstract:In this paper, we propose the video transmission scenario based on awareness in the Virtual Space Teleconference (VST).

What problem does this paper attempt to address?

VISION SPACE SYNTHESIZE OF VIRTUAL SPACE TELECONFERENCING SYSTEM

齐越,张茂军,孙立峰,胡晓峰,杨冰

DOI: https://doi.org/10.3969/j.issn.1000-1220.2001.02.008

2001-01-01

Abstract:Virtual Space Teleconferencing System is based on videoteleconferencing system. Participants appear in computer generated virtual space as avatars, and these avatars can locate, view, manipulate virtual objects, communicate with others face to face in this space, so participants could share“the same space" and do cooperative work. This paper introduces the concept of VST space, the method of synthesizing vision space, and our VST system VST-1.
Awareness scheduling and algorithm implementation for collaborative virtual environment

Yu Sheng,Dongming Lu,Yifeng Hu,Qingshu Yuan

DOI: https://doi.org/10.1007/11424758_102

2005-01-01

Abstract:The limitation of network resource reduces the awareness capability of CVE system, which becomes the main bottleneck for applications in Internet. In this paper, we study the relationship between the awareness capability of system and network parameters, such as latency, jitter, and data loss rate; also, according to the features and preferences of user awareness, a network-status-based solution is proposed for self-adaptable awareness scheduling. Moreover, the scheduling algorithm is implemented and verified by a prototype system, results from which indicate that awareness scheduling is useful for decreasing the loss of the awareness capability of system in a limited or unstable network.
Awareness-Driven Media Stream Transmitting Framework of Virtual Tele-Conferencing

LF Sun,YZ Zhong,YH Ji

DOI: https://doi.org/10.1109/tencon.2002.1180253

2002-01-01

Abstract:In this paper, we propose. an awareness-driven media stream transmitting framework of virtual tele-conferencing. First we introduce a space model of awareness and Interaction, which define the awareness and interaction between objects and determine the media streams transmitting at run time. Based on the space model of awareness, we design a multicast middleware above the socket layer; participants of a multicast session are connected via a virtual multicast tree that consists of unicast connections between end hosts where the cost of each link is the awareness degree between sender and receiver. According to different awareness degree, different type of data such as status, live audio and video will be transmitted to different objects composing dynamic multicast group. This framework supports flexible dynamic multicast, which effectively reduces the total bandwidth and has high scalability for system extension.
Communication Model for Internet-Oriented 2.5D Virtual Environments

LU Dong-Ming,ZHONG Ming-Yu,YUAN Qing-Shu,HU Yi-Feng

DOI: https://doi.org/10.3969/j.issn.1002-137X.2005.07.005

2005-01-01

Computer Science

Abstract:Computer Supported Collaboration has not only changed the way people work, but also the way people live, the way people entertain and the way people get education. The development of the Internet provides digital en tertainments and distant-learning with a good network environment and in these applications, 2.5D virtual environ ments are widely used due to their good performances and the sense of realism. But the Internet's inherent problem of latency affects the real-time feature of the virtual envirorunents, in particular multi-server ones. Based on traditional multi-server communication models, a new multi-server one is brought out which extended the region managed by each server. The model was adopted in Zhejiang Tourism Expo'2003, and achieved a great success.
The Design and Research of Video Conference System Based on H.323 Protocol

喻飞,朱淼良,何晶,安吉尧

DOI: https://doi.org/10.3969/j.issn.1673-4866.2003.12.023

2004-01-01

Abstract:Recently combining multimedia computer with communication technology go into a new fringe technology, which is multimedia communication technology. The paper introduce the development and construction of video conference system in the world. Meanwhile we designe video conference system on IP with the background of education office in hunan.
An Effective Communication Architecture for Collaborative Virtual Systems

L Chen,XL Xu,GC Chen,C Chen

DOI: https://doi.org/10.1109/icct.2003.1209833

2003-01-01

Abstract:In collaborative virtual environment (CVE) systems, participants can freely join and share a virtual environment and do some collaborative works synchronously. And network communication architecture is very important for CVE systems to realize scalability, minimized delay and reliability. In this paper, the communication of CVE systems is categorized in three types: state update, command and event. Furthermore, this paper introduces the collaboration requests and interactive stream in CVE systems. Based on these introductions, a communication architecture for collaborative virtual environment systems is described. This architecture uses updatable queue abstraction in application layer to do message obsolescence and uses interactive stream transport protocol in transport layer to achieve efficient transmission of messages among a large number of participants.
Stereo Camera System and Its Application in Networked Virtual Environment

L Chen,MH Tian,GC Chen,C Chen

DOI: https://doi.org/10.1109/icmlc.2002.1176744

2002-01-01

Abstract:With the appearance of different kinds of networked virtual environment systems, the technology of realistic video avatar has become a hotspot of research. How to create realistic video avatar with less hardware investment and limited computation is one of the purposes of these researches. We introduce a method that combines a single stereo camera system and a 3D head model to create a realistic video avatar. To create the video avatar's most important part-the face, we use a 2D image and a depth map, which is generated by the stereo camera system. The other parts of of the video avatar are created by mapping the head's texture to the 3D head model.
A Latency-Adaptive Communication Architecture for Inter-Networked Virtual Environments

QS Yuan,DM Lu

DOI: https://doi.org/10.1109/icsmc.2004.1401388

2004-01-01

Abstract:With the availability of broadband Internet access, networked virtual environment (NVE) is ready for deployment over the Internet. Of existing NVE communication architectures, the most suitable one for inter-networked VE is client/server architecture with multi-server. However under this architecture each client connects with only one server, so when a client migrates from one server to another, it should disconnect with the previous server and make connection to another server. Because of the Internet's inherent latency problem, there would be an abrupt appearance in other clients' view due to it. To avoid this abrupt appearance, the paper bright out a new NVE's communication architecture in which each client connects with other server(s) in advance according to prediction. The new architecture was adopted by Tourism Expo '2003 of Zhejiang Province, and achieved a great success.
Virtual Reality Based Immersive Telepresence System for Remote Conversation and Collaboration.

Zhipeng Tan,Yuning Hu,Kun Xu

DOI: https://doi.org/10.1007/978-3-319-69487-0_17

2017-01-01

Abstract:We developed a Virtual Reality (VR) based telepresence system providing novel immersive experience for remote conversation and collaboration. By wearing VR headsets, all the participants can be gathered into a same virtual space, with 3D cartoon Avatars representing them. The 3D VR Avatars can realistically emulate the head postures, facial expressions and hand motions of the participants, enabling them to conduct enjoyable group-to-group conversations with people spatially isolated from them. Moreover, our VR telepresence system offers conspicuously new manners for remote collaboration. For example, users can play PPT slides or watch videos together, or they can cooperate on solving a math problem by calculating on a virtual blackboard, all of which can be hardly achieved using conventional video-based telepresence system. Experiments show that our system can provide unprecedented immersive experience for tele-conversation and new possibilities for remote collaboration.
Design and Implementation of Two Immersive Audio and Video Communication Systems Based on Virtual Reality

Hanqi Zhang,Jing Wang,Zhuoran Li,Jingxin Li

DOI: https://doi.org/10.3390/electronics12051134

IF: 2.9

2023-02-27

Electronics

Abstract:Due to the impact of the COVID-19 pandemic in recent years, remote communication has become increasingly common, which has also spawned many online solutions. Compared with an in-person scenario, the feeling of immersion and participation is lacking in these solutions, and the effect is thus not ideal. In this study, we focus on two typical virtual reality (VR) application scenarios with immersive audio and video experience: VR conferencing and panoramic live broadcast. We begin by introducing the core principles of traditional video conferencing, followed by the existing research results of VR conferencing along with the similarities, differences, pros, and cons of each solution. Then, we outline our view about what elements a virtual conferencing room should have. After that, a simple implementation scheme for VR conferencing is provided. Regarding panoramic video, we introduce the steps to produce and transmit a panoramic live broadcast and analyze several current mainstream encoding optimization schemes. By comparing traditional video streams, the various development bottlenecks of panoramic live broadcast are identified and summarized. A simple implementation of a panoramic live broadcast is presented in this paper. To conclude, the main points are illustrated along with the possible future directions of the two systems. The simple implementation of two immersive systems provides a research and application reference for VR audio and video transmission, which can guide subsequent relevant research studies.

engineering, electrical & electronic,computer science, information systems,physics, applied
NOMA based VR Video Transmissions Exploiting User Behavioral Coherence

Ping Xiang,Hangguan Shan,Zhaoyang Zhang,Lu Yu,Tony Q. S. Quek

DOI: https://doi.org/10.1109/wcnc45663.2020.9120553

2020-01-01

Abstract:In this work, we study the cooperative and noncooperative transmission schemes design for live VR video broadcast scenarios by utilizing non-orthogonal multiple access (NOMA), considering that users' viewports partly overlap due to behavioral coherence. To characterize the performance of the proposed cooperative and non-cooperative transmission schemes, the exact and asymptotic expressions of outage probability, as well as the average outage capacity under imperfect successive interference cancellation (SIC), are derived, respectively. Based on the asymptotic outage probability results, we optimize the power allocation to maximize the average outage capacity of the proposed schemes. Finally, simulation results demonstrate that both of the proposed schemes can achieve a considerable performance gain over the traditional orthogonal multiple access (OMA) scheme in average outage capacity, and each of the proposed schemes has its advantages and applicable scenarios.
Real-time stereoscopic rendering of realistic avatar for interactive 3D telepresence system

Yanbin Wang,Eng Tat Khoo

DOI: https://doi.org/10.1109/icivc.2017.7984621

2017-06-01

Abstract:Digital communication technology has been developed for many years, but the communication forms are still limited to text, instant message, audio and video chat, etc. With the rapid development of new media technology, especially when the virtual reality technology comes to the public domain, it becomes possible to provide people from different locations with the face-to-face communication experience or even with the collaboration and interaction in the shared virtual environment. In this paper, we propose a solution of stereoscopic 3D rendering of the avatar in a telepresence system based on the latest virtual reality technologies. Two CAVE-like systems at different locations are connected through the network. The head position of the local user is tracked and sent to the remote server to reconstruct the 3D model of the remote user and render the stereo images, which are sent back to the local graphic workstations and rendered on a billboard together with the 3D environment. Therefore the holographic effect can be observed when the local user is moving around. The proposed solution has been tested and applied in an “experience of future communications” project. Together with the virtual reality system, it provides the users with not only the face-to-face but also the being-there experience.
Video Transmission over Cognitive Radio Networks

Jingfang Huang,Zhaoyang Zhang,Honggang Wang,Hong Liu

DOI: https://doi.org/10.1109/glocomw.2011.6162543

2011-01-01

Abstract:Distributed Video Coding (DVC) techniques utilize source statistics and dependencies among video frames in either spatial or time domain to compress the video and improve the error resilience. DVC promises great potentials for wireless video applications due to its advantages of using simple encoders. However, transmitting large size video stream consumes much network resource and still remains a challenging problem in terms of the resource efficiency. Recently, Cognitive Radio (CR) networks have been investigated to improve the bandwidth utilization through efficient channel allocations. Joint design of DVC and resource allocation in CR networks can provide a better solution to improve both resource efficiency and Quality of Service (QoS) performance of video transmissions. In this paper, we propose an efficient joint design scheme in which the interdependencies between cognitive radio resource management and the application-level characteristics of video traffic are jointly considered. Our studies show that the proposed scheme can significantly improve video transmission performance over CR networks.
Stochastic Resource Allocation for Semantic Communication-aided Virtual Transportation Networks in the Metaverse

Wei Chong Ng,Hongyang Du,Wei Yang Bryan Lim,Zehui Xiong,Dusit Niyato,Chunyan Miao

DOI: https://doi.org/10.48550/arXiv.2208.14661

2022-08-31

Abstract:The physical-virtual world synchronization to develop the Metaverse will require a massive transmission and exchange of data. In this paper, we introduce semantic communication for the development of virtual transportation networks in the Metaverse. Leveraging the perception capabilities of edge devices, virtual service providers (VSPs) can subscribe to their preferred edge devices to receive the semantic data of interest. However, the demands of the VSPs are highly dependent on the users that they are serving. To address the resource allocation problem amid stochastic user demand, we propose a stochastic semantic transmission scheme (SSTS) based on two-stage stochastic integer programming. Using real data captured by edge devices we deploy in Singapore, the simulation results show that SSTS can minimize the transmission cost of the VSPs while accounting for the users' demand uncertainties.

Computer Science and Game Theory
Natural Interaction Synthesizing in Virtual Teleconferencing

LF Sun,YZ Zhong,Z Zhong

DOI: https://doi.org/10.1109/icip.2002.1039973

2002-01-01

Abstract:The virtual teleconferencing system provides a collaborative virtual environment for applications such as collaborative seminar. The challenge of the natural interaction is for the participants to be aware of the virtual environment. A video avatar is a computer-synthesized three-dimension image created using live video. We study the factors contributing to the participant's natural interaction and introduce a video avatar based participant model to implement the natural, accurate and convenient interaction among participants. Our virtual teleconferencing prototype provides a seamless virtual collaboration work environment including eye contacts and gaze awareness. Our experiments on a three parties collaborative seminar show that natural interaction synthesizing can significantly improve the communication and that natural multi-model human computer interaction is necessary in collaboration.
Exploring Awareness in Virtual Learning Team

J. Leon Zhao,Lele Kang,Shaokun Fan

2013-01-01

Abstract:Current higher education has progress from face-to-face teaching to have students proactively engage in the virtual learning, where they need to rely on information systems to perform learning activities. Virtual learning teams enable students to collaboratively learn the courses. However, the effectiveness of virtual learning may be threatened by some problems of virtual teams, such as low trust, lack of motivation, and lack of shared mental model among members. This study tries to address the issues from the perspective of awareness. Based on Stimulus-Organism-Response model, we propose that virtual learning outcome is influenced by four types of awareness, namely awareness of peer presence, awareness of group structure, awareness of learning project progress, and awareness of advisor involvement. We further propose a set of system features to improve awareness, which will be used to validate the proposed theoretical model. We also discuss our plan to conduct a lab experiment to evaluate the proposed propositions.
ITEM: Immersive Telepresence for Entertainment and Meetings - A Practical Approach

Viet-Anh Nguyen,Jiangbo Lu,Shengkui Zhao,Tien Dung Vu,Hongsheng Yang,Jones L. Douglas,Minh N. Do

DOI: https://doi.org/10.1109/JSTSP.2014.2375819

2014-08-04

Abstract:This paper presents an Immersive Telepresence system for Entertainment and Meetings (ITEM). The system aims to provide a radically new video communication experience by seamlessly merging participants into the same virtual space to allow a natural interaction among them and shared collaborative contents. With the goal to make a scalable, flexible system for various business solutions as well as easily accessible by massive consumers, we address the challenges in the whole pipeline of media processing, communication, and displaying in our design and realization of such a system. Particularly, in this paper we focus on the system aspects that maximize the end-user experience, optimize the system and network resources, and enable various teleimmersive application scenarios. In addition, we also present a few key technologies, i.e. fast object-based video coding for real world data and spatialized audio capture and 3D sound localization for group teleconferencing. Our effort is to investigate and optimize the key system components and provide an efficient end-to-end optimization and integration by considering user needs and preferences. Extensive experiments show the developed system runs reliably and comfortably in real time with a minimal setup requirement (e.g. a webcam and/or a depth camera, an optional microphone array, a laptop/desktop connected to the public Internet) for teleimmersive communication. With such a really minimal deployment requirement, we present a variety of interesting applications and user experiences created by ITEM.

Multimedia
Virtual Reality Conferencing

Patrick David Pazour,Andreas Janecek,Helmut Hlavacs

DOI: https://doi.org/10.1109/AIVR.2018.00019

2018-01-01

Abstract:The development and availability of immersive VR devices has risen significantly in recent years. Combined with the latest milestones in computer graphics and the current motion tracking devices a certain feeling of presence inside the virtual world can be achieved which is aiming (or wishing) to be indistinguishable from the real world in the long term. Although this aspiration may be visionary at the present day, the possibilities of collaborative human interactions within a virtual reality system are already manifold. In this work we focus on the development and evaluation of a virtual reality conferencing application prototype supporting personalized user-based avatars for up to four persons joining remotely in a virtual conference room. The prototype has been evaluated in terms of the feeling of presence experienced inside the applications virtual environment when wearing a virtual reality headset and when using the application in desktop mode, respectively. The results of the conducted experiments indicate a positive impact on the feeling of presence by users wearing virtual reality headsets as compared to the group without headsets.
Audio-Visual Fused Online Context Analysis Toward Smart Meeting Room

Peng Dai,Linmi Tao,Guangyou Xu

DOI: https://doi.org/10.1007/978-3-540-73549-6_85

2007-01-01

Abstract:Context-aware systems incorporate multimodal information to analyze contextual information in users' environment and provide various proactive services according to dynamic context. In this paper, a novel online context analysis framework is proposed to support context-aware computing in smart meeting room. A novel dynamic context model is presented to model human group interactions. Robust audio and visual modules are integrated for the effective processing of multimodal signals from various sensors, based on which a multi-level dynamic context reasoning mechanism is adopted for the online understanding of group interactions in meeting scenarios. Experimental results show the effectiveness of our framework.
Semi-Videoconference System Using Real-Time Wireless Technologies.

Cheng Jin,Jiajun Bu,Chun Chen,Mingli Song,Mingyu You

DOI: https://doi.org/10.1007/11535409_40

2005-01-01

Abstract:We defined a novel system for wireless videoconferencing in this paper. Compared with normal videoconferencing systems, our approach does not need any visual inputs except a neutral image of the user. Our algorithm automatically calculates user expression features on conference server by corresponding voice audio input. These features are transmitted to end users' mobile sets and final expression synthesis can be done there. Since the large visual data is replaced by a small amount of feature data, a great quantity of data bandwidth can be saved, thus improving communication qualities under wireless conditions.

The Video Transmission Scenario Based on Awareness in the Virtual Space Teleconference

VISION SPACE SYNTHESIZE OF VIRTUAL SPACE TELECONFERENCING SYSTEM

Awareness scheduling and algorithm implementation for collaborative virtual environment

Awareness-Driven Media Stream Transmitting Framework of Virtual Tele-Conferencing

Communication Model for Internet-Oriented 2.5D Virtual Environments

The Design and Research of Video Conference System Based on H.323 Protocol

An Effective Communication Architecture for Collaborative Virtual Systems

Stereo Camera System and Its Application in Networked Virtual Environment

A Latency-Adaptive Communication Architecture for Inter-Networked Virtual Environments

Virtual Reality Based Immersive Telepresence System for Remote Conversation and Collaboration.

Design and Implementation of Two Immersive Audio and Video Communication Systems Based on Virtual Reality

NOMA based VR Video Transmissions Exploiting User Behavioral Coherence

Real-time stereoscopic rendering of realistic avatar for interactive 3D telepresence system

Video Transmission over Cognitive Radio Networks

Stochastic Resource Allocation for Semantic Communication-aided Virtual Transportation Networks in the Metaverse

Natural Interaction Synthesizing in Virtual Teleconferencing

Exploring Awareness in Virtual Learning Team

ITEM: Immersive Telepresence for Entertainment and Meetings - A Practical Approach

Virtual Reality Conferencing

Audio-Visual Fused Online Context Analysis Toward Smart Meeting Room

Semi-Videoconference System Using Real-Time Wireless Technologies.