The Human-Computer Dialogue Management of FCAD System

Zhang Fuyan,Cai Shijie,Wang Shu,Ge Ruding

DOI: https://doi.org/10.1007/bf02943347

IF: 1.871

1988-01-01

Journal of Computer Science and Technology

Abstract:This paper describes the dialogue management of FCAD’s user interface through introducing FCAD’s data-driven user interface model which eases the creation, modification, analyzing, and testing of it.

What problem does this paper attempt to address?

Design of a speech interaction system for man-machine confrontation

Zhenli Lu,Kai Tian,Huigang Xu,Cheng Zhang,Bin Li,Branislav Borovac,Jun Liu

DOI: https://doi.org/10.3772/j.issn.1002-0470.2017.05.010

2017-01-01

Abstract:A human-computer interaction system was designed by using the soccer robot game.Firstly, the related software was introduced briefly, and the speech recognition principle was analyzed;Secondly, the analysis of the speech synthesis technology and its implementation steps were performed,and according to robot soccers' actual needs in competition, a set of phonetic rules were designed;Thirdly, the experimental study on them was performed by using the Kinect software;Finally, many sets of data from different sounding objects were tested, and the testing results show that the designed speech interaction system is effective in voice instruction recognition and has the high recognition rate.The judge machine or team members in the system, can quickly and accurately identify and broadcast voice commands, showing that the system fully meets the needs of human-computer interaction in man-machine match.
An Event-Driven And Object-Oriented Framework For Human Computer Interface Of Cad System

Q Liu,W Lu,K Xiao,Jg Sun

1997-01-01

Abstract:This Paper describes a flexible framework for the construction of Human Computer interface (HCI) in CAD system. This framework is based on an event-driven and object-oriented model, which takes the interactive components as objects and converts user events into object messages, Considering the characteristics of CAD applications, we design an interface object model, a process control model and a communication model between user applications Therefore, this framework reduces the difficulty of application development and enhances the runtime efficiency.
An Architecture Of Adaptive Interface And Its Implementation

G Chen,G Wu,Jx Dong,Zj He

1997-01-01

Abstract:Most recently, attention has focused on adaptive interface in the human-computer interface domain. This paper presents an architecture of adaptive interface and its implementation. In this paper, we first introduce several fundamental concepts of adaptive interface, then an architecture of adaptive interface is designed based on the analysis of these concepts. The structure and technology of this architecture are discussed in detail. This architecture is applied to GS-ICCC, which is an integrated CAD/CAPP/CAM system. This paper also describes some details when implementing this architecture. The adaptive architecture of GS-ICCC has been implemented based on X-Window/Motif environments. It has proved to be highly efficient.
CHAT: a Conversational Helper for Automotive Tasks

Fuliang Weng,Sebastian Varges,Badri Raghunathan,Florin Ratiu,Heather Pon-Barry,Brian Lathrop,Qi Zhang,Harry Bratt,Tobias Scheideck,Kui Xu,Matthew Purver,Rohit Mishra,Annie Lien,M. Raya,S. Peters,Y. Meng,J. Russell,L. Cavedon,E. Shriberg,H. Schmidt,R. Prieto

DOI: https://doi.org/10.21437/interspeech.2006-159

2006-01-01

Abstract:Spoken dialogue interfaces, mostly command-and-control, become more visible in applications where attention needs to be shared with other tasks, such as driving a car. The deployment of the simple dialog systems, instead of more sophisticated ones, is partly because the computing platforms used for such tasks have been less powerful and partly because certain issues from these cognitively challenging tasks have not been well addressed even in the most advanced dialog systems. This paper reports the progress of our research effort in developing a robust, wide-coverage, and cognitive load-sensitive spoken dialog interface called CHAT: Conversational Helper for Automotive Tasks. Our research in the past few years has led to promising results, including high task completion rate, dialog efficiency, and improved user experience. Index Terms: dialog systems, cognitive load, robustness
User Behavior Fusion in Dialog Management with Multi-Modal History Cues

Minghao Yang,Jianhua Tao,Linlin Chao,Hao Li,Dawei Zhang,Hao Che,Tingli Gao,Bin Liu

DOI: https://doi.org/10.1007/s11042-014-2161-5

IF: 2.577

2014-01-01

Multimedia Tools and Applications

Abstract:It enhances user experience by making the talking avatar be sensitive to user behaviors in human computer interaction (HCI). In this study, we combine user's multi-modal behaviors with behaviors' historical information in dialog management (DM) to improve the avatar's sensitivity not only to user explicit behavior (speech command) but also to user supporting expression (emotion and gesture, etc.). In the dialog management, according to the different contributions of facial expression, gesture and head motion to speech comprehension, we divide the user's multi-modal behaviors into three categories: complementation, conflict and independence. The behavior categories could be first automatically obtained from a short-term and time-dynamic (STTD) fusion model with audio-visual input. Different behavior category leads to different avatar's response in later dialog turns. Usually, the conflict behavior reflects user's ambiguous intention (for example: user says "no" while he (her) is smiling). In this case, the trial-and-error schema is adopted to eliminate the conversation ambiguity. For the later dialog process, we divide all the avatar dialog states into four types: "Ask", "Answer", "Chat" and "Forget". With the detection of complementation and independence behaviors, the user supporting expression as well as his (her) explicit behavior could be estimated as triggers for topic maintenance or transfer among four dialog states. At the first section of experiments, we discuss the reliability of STTD model for user behavior classification. Based on the proposed dialog management and STTD model, we continue to construct a drive route information query system by connecting the user behavior sensitive dialog management (BSDM) to a 3D talking avatar. The practical conversation records of avatar with different users show that the BSDM makes the avatar be able to understand and be sensitive to the users' facial expressions, emotional voice and gesture, which improves user experience on multi-modal human computer conversation.
Human-computer interface development: concepts and systems for its management

H. Rex Hartson,Deborah Hix

DOI: https://doi.org/10.1145/62029.62031

IF: 16.6

1989-03-01

ACM Computing Surveys

Abstract:Human-computer interface management , from a computer science viewpoint, focuses on the process of developing quality human-computer interfaces, including their representation, design, implementation, execution, evaluation, and maintenance. This survey presents important concepts of interface management: dialogue independence, structural modeling, representation, interactive tools, rapid prototyping, development methodologies, and control structures. Dialogue independence is the keystone concept upon which all the other concepts depend. It is a characteristic that separates design of the interface from design of the computational component of an application system so that modifications in either tend not to cause changes in the other. The role of a dialogue developer, whose main purpose is to create quality interfaces, is a direct result of the dialogue independence concept. Structural models of the human-computer interface serve as frameworks for understanding the elements of interfaces and for guiding the dialogue developer in their construction. Representation of the human-computer interface is accomplished by a variety of notational schemes for describing the interface. Numerous kinds of interactive tools for human-computer interface development free the dialogue developer from much of the tedium of "coding" dialogue. The early ability to observe behavior of the interface—and indeed that of the whole application system—provided by rapid prototyping increases communication among system designers, implementers, evaluators, and end-users. Methodologies for interactive system development consider interface management to be an integral part of the overall development process and give emphasis to evaluation in the development life cycle. Finally, several types of control structures govern how sequencing among dialogue and computational components is designed and executed. Numerous systems for human-computer interface management are presented t o illustrate these concepts.

computer science, theory & methods
COLLABORATION WITH A MULTI-USER INTERFACE-CASE: PRODUCT DEVELOPMENT SIMULATION GAME

Markus ForstÃ,Ari Putkonen,Xiaobai Li

2009-01-01

Abstract:Paper Abstract: The purpose of this paper is to evaluate the design of a multi-user interface constructed for a product development simulation game. The utility and efficiency of the user interface design is demonstrated and evaluated. The majority of business management simulation games or methods do not support human face-to-face collaboration even though stakeholders play a significant role in the real product design processes. In this study, the multi-user interface was observed in terms of how collaboration evolved during the gaming session and how the multi-user interface supported the collaboration. The study was implemented with visual observation, by utilising the activity analysis and focusing on rolebased communication. The evolvement of collaboration indicated that the multi-user interface with its role-divided tasks lead participants to change and increase their patterns of communication during the …
Modification of product data for remote collaborative design

Caimao Su,Yinglin Ke

DOI: https://doi.org/10.1109/CACWD.2004.1349151

2004-01-01

Abstract:The complex contemporary design problems require collaborative solutions. The modification of product data is the important aspect for remote collaborative design process. This work presents a component agent model that is based on the finite state machine (FSM) theory and component technology. By combining the proposed agent model, collaborative design-oriented product data model with corresponding implement methods, a frame of component agent model for collaborative design is proposed, which is suitable for remote product data modification. The applications show that the proposed model can help the remote collaborative designer modify a part of product data without transferring the whole product data model.
A Novel Method for Dialogue Management Based on The Finite State Automaton

Min Lie Huang,Xiao Yan Zhu

2003-01-01

Abstract:Recently spoken dialogue systems in a range of domains have been developed, but there are still no commonly acceptable methods for the dialogue management. In this paper, we propose a novel scheme for it, in which a finite state automaton based on slot-feature is designed to establish the whole dialogue management structure. Two functions are used to implement the strategy control in dialogue session and proved to work pretty well and be efficient. Furthermore, intention-layered trees are proposed and applied to the topic detection and switch, which is quite intuitive and functionary in the multi-topics applications. Me experimental results show that our scheme is promising.
Research on the Window Design of the DCS Userface

Qian Xu,Li Yi,Li Jing

DOI: https://doi.org/10.3321/j.issn:1000-1964.1999.03.014

1999-01-01

Abstract:The userface is a medium that relates people with computer and the window of software product. Combining the object-oriented technology with the traditional design method for software the idea and method of DCS userface design are discussed. It can play an important part in improving the quality of DCS products and cutting the developing cycle short. This method is useful for an opening DCS product which is easy to combine, disassemble and repair.
Method of Dialog Program Design Based on AutoCAD

张文增,何云峰,孙振国,赵冬斌,陈强

DOI: https://doi.org/10.3969/j.issn.1002-2333.2002.03.007

2002-01-01

Abstract:This article introduces the development and change of AutoCAD,indicates the importance of dialog technolo-gy,analyses the total structure of AutoCAD dialog program.This article describes the design method of dia-log program based on Auto CAD in detail.
An Integrated Virtual Design And Virtual Assembly Environment

Hg Wan,Sm Gao,Qs Peng

1999-01-01

Abstract:Virtual reality is now becoming matured for serious engineering applications. This paper describes an integrated multi-modal virtual design and virtual assembly environment within which the designers are enabled to create both the exact solid model of a part and the assembly model of a product in 3D space by direct 3D manipulations and voice commands intuitively and easily. Assembly planning can also be performed by users interactively in the environment. By integrating virtual assembly with virtual design, designers are allowed to modify components of an assembly in the same virtual environment without the need of time-consuming data exchange between virtual environment and CAD tools.
Reflective Human-Machine Co-adaptation for Enhanced Text-to-Image Generation Dialogue System

Yuheng Feng,Yangfan He,Yinghui Xia,Tianyu Shi,Jun Wang,Jinsong Yang

2024-08-28

Abstract:Today's image generation systems are capable of producing realistic and high-quality images. However, user prompts often contain ambiguities, making it difficult for these systems to interpret users' potential intentions. Consequently, machines need to interact with users multiple rounds to better understand users' intents. The unpredictable costs of using or learning image generation models through multiple feedback interactions hinder their widespread adoption and full performance potential, especially for non-expert users. In this research, we aim to enhance the user-friendliness of our image generation system. To achieve this, we propose a reflective human-machine co-adaptation strategy, named RHM-CAS. Externally, the Agent engages in meaningful language interactions with users to reflect on and refine the generated images. Internally, the Agent tries to optimize the policy based on user preferences, ensuring that the final outcomes closely align with user preferences. Various experiments on different tasks demonstrate the effectiveness of the proposed method.

Computer Vision and Pattern Recognition,Artificial Intelligence
The First Evaluation of Chinese Human-Computer Dialogue Technology

Wei-Nan Zhang,Zhigang Chen,Wanxiang Che,Guoping Hu,Ting Liu

DOI: https://doi.org/10.48550/arXiv.1709.10217

2019-12-02

Abstract:In this paper, we introduce the first evaluation of Chinese human-computer dialogue technology. We detail the evaluation scheme, tasks, metrics and how to collect and annotate the data for training, developing and test. The evaluation includes two tasks, namely user intent classification and online testing of task-oriented dialogue. To consider the different sources of the data for training and developing, the first task can also be divided into two sub tasks. Both the two tasks are coming from the real problems when using the applications developed by industry. The evaluation data is provided by the iFLYTEK Corporation. Meanwhile, in this paper, we publish the evaluation results to present the current performance of the participants in the two tasks of Chinese human-computer dialogue technology. Moreover, we analyze the existing problems of human-computer dialogue as well as the evaluation scheme itself.

Computation and Language
A Hybrid Dialogue Management Approach for a Flight Spoken Dialogue System

XJ Wu,F Zheng,WH Wu

DOI: https://doi.org/10.1109/icmlc.2002.1174497

2002-01-01

Abstract:Finite-state based dialogue management approaches are powerful for simple tasks with strict and reliable dialogue control, while the plan-based dialogue management approaches are feasible for tasks with several topics or one complex topic. However, neither one is good enough for dialogue control throughout in a dialogue task providing a flight information enquiry and ticket reservation service. To solve this problem, a hybrid dialogue management approach is proposed, in which the plan-based topic forest structure is combined with some finite-state control, so that a proper management element can function in different dialogue situations.
KRM-based Dialogue Management

Wenwu Qu,Xiaoyu Chi,Wei Zheng

DOI: https://doi.org/10.48550/arXiv.1912.00669

IF: 6.4588

2019-12-02

Human-Computer Interaction

Abstract:A KRM-based dialogue management (DM) is proposed using to implement human-computer dialogue system in complex scenarios. KRM-based DM has a well description ability and it can ensure the logic of the dialogue process. Then a complex application scenario in the Internet of Things (IOT) industry and a dialogue system implemented based on the KRM-based DM will be introduced, where the system allows enterprise customers to customize topics and adapts corresponding topics in the interaction process with users. The experimental results show that the system can complete the interactive tasks well, and can effectively solve the problems of topic switching, information inheritance between topics, change of dominance.
Enabling Harmonious Human-Machine Interaction with Visual-Context Augmented Dialogue System: A Review

Hao Wang,Bin Guo,Yating Zeng,Yasan Ding,Chen Qiu,Ying Zhang,Lina Yao,Zhiwen Yu

DOI: https://doi.org/10.48550/arXiv.2207.00782

2022-07-02

Abstract:The intelligent dialogue system, aiming at communicating with humans harmoniously with natural language, is brilliant for promoting the advancement of human-machine interaction in the era of artificial intelligence. With the gradually complex human-computer interaction requirements (e.g., multimodal inputs, time sensitivity), it is difficult for traditional text-based dialogue system to meet the demands for more vivid and convenient interaction. Consequently, Visual Context Augmented Dialogue System (VAD), which has the potential to communicate with humans by perceiving and understanding multimodal information (i.e., visual context in images or videos, textual dialogue history), has become a predominant research paradigm. Benefiting from the consistency and complementarity between visual and textual context, VAD possesses the potential to generate engaging and context-aware responses. For depicting the development of VAD, we first characterize the concepts and unique features of VAD, and then present its generic system architecture to illustrate the system workflow. Subsequently, several research challenges and representative works are detailed investigated, followed by the summary of authoritative benchmarks. We conclude this paper by putting forward some open issues and promising research trends for VAD, e.g., the cognitive mechanisms of human-machine dialogue under cross-modal dialogue context, and knowledge-enhanced cross-modal semantic interaction.

Artificial Intelligence,Human-Computer Interaction
TFSM‐based Dialogue Management Model Framework for Affective Dialogue Systems

Fuji Ren,Yu Wang,Changqin Quan

DOI: https://doi.org/10.1002/tee.22100

IF: 0.923

2015-01-01

IEEJ Transactions on Electrical and Electronic Engineering

Abstract:A new dialogue management model for affective dialogue system, which aims to provide a service of information inquiry and affective interaction, is proposed in this paper. First, we construct two finite state machines (TFSM) to model the user and the system, respectively, and simulate the dialogue process as an information exchange between the two state machines. All possible state transitions in dialogue and its probabilities of the user are summarized as a user model, which is helpful for the system to inference and predict the user's internal states. Second, we further discuss the implementation methods of information inquiry and emotional response modules. Finally, we employ the return function of partially observable Markov decision processes (POMDP) model to analyze and evaluate the TFSM‐based dialogue management model. The experimental results not only show the relationships between the average returns, recognition error rates, and state transition probabilities but also confirm that our TFSM‐based dialogue management model outperforms the conventional FSM model. © 2015 Institute of Electrical Engineers of Japan. Published by John Wiley & Sons, Inc.
The Integration Method of Multimodal Human-Computer Interaction Framework

Yuetong Chen,Haifeng Zhao,Jie Chen

DOI: https://doi.org/10.1109/ihmsc.2016.245

2016-01-01

Abstract:This paper builds a five hierarchic multimodal human-computer interaction framework by studying two technologies of human-computer interaction integration framework technology and command control system session management technology. In order to improve interaction nature degree, interaction efficiency and intellectualized service level in command control system, the new humanc-omputer interaction methods such as speech, text, motion sensing and touching are synthetically applied and session management model based on context is integrated. This integration method has a good recognition accuracy rate and ability for different channels integration through experimental verification.
Dialogue Management in Conversational Systems: A Review of Approaches, Challenges, and Opportunities

Shayan Zamanirad,Walid Gaaloul,Marcos Báez,Sara Bouguelia,Hayet Brabra,B. Benatallah

DOI: https://doi.org/10.1109/TCDS.2021.3086565

IF: 4.546

2022-09-01

IEEE Transactions on Cognitive and Developmental Systems

Abstract:Attracted by their easy-to-use interfaces and captivating benefits, conversational systems have been widely embraced by many individuals and organizations as side-by-side digital co-workers. They enable the understanding of user needs, expressed in natural language, and on fulfilling such needs by invoking the appropriate backend services (e.g., APIs). Controlling the conversation flow, known as Dialogue Management, is one of the essential tasks in conversational systems and the key to its success and adoption as well. Nevertheless, designing scalable and robust dialogue management techniques to effectively support intelligent conversations remains a deeply challenging problem. This article studies dialogue management from an in-depth design perspective. We discuss the state-of-the-art approaches, identify their recent advances and challenges, and provide an outlook on future research directions. Thus, we contribute to guiding researchers and practitioners in selecting the appropriate dialogue management approach aligned with their objectives, among the variety of approaches proposed so far.

Computer Science

The Human-Computer Dialogue Management of FCAD System

Design of a speech interaction system for man-machine confrontation

An Event-Driven And Object-Oriented Framework For Human Computer Interface Of Cad System

An Architecture Of Adaptive Interface And Its Implementation

CHAT: a Conversational Helper for Automotive Tasks

User Behavior Fusion in Dialog Management with Multi-Modal History Cues

Human-computer interface development: concepts and systems for its management

COLLABORATION WITH A MULTI-USER INTERFACE-CASE: PRODUCT DEVELOPMENT SIMULATION GAME

Modification of product data for remote collaborative design

A Novel Method for Dialogue Management Based on The Finite State Automaton

Research on the Window Design of the DCS Userface

Method of Dialog Program Design Based on AutoCAD

An Integrated Virtual Design And Virtual Assembly Environment

Reflective Human-Machine Co-adaptation for Enhanced Text-to-Image Generation Dialogue System

The First Evaluation of Chinese Human-Computer Dialogue Technology

A Hybrid Dialogue Management Approach for a Flight Spoken Dialogue System

KRM-based Dialogue Management

Enabling Harmonious Human-Machine Interaction with Visual-Context Augmented Dialogue System: A Review

TFSM‐based Dialogue Management Model Framework for Affective Dialogue Systems

The Integration Method of Multimodal Human-Computer Interaction Framework

Dialogue Management in Conversational Systems: A Review of Approaches, Challenges, and Opportunities