Beyond words and actions: Exploring Multimodal Analytics and Collaboration in the Digital Age

Diego Miranda,Rene Noel,Jaime Godoy,Carlos Escobedo,Cristian Cechinel,Roberto Munoz

2024-06-23

Abstract:This article explores Multimodal Analytics' use in assessing communication within agile software development, particularly through planning poker, to understand collaborative behavior. Multimodal Analytics examines verbal, paraverbal, and non-verbal communication, crucial for effective collaboration in software engineering, which demands efficient communication, cooperation, and coordination. The study focuses on how planning poker influences speaking time and attention among team members by utilizing advanced audiovisual data analysis technologies. Results indicate that while planning poker doesn't significantly change total speaking or attention time, it leads to a more equitable speaking time distribution, highlighting its benefit in enhancing equitable team participation. These findings emphasize planning poker's role in improving software team collaboration and suggest multimodal analytics' potential to explore new aspects of team communication. This research contributes to better understanding coordination techniques' impact in software development and team education, proposing future investigations into optimizing team collaboration and performance through alternative coordination techniques and multimodal analysis across different collaborative settings.

Software Engineering,Emerging Technologies

What problem does this paper attempt to address?

This paper attempts to address the issue of evaluating the impact of Planning Poker, a collaborative technique, on team communication and collaboration effectiveness in the agile software development process. Specifically, the study focuses on the following two main questions: 1. **The impact of Planning Poker on participants' speaking time**: - The first research question explores whether Planning Poker affects the speaking time of team members during collaborative activities. The research hypothesis (H0st) posits that Planning Poker does not significantly alter participants' speaking time. 2. **The impact of Planning Poker on participants' attention time**: - The second question investigates whether Planning Poker affects the attention time of team members during collaborative activities. The research hypothesis (H0at) posits that Planning Poker does not significantly alter participants' attention time. Through the Multimodal Analytics (MmA) method, researchers are able to quantify and visualize verbal, paraverbal, and non-verbal communication among team members, thereby gaining a better understanding of how Planning Poker, as a coordination technique, influences communication patterns within the team. The study results indicate that while Planning Poker does not significantly change the total speaking time and attention time, it promotes a more equitable distribution of speaking time, thereby enhancing equal participation among team members. This helps improve the collaboration efficiency of software development teams and suggests future research directions for optimizing team collaboration and performance.

Beyond words and actions: Exploring Multimodal Analytics and Collaboration in the Digital Age

Introducing Low-Cost Sensors into the Classroom Settings: Improving the Assessment in Agile Practices with Multimodal Learning Analytics

Literature Review on Co-Located Collaboration Modeling Using Multimodal Learning Analytics—Can We Go the Whole Nine Yards?

Speech Is Not Enough: Interpreting Nonverbal Indicators of Common Knowledge and Engagement

Talk to the Wall: The Role of Speech Interaction in Collaborative Visual Analytics

Multimodal learning analytics of collaborative patterns during pair programming in higher education

Beyond Agile: Studying The Participatory Process in Software Development

Multimodal analysis within an interactive software environment: critical discourse perspectives

Multimodal Learning Analytics and Education Data Mining: using computational technologies to measure complex learning tasks

Toward a General Framework for Multimodal Big Data Analysis

Leveraging Multimodal Behavioral Analytics for Automated Job Interview Performance Assessment and Feedback

Talking to Data Visualizations: Opportunities and Challenges

A Multimodal Social Signal Processing Approach to Team Interactions

Beyond robotic speech: mutual benefits to cognitive psychology and artificial intelligence from the study of multimodal communication

Co-Located Human-Human Interaction Analysis using Nonverbal Cues: A Survey

Multimodality in Group Communication Research

From Jam Session to Recital: Synchronous Communication and Collaboration Around Data in Organizations

Multimodal Methods for Analyzing Learning and Training Environments: A Systematic Literature Review

A Digital Mixed Methods Research Design: Integrating Multimodal Analysis With Data Mining and Information Visualization for Big Data Analytics

Understanding Multimodal User Gesture and Speech Behavior for Object Manipulation in Augmented Reality Using Elicitation

Bridging Multimedia Modalities: Enhanced Multimodal AI Understanding and Intelligent Agents