Tasks, Time, and Tools: Quantifying Online Sensemaking Efforts Through a Survey-based Study

Andrew Kuznetsov,Michael Xieyang Liu,Aniket Kittur

2024-11-12

Abstract:Aiming to help people conduct online research tasks, much research has gone into tools for searching for, collecting, organizing, and synthesizing online information. However, outside of the lab, in-the-wild sensemaking sessions (with data on tasks, users, their tools and challenges) can ground us in the reality of such efforts and the state of tool support. We use a survey-based approach with aided recall focused on segmenting and contextualizing individual exploratory browsing sessions to conduct a mixed method analysis of everyday sensemaking sessions in the traditional desktop browser setting while preserving user privacy. We report data from our survey (n=111) collected in September, 2022, and use these results to update and deepen the rich literature on information seeking behavior and exploratory search, contributing new empirical insights into the time spent per week and distribution of that time across tasks, and the lack of externalization and tool-use despite widespread desire for support.

Human-Computer Interaction

What problem does this paper attempt to address?

The problem that this paper attempts to solve is to understand the time spent, the tools used, and the challenges encountered by modern Internet users in the process of daily information search and sensemaking. Specifically, the authors hope to answer the following key questions through this research:

1. **Frequency and time of user sensemaking**: How often do people conduct online exploratory search tasks? How much time does each task take?
2. **Tools and methods used by users**: What tools and methods do users use when performing these tasks? Do they feel that the existing tools adequately support their needs?
3. **Influence of the modern network environment on user behavior**: With the development of the Internet and the increase in the amount of information, has the user's online exploratory search behavior changed? For example, does information overload cause users to make decisions (satisficing) more quickly instead of thoroughly investigating all possible information sources?
4. **Users' need for externalized information**: Do users externalize information (such as taking notes or using specific tools) when dealing with complex tasks in order to better manage and synthesize information?

### Background and Motivation

Although a large number of studies have been devoted to developing tools to help users with online information search, collection, organization, and synthesis, most of these studies were conducted in a laboratory environment. However, sensemaking activities in the real world are more complex and involve more variables and uncertainties. Therefore, researchers need a method to more realistically reflect users' online exploratory search behavior in real - life.

### Research Methods

To solve the above - mentioned problems, the authors adopted a survey - based method combined with the aided recall technique. This method enables researchers to conduct a mixed - method analysis of users' online sensemaking behavior by analyzing users' browser history and self - reported data. Specifically, the research includes the following steps:

- **High - level task description**: Users were asked to record and describe their online research tasks within the past 72 hours and estimate the time spent on each task.
- **In - depth task analysis**: Users further described in detail their most recent seven tasks, including copying and pasting relevant browser history, and explained the specific steps they took to complete these tasks.

### Main Findings

By analyzing the survey data of 111 participants, the study found that:

- Users spend an average of about 4.4 hours per week on 12.5 exploratory network tasks.
- Most of the time (72%) is spent on a small number of long - duration tasks (≥30 minutes), while these tasks account for only 23% of the total number of tasks.
- Although users generally hope to have more tools to support their sensemaking process, in fact, very few people use specialized tools or externalized information management methods.

Through these findings, the study not only updates the existing literature on online information search behavior but also provides valuable empirical evidence for the future design of more effective sensemaking tools.