Abstract:With the rapid growth of video resources, techniques for efficient organization of video clips are becoming appealing in the multimedia domain. In this article, a sketch-based approach is proposed to intuitively organize video clips by: (1) enhancing their narrations using sketch annotations and (2) structurizing the organization process by gesture-based free-form sketching on touch devices. There are two main contributions of this work. The first is a sketch graph, a novel representation for the narrative structure of video clips to facilitate content organization. The second is a method to perform context-aware sketch recommendation scalable to large video collections, enabling common users to easily organize sketch annotations. A prototype system integrating the proposed approach was evaluated on the basis of five different aspects concerning its performance and usability. Two sketch searching experiments showed that the proposed context-aware sketch recommendation outperforms, in terms of accuracy and scalability, two state-of-the-art sketch searching methods. Moreover, a user study showed that the sketch graph is consistently preferred over traditional representations such as keywords and keyframes. The second user study showed that the proposed approach is applicable in those scenarios where the video annotator and organizer were the same person. The third user study showed that, for video content organization, using sketch graph users took on average 1/3 less time than using a mass-market tool Movie Maker and took on average 1/4 less time than using a state-of-the-art sketch alternative. These results demonstrated that the proposed sketch graph approach is a promising video organization tool.

Towards Understanding the Authoring Strategy and Effectiveness of Visualization Sketches

Research and Implementation of the Sketching Design System

An Interactive Personalized Video Summarization Based on Sketches.

SmartCanvas: Context-inferred Interpretation of Sketches for Preparatory Design Studies.

Model-Guided 3D Sketching

The function of text description in sketch promotion

Designers' perception during sketching: An examination of Creative Segment theory using eye movements

Sketch-Based Annotation and Visualization in Video Authoring.

The Role of Sketching States in the Stimulation of Idea Generation: an Eye Movement Study

SketchMaker: Sketch Extraction and Reuse for Interactive Scene Sketch Composition

Creative Segment: A descriptive theory applied to computer-aided sketching

Improving Engagement of Animated Visualization with Visual Foreshadowing

The Role of Mental Models in Collaborative Sketching

Sketchboard: Supporting natural interaction for video organization and navigation using sketching annotation

A 3d Sketching Interacting Tool For Physical Simulation Based On Web

Towards Practicality of Sketch-Based Visual Understanding

Exploring the efficacy of hybrid-sketch: an investigation into conceptual support in the early design stage

SketchDreamer: Interactive Text-Augmented Creative Sketch Ideation

iStoryline: Effective Convergence to Hand-drawn Storylines

Sketch-based Creativity Support Tools using Deep Learning

A Sketch-Based Approach for Interactive Organization of Video Clips