Abstract:One of the primary challenges inherent in utilizing deep learning models is the scarcity and accessibility hurdles associated with acquiring datasets of sufficient size to facilitate effective training of these networks. This is particularly significant in object detection, shape completion, and fracture assembly. Instead of scanning a large number of real-world fragments, it is possible to generate massive datasets with synthetic pieces. However, realistic fragmentation is computationally intensive in the preparation (e.g., pre-factured models) and generation. Otherwise, simpler algorithms such as Voronoi diagrams provide faster processing speeds at the expense of compromising realism. In this context, it is required to balance computational efficiency and realism. This paper introduces a GPU-based framework for the massive generation of voxelized fragments derived from high-resolution 3D models, specifically prepared for their utilization as training sets for machine learning models. This rapid pipeline enables controlling how many pieces are produced, their dispersion and the appearance of subtle effects such as erosion. We have tested our pipeline with an archaeological dataset, producing more than 1M fragmented pieces from 1,052 Iberian vessels (). Although this work primarily intends to provide pieces as implicit data represented by voxels, triangle meshes and point clouds can also be inferred from the initial implicit representation. To underscore the unparalleled benefits of CPU and GPU acceleration in generating vast datasets, we compared against a realistic fragment generator that highlights the potential of our approach, both in terms of applicability and processing time. We also demonstrate the synergies between our pipeline and realistic simulators, which frequently cannot select the number and size of resulting pieces. To this end, a deep learning model was trained over realistic fragments and our dataset, showcasing similar results.

Building a Dictionary of Image Fragments

Joint CRF and Locality-Consistent Dictionary Learning for Semantic Segmentation.

Learning Universal Shape Dictionary for Realtime Instance Segmentation

FragmentDiff: A Diffusion Model for Fractured Object Assembly

Discovery of Topical Object in Image Collections

Object Detection Using Edge Fragment-Based Features

Discovery of Topical Objects from Video: A Structured Dictionary Learning Approach

Dictionary learning based image enhancement for rarity detection

Electron Microscopy Images As Set of Fragments for Mitochondrial Segmentation

Extracting Meaningful Regions for Content-Based Retrieval of Image and Video

Enriching Phrases with Coupled Pixel and Object Contexts for Panoptic Narrative Grounding

Building Extraction From High Spatial Resolution Remote Sensing Images of Complex Scenes by Combining Region-Line Feature Fusion and OCNN

Discover and Learn New Objects from Documentaries

Making Heads or Tails: Towards Semantically Consistent Visual Counterfactuals

Exploring Phrase-Level Grounding with Text-to-Image Diffusion Model

Generating implicit object fragment datasets for machine learning

2D Irregular Fragment Reassembly With Deep Learning Assistance

Fine-Grained Imag E Categorization by Localizing Tiny Object Parts from Unannotated Images

Multi-Region Text-Driven Manipulation of Diffusion Imagery

Data-Driven Object Manipulation in Images

Global-aware Fragment Representation Aggregation Network for image–text retrieval