Open_3DSIM_DATA

Ruijie Cao,Peng Xi

DOI: https://doi.org/10.6084/m9.figshare.21731315.v2

2022-01-01

Abstract:This is the data of Open_3DSIM platform. 1. The data(*.dv or *.tif file) is provided singly to facilitate users to download. 2. The Parameters.zip is parmeters, and OTF the total raw data. 2. The Comparison.zip is the comparison between different reconstructions for referrence.

What problem does this paper attempt to address?

Open-3DSIM: an Open-Source Three-Dimensional Structured Illumination Microscopy Reconstruction Platform

Ruijie Cao,Yaning Li,Xin Chen,Xichuan Ge,Meiqi Li,Meiling Guan,Yiwei Hou,Yunzhe Fu,Xinzhu Xu,Shan Jiang,Baoxiang Gao,Peng Xi

DOI: https://doi.org/10.1038/s41592-023-01958-0

IF: 48

2023-01-01

Nature Methods

Abstract:Open-3DSIM is a versatile open-source software for high-fidelity reconstruction of three-dimensional structured illumination microscopy data (with polarization). It is available in three convenient forms for user-friendly and customizable applications. Open-3DSIM is an open-source reconstruction platform for three-dimensional structured illumination microscopy. We demonstrate its superior performance for artifact suppression and high-fidelity reconstruction relative to other algorithms on various specimens and over a range of signal-to-noise levels. Open-3DSIM also offers the capacity to extract dipole orientation, paving a new avenue for interpreting subcellular structures in six dimensions (xyz & theta;& lambda;t). The platform is available as MATLAB code, a Fiji plugin and an Exe application to maximize user-friendliness.
The Open Science Initiative for Perfusion Imaging (OSIPI): ASL Code Library

María Mora Álvarez,Zhao Li,Sudipto Dolui,Manuel Taso,Yiming Wang,Limin Zhou,Ze Wang,Azeez Adebimpe,Henk‐Jan Mutsaerts,Ananth J. Madhuranthakam

DOI: https://doi.org/10.58530/2022/0914

2023-01-01

Abstract:Task force 2.2 of the Open Science Initiative for Perfusion Imaging (OSIPI) is developing a library of open-source functions, and scripts for Arterial Spin Labeled (ASL) perfusion imaging preprocessing and analysis. This is aimed for developers of ASL perfusion methods looking for specific functionalities or development templates, or who want to share their own in-house code with others. The collected source code will be organized and documented so as to support the open library development.
Open3D: A Modern Library for 3D Data Processing

Qian-Yi Zhou,Jaesik Park,Vladlen Koltun

DOI: https://doi.org/10.48550/arXiv.1801.09847

2018-01-30

Computer Vision and Pattern Recognition

Abstract:Open3D is an open-source library that supports rapid development of software that deals with 3D data. The Open3D frontend exposes a set of carefully selected data structures and algorithms in both C++ and Python. The backend is highly optimized and is set up for parallelization. Open3D was developed from a clean slate with a small and carefully considered set of dependencies. It can be set up on different platforms and compiled from source with minimal effort. The code is clean, consistently styled, and maintained via a clear code review mechanism. Open3D has been used in a number of published research projects and is actively deployed in the cloud. We welcome contributions from the open-source community.
Data_prepare.csv

Shu‐Hong Yu,Haoren Wang,Lingpeng Yang,Yingxue Yan,Qiang Cai,Ding Ma,Jianmin Zhao,Long Jiang,Zehai Gao,Zhiyong Yu,Zongping Xia

DOI: https://doi.org/10.6084/m9.figshare.19383614

2022-01-01

Abstract:Information sheet for loading data using STUtility.
IsoExplorer: an Isosurface-Driven Framework for 3D Shape Analysis of Biomedical Volume Data

Dai, Haoran,Tao, Yubo,He, Xiangyang,Lin, Hai

DOI: https://doi.org/10.1007/s12650-021-00770-2

IF: 1.7

2021-01-01

Journal of Visualization

Abstract:The high-resolution scanning devices developed in recent decades provide biomedical volume datasets that support the study of molecular structure and drug design. Isosurface analysis is an important tool in these studies, and the key is to construct suitable description vectors to support subsequent tasks, such as classification and retrieval. Traditional methods based on handcrafted features are insufficient for dealing with complex structures, while deep learning-based approaches have high memory and computation costs when dealing directly with volume data. To address these problems, we propose IsoExplorer, an isosurface-driven framework for 3D shape analysis of biomedical volume data. We first extract isosurfaces from volume data and split them into individual 3D shapes according to their connectivity. Then, we utilize octree-based convolution to design a variational autoencoder model that learns the latent representations of the shape. Finally, these latent representations are used for low-dimensional isosurface representation and shape retrieval. We demonstrate the effectiveness and usefulness of IsoExplorer via isosurface similarity analysis, shape retrieval of real-world data, and comparison with existing methods.
Open-Structure: Structural Benchmark Dataset for SLAM Algorithms

Yanyan Li,Zhao Guo,Ze Yang,Yanbiao Sun,Liang Zhao,Federico Tombari

2024-10-18

Abstract:This paper presents Open-Structure, a novel benchmark dataset for evaluating visual odometry and SLAM methods. Compared to existing public datasets that primarily offer raw images, Open-Structure provides direct access to point and line measurements, correspondences, structural associations, and co-visibility factor graphs, which can be fed to various stages of SLAM pipelines to mitigate the impact of data preprocessing modules in ablation experiments. The dataset comprises two distinct types of sequences from the perspective of scenarios. The first type maintains reasonable observation and occlusion relationships, as these critical elements are extracted from public image-based sequences using our dataset generator. In contrast, the second type consists of carefully designed simulation sequences that enhance dataset diversity by introducing a wide range of trajectories and observations. Furthermore, a baseline is proposed using our dataset to evaluate widely used modules, including camera pose tracking, parametrization, and factor graph optimization, within SLAM systems. By evaluating these state-of-the-art algorithms across different scenarios, we discern each module's strengths and weaknesses in the context of camera tracking and optimization processes. The Open-Structure dataset and baseline system are openly accessible on website: \url{<a class="link-external link-https" href="https://open-structure.github.io" rel="external noopener nofollow">this https URL</a>}, encouraging further research and development in the field of SLAM.

Robotics
Open-Vocabulary High-Resolution 3D (OVHR3D) Data Segmentation and Annotation Framework

Jiuyi Xu,Meida Chen,Andrew Feng,Yangming Shi,Zifan Yu

2024-12-09

Abstract:In the domain of the U.S. Army modeling and simulation, the availability of high quality annotated 3D data is pivotal to creating virtual environments for training and simulations. Traditional methodologies for 3D semantic and instance segmentation, such as KpConv, RandLA, Mask3D, etc., are designed to train on extensive labeled datasets to obtain satisfactory performance in practical tasks. This requirement presents a significant challenge, given the inherent scarcity of manually annotated 3D datasets, particularly for the military use cases. Recognizing this gap, our previous research leverages the One World Terrain data repository manually annotated databases, as showcased at IITSEC 2019 and 2021, to enrich the training dataset for deep learning models. However, collecting and annotating large scale 3D data for specific tasks remains costly and inefficient. To this end, the objective of this research is to design and develop a comprehensive and efficient framework for 3D segmentation tasks to assist in 3D data annotation. This framework integrates Grounding DINO and Segment anything Model, augmented by an enhancement in 2D image rendering via 3D mesh. Furthermore, the authors have also developed a user friendly interface that facilitates the 3D annotation process, offering intuitive visualization of rendered images and the 3D point cloud.

Computer Vision and Pattern Recognition
3D-FRONT: 3D Furnished Rooms with layOuts and semaNTics

Huan Fu,Bowen Cai,Lin Gao,Lingxiao Zhang,Jiaming Wang Cao Li,Zengqi Xun,Chengyue Sun,Rongfei Jia,Binqiang Zhao,Hao Zhang

DOI: https://doi.org/10.48550/arXiv.2011.09127

2021-05-14

Abstract:We introduce 3D-FRONT (3D Furnished Rooms with layOuts and semaNTics), a new, large-scale, and comprehensive repository of synthetic indoor scenes highlighted by professionally designed layouts and a large number of rooms populated by high-quality textured 3D models with style compatibility. From layout semantics down to texture details of individual objects, our dataset is freely available to the academic community and beyond. Currently, 3D-FRONT contains 18,968 rooms diversely furnished by 3D objects, far surpassing all publicly available scene datasets. In addition, the 13,151 furniture objects all come with high-quality textures. While the floorplans and layout designs are directly sourced from professional creations, the interior designs in terms of furniture styles, color, and textures have been carefully curated based on a recommender system we develop to attain consistent styles as expert designs. Furthermore, we release Trescope, a light-weight rendering tool, to support benchmark rendering of 2D images and annotations from 3D-FRONT. We demonstrate two applications, interior scene synthesis and texture synthesis, that are especially tailored to the strengths of our new dataset. The project page is at: <a class="link-external link-https" href="https://tianchi.aliyun.com/specials/promotion/alibaba-3d-scene-dataset" rel="external noopener nofollow">this https URL</a>.

Computer Vision and Pattern Recognition
OpenIns3D: Snap and Lookup for 3D Open-vocabulary Instance Segmentation

Zhening Huang,Xiaoyang Wu,Xi Chen,Hengshuang Zhao,Lei Zhu,Joan Lasenby

2024-08-13

Abstract:In this work, we introduce OpenIns3D, a new 3D-input-only framework for 3D open-vocabulary scene understanding. The OpenIns3D framework employs a "Mask-Snap-Lookup" scheme. The "Mask" module learns class-agnostic mask proposals in 3D point clouds, the "Snap" module generates synthetic scene-level images at multiple scales and leverages 2D vision-language models to extract interesting objects, and the "Lookup" module searches through the outcomes of "Snap" to assign category names to the proposed masks. This approach, yet simple, achieves state-of-the-art performance across a wide range of 3D open-vocabulary tasks, including recognition, object detection, and instance segmentation, on both indoor and outdoor datasets. Moreover, OpenIns3D facilitates effortless switching between different 2D detectors without requiring retraining. When integrated with powerful 2D open-world models, it achieves excellent results in scene understanding tasks. Furthermore, when combined with LLM-powered 2D models, OpenIns3D exhibits an impressive capability to comprehend and process highly complex text queries that demand intricate reasoning and real-world knowledge. Project page: <a class="link-external link-https" href="https://zheninghuang.github.io/OpenIns3D/" rel="external noopener nofollow">this https URL</a>

Computer Vision and Pattern Recognition
SS3DM: Benchmarking Street-View Surface Reconstruction with a Synthetic 3D Mesh Dataset

Yubin Hu,Kairui Wen,Heng Zhou,Xiaoyang Guo,Yongjin Liu

2024-10-29

Abstract:Reconstructing accurate 3D surfaces for street-view scenarios is crucial for applications such as digital entertainment and autonomous driving simulation. However, existing street-view datasets, including KITTI, Waymo, and nuScenes, only offer noisy LiDAR points as ground-truth data for geometric evaluation of reconstructed surfaces. These geometric ground-truths often lack the necessary precision to evaluate surface positions and do not provide data for assessing surface normals. To overcome these challenges, we introduce the SS3DM dataset, comprising precise \textbf{S}ynthetic \textbf{S}treet-view \textbf{3D} \textbf{M}esh models exported from the CARLA simulator. These mesh models facilitate accurate position evaluation and include normal vectors for evaluating surface normal. To simulate the input data in realistic driving scenarios for 3D reconstruction, we virtually drive a vehicle equipped with six RGB cameras and five LiDAR sensors in diverse outdoor scenes. Leveraging this dataset, we establish a benchmark for state-of-the-art surface reconstruction methods, providing a comprehensive evaluation of the associated challenges. For more information, visit our homepage at <a class="link-external link-https" href="https://ss3dm.top" rel="external noopener nofollow">this https URL</a>.

Computer Vision and Pattern Recognition
Capturing, Reconstructing, and Simulating: the UrbanScene3D Dataset

Liqiang Lin,Yilin Liu,Yue Hu,Xingguang Yan,Ke Xie,Hui Huang

DOI: https://doi.org/10.48550/arXiv.2107.04286

2022-07-19

Abstract:We present UrbanScene3D, a large-scale data platform for research of urban scene perception and reconstruction. UrbanScene3D contains over 128k high-resolution images covering 16 scenes including large-scale real urban regions and synthetic cities with 136 km^2 area in total. The dataset also contains high-precision LiDAR scans and hundreds of image sets with different observation patterns, which provide a comprehensive benchmark to design and evaluate aerial path planning and 3D reconstruction algorithms. In addition, the dataset, which is built on Unreal Engine and Airsim simulator together with the manually annotated unique instance label for each building in the dataset, enables the generation of all kinds of data, e.g., 2D depth maps, 2D/3D bounding boxes, and 3D point cloud/mesh segmentations, etc. The simulator with physical engine and lighting system not only produce variety of data but also enable users to simulate cars or drones in the proposed urban environment for future research.

Computer Vision and Pattern Recognition,Graphics
Dataset for Article Titled "topography Effect on Seismic Waveform Tomography: A Quantitative Study"

Kai Zheng,Yi Wang,Li Zhao

DOI: https://doi.org/10.5281/zenodo.10516596

2024-01-01

Abstract:These files support a manuscript entitled "Topography effect on seismic waveform tomography: A quantitative study", by Kaiyue Zheng, Yi Wang and Li Zhao. This research has been supported by the Natural Science Foundation of China (Grants 42021003, 41974046 and 42104052), Shanghai Sheshan National Geophysical Observatory (No. SSOP202106) and Shandong Key Laboratory of Mining Disaster Prevention and Control, Shandong University of Science and Technology (No. SMDPC202202).
Open3DIS: Open-Vocabulary 3D Instance Segmentation with 2D Mask Guidance

Phuc D.A. Nguyen,Tuan Duc Ngo,Evangelos Kalogerakis,Chuang Gan,Anh Tran,Cuong Pham,Khoi Nguyen

2024-04-06

Abstract:We introduce Open3DIS, a novel solution designed to tackle the problem of Open-Vocabulary Instance Segmentation within 3D scenes. Objects within 3D environments exhibit diverse shapes, scales, and colors, making precise instance-level identification a challenging task. Recent advancements in Open-Vocabulary scene understanding have made significant strides in this area by employing class-agnostic 3D instance proposal networks for object localization and learning queryable features for each 3D mask. While these methods produce high-quality instance proposals, they struggle with identifying small-scale and geometrically ambiguous objects. The key idea of our method is a new module that aggregates 2D instance masks across frames and maps them to geometrically coherent point cloud regions as high-quality object proposals addressing the above limitations. These are then combined with 3D class-agnostic instance proposals to include a wide range of objects in the real world. To validate our approach, we conducted experiments on three prominent datasets, including ScanNet200, S3DIS, and Replica, demonstrating significant performance gains in segmenting objects with diverse categories over the state-of-the-art approaches.

Computer Vision and Pattern Recognition
VT3D: a visualization toolbox for 3D transcriptomic data

Lidong Guo,Yao Li,Yanwei Qi,Zhi Huang,Kai Han,Xiaobin Liu,Xin Liu,Mengyang Xu,Guangyi Fan

DOI: https://doi.org/10.1016/j.jgg.2023.04.001

IF: 5.723

2023-04-13

Journal of Genetics and Genomics

Abstract:Data visualization empowers researchers to communicate their results that support scientific reasoning in an intuitive way. 3D spatially resolved transcriptomic atlases constructed from multi-view and high-dimensional data have rapidly emerged as a powerful tool to unravel spatial gene expression patterns and cell type distribution in biological samples, revolutionizing the understanding of gene regulatory interactions and cell niches. However, limited accessible tools for data visualization impede the potential impact and application of this technology. Here we introduce VT3D, a visualization toolbox that allows users to explore 3D transcriptomic data, enabling gene expression projection to any 2D plane of interest, 2D virtual slice creation and visualization, and interactive 3D data browsing with surface model plots. In addition, it can either work on personal devices in standalone mode or be hosted as a web-based server. We apply VT3D to multiple datasets produced by most popular techniques, including both sequencing-based approaches including Stereo-seq, ST, and Slide-seq, and imaging-based approaches including MERFISH and STARMap, and successfully build a 3D atlas database that allows interactive data browsing. We demonstrate that VT3D bridges the gap between researchers and spatially resolved transcriptomics, thus accelerating related studies such as embryogenesis and organogenesis processes. The source code of VT3D is available at https://github.com/BGI-Qingdao/VT3D , and the modeled atlas database is available at http://www.bgiocean.com/vt3d_example .

genetics & heredity,biochemistry & molecular biology
ESMAC Diags Data

Shuaiqi Tang,Jerome D. Fast,Kai Zhang,Joseph Hardin,Adam Varble,John E. Shilling,Fan Mei,Maria A. Zawadowicz,Po‐Lun Ma

DOI: https://doi.org/10.5281/zenodo.5567856

2022-01-01

Abstract:This file includes all preprocessed data for version 2.1 of Earth System Model (ESM) aerosol-cloud diagnostics package (ESMAC Diags) that facilitate routine evaluation of aerosols, clouds and aerosol-cloud interactions simulated by the Department of Energy’s (DOE) Energy Exascale Earth System Model (E3SM). It also includes preprocessed E3SM output for test evaluation.
scDIOR: single cell RNA-seq data IO software

Huijian Feng,Lihui Lin,Jiekai Chen

DOI: https://doi.org/10.1186/s12859-021-04528-3

IF: 3.307

2022-01-06

BMC Bioinformatics

Abstract:Abstract Background Single-cell RNA sequencing is becoming a powerful tool to identify cell states, reconstruct developmental trajectories, and deconvolute spatial expression. The rapid development of computational methods promotes the insight of heterogeneous single-cell data. An increasing number of tools have been provided for biological analysts, of which two programming languages- R and Python are widely used among researchers. R and Python are complementary, as many methods are implemented specifically in R or Python. However, the different platforms immediately caused the data sharing and transformation problem, especially for Scanpy, Seurat, and SingleCellExperiemnt. Currently, there is no efficient and user-friendly software to perform data transformation of single-cell omics between platforms, which makes users spend unbearable time on data Input and Output (IO), significantly reducing the efficiency of data analysis. Results We developed scDIOR for single-cell data transformation between platforms of R and Python based on Hierarchical Data Format Version 5 (HDF5). We have created a data IO ecosystem between three R packages (Seurat, SingleCellExperiment, Monocle) and a Python package (Scanpy). Importantly, scDIOR accommodates a variety of data types across programming languages and platforms in an ultrafast way, including single-cell RNA-seq and spatial resolved transcriptomics data, using only a few codes in IDE or command line interface. For large scale datasets, users can partially load the needed information, e.g., cell annotation without the gene expression matrices. scDIOR connects the analytical tasks of different platforms, which makes it easy to compare the performance of algorithms between them. Conclusions scDIOR contains two modules, dior in R and diopy in Python. scDIOR is a versatile and user-friendly tool that implements single-cell data transformation between R and Python rapidly and stably. The software is freely accessible at https://github.com/JiekaiLab/scDIOR .

biochemical research methods,biotechnology & applied microbiology,mathematical & computational biology
Three Dimensional Reconstruction of Heart Based on Chinese Digitized Visible Human

Jun JIANG,Le XIE,Binji FANG,Shaoxiang ZHANG,Chaozhen ZHOU

DOI: https://doi.org/10.3969/j.issn.1673-0364.2014.01.003

2014-01-01

Abstract:Objective To provide three dimensional anatomic data for the preparation of cardio surgery and surgical training in VR by 3D reconstruction of heart with Chinese digitized visible human. Methods The data of the series of heart sections on Chinese digitized visible human were distinguished and imported to Mimics for the 3D reconstruction of heart. Results Three dimensional heart were reconstructed. The structures could be displayed by multiple structural and color modes, individually or jointly. Conclusion Through Chinese digitized visible human, the goal of 3D reconstruction of heart could be achieved.
Integration And Conversion Of 3d Models From 3ds To Openflight

Yuan Luo,Aizhu Ren

DOI: https://doi.org/10.4028/www.scientific.net/AMM.88-89.559

2011-01-01

Applied Mechanics and Materials

Abstract:OpenFlight is one of the standard formats in Virtual Reality applications. But it only provides crude 3D modeling. Therefore most of the users prefer to build up 3D models in 3DS Max software, while the models created in 3DS MAX could not be used directly in a virtual reality environment. This paper proposed a solution for format conversion between 3DS Max and OpenFlight. Among others it focused on combining triangle meshes in 3DS format into entire faces. A program followed the method proved its availability. The application of this program in a transportation safety education system showed that it has good effects.
4D-Explorer: A visual software for 4D-STEM data processing and image reconstruction

Yiming Hu,Si Gao,Xiaopeng Wu,Xudong Pei,Futao Huang,Wei Mao,Weiyang Zhang,Aidan Horne,Zhengbin Gu,Peng Wang

2023-06-14

Abstract:With the development of high-speed electron detectors, four-dimensional scanning transmission electron microscopy (4D-STEM) has emerged as a powerful tool for characterizing microstructures in material science and life science. However, the complexity of 4D-STEM data processing necessitates an intuitive graphical user interface software for researchers. In this regard, we have developed 4D-Explorer, an open-source, lightweight and extensible software for processing 4D-STEM data. It offers a visual and interactive workflow, including data preparation, calibration, image reconstruction and generating quantitative results. Furthermore, during calibration, our software includes a novel algorithm for rotational offset correction that uses a defocused 4D-STEM dataset and its axial bright field image, which has lower experimental requirements than conventional methods. We anticipate that 4D-Explorer will help researchers harness the capabilities of 4D-STEM technology.

Instrumentation and Detectors,Materials Science
OpenIllumination: A Multi-Illumination Dataset for Inverse Rendering Evaluation on Real Objects

Isabella Liu,Linghao Chen,Ziyang Fu,Liwen Wu,Haian Jin,Zhong Li,Chin Ming Ryan Wong,Yi Xu,Ravi Ramamoorthi,Zexiang Xu,Hao Su

DOI: https://doi.org/10.48550/arxiv.2309.07921

2023-01-01

Abstract:We introduce OpenIllumination, a real-world dataset containing over 108K images of 64 objects with diverse materials, captured under 72 camera views and a large number of different illuminations. For each image in the dataset, we provide accurate camera parameters, illumination ground truth, and foreground segmentation masks. Our dataset enables the quantitative evaluation of most inverse rendering and material decomposition methods for real objects. We examine several state-of-the-art inverse rendering methods on our dataset and compare their performances. The dataset and code can be found on the project page: https://oppo-us-research.github.io/OpenIllumination.

Open_3DSIM_DATA

Open-3DSIM: an Open-Source Three-Dimensional Structured Illumination Microscopy Reconstruction Platform

The Open Science Initiative for Perfusion Imaging (OSIPI): ASL Code Library

Open3D: A Modern Library for 3D Data Processing

Data_prepare.csv

IsoExplorer: an Isosurface-Driven Framework for 3D Shape Analysis of Biomedical Volume Data

Open-Structure: Structural Benchmark Dataset for SLAM Algorithms

Open-Vocabulary High-Resolution 3D (OVHR3D) Data Segmentation and Annotation Framework

3D-FRONT: 3D Furnished Rooms with layOuts and semaNTics

OpenIns3D: Snap and Lookup for 3D Open-vocabulary Instance Segmentation

SS3DM: Benchmarking Street-View Surface Reconstruction with a Synthetic 3D Mesh Dataset

Capturing, Reconstructing, and Simulating: the UrbanScene3D Dataset

Dataset for Article Titled "topography Effect on Seismic Waveform Tomography: A Quantitative Study"

Open3DIS: Open-Vocabulary 3D Instance Segmentation with 2D Mask Guidance

VT3D: a visualization toolbox for 3D transcriptomic data

ESMAC Diags Data

scDIOR: single cell RNA-seq data IO software

Three Dimensional Reconstruction of Heart Based on Chinese Digitized Visible Human

Integration And Conversion Of 3d Models From 3ds To Openflight

4D-Explorer: A visual software for 4D-STEM data processing and image reconstruction

OpenIllumination: A Multi-Illumination Dataset for Inverse Rendering Evaluation on Real Objects