[Biosynthesis of homovanilloylgycine during the perfusion of rat liver].

H. Thomas,F. Ganz,E. Büschemann

DOI: https://doi.org/10.1515/bchm2.1968.349.2.1686

Hoppe-Seyler´s Zeitschrift für physiologische Chemie

Abstract:

What problem does this paper attempt to address?

Miniature: Unsupervised glimpses into multiplexed tissue imaging datasets as thumbnails for data portals

Adam J Taylor

DOI: https://doi.org/10.1101/2024.10.01.615855

2024-10-02

Abstract:Multiplexed tissue imaging can illuminate complex spatial protein expression patterns in healthy and diseased specimens. Large-scale atlas programs such as Human Tumor Atlas Network and are relying heavily on highly-multiplexed approaches including CyCIF and CODEX to image up to 100 antigens. Such high dimensionality allows a deep understanding of cellular diversity and spatial structure, but can provide a challenge for image visualization and exploration. One challenge for data portals and visualization tools is the generation of an informative and pleasing image preview that captures the full heterogeneity of the image, rather than relying on a multi-channel overlay that may be restricted to 4-6 channels. We describe Miniature, a tool to automatically generate informative image thumbnails from multiplexed tissue images in an unsupervised and scalable manner. Miniature aims to aid researchers in understanding tissue heterogeneity and identifying potential pathological features without extensive manual intervention. Miniature uses a choice of unsupervised dimensionality reduction methods including uniform manifold embedding and projection (UMAP), t-distributed stochastic neighbor Embedding (t-SNE), and principal Component analysis (PCA) to reduce on-tissue pixels from a low-resolution, high dimensional image to two or three dimensions. Pixels are then color encoded by their coordinate in low dimensional space using a choice of color maps. We show that perceptually distinct regions in Miniature thumbnails reflect known pathological features seen in both the source multiplexed tissue image and H&E imaging of the same sample. We evaluate Miniature parameters for dimensionality reduction and pixel color encoding to recommend default configurations that maximize perceptual trustworthiness to both the low-dimensional embedding and high-dimensional image and provide high Mantel correlation between the perceived color difference (delta E 2000) and distance in high- and low-dimensional space. By simulating color vision deficiency, we show that Miniature thumbnails are accessible to all. We demonstrate that Miniature thumbnails are suitable for a wide range of multiplexed tissue imaging modalities and show their application in the Human Tumor Atlas Network Data Portal.

Bioinformatics
MINT: a toolbox for the analysis of multivariate neural information coding and transmission

Gabriel Matias Lorenz,Nicola Marie Engel,Marco Celotto,Loren Kocillari,Sebastiano Curreli,Tommaso Fellin,Stefano Panzeri

DOI: https://doi.org/10.1101/2024.11.04.621910

2024-11-04

Abstract:Information theory has deeply influenced the conceptualization of brain information processing and is a mainstream framework for analyzing how neural networks in the brain process information to generate behavior. Information theory tools have been initially conceived and used to study how information about sensory variables is encoded by the activity of small neural populations. However, recent multivariate information theoretic advances have enabled addressing how information is exchanged across areas and used to inform behavior. Moreover, its integration with dimensionality-reduction techniques has enabled addressing information encoding and communication by the activity of large neural populations or many brain areas, as recorded by multichannel activity measurements in functional imaging and electrophysiology. Here, we provide a Multivariate Information in Neuroscience Toolbox (MINT) that combines these new methods with statistical tools for robust estimation from limited-size empirical datasets. We demonstrate the capabilities of MINT by applying it to both simulated and real neural data recorded with electrophysiology or calcium imaging, but all MINT functions are equally applicable to other brain-activity measurement modalities. We highlight the synergistic opportunities that combining its methods afford for reverse engineering of specific information processing and flow between neural populations or areas, and for discovering how information processing functions emerge from interactions between neurons or areas. MINT works on Linux, Windows and macOS operating systems, is written in MATLAB (requires MATLAB version 2018b or newer) and depends on 5 native MATLAB toolboxes. The calculation of one possible way to compute information redundancy requires the installation and compilation of C files (made available by us also as pre-compiled files). MINT is freely available at https://github.com/panzerilab/MINT with DOI 10.5281/zenodo.13998526 and operates under a GNU GPLv3 license.

Neuroscience
Minian, an open-source miniscope analysis pipeline

W. Mau,D. Cai,Yu Feng,Zachary T. Pennington,Kanaka Rajan,Zhe Dong,Yosif Zaki,Daniel Aharoni,Lingxuan Chen,Tristan Shuman

DOI: https://doi.org/10.7554/eLife.70661

2021-05-04

bioRxiv

Abstract:Miniature microscopes have gained considerable traction for in vivo calcium imaging in freely behaving animals. However, extracting calcium signals from raw videos is a computationally complex problem and remains a bottleneck for many researchers utilizing single-photon in vivo calcium imaging. Despite the existence of many powerful analysis packages designed to detect and extract calcium dynamics, most have either key parameters that are hard-coded or insufficient step-by-step guidance and validations to help the users choose the best parameters. This makes it difficult to know whether the output is reliable and meets the assumptions necessary for proper analysis. Moreover, large memory demand is often a constraint for setting up these pipelines since it limits the choice of hardware to specialized computers. Given these difficulties, there is a need for a low memory demand, user-friendly tool offering interactive visualizations of how altering parameters at each step of the analysis affects data output. Our open-source analysis pipeline, Minian (Miniscope Analysis), facilitates the transparency and accessibility of single-photon calcium imaging analysis, permitting users with little computational experience to extract the location of cells and their corresponding calcium traces and deconvolved neural activities. Minian contains interactive visualization tools for every step of the analysis, as well as detailed documentation and tips on parameter exploration. Furthermore, Minian has relatively small memory demands and can be run on a laptop, making it available to labs that do not have access to specialized computational hardware. Minian has been validated to reliably and robustly extract calcium events across different brain regions and from different cell types. In practice, Minian provides an open-source calcium imaging analysis pipeline with user-friendly interactive visualizations to explore parameters and validate results.

Biology,Computer Science,Medicine
A New Generation of the IMAGIC Image Processing System

Marin van Heel,George Harauz,Elena V. Orlova,Ralf Schmidt,Michael Schatz

DOI: https://doi.org/10.1006/jsbi.1996.0004

IF: 3.234

1996-01-01

Journal of Structural Biology

Abstract:One of the aims of modern microscopy is to quantify two-, three-, or even four-dimensional phenomena in biology, medicine, and material sciences. The requirements imposed on software by such data processing are exemplified by the design considerations of the IMAGIC-5 software system. This system includes facilities for multivariate statistical analysis of large data sets, for correlation averaging of two-dimensional crystals, and for three-dimensional reconstruction of macromolecular structures. The molecules may be arranged as two-dimensional crystals, as helices, or as single particles with arbitrary pointgroup symmetry. IMAGIC's novel angular reconstitution approach allows for the rapid determination of three-dimensional structures of uncrystallized molecules to high resolution. The general organization, user interaction strategy, file structure, and extendibility of IMAGIC are discussed and illustrated with some practical examples.

cell biology,biochemistry & molecular biology,biophysics
OME-NGFF: a next-generation file format for expanding bioimaging data-access strategies

Josh Moore,Chris Allan,Sébastien Besson,Jean-Marie Burel,Erin Diel,David Gault,Kevin Kozlowski,Dominik Lindner,Melissa Linkert,Trevor Manz,Will Moore,Constantin Pape,Christian Tischer,Jason R. Swedlow

DOI: https://doi.org/10.1038/s41592-021-01326-w

IF: 48

2021-11-29

Nature Methods

Abstract:Abstract The rapid pace of innovation in biological imaging and the diversity of its applications have prevented the establishment of a community-agreed standardized data format. We propose that complementing established open formats such as OME-TIFF and HDF5 with a next-generation file format such as Zarr will satisfy the majority of use cases in bioimaging. Critically, a common metadata format used in all these vessels can deliver truly findable, accessible, interoperable and reusable bioimaging data.

biochemical research methods
xIV-LDDMM Toolkit: A Suite of Image-Varifold Based Technologies for Representing and Mapping 3D Imaging and Spatial-omics Data Simultaneously Across Scales

Kaitlin Stouffer,Xiaoyin Chen,Hongkui Zeng,Benjamin Charlier,Laurent Younes,Alain Trouve,Michael I Miller

DOI: https://doi.org/10.1101/2024.11.04.621983

2024-11-05

Abstract:Advancements in imaging and molecular techniques enable the collection of subcellular-scale data. Diversity in measured features, resolution, and physical scope of capture across technologies and experimental protocols pose numerous challenges to integrating data with reference coordinate systems and across scales. This resource paper describes a collection of technologies that we have developed for cross-modality 3D mapping for the alignment of transcriptomics at the micron scales of genes and cells to the anatomical tissue scales. Our collection of technologies include (i) an explicit censored data representation for the partial matching problem mapping whole brains to subsampled subvolumes, (ii) image-varifold measure norms for supporting nearly universal crossing of modality, (iii) a multi, scale-space optimization technology for generating resampling grids optimized to represent spatial geometry at fixed complexities, and (iv) mutual-information based functional feature selection. Collectively, these methods afford efficient representations of peta-scale imagery providing the algorithms for mapping from the nano to millimeter scales which we term cross-modality image-varifold LDDMM (xIV-LDDMM).

Bioengineering
Nanoscale Connectomics Annotation Standards Framework

Nicole K. Guittari,Miguel E. Wimbish,Patricia K. Rivlin,Mark A. Hinton,Jordan K. Matelsky,Victoria A. Rose,Jorge L. Rivera Jr.,Nicole E. Stock,Brock A. Wester,Erik C. Johnson,William R. Gray-Roncal

2024-10-31

Abstract:The promise of large-scale, high-resolution datasets from Electron Microscopy (EM) and X-ray Microtomography (XRM) lies in their ability to reveal neural structures and synaptic connectivity, which is critical for understanding the brain. Effectively managing these complex and rapidly increasing datasets will enable new scientific insights, facilitate querying, and support secondary use across the neuroscience community. However, without effective neurodata standards that permit use of these data across multiple systems and workflows, these valuable and costly datasets risk being underutilized especially as they surpass petascale levels. These standards will promote data sharing through accessible interfaces, allow researchers to build on each other's work, and guide the development of tools and capabilities that are interoperable. Herein we outline a standards framework for creating and managing annotations originating and derived from high-resolution volumetric imaging and connectomic datasets, focusing on ensuring Findable, Accessible, Interoperable, and Reusable (FAIR) practices. The goal is to enhance collaborative efforts, boost the reliability of findings, and enable comparative analysis across growing datasets of different species and modalities. We have formed a global working group with academic and industry partners in the high-resolution volumetric data generation and analysis community, focused on identifying gaps in current EM and XRM data pipelines, and refining outlines and platforms for standardizing EM and XRM methods. This focus considers existing and past community approaches and includes examining neuronal entities, biological components, and associated metadata, while emphasizing adaptability and fostering collaboration.

Neurons and Cognition
ACID: A Comprehensive Toolbox for Image Processing and Modeling of Brain, Spinal Cord, and Post-mortem Diffusion MRI Data

Gergely David,Björn Fricke,Jan Malte Oeschger,Lars Ruthotto,Francisco J. Fritz,Ora Ohana,Laurin Mordhorst,Thomas Sauvigny,Patrick Freund,Karsten Tabelow,Siawoosh Mohammadi

DOI: https://doi.org/10.1101/2023.10.13.562027

2024-07-17

Abstract:Diffusion MRI (dMRI) has become a crucial imaging technique in the field of neuroscience, with a growing number of clinical applications. Although most studies still focus on the brain, there is a growing interest in utilizing dMRI to investigate the healthy or injured spinal cord. The past decade has also seen the development of biophysical models that link MR-based diffusion measures to underlying microscopic tissue characteristics, which necessitates validation through ex vivo dMRI measurements. Building upon 13 years of research and development, we present an open-source, MATLAB-based academic software toolkit dubbed ACID: A Comprehensive Toolbox for Image Processing and Modeling of Brain, Spinal Cord, and Ex Vivo Diffusion MRI Data. ACID is an extension to the Statistical Parametric Mapping (SPM) software, designed to process and model dMRI data of the brain, spinal cord, and ex vivo specimens by incorporating state-of-the-art artifact correction tools, diffusion and kurtosis tensor imaging, and biophysical models that enable the estimation of microstructural properties in white matter. Additionally, the software includes an array of linear and non-linear fitting algorithms for accurate diffusion parameter estimation. By adhering to the Brain Imaging Data Structure (BIDS) data organization principles, ACID facilitates standardized analysis, ensures compatibility with other BIDS-compliant software, and aligns with the growing availability of large databases utilizing the BIDS format. Furthermore, being integrated into the popular SPM framework, ACID benefits from a wide range of segmentation, spatial processing, and statistical analysis tools as well as a large and growing number of SPM extensions. As such, this comprehensive toolbox covers the entire processing chain from raw DICOM data to group-level statistics, all within a single software package.

Neuroscience
Integrating Multimodal Neuroimaging and Genetics: A Structurally-Linked Sparse Canonical Correlation Analysis Approach

Jiwon Chung,Sunghun Kim,Ji Hye Won,Hyunjin Park

DOI: https://doi.org/10.1109/jtehm.2024.3463720

2024-10-16

IEEE Journal of Translational Engineering in Health and Medicine

Abstract:Neuroimaging genetics represents a multivariate approach aimed at elucidating the intricate relationships between high-dimensional genetic variations and neuroimaging data. Predominantly, existing methodologies revolve around Sparse Canonical Correlation Analysis (SCCA), a framework we expand to 1) encompass multiple imaging modalities and 2) promote the simultaneous identification of structurally linked features across imaging modalities. The structurally linked brain regions were assessed using diffusion tensor imaging, which quantifies the presence of neuronal fibers, thereby grounding our approach in biologically well-founded prior knowledge within the SCCA model. In our proposed structurally linked SCCA framework, we leverage T1-weighted MRI and functional MRI (fMRI) time series data to delineate both the structural and functional characteristics of the brain. Genetic variations, specifically single nucleotide polymorphisms (SNPs), are also incorporated as a genetic modality. Validation of our methodology was conducted using a simulated dataset and large-scale normative data from the Human Connectome Project (HCP). Our approach demonstrated superior performance compared to existing methods on simulated data and revealed interpretable gene-imaging associations in the real dataset. Thus, our methodology lays the groundwork for elucidating the genetic underpinnings of brain structure and function, thereby providing novel insights into the field of neuroscience. Our code is available at https://github.com/mungegg.

engineering, biomedical
Implicit Neural Image Field for Biological Microscopy Image Compression

Gaole Dai,Cheng-Ching Tseng,Qingpo Wuwu,Rongyu Zhang,Shaokang Wang,Ming Lu,Tiejun Huang,Yu Zhou,Ali Ata Tuz,Matthias Gunzer,Jianxu Chen,Shanghang Zhang

2024-05-29

Abstract:The rapid pace of innovation in biological microscopy imaging has led to large images, putting pressure on data storage and impeding efficient sharing, management, and visualization. This necessitates the development of efficient compression solutions. Traditional CODEC methods struggle to adapt to the diverse bioimaging data and often suffer from sub-optimal compression. In this study, we propose an adaptive compression workflow based on Implicit Neural Representation (INR). This approach permits application-specific compression objectives, capable of compressing images of any shape and arbitrary pixel-wise decompression. We demonstrated on a wide range of microscopy images from real applications that our workflow not only achieved high, controllable compression ratios (e.g., 512x) but also preserved detailed information critical for downstream analysis.

Artificial Intelligence
EM and XRM Connectomics Imaging and Experimental Metadata Standards

Miguel E. Wimbish,Nicole K. Guittari,Victoria A. Rose,Jorge L. Rivera Jr,Patricia K. Rivlin,Mark A. Hinton,Jordan K. Matelsky,Nicole E. Stock,Brock A. Wester,Erik C. Johnson,William R. Gray-Roncal

2024-01-27

Abstract:High resolution volumetric neuroimaging datasets from electron microscopy (EM) and x-ray micro and holographic-nano tomography (XRM/XHN) are being generated at an increasing rate and by a growing number of research teams. These datasets are derived from an increasing number of species, in an increasing number of brain regions, and with an increasing number of techniques. Each of these large-scale datasets, often surpassing petascale levels, is typically accompanied by a unique and varied set of metadata. These datasets can be used to derive connectomes, or neuron-synapse level connectivity diagrams, to investigate the fundamental organization of neural circuitry, neuronal development, and neurodegenerative disease. Standardization is essential to facilitate comparative connectomics analysis and enhance data utilization. Although the neuroinformatics community has successfully established and adopted data standards for many modalities, this effort has not yet encompassed EM and XRM/ XHN connectomics data. This lack of standardization isolates these datasets, hindering their integration and comparison with other research performed in the field. Towards this end, our team formed a working group consisting of community stakeholders to develop Image and Experimental Metadata Standards for EM and XRM/XHN data to ensure the scientific impact and further motivate the generation and sharing of these data. This document addresses version 1.1 of these standards, aiming to support metadata services and future software designs for community collaboration. Standards for derived annotations are described in a companion document. Standards definitions are available on a community github page. We hope these standards will enable comparative analysis, improve interoperability between connectomics software tools, and continue to be refined and improved by the neuroinformatics community.

Neurons and Cognition
A Semantic Cross-Species Derived Data Management Application

David B. Keator,Jinran Chen,Nolan Nichols,Fariba Fana,Hal Stern,Tallie Z. Baram,Steven L. Small

DOI: https://doi.org/10.5334/dsj-2017-045

2017-09-20

Data Science Journal

Abstract:Managing dynamic information in large multi-site, multi-species, and multi-discipline consortia is a challenging task for data management applications. Often in academic research studies the goals for informatics teams are to build applications that provide extract-transform-load (ETL) functionality to archive and catalog source data that has been collected by the research teams. In consortia that cross species and methodological or scientific domains, building interfaces which supply data in a usable fashion and make intuitive sense to scientists from dramatically different backgrounds increases the complexity for developers. Further, reusing source data from outside one’s scientific domain is fraught with ambiguities in understanding the data types, analysis methodologies, and how to combine the data with those from other research teams. We report on the design, implementation, and performance of a semantic data management application to support the NIMH funded Conte Center at the University of California, Irvine. The Center is testing a theory of the consequences of “fragmented” (unpredictable, high entropy) early-life experiences on adolescent cognitive and emotional outcomes in both humans and rodents. It employs cross-species neuroimaging, epigenomic, molecular, and neuroanatomical approaches in humans and rodents to assess the potential consequences of fragmented unpredictable experience on brain structure and circuitry. To address this multi-technology, multi-species approach, the system uses semantic web techniques based on the Neuroimaging Data Model (NIDM) to facilitate data ETL functionality. We find this approach enables a low-cost, easy to maintain, and semantically meaningful information management system, enabling the diverse research teams to access and use the data.

English Else
Methods for Specifying Scientific Data Standards and Modeling Relationships with Applications to Neuroscience

Oliver Rübel,Max Dougherty,Prabhat,Peter Denes,David Conant,Edward F. Chang,Kristofer Bouchard

DOI: https://doi.org/10.3389/fninf.2016.00048

2016-11-04

Frontiers in Neuroinformatics

Abstract:Neuroscience continues to experience a tremendous growth in data; in terms of the volume and variety of data, the velocity at which data is acquired, and in turn the veracity of data. These challenges are a serious impediment to sharing of data, analyses, and tools within and across labs. Here, we introduce BRAINformat, a novel data standardization framework for the design and management of scientific data formats. The BRAINformat library defines application-independent design concepts and modules that together create a general framework for standardization of scientific data. We describe the formal specification of scientific data standards, which facilitates sharing and verification of data and formats. We introduce the concept of Managed Objects, enabling semantic components of data formats to be specified as self-contained units, supporting modular and reusable design of data format components and file storage. We also introduce the novel concept of Relationship Attributes for modeling and use of semantic relationships between data objects. Based on these concepts we demonstrate the application of our framework to design and implement a standard format for electrophysiology data and show how data standardization and relationship-modeling facilitate data analysis and sharing. The format uses HDF5, enabling portable, scalable, and self-describing data storage and integration with modern high-performance computing for data-driven discovery. The BRAINformat library is open source, easy-to-use, and provides detailed user and developer documentation and is freely available at: https://bitbucket.org/oruebel/brainformat.

neurosciences,mathematical & computational biology
MolNetInvert: A Tool for Creating Metadata Based Molecular Networks and Their Applications in Large Microbial Datasets

Aaron J.C. Andersen,Johan V. Christiansen,Scott A. Jarmusch,Manca Vertot

DOI: https://doi.org/10.26434/chemrxiv-2024-q4dpr

2024-07-08

Abstract:Untargeted mass spectrometry-based metabolomics, crucial in diverse research areas such as clinical diagnostics and chemical ecology, often encounters the challenge of interpreting complex datasets with thousands of unique, low-annotation-rate features. Advancements in MS2-based molecular networking, particularly Feature-Based Molecular Networking and its offshoots, have improved data deconvolution and annotation. Although this is the case, these approaches often result in networks with numerous singletons, complicating interpretation when extended metadata is incorporated. Herein, we introduce Metadata-Based Molecular Networks (MBMN), a new approach to visualizing complex untargeted metabolomics datasets that enhances the interpretability of molecular networks in untargeted metabolomics, as well as MolNetInvert, an open-source GUI tool for producing these new networks. MolNetInvert simplifies network visualization by collapsing clusters into single nodes and reorganizes the networks into metadata centric networks. Overall, MBMN produces new networks based on selected metadata, creating new edges between metadata-linked nodes. Its utility is demonstrated through three case studies: 1) a co-culture analysis of metabolite production in fungal strains, 2) an investigation of secondary metabolism in black Aspergilli species using a public dataset, and 3) a comparative study of ant fungal gardens and trash piles. These applications underscore the effectiveness of MBMN’s in clarifying data analysis in mass spectrometry-based metabolomics networking, showcasing its potential in various research fields dealing with complex datasets.

Chemistry
GAN-MAT: Generative Adversarial Network-based Microstructural Profile Covariance Analysis Toolbox

Yeongjun Park,Mi Ji Lee,Seulki Yoo,Chae Yeon Kim,Jong Young Namgung,Yunseo Park,Hyunjin Park,Eun-Chong Lee,Yeo Dong Yoon,Casey Paquola,Boris C. Bernhardt,Bo-yong Park

DOI: https://doi.org/10.1016/j.neuroimage.2024.120595

IF: 5.7

2024-04-01

NeuroImage

Abstract:Multimodal magnetic resonance imaging (MRI) provides complementary information for investigating brain structure and function; for example, an in vivo microstructure-sensitive proxy can be estimated using the ratio between T1- and T2-weighted structural MRI. However, acquiring multiple imaging modalities is challenging in patients with inattentive disorders. In this study, we proposed a comprehensive framework to provide multiple imaging features related to the brain microstructure using only...

radiology, nuclear medicine & medical imaging,neurosciences,neuroimaging
MiniMounter: a low‐cost miniaturized microscopy development toolkit for image quality control and enhancement

Xinyi Zhu,Liangtao Gu,Rui Li,Liang Chen,Jingying Chen,Ning Zhou,Wuwei Ren

DOI: https://doi.org/10.1002/jbio.202300214

IF: 3.3899

2023-10-26

Journal of Biophotonics

Abstract:Head‐mounted miniaturized fluorescence microscopy (Miniscope) has emerged as a significant tool in neuroscience, particularly for behavioral studies in awake rodents. However, the challenges of image quality control and standardization persist for both Miniscope users and developers. In this study, we propose a cost‐effective and comprehensive toolkit named MiniMounter. This toolkit comprises a hardware platform that offers customized grippers and four‐degree‐of‐freedom adjustment for Miniscope, along with software that integrates displacement control, image quality evaluation, and enhancement of 3D visualization. Our toolkit makes it feasible to accurately characterize Miniscope. Furthermore, MiniMounter enables auto‐focusing and 3D imaging for Miniscope prototypes that possess solely a 2D imaging function, as demonstrated in phantom and animal experiments. Overall, the implementation of MiniMounter effectively enhances image quality, reduces the time required for experimental operations and image evaluation, and consequently accelerates the development and research cycle for both users and developers within the Miniscope community. This article is protected by copyright. All rights reserved.

optics,biochemical research methods,biophysics
Miniature microscopes for manipulating and recording in vivo brain activity

Alice M Stamatakis,Shanna L Resendez,Kai-Siang Chen,Morgana Favero,Jing Liang-Guallpa,Jonathan J Nassi,Shay Q Neufeld,Koen Visscher,Kunal K Ghosh

DOI: https://doi.org/10.1093/jmicro/dfab028

2021-10-05

Abstract:Here we describe the development and application of miniature integrated microscopes (miniscopes) paired with microendoscopes that allow for the visualization and manipulation of neural circuits in superficial and subcortical brain regions in freely behaving animals. Over the past decade the miniscope platform has expanded to include simultaneous optogenetic capabilities, electrically-tunable lenses that enable multi-plane imaging, color-corrected optics, and an integrated data acquisition platform that streamlines multimodal experiments. Miniscopes have given researchers an unprecedented ability to monitor hundreds to thousands of genetically-defined neurons from weeks to months in both healthy and diseased animal brains. Sophisticated algorithms that take advantage of constrained matrix factorization allow for background estimation and reliable cell identification, greatly improving the reliability and scalability of source extraction for large imaging datasets. Data generated from miniscopes have empowered researchers to investigate the neural circuit underpinnings of a wide array of behaviors that cannot be studied under head-fixed conditions, such as sleep, reward seeking, learning and memory, social behaviors, and feeding. Importantly, the miniscope has broadened our understanding of how neural circuits can go awry in animal models of progressive neurological disorders, such as Parkinson's disease. Continued miniscope development, including the ability to record from multiple populations of cells simultaneously, along with continued multimodal integration of techniques such as electrophysiology, will allow for deeper understanding into the neural circuits that underlie complex and naturalistic behavior.
MinD-3D: Reconstruct High-quality 3D objects in Human Brain

Jianxiong Gao,Yuqian Fu,Yun Wang,Xuelin Qian,Jianfeng Feng,Yanwei Fu

2024-07-19

Abstract:In this paper, we introduce Recon3DMind, an innovative task aimed at reconstructing 3D visuals from Functional Magnetic Resonance Imaging (fMRI) signals, marking a significant advancement in the fields of cognitive neuroscience and computer vision. To support this pioneering task, we present the fMRI-Shape dataset, which includes data from 14 participants and features 360-degree videos of 3D objects to enable comprehensive fMRI signal capture across various settings, thereby laying a foundation for future research. Furthermore, we propose MinD-3D, a novel and effective three-stage framework specifically designed to decode the brain's 3D visual information from fMRI signals, demonstrating the feasibility of this challenging task. The framework begins by extracting and aggregating features from fMRI frames through a neuro-fusion encoder, subsequently employs a feature bridge diffusion model to generate visual features, and ultimately recovers the 3D object via a generative transformer decoder. We assess the performance of MinD-3D using a suite of semantic and structural metrics and analyze the correlation between the features extracted by our model and the visual regions of interest (ROIs) in fMRI signals. Our findings indicate that MinD-3D not only reconstructs 3D objects with high semantic relevance and spatial similarity but also significantly enhances our understanding of the human brain's capabilities in processing 3D visual information. Project page at: <a class="link-external link-https" href="https://jianxgao.github.io/MinD-3D" rel="external noopener nofollow">this https URL</a>.

Computer Vision and Pattern Recognition
Penalized matrix decomposition for denoising, compression, and improved demixing of functional imaging data

E. Kelly Buchanan,Ian Kinsella,Ding Zhou,Rong Zhu,Pengcheng Zhou,Felipe Gerhard,John Ferrante,Ying Ma,Sharon Kim,Mohammed Shaik,Yajie Liang,Rongwen Lu,Jacob Reimer,Paul Fahey,Taliah Muhammad,Graham Dempsey,Elizabeth Hillman,Na Ji,Andreas Tolias,Liam Paninski

DOI: https://doi.org/10.48550/arXiv.1807.06203

2018-07-17

Abstract:Calcium imaging has revolutionized systems neuroscience, providing the ability to image large neural populations with single-cell resolution. The resulting datasets are quite large, which has presented a barrier to routine open sharing of this data, slowing progress in reproducible research. State of the art methods for analyzing this data are based on non-negative matrix factorization (NMF); these approaches solve a non-convex optimization problem, and are effective when good initializations are available, but can break down in low-SNR settings where common initialization approaches fail. Here we introduce an approach to compressing and denoising functional imaging data. The method is based on a spatially-localized penalized matrix decomposition (PMD) of the data to separate (low-dimensional) signal from (temporally-uncorrelated) noise. This approach can be applied in parallel on local spatial patches and is therefore highly scalable, does not impose non-negativity constraints or require stringent identifiability assumptions (leading to significantly more robust results compared to NMF), and estimates all parameters directly from the data, so no hand-tuning is required. We have applied the method to a wide range of functional imaging data (including one-photon, two-photon, three-photon, widefield, somatic, axonal, dendritic, calcium, and voltage imaging datasets): in all cases, we observe ~2-4x increases in SNR and compression rates of 20-300x with minimal visible loss of signal, with no adjustment of hyperparameters; this in turn facilitates the process of demixing the observed activity into contributions from individual neurons. We focus on two challenging applications: dendritic calcium imaging data and voltage imaging data in the context of optogenetic stimulation. In both cases, we show that our new approach leads to faster and much more robust extraction of activity from the data.

Neurons and Cognition,Machine Learning
Multiple Instance Neuroimage Transformer

Ayush Singla,Qingyu Zhao,Daniel K. Do,Yuyin Zhou,Kilian M. Pohl,Ehsan Adeli

DOI: https://doi.org/10.1007/978-3-031-16919-9_4

2022-08-20

Abstract:For the first time, we propose using a multiple instance learning based convolution-free transformer model, called Multiple Instance Neuroimage Transformer (MINiT), for the classification of T1weighted (T1w) MRIs. We first present several variants of transformer models adopted for neuroimages. These models extract non-overlapping 3D blocks from the input volume and perform multi-headed self-attention on a sequence of their linear projections. MINiT, on the other hand, treats each of the non-overlapping 3D blocks of the input MRI as its own instance, splitting it further into non-overlapping 3D patches, on which multi-headed self-attention is computed. As a proof-of-concept, we evaluate the efficacy of our model by training it to identify sex from T1w-MRIs of two public datasets: Adolescent Brain Cognitive Development (ABCD) and the National Consortium on Alcohol and Neurodevelopment in Adolescence (NCANDA). The learned attention maps highlight voxels contributing to identifying sex differences in brain morphometry. The code is available at <a class="link-external link-https" href="https://github.com/singlaayush/MINIT" rel="external noopener nofollow">this https URL</a>.

Computer Vision and Pattern Recognition,Machine Learning

[Biosynthesis of homovanilloylgycine during the perfusion of rat liver].

Miniature: Unsupervised glimpses into multiplexed tissue imaging datasets as thumbnails for data portals

MINT: a toolbox for the analysis of multivariate neural information coding and transmission

Minian, an open-source miniscope analysis pipeline

A New Generation of the IMAGIC Image Processing System

OME-NGFF: a next-generation file format for expanding bioimaging data-access strategies

xIV-LDDMM Toolkit: A Suite of Image-Varifold Based Technologies for Representing and Mapping 3D Imaging and Spatial-omics Data Simultaneously Across Scales

Nanoscale Connectomics Annotation Standards Framework

ACID: A Comprehensive Toolbox for Image Processing and Modeling of Brain, Spinal Cord, and Post-mortem Diffusion MRI Data

Integrating Multimodal Neuroimaging and Genetics: A Structurally-Linked Sparse Canonical Correlation Analysis Approach

Implicit Neural Image Field for Biological Microscopy Image Compression

EM and XRM Connectomics Imaging and Experimental Metadata Standards

A Semantic Cross-Species Derived Data Management Application

Methods for Specifying Scientific Data Standards and Modeling Relationships with Applications to Neuroscience

MolNetInvert: A Tool for Creating Metadata Based Molecular Networks and Their Applications in Large Microbial Datasets

GAN-MAT: Generative Adversarial Network-based Microstructural Profile Covariance Analysis Toolbox

MiniMounter: a low‐cost miniaturized microscopy development toolkit for image quality control and enhancement

Miniature microscopes for manipulating and recording in vivo brain activity

MinD-3D: Reconstruct High-quality 3D objects in Human Brain

Penalized matrix decomposition for denoising, compression, and improved demixing of functional imaging data

Multiple Instance Neuroimage Transformer