Potential efficacy of interleukin-1β inhibition in lung cancer

B. Jenkins

DOI: https://doi.org/10.1016/S0140-6736(17)32289-4

IF: 202.731

2017-10-21

The Lancet

Abstract:

What problem does this paper attempt to address?

Multi-scale Cross-form Pyramid Network for Stereo Matching

Zhidong Zhu,Mingyi He,Yuchao Dai,Zhibo Rao,Bo Li

DOI: https://doi.org/10.48550/arXiv.1904.11309

2019-06-04

Abstract:Stereo matching plays an indispensable part in autonomous driving, robotics and 3D scene reconstruction. We propose a novel deep learning architecture, which called CFP-Net, a Cross-Form Pyramid stereo matching network for regressing disparity from a rectified pair of stereo images. The network consists of three modules: Multi-Scale 2D local feature extraction module, Cross-form spatial pyramid module and Multi-Scale 3D Feature Matching and Fusion module. The Multi-Scale 2D local feature extraction module can extract enough multi-scale features. The Cross-form spatial pyramid module aggregates the context information in different scales and locations to form a cost volume. Moreover, it is proved to be more effective than SPP and ASPP in ill-posed regions. The Multi-Scale 3D feature matching and fusion module is proved to regularize the cost volume using two parallel 3D deconvolution structure with two different receptive fields. Our proposed method has been evaluated on the Scene Flow and KITTI datasets. It achieves state-of-the-art performance on the KITTI 2012 and 2015 benchmarks.

Computer Vision and Pattern Recognition
Stereo Matching Using Multi-Level Cost Volume and Multi-Scale Feature Constancy

Zhengfa Liang,Yulan Guo,Yiliu Feng,Wei Chen,Linbo Qiao,Li Zhou,Jianfeng Zhang,Hengzhu Liu

DOI: https://doi.org/10.1109/tpami.2019.2928550

IF: 23.6

2019-01-01

IEEE Transactions on Pattern Analysis and Machine Intelligence

Abstract:For CNNs based stereo matching methods, cost volumes play an important role in achieving good matching accuracy. In this paper, we present an end-to-end trainable convolution neural network to fully use cost volumes for stereo matching. Our network consists of three sub-modules, i.e., shared feature extraction, initial disparity estimation, and disparity refinement. Cost volumes are calculated at multiple levels using the shared features, and are used in both initial disparity estimation and disparity refinement sub-modules. To improve the efficiency of disparity refinement, multi-scale feature constancy is introduced to measure the correctness of the initial disparity in feature space. These sub-modules of our network are tightly-coupled, making it compact and easy to train. Moreover, we investigate the problem of developing a robust model to perform well across multiple datasets with different characteristics. We achieve this by introducing a two-stage finetuning scheme to gently transfer the model to target datasets. Specifically, in the first stage, the model is finetuned using both a large synthetic dataset and the target datasets with a relatively large learning rate, while in the second stage the model is trained using only the target datasets with a small learning rate. The proposed method is tested on several benchmarks including the Middlebury 2014, KITTI 2015, ETH3D 2017, and SceneFlow datasets. Experimental results show that our method achieves the state-of-the-art performance on all the datasets. The proposed method also won the 1st prize on the Stereo task of Robust Vision Challenge 2018.
Practical Stereo Matching via Cascaded Recurrent Network with Adaptive Correlation

Jiankun Li,Peisen Wang,Pengfei Xiong,Tao Cai,Ziwei Yan,Lei Yang,Jiangyu Liu,Haoqiang Fan,Shuaicheng Liu

DOI: https://doi.org/10.48550/arXiv.2203.11483

2022-03-22

Computer Vision and Pattern Recognition

Abstract:With the advent of convolutional neural networks, stereo matching algorithms have recently gained tremendous progress. However, it remains a great challenge to accurately extract disparities from real-world image pairs taken by consumer-level devices like smartphones, due to practical complicating factors such as thin structures, non-ideal rectification, camera module inconsistencies and various hard-case scenes. In this paper, we propose a set of innovative designs to tackle the problem of practical stereo matching: 1) to better recover fine depth details, we design a hierarchical network with recurrent refinement to update disparities in a coarse-to-fine manner, as well as a stacked cascaded architecture for inference; 2) we propose an adaptive group correlation layer to mitigate the impact of erroneous rectification; 3) we introduce a new synthetic dataset with special attention to difficult cases for better generalizing to real-world scenes. Our results not only rank 1st on both Middlebury and ETH3D benchmarks, outperforming existing state-of-the-art methods by a notable margin, but also exhibit high-quality details for real-life photos, which clearly demonstrates the efficacy of our contributions.
Few-Shot Stereo Matching with High Domain Adaptability Based on Adaptive Recursive Network

Rongcheng Wu,Mingzhe Wang,Zhidong Li,Jianlong Zhou,Fang Chen,Xuan Wang,Changming Sun

DOI: https://doi.org/10.1007/s11263-023-01953-0

IF: 13.369

2023-11-24

International Journal of Computer Vision

Abstract:Deep learning based stereo matching algorithms have been extensively researched in areas such as robot vision and autonomous driving due to their promising performance. However, these algorithms require a large amount of labeled data for training and encounter inadequate domain adaptability, which degraded their applicability and flexibility. This work addresses the two deficiencies and proposes a few-shot trained stereo matching model with high domain adaptability. In the model, stereo matching is formulated as the problem of dynamic optimization in the possible solution space, and a multi-scale matching cost computation method is proposed to obtain the possible solution space for the application scenes. Moreover, an adaptive recurrent 3D convolutional neural network is designed to determine the optimal solution from the possible solution space. Experimental results demonstrate that the proposed model outperforms the state-of-the-art stereo matching algorithms in terms of training requirements and domain adaptability.

computer science, artificial intelligence
Edge supervision and multi-scale cost volume for stereo matching

Xiaowei Yang,Zhiguo Feng,Yong Zhao,Guiying Zhang,Lin He

DOI: https://doi.org/10.1016/j.imavis.2021.104336

IF: 3.86

2022-01-01

Image and Vision Computing

Abstract:Recently, methods based on Convolutional Neural Network have achieved huge progress in stereo matching. However, it is still difficult to find accurate matching points in inherently ill-posed regions (e.g., weak texture areas and around object edges), in which the accuracy of disparity estimate can be improved by the corresponding geometric constraints. To tackle this problem, we innovatively generate the depth ground-truth boundary dataset by mining the instance segmentation and semantic segmentation datasets and propose RDNet, which incorporates edge cues into stereo matching. The network learns geometric information through a separate processing branch edge stream, which can process feature information in parallel with the stereo stream. The edge stream removes noise and only focuses on processing the relevant boundary information. Besides, we introduce a multi-scale cost volume in hierarchical cost aggregation to enlarge the receptive fields and capture structural and global representations that can significantly improve the ability of scene understanding and disparity estimation accuracy. Moreover, a disparity refinement network with several dilated convolutions is applied to further improve the accuracy of the final disparity estimation. The proposed method is evaluated on Sceneflow, KITTI 2015 and KITTI 2012 benchmark datasets, and the qualitative and quantitative results demonstrate that the proposed RDNet significantly achieves the state-of-the-art stereo matching performance.

computer science, artificial intelligence, theory & methods,engineering, electrical & electronic, software engineering,optics
Re-Parameterized Real-Time Stereo Matching Network Based on Mixed Cost Volumes Toward Autonomous Driving

Bowen Yao,Wei Wei,Jinhao Huang,Bifa Liang,Jun Li

DOI: https://doi.org/10.1109/tits.2023.3295930

IF: 8.5

2023-01-01

IEEE Transactions on Intelligent Transportation Systems

Abstract:3D perception is an essential capability of autonomous vehicles. Most state-of-the-art stereo matching networks pursue higher prediction accuracy at the cost of the inference speed. However, high demand on computational resource pushes the cost of hardware, hindering practical applications of stereo matching. In this paper, we propose RMCNet, a novel re-parameterized coarse-to-fine network for stereo matching. RMCNet achieves real time on edge devices while outputs accurate disparity maps. To reduce the computing complexity of 3D convolution in cost aggregation, we propose Mixed Cost Volumes that consist of 4D and 3D cost volumes, enabling efficient optimization of the initial disparity map for real-time inference. An Efficient Feature Matching module is proposed to provide absolute disparity candidates for 3D cost volume. To increase the reliability of 4D and 3D cost volumes, we propose a simple but efficient 3D cost aggregation module and a pyramid 2D cost aggregation module for the aggregation of Mixed Cost Volumes. Moreover, we propose a Re-parameterized Channel Sensing module and a Re-parameterized Disparity-Aware module to replace 2D and 3D convolutional blocks with residual connections. Being evaluated on KITTI 2012 and KITTI 2015, the comprehensive performance of the proposed network is improved by the re-parameterization approach. Outstanding trade-off between accuracy and speed on edge devices over existing SOTA works is achieved. With fast average inference speed on NVIDIA Jetson Nano of 33.74 FPS, the accuracy in terms of 3px-all on KITTI 2012 test set and D1-all on KITTI 2015 test set are 3.01% and 3.41%, respectively.

engineering, electrical & electronic,transportation science & technology, civil
Multi-Dimensional Cooperative Network for Stereo Matching

Wei Chen,Xiaogang Jia,Mingfei Wu,Zhengfa Liang

DOI: https://doi.org/10.1109/lra.2021.3130984

IF: 5.2

2022-01-01

IEEE Robotics and Automation Letters

Abstract:The dimensions of cost volumes and corresponding aggregation networks play a critical role in balancing the speed and accuracy for stereo matching. Current most 2D stereo networks based on 3D cost volumes are speedy but poor in precision, while 3D stereo networks with 4D volumes are slow but precise. To tackle this problem, we propose a novel stereo framework for combining 2D and 3D networks. The disparity range generated by the 2D network is used to guide the 3D network and reduce the computational complexity. Meanwhile, the 3D network can refine the rough disparity from coarse to fine. Through the cooperation of 2D and 3D networks, our method can achieve accurate stereo results at a fast speed. We evaluate our method on three popular public benchmark datasets. Experimental results from the KITTI official website show that, our method can achieve similar accuracy with other 3D stereo networks (PSMNet, GCNet, GwcNet, etc.) at a significantly faster speed. The ablation studies further demonstrate the facticity and reasonability of our propose method.

robotics
AdaStereo: An Efficient Domain-Adaptive Stereo Matching Approach

Xiao Song,Guorun Yang,Xinge Zhu,Hui Zhou,Yuexin Ma,Zhe Wang,Jianping Shi

DOI: https://doi.org/10.48550/arXiv.2112.04974

2021-12-09

Abstract:Recently, records on stereo matching benchmarks are constantly broken by end-to-end disparity networks. However, the domain adaptation ability of these deep models is quite limited. Addressing such problem, we present a novel domain-adaptive approach called AdaStereo that aims to align multi-level representations for deep stereo matching networks. Compared to previous methods, our AdaStereo realizes a more standard, complete and effective domain adaptation pipeline. Firstly, we propose a non-adversarial progressive color transfer algorithm for input image-level alignment. Secondly, we design an efficient parameter-free cost normalization layer for internal feature-level alignment. Lastly, a highly related auxiliary task, self-supervised occlusion-aware reconstruction is presented to narrow the gaps in output space. We perform intensive ablation studies and break-down comparisons to validate the effectiveness of each proposed module. With no extra inference overhead and only a slight increase in training complexity, our AdaStereo models achieve state-of-the-art cross-domain performance on multiple benchmarks, including KITTI, Middlebury, ETH3D and DrivingStereo, even outperforming some state-of-the-art disparity networks finetuned with target-domain ground-truths. Moreover, based on two additional evaluation metrics, the superiority of our domain-adaptive stereo matching pipeline is further uncovered from more perspectives. Finally, we demonstrate that our method is robust to various domain adaptation settings, and can be easily integrated into quick adaptation application scenarios and real-world deployments.

Computer Vision and Pattern Recognition
Playing to Vision Foundation Model's Strengths in Stereo Matching

Chuang-Wei Liu,Qijun Chen,Rui Fan

2024-04-09

Abstract:Stereo matching has become a key technique for 3D environment perception in intelligent vehicles. For a considerable time, convolutional neural networks (CNNs) have remained the mainstream choice for feature extraction in this domain. Nonetheless, there is a growing consensus that the existing paradigm should evolve towards vision foundation models (VFM), particularly those developed based on vision Transformers (ViTs) and pre-trained through self-supervision on extensive, unlabeled datasets. While VFMs are adept at extracting informative, general-purpose visual features, specifically for dense prediction tasks, their performance often lacks in geometric vision tasks. This study serves as the first exploration of a viable approach for adapting VFMs to stereo matching. Our ViT adapter, referred to as ViTAS, is constructed upon three types of modules: spatial differentiation, patch attention fusion, and cross-attention. The first module initializes feature pyramids, while the latter two aggregate stereo and multi-scale contextual information into fine-grained features, respectively. ViTAStereo, which combines ViTAS with cost volume-based stereo matching back-end processes, achieves the top rank on the KITTI Stereo 2012 dataset and outperforms the second-best network StereoBase by approximately 7.9% in terms of the percentage of error pixels, with a tolerance of 3 pixels. Additional experiments across diverse scenarios further demonstrate its superior generalizability compared to all other state-of-the-art approaches. We believe this new paradigm will pave the way for the next generation of stereo matching networks.

Computer Vision and Pattern Recognition,Artificial Intelligence,Robotics
Multi-Scale Cost Volumes Cascade Network for Stereo Matching

Xiaogang Jia,Wei Chen,Chen Li Zhengfa Liang,Mingfei Wu,Yusong Tan,Libo Huang

DOI: https://doi.org/10.1109/icra48506.2021.9560864

2021-01-01

Abstract:Stereo matching is essential for robot navigation. However, the accuracy of current widely used traditional methods is low, while methods based on CNN need expensive computational cost and running time. This is because different cost volumes play a crucial role in balancing speed and accuracy. Thus we propose MSCVNet, which combines traditional methods and neural networks to improve the quality of cost volume. Concretely, our network first generates multiple 3D cost volumes with different resolutions and then uses 2D convolutions to construct a novel cascade hourglass network for cost aggregation. Meanwhile, we design an algorithm to distinguish and calculate the loss for discontinuous areas of the disparity result. According to the KITTI official website, our network is much faster than most top-performing methods (24than CSPN, 44than GANet, etc.). Meanwhile, compared to traditional methods (SPS-St, SGM) and other real-time stereo matching networks (Fast DS-CS, DispNetC, and RTSNet, etc.), our network achieves a big improvement in accuracy, demonstrating the feasibility and capability of the proposed method.
A Joint 2D-3D Complementary Network for Stereo Matching

Xiaogang Jia,Wei Chen,Zhengfa Liang,Xin Luo,Mingfei Wu,Chen Li,Yulin He,Yusong Tan,Libo Huang

DOI: https://doi.org/10.3390/s21041430

IF: 3.9

2021-02-18

Sensors

Abstract:Stereo matching is an important research field of computer vision. Due to the dimension of cost aggregation, current neural network-based stereo methods are difficult to trade-off speed and accuracy. To this end, we integrate fast 2D stereo methods with accurate 3D networks to improve performance and reduce running time. We leverage a 2D encoder-decoder network to generate a rough disparity map and construct a disparity range to guide the 3D aggregation network, which can significantly improve the accuracy and reduce the computational cost. We use a stacked hourglass structure to refine the disparity from coarse to fine. We evaluated our method on three public datasets. According to the KITTI official website results, Our network can generate an accurate result in 80 ms on a modern GPU. Compared to other 2D stereo networks (AANet, DeepPruner, FADNet, etc.), our network has a big improvement in accuracy. Meanwhile, it is significantly faster than other 3D stereo networks (5× than PSMNet, 7.5× than CSN and 22.5× than GANet, etc.), demonstrating the effectiveness of our method.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
Exploiting Semantic and Boundary Information for Stereo Matching

Peng Fang,Tan Yu,Zhang Cheng

DOI: https://doi.org/10.1007/s11265-021-01675-x

2021-01-01

Journal of Signal Processing Systems

Abstract:Stereo matching aims to estimating disparity by finding the correspondence of each pixel between two images which is crucial to 3D scene reconstruction. Nowadays 3D convolution neural networks achieve impressive performances on stereo matching. However, it is memory consuming and computation complex. And it is challenging to finding the corresponding pixels in textureless and near boundary regions. Therefore, a stereo matching neural network is proposed which use semantic segmentation and boundary detection task to improve the accuracy of stereo matching near boundary and textureless regions. And a hybrid cost volume which reflects the similarity between left and right feature map, is designed to contains semantic cost volume and boundary cost volume with attention mechanism. The stereo matching neural network is designed to rely on coarse-to-fine strategy which predict a complete disparity map at the highest resolution and refine disparity at the lower resolution. We conduct comprehensive experiments on KITTI 2015 datasets, and compare with some recent stereo matching neural networks, the D1-all (3-pixel error) is 2.8% and run time is 0.044s which shows that embedding semantic and boundary information can improve the accuracy of stereo matching.
Co-Teaching: An Ark to Unsupervised Stereo Matching

Hengli Wang,Rui Fan,Ming Liu

DOI: https://doi.org/10.48550/arXiv.2107.08186

2021-07-17

Abstract:Stereo matching is a key component of autonomous driving perception. Recent unsupervised stereo matching approaches have received adequate attention due to their advantage of not requiring disparity ground truth. These approaches, however, perform poorly near occlusions. To overcome this drawback, in this paper, we propose CoT-Stereo, a novel unsupervised stereo matching approach. Specifically, we adopt a co-teaching framework where two networks interactively teach each other about the occlusions in an unsupervised fashion, which greatly improves the robustness of unsupervised stereo matching. Extensive experiments on the KITTI Stereo benchmarks demonstrate the superior performance of CoT-Stereo over all other state-of-the-art unsupervised stereo matching approaches in terms of both accuracy and speed. Our project webpage is <a class="link-external link-https" href="https://sites.google.com/view/cot-stereo" rel="external noopener nofollow">this https URL</a>.

Computer Vision and Pattern Recognition,Robotics
A Fast Stereo Matching Network with Multi-Cross Attention

Ming Wei,Ming Zhu,Yi Wu,Jiaqi Sun,Jiarong Wang,Changji Liu

DOI: https://doi.org/10.3390/s21186016

IF: 3.9

2021-09-08

Sensors

Abstract:Stereo matching networks based on deep learning are widely developed and can obtain excellent disparity estimation. We present a new end-to-end fast deep learning stereo matching network in this work that aims to determine the corresponding disparity from two stereo image pairs. We extract the characteristics of the low-resolution feature images using the stacked hourglass structure feature extractor and build a multi-level detailed cost volume. We also use the edge of the left image to guide disparity optimization and sub-sample with the low-resolution data, ensuring excellent accuracy and speed at the same time. Furthermore, we design a multi-cross attention model for binocular stereo matching to improve the matching accuracy and achieve end-to-end disparity regression effectively. We evaluate our network on Scene Flow, KITTI2012, and KITTI2015 datasets, and the experimental results show that the speed and accuracy of our method are excellent.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
An efficient and accurate multi-level cascaded recurrent network for stereo matching

Ziyu Zhong,Xiuze Yang,Xiubian Pan,Wei Guan,Ke Liang,Jing Li,Xiaolan Liao,Shuo Wang

DOI: https://doi.org/10.1038/s41598-024-57321-6

IF: 4.6

2024-04-10

Scientific Reports

Abstract:With the advent of Transformer-based convolutional neural networks, stereo matching algorithms have achieved state-of-the-art accuracy in disparity estimation. Nevertheless, this method requires much model inference time, which is the main reason limiting its application in many vision tasks and robots. Facing the trade-off problem between accuracy and efficiency, this paper proposes an efficient and accurate multi-level cascaded recurrent network, LMCR-Stereo. To recover the detailed information of stereo images more accurately, we first design a multi-level network to update the difference values in a coarse-to-fine recurrent iterative manner. Then, we propose a new pair of slow-fast multi-stage superposition inference structures to accommodate the differences between different scene data. Besides, to ensure better disparity estimation accuracy with faster model inference speed, we introduce a pair of adaptive and lightweight group correlation layers to reduce the impact of erroneous rectification and significantly improve model inference speed. The experimental results show that the proposed approach achieves a competitive disparity estimation accuracy with a faster model inference speed than the current state-of-the-art methods. Notably, the model inference speed of the proposed approach is improved by 46.0% and 50.4% in the SceneFlow test set and Middlebury benchmark, respectively.

multidisciplinary sciences
GraftNet: Towards Domain Generalized Stereo Matching with a Broad-Spectrum and Task-Oriented Feature

Biyang Liu,Huimin Yu,Guodong Qi

DOI: https://doi.org/10.1109/cvpr52688.2022.01267

2022-01-01

Abstract:Although supervised deep stereo matching networks have made impressive achievements, the poor generalization ability caused by the domain gap prevents them from being applied to real-life scenarios. In this paper, we propose to leverage the feature of a model trained on large-scale datasets to deal with the domain shift since it has seen various styles of images. With the cosine similarity based cost volume as a bridge, the feature will be grafted to an ordinary cost aggregation module. Despite the broad-spectrum representation, such a low-level feature contains much general information which is not aimed at stereo matching. To recover more task-specific information, the grafted feature is further input into a shallow network to be transformed before calculating the cost. Extensive experiments show that the model generalization ability can be improved significantly with this broad-spectrum and task-oriented feature. Specifically, based on two well-known architectures PSMNet and GANet, our methods are superior to other robust algorithms when transferring from SceneFlow to KITTI 2015, KITTI 2012, and Middlebury. Code is available at https://github.com/SpadeLiu/Graft-PSMNet.
Improved real-time three-dimensional stereo matching with local consistency

Xiaoqian Ye,Binbin Yan,Boyang Liu,Huachun Wang,Shuai Qi,Duo Chen,Peng Wang,Kuiru Wang,Xinzhu Sang

DOI: https://doi.org/10.1016/j.imavis.2022.104509

IF: 3.86

2022-08-01

Image and Vision Computing

Abstract:Existing stereo matching algorithms are unable to meet the real-time and high-performance dual requirements in practical applications. To address this problem, a novel stereo network is proposed, which utilizes the prior of local disparity consistency to improve the performance of real-time disparity estimation. Based on the initial disparity estimation by the light-weight pyramid matching network, novel spatial consistency refinement (SCR) module and time consistency refinement (TCR) module are designed for further disparity refinement. SCR module propagates the neighborhood high-confidence predictions of sparse sampling to unreliable regions for disparity refinement. A single-layer Dynamic Local Filter (DLF) is designed to realize the content-adaptive propagation, which effectively improves the disparity quality without significantly increasing the burden of computation and memory. For real-time disparity estimation of consecutive frames, novel TCR module is further proposed to refine the disparity estimation based on the time local consistency of disparity. The proposed method is evaluated on the Scene Flow and KITTI 2015 datasets with comprehensive experiments. Experimental results demonstrated that our method can achieve high-accuracy disparity estimation and real-time running speed of over 40 FPS, which significantly outperforms the compared networks with similar runtimes.

computer science, artificial intelligence, theory & methods,engineering, electrical & electronic, software engineering,optics
Matching-space Stereo Networks for Cross-domain Generalization

Changjiang Cai,Matteo Poggi,Stefano Mattoccia,Philippos Mordohai

DOI: https://doi.org/10.1109/3dv50981.2020.00046

2020-11-01

Abstract:End-to-end deep networks represent the state of the art for stereo matching. While excelling on images framing environments similar to the training set, major drops in accuracy occur in unseen domains (e.g., when moving from synthetic to real scenes). In this paper we introduce a novel family of architectures, namely Matching-Space Networks (MS-Nets), with improved generalization properties. By replacing learning-based feature extraction from image RGB values with matching functions and confidence measures from conventional wisdom, we move the learning process from the color space to the Matching Space, avoiding over-specialization to domain specific features. Extensive experimental results on four real datasets highlight that our proposal leads to superior generalization to unseen environments over conventional deep architectures, keeping accuracy on the source domain almost unaltered. Our code is available at https://qithub.com/ccj5351/MS-Nets.
Brain Cholesterol XVIII: Effect of Methylphenidate (Ritalin) on [U-14C] Glucose and [2-3H] Acetate Incorporation

J. Kabara

DOI: https://doi.org/10.3181/00379727-150-39070

1975-11-01

Abstract:Summary The effect of a single injection of methylphenidate (Ritalin, 4 mg/kg) on precursor ([2-3H]acetate and [U-14C]glucose) incorporation into brain cholesterol was studied. The drug caused a steady decrease in the concentration of brain cholesterol during the 24-hr period examined. Incorporation studies during this time with [U-14C]glucose indicated higher than normal incorporation for all time periods studied. The most significant incorporation increases took place 2 and 4 hr after drug injection. Experiments using [2-3H]acetate as the sterol precursor gave incorporation values which tended (not significantly) to be lower than control values at 2 and 4 h. The values after 12 hr were less than normal, while the 24-hr group indicated an increase to or slightly higher than normal values. These data suggest that the pharmacological effect of methylphenidate may be due to lowering of brain cholesterol levels directly or on some more basic metabolic process leading to a decreased level of membrane sterols.
Superpixel Guided Network for Three-Dimensional Stereo Matching

Xiaoqian Ye,Xinzhu Sang,Duo Chen,Peng Wang,Kuiru Wang,Binbin Yan,Boyang Liu,Huachun Wang,Shuai Qi

DOI: https://doi.org/10.1109/tci.2021.3139328

IF: 5.4

2022-01-01

IEEE Transactions on Computational Imaging

Abstract:Superpixel provides local pixel coherence and respects object boundary, which is beneficial to stereo matching. Recently, superpixel cues are introduced into deep stereo networks. These methods develop a superpixel-based sampling scheme to downsample input color images and upsample output disparity maps. However, in this way, the image details are inevitably lost in the downsampling and the upsampling process introduces errors in the final disparity as well. Besides, this mechanism further limits the possibility of utilizing larger and multi-scale superpixels, which are important to alleviate the matching ambiguity. To address these problems, a superpixel-guided stereo matching method (LSG-Stereo) is proposed, which explicitly exploits the feature and disparity consistency within multi-scale superpixels to improve disparity estimation. To effectively incorporate superpixel cues into a stereo matching network, two novel modules are designed, including Superpixel Attention Spatial Pyramid Pooling (SA-SPP) and Superpixel-Guided Refinement (SGR). The SA-SPP module takes advantage of the content-aware superpixel pooling to construct an adaptive spatial pooling pyramid for better feature extraction. The SGR module explicitly utilizes the disparity consistency over multi-scale superpixels to further refine the disparity estimation in details and ill-posed regions. The proposed method is evaluated on the Scene Flow dataset, KITTI 2012, and KITTI 2015 stereo benchmarks with comprehensive experiments. Experimental results demonstrate that our method can significantly improve the accuracy of stereo matching, especially in details, occlusions, and texture-less regions.

engineering, electrical & electronic,imaging science & photographic technology

Potential efficacy of interleukin-1β inhibition in lung cancer

Multi-scale Cross-form Pyramid Network for Stereo Matching

Stereo Matching Using Multi-Level Cost Volume and Multi-Scale Feature Constancy

Practical Stereo Matching via Cascaded Recurrent Network with Adaptive Correlation

Few-Shot Stereo Matching with High Domain Adaptability Based on Adaptive Recursive Network

Edge supervision and multi-scale cost volume for stereo matching

Re-Parameterized Real-Time Stereo Matching Network Based on Mixed Cost Volumes Toward Autonomous Driving

Multi-Dimensional Cooperative Network for Stereo Matching

AdaStereo: An Efficient Domain-Adaptive Stereo Matching Approach

Playing to Vision Foundation Model's Strengths in Stereo Matching

Multi-Scale Cost Volumes Cascade Network for Stereo Matching

A Joint 2D-3D Complementary Network for Stereo Matching

Exploiting Semantic and Boundary Information for Stereo Matching

Co-Teaching: An Ark to Unsupervised Stereo Matching

A Fast Stereo Matching Network with Multi-Cross Attention

An efficient and accurate multi-level cascaded recurrent network for stereo matching

GraftNet: Towards Domain Generalized Stereo Matching with a Broad-Spectrum and Task-Oriented Feature

Improved real-time three-dimensional stereo matching with local consistency

Matching-space Stereo Networks for Cross-domain Generalization

Brain Cholesterol XVIII: Effect of Methylphenidate (Ritalin) on [U-14C] Glucose and [2-3H] Acetate Incorporation

Superpixel Guided Network for Three-Dimensional Stereo Matching