Soil : Scalable Optical Interconnect Network For On-Chip Parallel Memory Access

Yue Wang,Kang Wang,Duan Zhou,Kun Wang,Huaxi Gu

DOI: https://doi.org/10.1364/acpc.2017.su2a.56

2017-01-01

Abstract:An optical interconnect network SOIN is proposed for the on-chip parallel memory, access with better scalability. The 8-rank SOIN is shown and compared with 4-rank SOIN in terms of bandwidth latency and power consumption.

What problem does this paper attempt to address?

Extending On-Chip Interconnects for Rack-Level Remote Resource Access

Yisong Chang,Ke Zhang,Sally A. McKee,Lixin Zhang,Mingyu Chen,Liqiang Ren,Zhiwei Xu

DOI: https://doi.org/10.1109/iccd.2016.7753261

2016-01-01

Abstract:The need to perform data analytics on exploding data volumes coupled with the rapidly changing workloads in cloud computing places great pressure on data-center servers. To improve hardware resource utilization across servers within a rack, we propose Direct Extension of On-chip Interconnects (DEOI), a high-performance and efficient architecture for remote resource access among server nodes. DEOI extends an SoC server node's on-chip interconnect to access resources in adjacent nodes with no protocol changes, allowing remote memory and network resources to be used as if they were local. Our results on a four-node FPGA prototype show that the latency of user-level, cross-node, random reads to DEOI-connected remote memory is as low as 1.16µs, which beats current commercial technologies. We exploit DEOI remote access to improve performance of the Redis in-memory key-value framework by 47%. When using DEOI to access remote network resources, we observe an 8.4% average performance degradation and only a 2.52µs ping-pong latency disparity compared to using local assets. These results suggest that DEOI can be a promising mechanism for increasing both performance and efficiency in next-generation data-center servers.
SAMNoC: A Novel Optical Network-on-Chip for Energy-Efficient Memory Access

Weiwei Fu,Mingmin Yuan,Tianzhou Chen,Li Liu,Minghui Wu

DOI: https://doi.org/10.1109/mcsoc.2014.34

2014-01-01

Abstract:Thanks to recent progresses in optical device integration, nanophotonic interconnect can be applied to build optical network-on-chip (ONoC) for providing connectivity among increasing number of cores and memory modules in future many-core processors. However, there are still challenges in architecture and protocol design of ONoC for massive parallel memory accesses in CMPs, The on-chip memory access traffic exhibits heterogeneity for different nodes, i.e. Cores and memory controllers and different memory packets. This paper analyses on-chip communication characteristics and proposes a novel ONoC named SAMNoC. In SAMNoC, memory controllers are able to make self-arbitration for network resources to support node heterogeneity, and different packets are transmitted in dedicated sub-networks to optimize memory traffic. The memory request sub-network applies efficient global communication via slot and coded tokens to exploit bank level parallelism and the response sub-network can eliminate network bottleneck and process memory transactions quickly when the data is ready. Simulation results on real applications show that our SAMNoC can significantly improve memory performance, compared with other bus-based ONoC alternatives, with lower static power consumption and less number of optical waveguides and micro-rings.
An Inter/Intra-Chip Optical Network for Manycore Processors

Xiaowen Wu,Jiang Xu,Yaoyao Ye,Xuan Wang,Mahdi Nikdast,Zhehui Wang,Zhe Wang

DOI: https://doi.org/10.1109/tvlsi.2014.2319089

2015-01-01

IEEE Transactions on Very Large Scale Integration (VLSI) Systems

Abstract:Manycore processor system is becoming an attractive platform for applications seeking both high performance and high energy efficiency. However, huge communication demands among cores, large power density, and low process yield will be three significant limitations for the scalability of future manycore processors. Breaking a large chip into multiple smaller ones can alleviate the problems of power density and yield, but would worsen the problem of communication efficiency due to the limited off-chip bandwidth. In response, we propose an inter/intra-chip optical network, which will not only fulfill the intra-chip communication requirements but also address the inter-chip communication, by exploiting the advantages of optical links with high bandwidth and energy efficiency. The network is composed of an inter-chip subnetwork and multiple intra-chip subnetworks, and the subnetworks closely coordinate with each other to balance the traffic. The proposed network effectively explores the distinctive properties of optical signals and photonic devices, and dynamically partitions each data channel into multiple sections. Each section can be utilized independently to boost performance as well as reduce energy consumption. Simulation results show that our network can achieve higher throughput with lower power consumption than alternative designs under most of synthetic traffics and real applications.
A New Optical Network-on-Chip Architecture for Chip Multiprocessor

Xiuhua Li,Kang Wang,Ke Chen,Huaxi Gu,Liang Song,Qinfen Hao

DOI: https://doi.org/10.1364/acpc.2015.asu1h.2

2015-01-01

Abstract:A screwy torus topology (STorus) is proposed to improve the performance of network that memory access oriented. STorus divides an optical network into two subnets, and employs waveguide hierarchy. Comparisons between STorus and mesh are made, connecting with 4 memory controllers.
Demonstration of Optically Connected Disaggregated Memory with Hitless Wavelength-Selective Switch

Bin Zhang,Zeyu Yu,Qishen Liang,Zichao Zhao,Bei Chen,Tingge Dai,Kun Yin,Hui Yu,Yuehai Wang,Jianyi Yang

DOI: https://doi.org/10.1109/lpt.2024.3491805

IF: 2.6

2024-01-01

IEEE Photonics Technology Letters

Abstract:We demonstrate a disaggregated optically-connected memory (OCM) architecture that supports dynamic resource allocation. Our proposed architecture utilizes a hitless wavelength-selective switch (WSS) based on silicon photonic (SiP) micro-ring resonators (MRRs) embedded with an equal-armed Mach-Zehnder interferometer, which permits a hitless rerouting of multi-wavelength signals. Error-free operation is achieved between a CPU node and two remote memory nodes using silicon photonic switch fabrics, showing the potential of integrating the photonic switched optically connected memory pools to the large-scale data centers and high performance computing (HPC) systems.
A Scalable Low-Power Optical Chip: Realization and Static Loss Analysis

Yue Wang,Huaxi Gu,Yonghui Tian,Lei Huang,Kang Wang

DOI: https://doi.org/10.1109/lpt.2022.3164749

IF: 2.6

2022-01-01

IEEE Photonics Technology Letters

Abstract:Optical interconnects outperforms the traditional electrical interconnects with lower power consumption, higher bandwidth density and scalability. We propose a scalable optical interconnect for on- chip core-to-memory communication. The key part of the optical interconnect is scalable optical switching blocks, which use less microring resonators with different wavelengths to provide higher parallelism for the memory access communication. We demonstrate the 4-port switching block with six microring resonators. The experimental results show the average insertion loss of 4-port optical switching block is 6.956 dB.
A Scalable Distributed Memory Architecture For Network On Chip

Zhang Yuang,Li Li,Yang Shengguang,Dong Lan,Lou Xiaoxiang,Gao Minglun

DOI: https://doi.org/10.1109/APCCAS.2008.4746256

2008-01-01

Abstract:Besides processors, DSPs and other IP blocks, Network on Chip (NoC) also integrates lots of memories. However, the research of on chip memory subsystem for NoC has not been undertaken thoroughly. In this paper, a distributed None Uniform Memory Access (NUMA) memory architecture for NoC is developed; the performance and the programming mode of this system are discussed. Two kinds of parallel algorithms are implemented, the pipelined matrix multiplication and the full-parallel FFT. Simulation results verify the proposed architecture can achieve high parallelism and provide flexible programming scheme.
A novel micro-ring-based 4 × 4 non-blocking silicon optical router

ZHANG Bin,SONG Shao-hong,WANG Hong-jian,JIANG Xiao-qing,YANG Jian-yi

DOI: https://doi.org/10.7510/jgjs.issn.1001-3806.2013.06.006

2013-01-01

Abstract:Optical network-on-chip( ONoC) has many characteristics superior to electrical interconnection and has emerged as a promising alternative. To improve the performance of optical on-chip networks,a novelring-based 4 × 4nonblocking silicon optical router was proposed by means of optical module method. This structure just composes evenmicroring-resonator-based switching elements and six waveguide crossings,which reduce power consumption,device area and insertion loss. Finally,the topology performance were evalutated in terms of insertion loss and power consumption.The simulation results demonstrate that the proposed architecture consumes 8% less power and 7% less optical insertion loss.
Unified Inter- and Intra-chip Optical Interconnect Networks

Peng Yang,Xiaowen Wu,Yaoyao Ye,Jiang Xu

DOI: https://doi.org/10.1201/9781003339076-3

2022-01-01

Abstract:The demand for high performance and energy efficiency makes many-core processor system a promising platform for modern computing system. The communication of inter/intra-chip is becoming as important as the computation speeds of single processing cores. The huge communication demands also aggravate the power dissipation issue on the increasingly high integration density of individual chips. Spreading the processing cores to different chips can relieve the on chip communication and power problem to some extent. But the overall communication efficiency would suffer from the limited off-chip bandwidth. To this end, we propose unified inter-and intra-chip optical networks, called SUPERB to replace the electrical interconnects for both inter/intra-chip communications. SUPERB is composed of intra-chip networks and inter-chip networks, which can coordinate closely to not only fulfill the intra-chip communication demands, but also relieve the off-chip bandwidth limitation. The evaluations demonstrate that the optical interconnect networks can achieve great improvement on network performance and energy efficiency compared to their electrical counterparts.
An Optimized Low-Power Optical Memory Access Network for Kilocore Systems

Tao Liu,Huaxi Gu,Yue Wang,Wei Zou

DOI: https://doi.org/10.1587/transinf.2018edl8234

2019-01-01

IEICE Transactions on Information and Systems

Abstract:An optimized low-power optical memory access network is proposed to alleviate the cost of microring resonators (MRs) in kilocore systems, such as the pass-by loss and integration difficulty. Compared with traditional electronic bus interconnect, the proposed network reduces power consumption and latency by 80% to 89% and 21% to 24%. Moreover, the new network decreases the number of MRs by 90.6% without an increase in power consumption and latency when making a comparison with Optical Ring Network-on-Chip (ORNoC).
On-Chip Optical Interconnect Roadmap: Challenges and Critical Directions

M Haurylau,H Chen,JD Zhang,GQ Chen,NA Nelson,DH Albonesi,EG Friedman,PM Fauchet

DOI: https://doi.org/10.1109/jstqe.2006.880615

IF: 4.9

2006-01-01

IEEE Journal of Selected Topics in Quantum Electronics

Abstract:Intrachip optical interconnects (OIs) have the potential to outperform electrical wires and to ultimately solve the communication bottleneck in high-performance integrated circuits. Performance targets and critical directions for ICs progress are yet to be fully explored. In this paper, the International Technology Roadmap for Semiconductors (ITRS) is used as a reference to explore the requirements that silicon-based ICs must satisfy to successfully outperform copper electrical interconnects (IEs). Considering the state-of-the-art devices, these requirements are extended to specific IC components.
Electrical And Optical On-Chip Interconnects In Scaled Microprocessors

Gq Chen,H Chen,M Haurylau,N Nelson,D Albonesi,Pm Fauchet,Eg Friedman

2005-01-01

Abstract:Interconnect has become a primary bottleneck in integrated circuit design. As CMOS technology is scaled, it will become increasingly difficult for conventional copper interconnect to satisfy the design requirements of delay, power, bandwidth, and noise. On-chip optical interconnect is therefore being considered as a potential substitute for electrical interconnect. Based on predictions of optical device development, electrical and optical interconnects are compared for various design criteria. The critical dimensions beyond which optical interconnect becomes advantageous over electrical interconnect at the 22 nm technology node are approximately one tenth of the chip edge length.
3-D Mesh-Based Optical Network-on-Chip for Multiprocessor System-on-Chip

Yaoyao Ye,Jiang Xu,Baihan Huang,Xiaowen Wu,Wei Zhang,Xuan Wang,Mahdi Nikdast,Zhehui Wang,Weichen Liu,Zhe Wang

DOI: https://doi.org/10.1109/tcad.2012.2228739

IF: 2.9

2013-01-01

IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems

Abstract:Optical networks-on-chip (ONoCs) are emerging communication architectures that can potentially offer ultrahigh communication bandwidth and low latency to multiprocessor systems-on-chip (MPSoCs). In addition to ONoC architectures, 3-D integrated technologies offer an opportunity to continue performance improvements with higher integration densities. In this paper, we present a 3-D mesh-based ONoC for MPSoCs, and new low-cost nonblocking 4$\,\times\,$4, 5 $\,\times\,$5, 6$\,\times\,$6, and 7$\,\times\,$7 optical routers for dimension-order routing in the 3-D mesh-based ONoC. Besides, we propose an optimized floorplan for the 3-D mesh-based ONoC. The floorplan follows the regular 3-D mesh topology but implements all optical routers in a single optical layer. The floorplan is optimized to minimize the number of extra waveguide crossings caused when merging the 3-D ONoC to one optical layer. Based on a set of real applications and uniform traffic pattern, we develop a SystemC-based cycle-accurate NoC simulator and compare the 3-D mesh-based ONoC with the matched 2-D mesh-based ONoC and 2-D electronic NoC for performance and energy efficiency. Additionally, we quantitatively analyze thermal effects on the 3-D 8 $\,\times\,$8$\,\times\,$2 mesh-based ONoC.
SUOR: Sectioned Undirectional Optical Ring for Chip Multiprocessor

Xiaowen Wu,Jiang Xu,Yaoyao Ye,Zhehui Wang,Mahdi Nikdast,Xuan Wang

DOI: https://doi.org/10.1145/2600072

2014-01-01

Abstract:Chip multiprocessor (CMP) is becoming an attractive platform for applications seeking both high performance and high energy efficiency. In large-scale CMPs, the communication efficiency among cores is crucial for the overall system performance and energy consumption. In this article, we propose a ring-based optical network-on-chip, called SUOR, to fulfill the communication requirement of CMPs. SUOR effectively explores the distinctive properties of optical signals and photonic devices, and dynamically partitions each data channel into multiple sections. Each section can be utilized independently to boost performance as well as reduce energy consumption. We develop a set of distributed control protocols and algorithms for SUOR, but physically allocate the corresponding cluster agents close to each other to benefit from the strengths of optical interconnects at long distances as well as electrical interconnects at short distances. Simulation results show that SUOR outperforms the alternative optical networks under a wide range of traffic patterns. For example, compared with MWSR design, SUOR achieves 2.58× throughput as well as saves 64&percnt; energy consumption on average in a 256-core CMP. Compared with MWMR design, SUOR achieves 1.52× throughput and reduces 73&percnt; energy consumption on average.
A Survey of On-Chip Optical Interconnects

Janibul Bashir,Eldhose Peter,Smruti R. Sarangi

DOI: https://doi.org/10.1145/3267934

IF: 16.6

2019-02-27

ACM Computing Surveys

Abstract:Numerous challenges present themselves when scaling traditional on-chip electrical networks to large manycore processors. Some of these challenges include high latency, limitations on bandwidth, and power consumption. Researchers have therefore been looking for alternatives. As a result, on-chip nanophotonics has emerged as a strong substitute for traditional electrical NoCs. As of 2017, on-chip optical networks have moved out of textbooks and found commercial applicability in short-haul networks such as links between servers on the same rack or between two components on the motherboard. It is widely acknowledged that in the near future, optical technologies will move beyond research prototypes and find their way into the chip. Optical networks already feature in the roadmaps of major processor manufacturers and most on-chip optical devices are beginning to show signs of maturity. This article is designed to provide a survey of on-chip optical technologies covering the basic physics underlying the operation of optical technologies, optical devices, popular architectures, power reduction techniques, and applications. The aim of this survey article is to start from the fundamental concepts and move on to the latest in the field of on-chip optical interconnects.

computer science, theory & methods
A high performance inter-chip fiber communication scheme with short frame protocol

Qinhong Zhang,Zhaolin Li,Songwei Pei

DOI: https://doi.org/10.1109/ICIST.2013.6747674

2013-01-01

Information Science and Technology

Abstract:Optical interconnection is a potential substitute for electrical interconnection in the chip integration field, as it can ultimately solve the problems such as crosstalk and electric migration brought by electrical wires. In the paper, a short frame asynchronous optical communication protocol is proposed to implement the inter-chip optical communication between the microprocessor and the static memory chip. Accordingly, an inter-chip fiber communication system is designed with FPGA to implement the protocol and to verify the inter-chip fiber communication. The experimental results show that the proposed method can work correctly and has a high performance.
A Hierarchical Hybrid Optical-Electronic Network-on-Chip

Mo Kwai Hung,Yaoyao Ye,Xiaowen Wu,Wei Zhang,Weichen Liu,Jiang Xu

DOI: https://doi.org/10.1109/ISVLSI.2010.17

2010-01-01

Abstract:Network-on-chip (NoC) can improve the performance, power efficiency, and scalability of multiprocessor system-on-chip (MPSoC). However, traditional NoCs using metallic interconnects consume significant amount of power to deliver even higher communication bandwidth required in the near future. Optical NoCs are based on CMOS-compatible optical waveguides and micro resonators, and promise significant bandwidth and power advantages. In this paper, we propose a hybrid optical mesh NoC, HOME, which utilizes optical waveguides as well as metallic interconnects in a hierarchical manner. HOME employs a new set of protocols to improve the network throughput and latency. We compared HOME with a matched optical mesh NoC for a 64-core MPSoC in 45nm, using SPICE simulations and our cycle-accurate multi-objective NoC simulation platform, MoLab. Comparing with the optical mesh NoC, HOME uses 75% less optical/electronic interfaces and laser diodes. Simulation results show that HOME achieves 17% higher throughput and 40% less latency while consuming 42% less power.
Optical Versus Electrical: Performance Evaluation of Network On-Chip Topologies for UWASN Manycore Processors

Muhammad Rehan Yahya,Ning Wu,Zain Anwar Ali,Yasir Khizar

DOI: https://doi.org/10.1007/s11277-019-06630-5

IF: 2.017

2019-08-01

Wireless Personal Communications

Abstract:Optical network on chip (ONoC) has evolved as an innovative technology for on-chip interconnects that can fulfill the upcoming requirements of manycore processors used in UWASN. The objective of this paper is two-fold, first we assessed the performance of electrical and optical NoC mesh and torus topologies with 64 and 144 nodes. We explored the impact of different packet and network sizes on average latency and throughput of NoCs. Furthermore, we investigated the effect of application mapping on crosstalk noise, laser power consumption and SNR for optical mesh/torus architectures under real time benchmark applications. The experimental outcomes revealed that ONoC has advantages of improved average latency and improved throughput for large packet size. Second, we proposed a hybrid optical–electrical NoC topology based on multi write single read serpentine optical bus architecture aiming to minimize the communication latency and energy consumption. We present an optimized routing algorithm for the proposed topology that exploits the advantage of processing parallelism level to reduce latency in hybrid network. The proposed topology proved to be 48% and 53% efficient in latency, 12% and 17% higher in throughput and provides 54% and 23% reduction in energy consumption under uniform random and hotspot traffic patterns respectively as compared to other NoC architectures.

telecommunications
Design of a Hierarchical Clos-Benes Optical Network-on-Chip Architecture

Renjie Yao,Yaoyao Ye,Weichen Liu

DOI: https://doi.org/10.1109/ISVLSI.2019.00100

2019-01-01

Abstract:As chip multiprocessors keep growing in capability, on-chip communication efficiency is crucial to the overall performance. However, on-chip networks based on electronic switches suffer from excessive power consumption and limited performance. In order to take advantages of optical interconnect for large-scale on-chip communication in chip multiprocessors, we propose a design of hierarchical Clos-Benes optical network-on-chip (NoC) with an optimized control and routing scheme. The proposed control and routing scheme includes a priority based round-robin virtual output queue selection and a Q-learning based heuristic routing algorithm for the Clos network, and a traffic-aware adaptive routing for the intra-switch Benes network. By taking network load and runtime path allocation into account, the proposed Q-learning based heuristic routing can finally predict the best alternative path among all possible available paths with a much better path allocation success rate. A case study on a 256-core chip multiprocessor under uniform traffic shows that the network throughput is increased by 400%, 60%, and 16% respectively than the mesh, fattree and the baseline Clos-Benes optical NoC. On average of a set of real applications, the application ETE delay is reduced by 48%, 29%, and 20% respectively than the mesh, fattree and the baseline Clos-Benes network.

Soil : Scalable Optical Interconnect Network For On-Chip Parallel Memory Access

Extending On-Chip Interconnects for Rack-Level Remote Resource Access

SAMNoC: A Novel Optical Network-on-Chip for Energy-Efficient Memory Access

An Inter/Intra-Chip Optical Network for Manycore Processors

A New Optical Network-on-Chip Architecture for Chip Multiprocessor

Demonstration of Optically Connected Disaggregated Memory with Hitless Wavelength-Selective Switch

A Scalable Low-Power Optical Chip: Realization and Static Loss Analysis

A Scalable Distributed Memory Architecture For Network On Chip

A novel micro-ring-based 4 × 4 non-blocking silicon optical router

Unified Inter- and Intra-chip Optical Interconnect Networks

An Optimized Low-Power Optical Memory Access Network for Kilocore Systems

On-Chip Optical Interconnect Roadmap: Challenges and Critical Directions

Electrical And Optical On-Chip Interconnects In Scaled Microprocessors

3-D Mesh-Based Optical Network-on-Chip for Multiprocessor System-on-Chip

SUOR: Sectioned Undirectional Optical Ring for Chip Multiprocessor

A Survey of On-Chip Optical Interconnects

A high performance inter-chip fiber communication scheme with short frame protocol

A Hierarchical Hybrid Optical-Electronic Network-on-Chip

Optical Versus Electrical: Performance Evaluation of Network On-Chip Topologies for UWASN Manycore Processors

Design of a Hierarchical Clos-Benes Optical Network-on-Chip Architecture