Lighthouse: An Open Research Framework for Optical Data Center Networks

Yiming Lei,Federico De Marchi,Jialong Li,Raj Joshi,Balakrishnan Chandrasekaran,Yiting Xia

2024-11-27

Abstract:Optical data center networks (DCNs) are emerging as a promising design for cloud infrastructure. However, existing optical DCN architectures operate as closed ecosystems, tying software solutions to specific optical hardware. We introduce Lighthouse, an open research framework that decouples software from hardware, allowing them to evolve independently. Central to Lighthouse is the time-flow table abstraction, serving as a common interface between optical hardware and software. We develop Lighthouse on programmable switches, achieving a minimum optical circuit duration of 2 {\mu}s, the shortest duration realized by commodity devices to date. We demonstrate Lighthouse's generality by implementing six optical architectures on an optical testbed and conducted extensive benchmarks on a 108-ToR setup, highlighting system efficiency. Additionally, we present case studies that identify potential research topics enabled by Lighthouse.

Networking and Internet Architecture

What problem does this paper attempt to address?

The problem that this paper attempts to solve is: Existing Optical Data Center Networks (DCNs) architectures operate as closed ecosystems, binding software solutions to specific optical hardware, which hinders the independent development of software and hardware. Moreover, this tight coupling makes the research and innovation of optical DCNs isolated. Each architecture is a closed ecosystem containing specialized optical hardware and customized network systems. System solutions rely on the underlying hardware architecture, which sets a high entry barrier for system researchers, especially those lacking optical expertise.

To overcome these problems, the paper introduces Lighthouse, an open research framework aimed at decoupling software and hardware to enable them to evolve independently. At the core of Lighthouse is the time - flow table abstraction, which serves as a common interface between optical hardware and software. Through this framework, Lighthouse achieves the following goals:

1. **Decouple software and hardware**: Enable software and hardware to develop independently and lower the threshold for research and innovation.
2. **Provide a common interface**: Through the time - flow table abstraction, provide an interface that can be used commonly among different optical architectures.
3. **Support multiple optical architectures**: Be able to achieve a minimum optical circuit duration of 2 microseconds on a programmable switch and implement six different optical architectures on the test platform.
4. **Promote experimentation and verification**: Provide a real - life experimental environment so that different proposals can be verified, compared, and improved, thereby accelerating the innovation cycle.

Therefore, Lighthouse not only solves the problem of tight coupling between software and hardware in existing optical DCN architectures but also provides an open and general - purpose platform for future optical DCN research.