400G Pluggables Usher in an Architectural Change to High-Bandwidth DCI

By 海角社区 | Posted on March 25, 2020

Bandwidth demands continue to grow, putting pressure on cloud providers to increase the data center interconnects (DCI) that link their facilities around the globe. This has driven the emergence of new architectures that can support coherent transport in the same form factors as client optics, thereby satisfying those demands in a cost-effective and operationally efficient way. 400G pluggables were designed to be plugged directly into switches and routers, offering the same density for both coherent DWDM and client optics in the same chassis.

This article looks at the work that has been done to bring 400G pluggables to market, starting with a historical perspective on the 400G standards that have been put in place including 400ZR, OpenZR+, and Open ROADM MSA. It also looks at the evolution of silicon photonics, which is now moving beyond proof of performance toward greater focus on advanced packaging technologies that fully leverage the benefits of silicon photonics. This combination offers the potential for improved performance, lower power, scalability, and reliability in small, cost effective form factors.

Historical View of 400G Standards

In late 2016, hyperscale network operators approached the Optical Internetworking Forum (OIF) and proposed a new project, known as 400ZR, targeting DCI edge applications up to 120km, with an objective to target power dissipation of less than 15W.

400G Pluggables Usher in an Architectural Change to High-Bandwidth DCIThe primary 400ZR use case is to apply the technology to DCI edge networks in Data Center Networks.

A comparison of the power trade-offs between modulation format and baud rate led to the adoption of 16QAM at approximately 60Gbaud, and a concatenated (hard-decision + soft-decision) FEC, which supported low-power and sufficient coding gain for the edge application, was selected.

While 400ZR benefited from a well-defined target application, some carrier applications needed features that were excluded from the 400ZR standard, such as the ability to support multiple rates, multiplexing functionality and additional protocol types such as OTU4 DWDM. Carrier applications also have more stringent performance requirements than 400ZR with less focus on density. For these carrier applications the CFP2-DCO form factor provides a good combination of performance, pluggability and density.

With these different priorities, the OpenROADM MSA defined a framing approach that supported line rates of 200G, 300G or 400G, greater host interface flexibility and chose a new high performance soft-decision FEC, called openFEC, which offered higher coding gain more comparable to proprietary implementations typically used in long-haul applications.

In the same timeframe, CableLabs developed a coherent interconnect standard to address the access aggregation requirements of the cable industry. The data rates targeted for this standard were 100G and 200G. This application has its own unique set of requirements but CableLabs recognized the benefit to align with standards activity taking place in the other bodies. It was decided that alignment with the 100G and 200G standards in OpenROADM offered the best combination of benefits for this application, including the high performance openFEC for 200G. The CableLabs standard utilizes a common protocol with OpenROADM, but defined optical specifications that address the specific requirements of the cable access aggregation application.

In late 2019, a new mode was introduced to combine the focus on ethernet traffic of 400ZR, the performance of the OpenROADM specification, and multi-vendor interoperability in order to provide network operators with an operationally efficient solution for DCI applications with reaches beyond 120km. This was known as OpenZR+. The OpenZR+ mode maintains the simpler ethernet-only host interface of 400ZR, but adds support for multi-rate Ethernet and multiplexing capabilities at 100G, 200G, 300G or 400G line interfaces with higher dispersion tolerance and higher coding gain using openFEC selected for standardization by the OpenROADM MSA and CableLabs. These enhanced modes allow an OpenZR+ module in a QSFP-DD or OSFP form factor to support reaches well beyond 400ZR.

Benefits of 400G Pluggable Modules

The use of coherent optics in switches and routers can simplify architectures, resulting in reductions in CapEx and OpEx. The volume driven by DCI applications, combined with higher performance standards, also has the potential to drive more traditional transport applications toward CFP2-DCO solutions.

To address this market shift, 海角社区 is now sampling a comprehensive 400G pluggable portfolio, including , OpenZR+, and . 海角社区鈥檚 400G pluggable module family features an expansive list of interoperability solutions in QSFP-DD, OSFP and CFP2-DCO pluggable form factors for cloud DCIs and service provider networks. These pluggable solutions were designed to enable network operators to address increasing bandwidth demand through a simplified network architecture, reducing both capital and operational expenditures.

海角社区鈥檚 new 400G pluggable modules are based on its Greylock 7nm DSP, which is 海角社区鈥檚 3rd generation of coherent DSP supporting low-power pluggable modules. These new modules were designed using 海角社区鈥檚 3D Siliconization approach, which leverages high volume electronics manufacturing processes, the maturity of 海角社区鈥檚 silicon photonics technology and the company鈥檚 vertical integration strategy. With 3D Siliconization, RF electronics are tightly coupled to the silicon photonics, resulting in improved signal integrity for these higher baud rate applications.

400G Pluggables Usher in an Architectural Change to High-Bandwidth DCI海角社区鈥檚 3D Siliconization technology designed to be highly scalable and reliable.

海角社区鈥檚 400G pluggable modules fit into high-density switch and router client ports for optical interconnect links. A key application of this form-factor is high-capacity coherent optical transmission over data center interconnect (DCI) edge networks, as well as service provider network applications.

Ensuring Scalability and Yield

These solutions are targeting volume applications at cloud providers that are looking for solutions that can scale to meet their demands. By utilizing its 3D siliconization, 海角社区 has been able to move from traditional optics manufacturing, utilizing semiconductor processes to enable these pluggable modules to be made in volume. The company focused on developing advanced packaging technologies to leverage its proven silicon photonics technology. As a result, 海角社区 was able to take the DSP and optics and turn them into an opto-electronic component that can offer increased reliability and a volume-repeatable process.

海角社区鈥檚 new 400G pluggable module family builds upon the technology leadership that 海角社区 has demonstrated in the coherent module market. For example, the company has shipped more than 200,000 coherent silicon photonic integrated circuits since 2014.

As 海角社区 brings these new modules to production, it will continue to focus on operational scale, quality and reliability. Due to the industry standardization efforts discussed earlier, pluggable coherent architectures are expected to become more widespread in the future. 海角社区 was an early innovator in this space and plans to continue executing on the DSP, optics and packaging technology needed to enable these solutions, both from a performance and an operational perspective.