25GbE Cabling vs 40GbE Cabling

In recent years, 40 Gigabit Ethernet (GbE) has gained more popularity and the market of 40GbE is encouraging. But with the rapid growth of the new standard 100GbE, a new voice is announcing, namely 25GbE. As the increasing bandwidth requirements of private and public cloud data centers and communication service providers, 25GbE will to have a significant impact on server interconnect interfaces. Now you have two upgrade paths to 100G, 10G-25G-100G and 10G-40G-100G. Which one to choose? This post will make a comparison of 25GbE and 40GbE cabling, hoping it can help you make an appropriate decision.

25GbE Cabling Overview

25GbE is a standard developed by developed by IEEE 802.3 task forces P802.3by, used for Ethernet servers and switches connectivity in a datacenter environment. The single-lane design of 25 GbE gives it a low cost per bit, which enables cloud providers and large-scale data center operators to deploy fewer switches to meet the needs while still scaling their network infrastructure.

25GbE physical interface specification supports two main form factors, SFP28 (1×25 Gbps) and QSFP28 (4×25 Gbps). 25GBASE-SR SFP28 is an 850nm VCSEL 25GbE transceiver available in the market. It is designed to transmit and receive optical data over 50/125µm multi-mode optical fiber (MMF) and support up to 70m on OM3 MMF and 100m on OM4 MMF (LC duplex). In fact, using an SFP28 direct attach copper (DAC) cable for switches direct connection is a preferred option now. In addition, a more cost-effective solution is to use a QSFP28 to 4xSFP28 breakout cable to connect a 100GbE QSFP28 switch port with four SFP28 ports. DAC cable lengths are limited to three meters for 25GbE. Thus, active optic cable (AOC) solutions are also used for longer lengths of applications.

40GbE Cabling Overview

40GbE is a standard developed by the IEEE 802.3ba task force. The official development of 40GbE standards first began in January 2008, and were officially approved in June 2010. At the heart of the 40GbE network layer is a pair of transceivers connected by a fiber optic cable, OM4 or OM3 fiber cable. Fiber optic transceivers are plugged into either network servers or a variety of components, including interface cards and switches.

There are several standard form factors of 40GbE transceivers in the whole evolution. The CFP (C form-factor pluggable) transceiver uses 12 Tx and 12 Rx 10Gbps lanes to support one 100GbE port, or up to three 40GbE ports. With its large size, it can meet the needs of single-mode optics and can easily serve multi-mode optics or copper. But it is gradually falling behind since the increasing demand for high density. Another form factor is the CXP. It also provides twelve 10Gbps lanes in each direction, but is much smaller than the CFP and serves the needs of multi-mode optics and copper. At present, the most commonly used 40GbE form factor is the QSFP+ (quad small form-factor pluggable plus). It has the similar size with CXP but can provide four Tx and four Rx lanes to support 40GbE applications for single-mode, multi-mode fiber and copper.

Fiber optic cabling and copper cabling are both available for 40 GbE. The supportable channel length depends on the cable and the transceiver type. For data center 40GbE fiber optic cabling, OM3 and OM4 multi-mode cables are generally recommended because they can support a wider range of deployment configurations compared to copper solutions, and lower costs compared to single-mode solutions. MPO/MTP connectors are used at the multimode transceivers to support the multifiber parallel optics channels. For copper solutions, you can use QSFP+ direct attach copper cables, such as Cisco QSFP+ breakout cable. There are a lot of options, both active and passive, like Cisco QSFP-4SFP10G-CU5M compatible 40G QSFP+ to 4x10G SFP+ passive direct attach copper breakout cable (as shown below).

Cisco QSFP-4SFP10G-CU5M Compatible 40G QSFP+ to 4x10G SFP+ Passive DAC

25GbE Cabling vs 40GbE Cabling

Compared to 40 GbE, 25GbE seems to be more suitable and cost-effective for cloud and web-scale data center applications. Using 25GbE with QSFP28 transceivers, users can deliver a single-lane connection, similar to the existing 10GbE technology but with 2.5X faster performance. In addition, 25GbE can provide superior switch port density by requiring just one lane (vs. 4 lanes with 40 GbE). Thus, it costs less and requires lower power consumption. Benefits of 25GbE compared to 40GbE are shown as below:

  • Greater port density vs 40 GbE (one lane vs. four lanes)
  • Maximum switch I/O performance and fabric capability
  • Lower cost versus 40 GbE
  • Reduced capital expenditures (CAPEX) and operational expenditures (OPEX)
  • Fewer ToR switches and fewer cables
  • Requires less power, cooling, and footprint
  • Leverage of the existing IEEE 100GbE standard
Summary

25GbE seems to be a preferred option in the next step. It can provide up to 2.5 times faster performance than the existing 10GbE connections while maximizing the Ethernet controller bandwidth/pin and switch fabric capability. It can also provide greater port density with lower cost compared to 40GbE solutions. The trend will always be wider band and higher speed and port density. 25GbE or 40 GbE, let’s wait and see how things play out.

Introduction to 40GbE Components

40GbE (Gigabit Ethernet) is an Ethernet standard which enables the transfer of Ethernet frames at speeds of up to 40 gigabits per second (Gbps) and addresses physical layer specifications for communication across backplanes, copper cabling, multimode fiber and single-mode fiber. 40GbE standard is becoming a new generation of high-speed and high-demand computing applications. Like 1GbE and 10GbE networks, the heart of the 40GbE network layer is a pair of transceiver modules which are connected by a patch cable. Optical transceiver modules and fiber patch cables are two basic types of components for 40GbE transmission. In this post, these two kinds of components for 40GbE transmission will be introduced.

40GbE Transceivers

40GbE transceivers are being developed along several standard form factors.

CXP Transceiver

The CXP form factor transceiver provides twelve lanes in each direction. It has a smaller size than the CFP transceiver. CXP transceiver serves the needs of multimode optics and copper. The Roman number “X” means that each channel has a transmission rate of 10 Gbps. CXP is a kind of hot-pluggable transceiver with data rate up to 12×10 Gbps.

CFP Transceiver

The CFP (C form-factor pluggable) transceiver also features twelve transmit and twelve receive 10Gbps lanes to support one 100GbE port, or up to three 40GbE ports. It is suitable for the needs of single-mode optics and can easily serve multimode optics or copper as well.

QSFP/QSFP+ Transceiver

The QSFP/QSFP+ (quad small-form-factor pluggable) transceiver has similar size with the CXP transceiver. It provides four transmit and four receive lanes to support 40GbE applications for multi-mode and single-mode fiber and copper today. QSFP+ transceiver is the most popular interface of 40G transceivers now. Two main types of QSFP+ transceivers are commonly used in the data center: short reach (QSFP-40G-SR4) for ~100 meters transmission on multimode fiber and long reach (QSFP-40G-LR4) for 100 meters to 10km using single-mode fiber. And there are other types of QSFP+ modules according to different objectives, such as 40GBASE-ER4, 40GBASE-LX4 (like JNP-QSFP-40G-LX4), 40GBASE-PLRL4 QSFP+, etc.

40GbE Cables and Connectors

Fiber optic cable and copper cable are two mainly cabling choices for 40 GbE. OM3 and OM4 multi-mode fiber optic cables are generally recommended for 40GbE data center applications. They support a wider range of deployment configurations compared to copper cabling. The cost of using OM3 and OM4 multimode cabling solution is lower than the single-mode cabling solution. The supportable channel length depends on the cable and the transceiver type. With regard to connectors, MPO/MTP connectors for multimode transceivers can support multifiber parallel optics channels.

DAC and AOC

Direct attach copper cable (DAC) and active optical cable (AOC) are ideal solutions for short-distance interconnection. They are widely used in data centers. Especially 40G QSFP+ breakout cables, with various of advantages compared with copper solutions and transceiver modules, are cost-effective solutions for 40GbE.

40G DAC includes active DACs and passive DACs. 40GbE passive copper cables provide robust connections for 40G systems and have low power consumption which improves data center power consumption and thermal efficiency, which makes them ideal for 40G LAN, HPC and SAN applications. QSFP+ to QSFP+ passive copper cable and QSFP+ to 4SFP+ passive breakout copper cable (such as QSFP-4SFP10G-CU3M) are two common types of QSFP+ passive DAC cables. 40G AOC is a type of active optical cable for 40GbE applications that is terminated with 40GBASE QSFP+ transceiver on one end while on the other end, it can be terminated with QSFP+ connector, SFP+ connector, or LC/SC/FC/ST connector. QSFP+ AOC integrates four data lanes in each direction with 40Gbps aggregate bandwidth. Each lane can operate at 10Gbps with lengths ranging from one to 100m. It is compliant with the QSFP MSA and IEEE P802.3ba. The following picture shows a Cisco QSFP-4X10G-AOC5M compatible 40G QSFP+ to 4x10G SFP+ active optical cable.

Cisco QSFP-4X10G-AOC5M compatible 40G QSFP+ to 4x10G SFP+ active optical cable

Parallel Fiber Optic Transmission

Unlike traditional Ethernet standard which has relied upon duplex fiber cabling with each channel using one fiber to transmit and the other to receive, 40GbE standard uses parallel optics for transmission. A 12-fiber cabling solution with each channel featuring four dedicated transmit fibers and four dedicated receiver fibers is used for 40GbE. The middle four fiber generally remain unused.

Summary

40GbE networks have now been popular choices for higher data rates applications and the market of 100GbE is accelerating. As 40 GbE and 100 GbE related products become less expensive and more available over time, they will evolve and become more popular in the next three to seven years. A quick and simple overview of 40GbE fiber optic components of the interconnected foundation is provided in this text, hoping it can help you have a general idea of 40GbE.