Fibre Channel over Ethernet
Fibre Channel over Ethernet (FCoE) is a computer network technology that encapsulates Fibre Channel frames over Ethernet networks. This allows Fibre Channel to use 10 Gigabit Ethernet networks (or higher speeds) while preserving the Fibre Channel protocol. The specification was part of the International Committee for Information Technology Standards T11 FC-BB-5 standard published in 2009.
FCoE transports Fibre Channel directly over Ethernet while being independent of the Ethernet forwarding scheme. The FCoE protocol specification replaces the FC0 and FC1 layers of the Fibre Channel stack with Ethernet. By retaining the native Fibre Channel constructs, FCoE was meant to integrate with existing Fibre Channel networks and management software.
Data centers used Ethernet for TCP/IP networks and Fibre Channel for storage area networks (SANs). With FCoE, Fibre Channel becomes another network protocol running on Ethernet, alongside traditional Internet Protocol (IP) traffic. FCoE operates directly above Ethernet in the network protocol stack, in contrast to iSCSI which runs on top of TCP and IP. As a consequence, FCoE is not routable at the IP layer, and will not work across routed IP networks.
Since classical Ethernet had no priority-based flow control, unlike Fibre Channel, FCoE required enhancements to the Ethernet standard to support a priority-based flow control mechanism (to reduce frame loss from congestion). The IEEE standards body added priorities in the data center bridging (dcb) Task Group.
Fibre Channel required three primary extensions to deliver the capabilities of Fibre Channel over Ethernet networks:
- Encapsulation of native Fibre Channel frames into Ethernet Frames.
- Extensions to the Ethernet protocol itself to enable an Ethernet fabric in which frames are not routinely lost during periods of congestion.
- Mapping between Fibre Channel N_port IDs (aka FCIDs) and Ethernet MAC addresses.
Computers can connect to FCoE with converged network adapters (CNAs), which contain both Fibre Channel host bus adapter (HBA) and Ethernet network interface controller (NIC) functionality on the same physical card. CNAs have one or more physical Ethernet ports. FCoE encapsulation can be done in software with a conventional Ethernet network interface card, however FCoE CNAs offload (from the CPU) the low level frame processing and SCSI protocol functions traditionally performed by Fibre Channel host bus adapters.
The main application of FCoE is in data center storage area networks (SANs). FCoE has particular application in data centers due to the cabling reduction it makes possible, as well as in server virtualization applications, which often require many physical I/O connections per server.
With FCoE, network (IP) and storage (SAN) data traffic can be consolidated using a single network. This consolidation can:
- reduce the number of network interface cards required to connect to disparate storage and IP networks
- reduce the number of cables and switches
- reduce power and cooling costs
FCoE is encapsulated over Ethernet with the use of a dedicated Ethertype, 0x8906. A single 4-bit field (version) satisfies the IEEE sub-type requirements. The 802.1Q tag is optional but may be necessary in a given implementation. The SOF (start of frame) and EOF (end of frame) are encoded as specified in RFC 3643. Reserved bits are present to guarantee that the FCoE frame meets the minimum length requirement of Ethernet. Inside the encapsulated Fibre Channel frame, the frame header is retained so as to allow connecting to a storage network by passing on the Fibre Channel frame directly after de-encapsulation.
The FIP (FCoE Initialization Protocol) is an integral part of FCoE. Its main goal is to discover and initialize FCoE capable entities connected to an Ethernet cloud. FIP uses a dedicated Ethertype of 0x8914.
In October 2003, Azul Technology developed early version and applied for a patent.
In April 2007, the FCoE standardization activity started.
In October 2007, the first public end-to-end FCoE demo occurred at Storage Network World including adapters from QLogic, switches from Nuova Systems, and storage from NetApp (none of the companies involved made any product announcements at the time).
In April 2008, an early implementor was Nuova Systems, a subsidiary of Cisco Systems, which announced a switch. Brocade Communications Systems also announced support in 2008. After the late-2000s financial crisis, however, any new technology had a hard time getting established.
In June 2009, the FCoE technology that had been defined as part of the International Committee for Information Technology Standards (INCITS) T11 FC-BB-5 standard was forwarded to ANSI for publication.
Data center switches from Force10 and Dell PowerConnect supported FCoE and in June 2013, Dell Networking, which is the new brand-name for all networking portfolio of Dell, introduced the S5000 series which can be a fully native FCoE switch with the option to include a native fibre channel module, allowing you to connect the S5000 directly to an FC SAN environment.
- "Fibre Channel: Backbone - 5 revision 2.00" (PDF). American National Standard for Information Technology International Committee for Information Technology Standards Technical Group T11. June 4, 2009. Archived from the original (PDF) on December 29, 2009. Retrieved May 5, 2011.
- "Fibre Channel – Backbone 5, 7.7 FCoE frame format" (PDF). T11. 4 June 2009. Archived from the original (PDF) on December 29, 2009. Retrieved 2015-01-06.
- Alex E. Henderson; John William Hayes; Walter E. Croft; Linda Elaine Eaton (October 21, 2003). "Transporting fibre channel over ethernet". US Patent and Trademark Office. US Patent 20080028096 granted January 31, 2008
- Austin Modine (October 17, 2007). "QLogic hypes ′network consolidation′ with FCoE". The Register.
- PrimeNewswire (October 16, 2007). "QLogic, NetApp and Nuova Systems Demonstrate Industry′s First Converged Network With Fibre Channel Over Ethernet". TMC News.
- Paul Shread (April 10, 2008). "Cisco Buys Nuova as FCoE Heats Up". Enterprise Storage Forum. Retrieved May 5, 2011.
- "Cisco Announces Intent to Acquire Remaining Interest in Nuova Systems". Press release. Cisco Systems. April 8, 2008. Archived from the original on March 4, 2012. Retrieved May 5, 2011.
- Dave Rowell (March 19, 2008). "Cisco, Brocade See One Big Happy Fabric". Enterprise Storage Forum. Retrieved May 5, 2011.
- Drew Robb (March 29, 2011). "FCoE Struggles to Gain Traction". Enterprise Storage Forum. Retrieved May 5, 2011.
- Henry Newman (April 25, 2011). "FCoE Gets Lost in Vendor Stupidity". Enterprise Storage Forum. Retrieved May 5, 2011.
- "Information technology - Fibre Channel - Backbone - 5 (FC-BB-5)". ANSI/INCITS 462-2010. International Committee for Information Technology Standards (formerly NCITS). May 13, 2010. Official standard.
- "Fibre Channel over Ethernet". T11 web site. Retrieved May 23, 2013.
- Dell Networking S-Series switches overview, visited 26 May 2013