Facebook Data Center Showcases Open Compute Work - InformationWeek

InformationWeek is part of the Informa Tech Division of Informa PLC

This site is operated by a business or businesses owned by Informa PLC and all copyright resides with them.Informa PLC's registered office is 5 Howick Place, London SW1P 1WG. Registered in England and Wales. Number 8860726.

IoT
IoT
Cloud // Software as a Service
News
11/25/2014
09:41 AM
Connect Directly
Twitter
RSS
E-Mail
100%
0%

Facebook Data Center Showcases Open Compute Work

Facebook's Altoona, Iowa, data center includes Open Compute Project data center network fabric.

H-1B Visa Program: 13 Notable Statistics
H-1B Visa Program: 13 Notable Statistics
(Click image for larger view and slideshow.)

The Open Compute Project has taken strides forward with its Networking Project, including a data center network fabric, installed by Facebook at its newest data center, which will be contributed to the project.

The Altoona, Iowa, data center opened Nov. 14 and is the first Facebook facility to include a 40-Gbps Ethernet network fabric that links every pod, or set of 48 server racks, to every other pod in the data center. The fabric design gets away from the constraint of a server cluster being limited by the lack of bandwidth connecting it to other clusters.

"We challenged ourselves to make the entire data center building one high-performance network, instead of a hierarchically oversubscribed system of clusters," wrote Alexey Andreyev, Facebook network architect, in a blog post on the fabric.

[Take a look inside another Facebook data center. See Facebook's Futuristic Data Center: Inside Tour.]

That means Facebook has found a way to "disaggregate" what had been a few high-performance and vendor proprietary switches managing each cluster's traffic into smaller units spread throughout the data center. "Instead of the large devices and clusters, we broke the network up into small identical units -- server pods -- and created uniform high-performance connectivity between all pods."

And that means Facebook can extend high-performance networking throughout its data centers whenever it chooses. Its more modular networking approach is scalable beyond the limits of its previous cluster management switches.

Facebook's New Altoona, Iowa, data center. (Source: Facebook)
Facebook's New Altoona, Iowa, data center.
(Source: Facebook)

In addition, Facebook has been enhancing its Wedge top-of-rack switch, whose specifications are part of the Networking Project, noted Najam Ahmad, VP of network engineering at Facebook, in an interview.

"We didn't have a top-of-rack design laid out initially. We spun up the Networking Project (a year ago) without having a design ready to go," he recalled.

Facebook, through the Open Compute Project, is trying to make basic components of data center hardware available through open source designs. "The primary job was to disaggregate the network appliance, most often a proprietary chip, operating system, and hardware built by one vendor," he said.

Among other things, Open Compute advocates are seeking to add a micro-server to a standard switch or other network hardware device through which it may be programmed and managed on a dynamic networking basis. That's a hardware idea that meshes with a software-defined network, with a network controller reaching out to such devices with sets of instructions.

Mellanox and Dell have produced Wedge-specified switches, he noted.

At the end of October, the Open Compute Project announced that it has achieved the Open Network Install Environment (ONIE), an open source and freely available way to boot up network switches, after testing them. There are already ways to boot switches, but they are either proprietary and billed with the purchase of products, or they are a published standard that's still accompanied by a fee.

ONIE, contributed by Cumulus Networks, "is one of the fundamental pieces that we've done and announced," said Ahmad.

Cumulus Networks produced ONIE as an open source boot loader for the switch. It does initial testing of the hardware, then can boot it up for operations with the software assigned to it. "It's like the BIOS on a compute server," noted Ahmad.

Our latest survey shows growing demand, fixed budgets, and good reason why resellers and vendors must fight to remain relevant. One thing's for sure: The data center is poised for a wild ride, and no one wants to be left behind. Get the Research: 2014 State Of The Data Center report today. (Free registration required.)

Charles Babcock is an editor-at-large for InformationWeek and author of Management Strategies for the Cloud Revolution, a McGraw-Hill book. He is the former editor-in-chief of Digital News, former software editor of Computerworld and former technology editor of Interactive ... View Full Bio

We welcome your comments on this topic on our social media channels, or [contact us directly] with questions about the site.
Comment  | 
Print  | 
More Insights
Comments
Oldest First  |  Newest First  |  Threaded View
Charlie Babcock
50%
50%
Charlie Babcock,
User Rank: Author
11/25/2014 | 3:18:06 PM
Altoona is built to a familiar Facebook scale
The Altoona site is currently one of two data centers planned for the site. It is a massive structure, built on a scale similar to the 330,000 square-foot data centers in Prineville, Ore. If each of the two main data centers there were stood up on one end, they would be the Twin Towers, each 81 stories high, of the high desert.
asksqn
50%
50%
asksqn,
User Rank: Ninja
11/25/2014 | 3:19:04 PM
Open Compute Networking Project
Hopefully, this initiative will lead to a new framework for integrating hardware forwarding engines with the Linux kernal networking stack and otherwise enabling fully open source switching hardware drivers.

 
Charlie Babcock
50%
50%
Charlie Babcock,
User Rank: Author
11/25/2014 | 4:33:45 PM
That's a goal of OCP
Yes, Asksqn, multiple suppliers of generic, programmable switches running open source and built to a common design -- that's a goal of the Open Compute Project.

 

 
Thomas Claburn
50%
50%
Thomas Claburn,
User Rank: Author
11/25/2014 | 5:30:16 PM
Re: Altoona is built to a familiar Facebook scale
Has the Open Compute Project affected the stock price of network equipment makers like Cisco? Because it seems as if it should.
Slideshows
What Digital Transformation Is (And Isn't)
Cynthia Harvey, Freelance Journalist, InformationWeek,  12/4/2019
Commentary
Watch Out for New Barriers to Faster Software Development
Lisa Morgan, Freelance Writer,  12/3/2019
Commentary
If DevOps Is So Awesome, Why Is Your Initiative Failing?
Guest Commentary, Guest Commentary,  12/2/2019
White Papers
Register for InformationWeek Newsletters
Video
Current Issue
The Cloud Gets Ready for the 20's
This IT Trend Report explores how cloud computing is being shaped for the next phase in its maturation. It will help enterprise IT decision makers and business leaders understand some of the key trends reflected emerging cloud concepts and technologies, and in enterprise cloud usage patterns. Get it today!
Slideshows
Flash Poll