Sea Change Series: Orchestration Software in the Mega Data Center

$4200 - Single Copy or $8400 - Web Posting | Report # SH27005197 | 115 Pages | 75 Tables and Figures | 2017
  • Key Topics
  • Orchestration Software In The Mega Data Center
  • Realign IT Cost Structure
  • Mega Datacenter Physical Infrastructure
  • Automation of Mega Data Center
  • Networking Fabric
  • Exchange Of Data Between Servers
  • Complex Automation Of Process
  • Applications Customized For Each User
  • Machine-To-Machine Management of Traffic Growth
  • Fabric Network Topology
  • Building-Wide Connectivity
  • Highly Modular Data Cebter Design
  • Scale Capacity
  • Back-End Service Tiers
  • Applications Scaling
  • Mega Data Center Network
  • Fabric Next-Generation Data Center Network Design
  • Pod Unit of Network
  • Mega Data Center Server Pods
  • Non-Blocking Network Architecture
  • Data Center Auto Discovery
  • Large-Scale Network
  • Rapid Deployment Architecture
  • Expedites Provisioning And Changes
  • Programmable Access To Network Stack
  • Software Defined Networking (SDN)-Supports Scale and Automation
  • Compute Engine Load Balancing
  • Load Balanced Requests Architecture
  • Scale-Out: Server And Storage Expansion
  • Switches and Routers Deployed in Fabrics
  • Mega Data Center Multipathing
  • Routing Destinations
  • Clos Topology Network
  • Capacity Scalability
  • Aggregation Switches
  • Intelligent Cloud Platform
  • Linux For Azure

LEXINGTON, Massachusetts (April 25, 2017) – The 2017 module has 115 pages and 74 tables and figures.  Orchestration Software in the Mega Data Center is used to tie a fabric architecture together that fills up an entire building with 100,000 processors and 100,001 switches.  The mega data center described in the study is effective because it leverages the economies of scale.  This orchestration software infrastructure study module is part of a longer study that addresses the business issues connected with data center modernization.  There are 26 module parts to the larger study comprised of detailed analysis of how new infrastructure layers will work to support management of vast quantities of data. 

Business growth depends on technology spending.  Intelligent, automated process, not manual labor systems are what speed business growth.  We have had the situation in the data center where 93% of spending is just to keep current systems running, many of those plagued with manual input.  Mega data centers change that pattern of IT manual process.

The Internet has grown by a factor of 100 over the past 10 years. To accommodate that growth, mega data centers have evolved to provide processing at scale.  Facebook for one, has increased the corporate data center compute capacity by a factor of 1,000, virtually eliminating much manual process. Orchestration software is a key aspect of that process.  To meet future demands on the Internet over the next 10 years, companies with that capacity need to increase capacity by the same amount again while the other companies struggle to catch up.  Nobody really knows how to get to increasing compute capacity by another factor of 1,000.

Business growth depends on technology spending.  Intelligent, automated process, not manual labor systems are what speed business growth.  We have had the situation in the data center where 93% of spending is just to keep current systems running, many of those plagued with manual input.  Mega data centers change that pattern of IT manual process.

Realigning data center cost structures is a core job of orchestration software.  The enterprise data centers and many cloud infrastructure operations all have similar problems of being mired in administrative expense.  Containers address that issue by creating vastly more efficient operations for data center infrastructure.

According to Susan Eustis, lead author of the team that prepared the study, “The only way to realign cost structure is to automate infrastructure management and orchestration.   Mega data centers automate server and connectivity management using orchestration software to manage multiple application containers.  Other systems automate switching and storage, along with hypervisor, operating system, and virtual machine provisioning. “

As IT relies more on virtualization and cloud mega data center computing, the physical infrastructure is flexible and agile enough to support the virtual infrastructure.  Comprehensive infrastructure management and orchestration is essential.  

The Enterprise Data Center has become a bottleneck, it needs to be completely replaced.  Category 5 and Category 6 Ethernet cable is spread throughout the existing enterprise data centers and is too slow to handle all the digital data coming through the data center.  Cat 5 and Cat 6 Ethernet utilized by the servers to achieve data transport using that cable does not keep up with the data coming through the data center the way optical cable and optical transceivers do.  

The existing servers and cable are a problem because they are too slow for modern systems.  The cable is too slow to handle all the data coming at us in the new digital age, and the associated technology that operates at Ethernet category 5 and category 6 cable speeds is too slow as well, this is why the entire set of existing enterprise data centers is a bottleneck.  

Mobile data traffic is set to increase by a factor of eight between 2015 and 2020.   Growth is anticipated at 53 percent per year, faster than systems revenue or industry revenue.  

The theme of this study is that the pace of data expansion creates the need for more modern means of managing data.  There are some companies that are doing a better job, better than others of adapting to IT infrastructure to the wild influx of data.

The four superstar companies that are able to leverage IT to achieve growth, Microsoft, Google, Facebook, and the leader AWS all use Clos architecture.  What is significant is that systems have to hit a certain scale before Clos networks work   Clos networks are what work now for flexibility and supporting innovation in an affordable manner.  There is no dipping your toe in to try the system to see if it will work, it will not and then the IT says, “We tried that, we failed,” but what the executive needs to understand is that scale matters.  A little mega data center does not exist.  Only scale works.  

Many companies are using digital technology to create market disruption.  Amazon, Uber, Google, IBM, and Microsoft represent companies using effective strategic positioning that protects the security of the data.  As entire industries shift to the digital world, once buoyant companies are threatened with disappearing.  A digital transformation represents an approach that enables organizations to drive changes in their business models and ecosystems leveraging cloud computing, and not just hyperscale systems but leveraging mega data centers.  Just as robots make work more automated, so also cloud based communications systems implement the IoT digital connectivity transformation.  

WinterGreen Research is an independent research organization funded by the sale of market research studies all over the world and by the implementation of ROI models that are used to calculate the total cost of ownership of equipment, services, and software.  The company has 35 distributors worldwide, including Global Information Info Shop, Market, Research and Markets,, and Thompson Financial.  It conducts its business with integrity.  

The increasingly global nature of science, technology and engineering is a reflection of the implementation of the globally integrated enterprise.  Customers trust wintergreen research to work alongside them to ensure the success of the participation in a particular market segment.

WinterGreen Research supports various market segment programs; provides trusted technical services to the marketing departments.  It carries out accurate market share and forecast analysis services for a range of commercial and government customers globally.  These are all vital market research support solutions requiring trust and integrity.

Companies Profiled
Market Leaders
  • Amazon
  • Microsoft
  • Google
  • Facebook

Report Methodology

This is the 700th report in a series of market research reports that provide forecasts in communications, telecommunications, the internet, computer, software, and telephone equipment. The project leaders take direct responsibility for writing and preparing each report. They have significant experience preparing industry studies. Forecasts are based on primary research and proprietary databases. Forecasts reflect analysis of the market trends in the segment and related segments. Unit and dollar shipments are analyzed through consideration of dollar volume of each market participation in the segment. Market share analysis includes conversations with key customers of products, industry segment leaders, marketing directors, distributors, leading market participants, and companies seeking to develop measurable market share. Over 200 in-depth interviews are conducted for each report with a broad range of key participants and opinion leaders in the market segment.

About the Company

WinterGreen Research, founded in 1985, provides strategic market assessments in telecommunications, communications equipment, health care, and advanced computer technology. Industry reports focus on opportunities that will expand existing markets or develop major new markets. The reports assess new product and service positioning strategies, new and evolving technologies, and technological impact on products, services, and markets. Market shares are provided. Leading market participants are profiled, and their marketing strategies, acquisitions, and strategic alliances are discussed. The principals of WinterGreen Research have been involved in analysis and forecasting of international business opportunities in telecommunications and advanced computer technology markets for over 30 years.

About the Principal Author

Susan Eustis, President, co-founder of WinterGreen Research, has done research in communications and computer markets and applications. She holds several patents in microcomputing and parallel processing. She is the author of recent studies of the Service Oriented Architecture (SOA) marketing strategies, Internet software, a study of Push to Talk Equipment, Worldwide Telecommunications Equipment, Top Ten Telecommunications, Digital Loop Carrier, Web Hosting, Business Process Management, Servers, Blades, the Mainframe as a Green Machine, and Application Server markets. Ms. Eustis is a graduate of Barnard College.

$4200 - Single Copy or $8400 - Web Posting | Report # SH27005197 | 115 Pages | 75 Tables and Figures | 2017