Data center

An operation engineer overseeing a Network Operations Control Room of a data center.

A data center (or data centre or datacentre or datacenter) is a facility used to house computer systems and associated components, such as telecommunications and storage systems. It generally includes redundant or backup power supplies, redundant data communications connections, environmental controls (e.g., air conditioning, fire suppression) and security devices.

History

Data centers have their roots in the huge computer rooms of the early ages of the computing industry. Early computer systems were complex to operate and maintain, and required a special environment in which to operate. Many cables were necessary to connect all the components, and methods to accommodate and organize these were devised, such as standard racks to mount equipment, elevated floors, and cable trays (installed overhead or under the elevated floor). Also, a single mainframe required a great deal of power, and had to be cooled to avoid overheating. Security was important – computers were expensive, and were often used for military purposes. Basic design guidelines for controlling access to the computer room were therefore devised.

During the boom of the microcomputer industry, and especially during the 1980s, computers started to be deployed everywhere, in many cases with little or no care about operating requirements. However, as information technology (IT) operations started to grow in complexity, companies grew aware of the need to control IT resources. With the advent of client-server computing, during the 1990s, microcomputers (now called "servers") started to find their places in the old computer rooms. The availability of inexpensive networking equipment, coupled with new standards for network structured cabling, made it possible to use a hierarchical design that put the servers in a specific room inside the company. The use of the term "data center," as applied to specially designed computer rooms, started to gain popular recognition about this time,

The boom of data centers came during the dot-com bubble. Companies needed fast Internet connectivity and nonstop operation to deploy systems and establish a presence on the Internet. Installing such equipment was not viable for many smaller companies. Many companies started building very large facilities, called Internet data centers (IDCs), which provide businesses with a range of solutions for systems deployment and operation. New technologies and practices were designed to handle the scale and the operational requirements of such large-scale operations. These practices eventually migrated toward the private data centers, and were adopted largely because of their practical results.

As of 2007^[update], data center design, construction, and operation is a well-known discipline. Standard Documents from accredited professional groups, such as the Telecommunications Industry Association, specify the requirements for data center design. Well-known operational metrics for data center availability can be used to evaluate the business impact of a disruption. There is still a lot of development being done in operation practice, and also in environmentally-friendly data center design. Data centers are typically very expensive to build and maintain. For instance, Amazon.com's 116,000 sq ft (10,800 m²) data center in Boardman, Oregon cost up to $100 million.^[1]

Requirements for modern data centers

Racks of telecommunications equipment in part of a data center.

IT operations are a crucial aspect of most organizational operations. One of the main concerns is business continuity; companies rely on their information systems to run their operations. If a system becomes unavailable, company operations may be impaired or stopped completely. It is necessary to provide a reliable infrastructure for IT operations, in order to minimize any chance of disruption. Information security is also a concern, and for this reason a data center has to offer a secure environment which minimizes the chances of a security breach. A data center must therefore keep high standards for assuring the integrity and functionality of its hosted computer environment. This is accomplished through redundancy of both fiber optic cables and power, which includes emergency backup power generation.

The Telecommunications Industry Association's TIA-942 Telecommunications Infrastructure Standard for Data Centers, which specifies the minimum requirements for telecommunications infrastructure of data centers and computer rooms including single tenant enterprise data centers and multi-tenant Internet hosting data centers. The topology proposed in this document is intended to be applicable to any size data center.^[2]

Telcordia GR-3160, NEBS Requirements for Telecommunications Data Center Equipment and Spaces, provides guidelines for data center spaces within telecommunications networks, and environmental requirements for the equipment intended for installation in those spaces. These criteria were developed jointly by Telcordia and industry representatives. They may be applied to data center spaces housing data processing or Information Technology (IT) equipment. The equipment may be used to:

• Operate and manage a carrier’s telecommunication network
• Provide data center based applications directly to the carrier’s customers
• Provide hosted applications for a third party to provide services to their customers
• Provide a combination of these and similar data center applications.

Effective data center operation requires a balanced investment in both the facility and the housed equipment. The first step is to establish a baseline facility environment suitable for equipment installation. Standardization and modularity can yield savings and efficiencies in the design and construction of telecommunications data centers.

Standardization means integrated building and equipment engineering. Modularity has the benefits of scalability and easier growth, even when planning forecasts are less than optimal. For these reasons, telecommunications data centers should be planned in repetitive building blocks of equipment, and associated power and support (conditioning) equipment when practical. The use of dedicated centralized systems requires more accurate forecasts of future needs to prevent expensive over construction, or perhaps worse — under construction that fails to meet future needs.

The "lights-out" data center, also known as a darkened or a dark data center, is a data center that, ideally, has all but eliminated the need for direct access by personnel, except under extraordinary circumstances. Because of the lack of need for staff to enter the data center, it can be operated without lighting. All of the devices are accessed and managed by remote systems, with automation programs used to perform unattended operations. In addition to the energy savings, reduction in staffing costs and the ability to locate the site further from population centers, implementing a lights-out data center reduces the threat of malicious attacks upon the infrastructure.^[3][4]

There is a trend to modernize data centers in order to take advantage of the performance and energy efficiency increases of newer IT equipment and capabilities, such as cloud computing. This process is also known as data center transformation.^[5]

Organizations are experiencing rapid IT growth but their data centers are aging. Industry research company International Data Corporation (IDC) puts the average age of a data center at nine-years-old.^[5] Gartner, another research company says data centers older than seven years are obsolete.^[6]

In May 2011, data center research organization Uptime Institute, reported that 36 percent of the large companies it surveyed expect to exhaust IT capacity within the next 18 months.^[7]

Data center transformation takes a step-by-step approach through integrated projects carried out over time. This differs from a traditional method of data center upgrades that takes a serial and siloed approach.^[8] The typical projects within a data center transformation initiative include standardization/consolidation, virtualization, automation and security.

• Standardization/consolidation: The purpose of this project is to reduce the number of data centers a large organization may have. This project also helps to reduce the number of hardware, software platforms, tools and processes within a data center. Organizations replace aging data center equipment with newer ones that provide increased capacity and performance. Computing, networking and management platforms are standardized so they are easier to manage.^[9]

• Virtualize: There is a trend to use IT virtualization technologies to replace or consolidate multiple data center equipment, such as servers. virtualization helps to lower capital and operational expenses,^[10] and reduce energy consumption.^[11] Data released by investment bank Lazard Capital Markets reports that 48 percent of enterprise operations will be virtualized by 2012. Gartner views virtualization as a catalyst for modernization.^[12]

• Automating: Data center automation involves automating tasks such as provisioning, configuration, patching, release management and compliance. As enterprises suffer from few skilled IT workers,^[9] automating tasks make data centers run more efficiently.

• Securing: In modern data centers, the security of data on virtual systems is integrated with existing security of physical infrastructures.^[13] The security of a modern data center must take into account physical security, network security, and data and user security.

Data center classification

The Telecommunications Industry Association is a trade association accredited by ANSI (American National Standards Institute). In 2005 it published ANSI/TIA-942, Telecommunications Infrastructure Standard for Data Centers, which defined four levels (called tiers) of data centers in a thorough, quantifiable manner. TIA-942 was amended in 2008 and again in 2010.TIA-942:Data Center Standards Overview describes the requirements for the data center infrastructure. The simplest is a Tier 1 data center, which is basically a server room, following basic guidelines for the installation of computer systems. The most stringent level is a Tier 4 data center, which is designed to host mission critical computer systems, with fully redundant subsystems and compartmentalized security zones controlled by biometric access controls methods. Another consideration is the placement of the data center in a subterranean context, for data security as well as environmental considerations such as cooling requirements.^[14]

The German Datacenter star audit programme uses an auditing process to certify 5 levels of "gratification" that affect Data Center criticality.

Independent from the ANSI/TIA-942 standard, the Uptime Institute, a think tank and professional-services organization based in Santa Fe, New Mexico, has defined its own four levels on which it holds a copyright. The levels describe the availability of data from the hardware at a location. The higher the tier, the greater the availability. The levels are: ^{[15] [16] [17]}

Tier Level	Requirements
1	Single non-redundant distribution path serving the IT equipment Non-redundant capacity components Basic site infrastructure guaranteeing 99.671% availability
2	Meets or exceeds all Tier 1 requirements Redundant site infrastructure capacity components guaranteeing 99.741% availability
3	Meets or exceeds all Tier 1 and Tier 2 requirements Multiple independent distribution paths serving the IT equipment All IT equipment must be dual-powered and fully compatible with the topology of a site's architecture Concurrently maintainable site infrastructure guaranteeing 99.982% availability
4	Meets or exceeds all Tier 1, Tier 2 and Tier 3 requirements All cooling equipment is independently dual-powered, including chillers and heating, ventilating and air-conditioning (HVAC) systems Fault-tolerant site infrastructure with electrical power storage and distribution facilities guaranteeing 99.995% availability

Design considerations

A typical server rack, commonly seen in colocation.

A data center can occupy one room of a building, one or more floors, or an entire building. Most of the equipment is often in the form of servers mounted in 19 inch rack cabinets, which are usually placed in single rows forming corridors (so-called aisles) between them. This allows people access to the front and rear of each cabinet. Servers differ greatly in size from 1U servers to large freestanding storage silos which occupy many tiles on the floor. Some equipment such as mainframe computers and storage devices are often as big as the racks themselves, and are placed alongside them. Very large data centers may use shipping containers packed with 1,000 or more servers each;^[18] when repairs or upgrades are needed, whole containers are replaced (rather than repairing individual servers).^[19]

Local building codes may govern the minimum ceiling heights.

A bank of batteries in a large data center, used to provide power until diesel generators can start.

Environmental control

Main article: Data center environmental control

The physical environment of a data center is rigorously controlled. Air conditioning is used to control the temperature and humidity in the data center. ASHRAE's "Thermal Guidelines for Data Processing Environments"^[20] recommends a temperature range of 16–24 °C (61–75 °F) and humidity range of 40–55% with a maximum dew point of 15°C as optimal for data center conditions.^[21] The temperature in a data center will naturally rise because the electrical power used heats the air. Unless the heat is removed, the ambient temperature will rise, resulting in electronic equipment malfunction. By controlling the air temperature, the server components at the board level are kept within the manufacturer's specified temperature/humidity range. Air conditioning systems help control humidity by cooling the return space air below the dew point. Too much humidity, and water may begin to condense on internal components. In case of a dry atmosphere, ancillary humidification systems may add water vapor if the humidity is too low, which can result in static electricity discharge problems which may damage components. Subterranean data centers may keep computer equipment cool while expending less energy than conventional designs.

Modern data centers try to use economizer cooling, where they use outside air to keep the data center cool.^[22] Many data centers now cool all of the servers using outside air. They do not use chillers/air conditioners, which creates potential energy savings in the millions.^[23]

Telcordia GR-2930, NEBS: Raised Floor Generic Requirements for Network and Data Centers, presents generic engineering requirements for raised floors that fall within the strict NEBS guidelines.

There are many types of commercially available floors that offer a wide range of structural strength and loading capabilities, depending on component construction and the materials used. The general types of raised floors include stringerless, stringered, and structural platforms, all of which are discussed in detail in GR-2930 and summarized below.

• Stringerless Raised Floors - One non-earthquake type of raised floor generally consists of an array of pedestals that provide the necessary height for routing cables and also serve to support each corner of the floor panels. With this type of floor, there may or may not be provisioning to mechanically fasten the floor panels to the pedestals. This stringerless type of system (having no mechanical attachments between the pedestal heads) provides maximum accessibility to the space under the floor. However, stringerless floors are significantly weaker than stringered raised floors in supporting lateral loads and are not recommended.

• Stringered Raised Floors - This type of raised floor generally consists of a vertical array of steel pedestal assemblies (each assembly is made up of a steel base plate, tubular upright, and a head) uniformly spaced on two-foot centers and mechanically fastened to the concrete floor. The steel pedestal head has a stud that is inserted into the pedestal upright and the overall height is adjustable with a leveling nut on the welded stud of the pedestal head.

• Structural Platforms - One type of structural platform consists of members constructed of steel angles or channels that are welded or bolted together to form an integrated platform for supporting equipment. This design permits equipment to be fastened directly to the platform without the need for toggle bars or supplemental bracing. Structural platforms may or may not contain panels or stringers.

Metal Whiskers

Raised floors and other metal structures such as cable trays and ventilation ducts have caused many problems with zinc whiskers in the past, and likely are still present in many data centers. This happens when microscopic metallic filaments form on metals such as zinc or tin that protect many metal structures and electronic components from corrosion. Maintenance on a raised floor or installing of cable etc. can dislodge the whiskers, which enter the airflow and may short circuit server components or power supplies, sometimes through a high current metal vapor plasma arc. This phenomenon is not unique to data centers, and has also caused catastrophic failures of satellites and military hardware.^[24]

Electrical power

Backup power consists of one or more uninterruptible power supplies, battery banks, and/or diesel generators.^[25]

To prevent single points of failure, all elements of the electrical systems, including backup systems, are typically fully duplicated, and critical servers are connected to both the "A-side" and "B-side" power feeds. This arrangement is often made to achieve N+1 redundancy in the systems. Static switches are sometimes used to ensure instantaneous switchover from one supply to the other in the event of a power failure.

Data centers typically have raised flooring made up of 60 cm (2 ft) removable square tiles. The trend is towards 80–100 cm (31–39 in) void to cater for better and uniform air distribution. These provide a plenum for air to circulate below the floor, as part of the air conditioning system, as well as providing space for power cabling.

Some new data centres and technology demonstrations are beginning to standardise a 380VDC power distribution network that is expected to improve efficiency of building power systems.^[26][27] Since much of the power loss in electrical systems is caused by voltage and AC/DC conversion, an all DC network supplying low voltage (LV) power close to equipment loads is expected to achieve significant savings in power usage and cooling loads.^[28] 380VDC power supply requires DC connectors that prevent them being used on AC equipment, with possible standardisation likely to use connectors such as the Anderson Powerpole® Pak.^[29]

Low-voltage cable routing

Data cabling is typically routed through overhead cable trays in modern data centers. But some are still recommending under raised floor cabling for security reasons and to consider the addition of cooling systems above the racks in case this enhancement is necessary. Smaller/less expensive data centers without raised flooring may use anti-static tiles for a flooring surface. Computer cabinets are often organized into a hot aisle arrangement to maximize airflow efficiency.

Fire protection

Data centers feature fire protection systems, including passive and active design elements, as well as implementation of fire prevention programs in operations. Smoke detectors are usually installed to provide early warning of a developing fire by detecting particles generated by smoldering components prior to the development of flame. This allows investigation, interruption of power, and manual fire suppression using hand held fire extinguishers before the fire grows to a large size. A fire sprinkler system is often provided to control a full scale fire if it develops. Fire sprinklers require 18 in (46 cm) of clearance (free of cable trays, etc.) below the sprinklers. Clean agent fire suppression gaseous systems are sometimes installed to suppress a fire earlier than the fire sprinkler system. Passive fire protection elements include the installation of fire walls around the data center, so a fire can be restricted to a portion of the facility for a limited time in the event of the failure of the active fire protection systems, such as making sure the door is not left open or if they are not installed. For critical facilities these firewalls are often insufficient to protect heat-sensitive electronic equipment, however, because conventional firewall construction is only rated for flame penetration time, not heat penetration. There are also deficiencies in the protection of vulnerable entry points into the server room, such as cable penetrations, coolant line penetrations and air ducts. For mission critical data centers fireproof vaults with a Class 125 rating are necessary to meet NFPA 75^[30] standards.

Security

Physical security also plays a large role with data centers. Physical access to the site is usually restricted to selected personnel, with controls including bollards and mantraps.^[31] Video camera surveillance and permanent security guards are almost always present if the data center is large or contains sensitive information on any of the systems within. The use of finger print recognition man traps is starting to be commonplace.

Energy use

Google Data Center, The Dalles

Main article: IT energy management

Energy use is a central issue for data centers. Power draw for data centers ranges from a few kW for a rack of servers in a closet to several tens of MW for large facilities. Some facilities have power densities more than 100 times that of a typical office building.^[32] For higher power density facilities, electricity costs are a dominant operating expense and account for over 10% of the total cost of ownership (TCO) of a data center.^[33] By 2012 the cost of power for the data center is expected to exceed the cost of the original capital investment.^[34]

Greenhouse gas emissions

In 2007 the entire information and communication technologies or ICT sector was estimated to be responsible for roughly 2% of global carbon emissions with data centers accounting for 14% of the ICT footprint.^[35] The US EPA estimates that servers and data centers are responsible for up to 1.5% of the total US electricity consumption,^[36] or roughly .5% of US GHG emissions,^[37] for 2007. Given a business as usual scenario greenhouse gas emissions from data centers is projected to more than double from 2007 levels by 2020.^[35]

Siting is one of the factors that affect the energy consumption and environmental effects of a datacenter. In areas where climate favors cooling and lots of renewable electricity is available the environmental effects will be more moderate. Thus countries with favorable conditions, such as: Canada,^[38] Finland,^[39] Sweden^[40] and Switzerland,^[41] are trying to attract cloud computing data centers.

In an 18-month investigation by scholars at Rice University’s Baker Institute for Public Policy in Houston and the Institute for Sustainable and Applied Infodynamics in Singapore, data center-related emissions will more than triple by 2020. ^[42]

Energy efficiency

The most commonly used metric to determine the energy efficiency of a data center is power usage effectiveness, or PUE. This simple ratio is the total power entering the data center divided by the power used by the IT equipment.

$\mathrm{PUE} = {\mbox{Total Facility Power} \over \mbox{IT Equipment Power}}$

Power used by support equipment, often referred to as overhead load, mainly consists of cooling systems, power delivery, and other facility infrastructure like lighting. The average data center in the US has a PUE of 2.0,^[36] meaning that the facility uses one Watt of overhead power for every Watt delivered to IT equipment. State-of-the-art data center energy efficiency is estimated to be roughly 1.2.^[43] Some large data center operators like Microsoft and Yahoo! have published projections of PUE for facilities in development; Google publishes quarterly actual efficiency performance from data centers in operation.^[44]

The U.S. Environmental Protection Agency has an Energy Star rating for standalone or large data centers. To qualify for the ecolabel, a data center must be within the top quartile of energy efficiency of all reported facilities.^[45]

European Union also has a similar initiative: EU Code of Conduct for Data Centres^[46]

Network infrastructure

An example of "rack mounted" servers.

Communications in data centers today are most often based on networks running the IP protocol suite. Data centers contain a set of routers and switches that transport traffic between the servers and to the outside world. Redundancy of the Internet connection is often provided by using two or more upstream service providers (see Multihoming).

Some of the servers at the data center are used for running the basic Internet and intranet services needed by internal users in the organization, e.g., e-mail servers, proxy servers, and DNS servers.

Network security elements are also usually deployed: firewalls, VPN gateways, intrusion detection systems, etc. Also common are monitoring systems for the network and some of the applications. Additional off site monitoring systems are also typical, in case of a failure of communications inside the data center.

Data Center Infrastructure Management

Data center infrastructure management (DCIM) is the integration of information technology (IT) and facility management disciplines to centralize monitoring, management and intelligent capacity planning of a data center's critical systems. Achieved through the implementation of specialized software, hardware and sensors, DCIM enables common, real-time monitoring and management platform for all interdependent systems across IT and facility infrastructures.

Depending on the type of implementation, DCIM products can help data center managers identify and eliminate sources of risk to increase availability of critical IT systems. DCIM products also can be used to identify interdependencies between facility and IT infrastructures to alert the facility manager to gaps in system redundancy, and provide dynamic, holistic benchmarks on power consumption and efficiency to measure the effectiveness of “green IT” initiatives.

Applications

A 40-foot Portable Modular Data Center.

The main purpose of a data center is running the applications that handle the core business and operational data of the organization. Such systems may be proprietary and developed internally by the organization, or bought from enterprise software vendors. Such common applications are ERP and CRM systems.

A data center may be concerned with just operations architecture or it may provide other services as well.

Often these applications will be composed of multiple hosts, each running a single component. Common components of such applications are databases, file servers, application servers, middleware, and various others.

Data centers are also used for off site backups. Companies may subscribe to backup services provided by a data center. This is often used in conjunction with backup tapes. Backups can be taken of servers locally on to tapes. However, tapes stored on site pose a security threat and are also susceptible to fire and flooding. Larger companies may also send their backups off site for added security. This can be done by backing up to a data center. Encrypted backups can be sent over the Internet to another data center where they can be stored securely.

For quick deployment or disaster recovery, several large hardware vendors have developed mobile solutions that can be installed and made operational in very short time. Companies such as Cisco Systems,^[47] Sun Microsystems (Sun Modular Datacenter),^[48][49] Bull,^[50] IBM (Portable Modular Data Center), HP, and Google (Google Modular Data Center) have developed systems that could be used for this purpose.^[51][52]

See also

• Central apparatus room
• Colocation center
• Data center infrastructure management
• Disaster recovery
• Dynamic Infrastructure
• Electrical network
• HVAC
• Internet exchange point
• Modular data center
• Network operations center
• Peering
• Server farm
• Server room
• Server Room Environment Monitoring System
• Server sprawl
• Sun Modular Datacenter
• Telecommunications network
• Vendor-neutral data centre
• Web hosting service
• Internet hosting service
• Neher–McGrath
• Datacenter star audit

References

1. ^ Amazon Building Large Data Center in Oregon « Data Center Knowledge
2. ^ http://www.tiaonline.org/standards/
3. ^ Kasacavage, Victor (2002). Complete book of remote access: connectivity and security. The Auerbach Best Practices Series. CRC Press. p. 227. ISBN 0849312531. 
4. ^ Burkey, Roxanne E.; Breakfield, Charles V. (2000). Designing a total data solution: technology, implementation and deployment. Auerbach Best Practices. CRC Press. p. 24. ISBN 0849308933. 
5. ^ ^{a b} Mukhar, Nicholas. "HP Updates Data Center Transformation Solutions," August 17, 2011 [1]
6. ^ Sperling, Ed. "Next-Generation Data Centers," Forbes, March 15. 2010
7. ^ Niccolai, James. "Data Centers Turn to Outsourcing to Meet Capacity Needs," CIO.com, May 10, 2011 [2]
8. ^ Tang, Helen. "Three Signs it's time to transform your data center," August 3, 2010, Data Center Knowledge [3]
9. ^ ^{a b} Miller, Rich. "Complexity: Growing Data Center Challenge," Data Center Knowledge, May 16, 2007 [4]
10. ^ Sims, David. "Carousel's Expert Walks Through Major Benefits of Virtualization," TMC Net, July 6, 2010 [5]
11. ^ Delahunty, Stephen. "The New urgency for Server Virtualization," InformationWeek, August 15, 2011. [6]
12. ^ Miller, Rich. "Gartner: Virtualization Disrupts Server Vendors," Data Center Knowledge, December 2, 2008 [7]
13. ^ Ritter, Ted. Nemertes Research, "Securing the Data-Center Transformation Aligning Security and Data-Center Dynamics," [8]
14. ^ A ConnectKentucky article mentioning Stone Mountain Data Center Complex "Global Data Corp. to Use Old Mine for Ultra-Secure Data Storage Facility" (PDF). ConnectKentucky. 2007-11-01. http://connectkentucky.org/_documents/connected_fall_FINAL.pdf. Retrieved 2007-11-01. 
15. ^ A definition from Webopedia "Data Center Tiers". Webopedia. 2010-02-13. http://www.webopedia.com/TERM/D/data_center_tiers.html. Retrieved 2010-02-13. 
16. ^ A document from the Uptime Institute describing the different tiers (click through the download page) "Data Center Site Infrastructure Tier Standard: Topology" (PDF). Uptime Institute. 2010-02-13. http://uptimeinstitute.org/index.php?option=com_docman&task=doc_download&gid=82. Retrieved 2010-02-13. 
17. ^ The rating guidelines from the Uptime Institute "Data Center Site Infrastructure Tier Standard: Topology" (PDF). Uptime Institute. 2010-02-13. http://professionalservices.uptimeinstitute.com/UIPS_PDF/TierStandard.pdf. Retrieved 2010-02-13. 
18. ^ "Google Container Datacenter Tour (video)". http://www.youtube.com/watch?v=zRwPSFpLX8I. 
19. ^ "Walking the talk: Microsoft builds first major container-based data center". Archived from the original on 2008-06-12. http://web.archive.org/web/20080612193106/http://www.computerworld.com/action/article.do?command=viewArticleBasic&articleId=9075519. Retrieved 2008-09-22. 
20. ^ "ASHRAE's "Thermal Guidelines for Data Processing Environments"" (PDF). http://tc99.ashraetcs.org/documents/ASHRAE_Extended_Environmental_Envelope_Final_Aug_1_2008.pdf. 
21. ^ "ServersCheck's Blog on Why Humidity Monitoring". July 1, 2008. http://www.serverscheck.com/blog/2008/07/why-monitor-humidity-in-computer-rooms.html. 
22. ^ Detailed expanation of economizer-based cooing"Economizer Fundamentals: Smart Approaches to Energy-Efficient Free-Cooling for Data Centers" (PDF). http://www.emersonnetworkpower.com/en-US/Brands/Liebert/Documents/White%20Papers/Economizer%20Fundamentals%20-%20Smart%20Approaches%20to%20Energy-Efficient%20Free-Cooling%20for%20Data%20Centers.pdf. 
23. ^ "tw telecom and NYSERDA Announce Co-location Expansion". Reuters. 2009-09-14. http://www.reuters.com/article/pressRelease/idUS141369+14-Sep-2009+PRN20090914. 
24. ^ "NASA - metal whiskers research". NASA. http://nepp.nasa.gov/whisker/other_whisker/index.htm. Retrieved 1 August 2011. 
25. ^ Detailed expanation of UPS topologies "EVALUATING THE ECONOMIC IMPACT OF UPS TECHNOLOGY" (PDF). http://www.emersonnetworkpower.com/en-US/Brands/Liebert/Documents/White%20Papers/Evaluating%20the%20Economic%20Impact%20of%20UPS%20Technology.pdf. 
26. ^ "ISSUES RELATING TO THE ADOPTION OF HIGHER VOLTAGE DIRECT CURRENT POWER IN THE DATA CENTER". The Green Grid. http://www.thegreengrid.org/~/media/WhitePapers/IssuesRelatingtotheAdoptionofHVdcPowerintheDataCenter_v1.ashx?lang=en. Retrieved 16 June 2011. 
27. ^ http://dcbuildingpowerasia.darnell.com/. "380Vdc Data Center Power Standard Approved During DC Building Power Japan". http://www.powerpulse.net/. http://www.powerpulse.net/story.php?storyID=21530. Retrieved 16 June 2011. 
28. ^ "Researchers Flip the Switch to Test Energy Saving in Data Centers Using DC Power Directly". Anderson Power Products Inc. http://www.calit2.net/newsroom/release.php?id=1730. Retrieved 16 June 2011. 
29. ^ "Powerpole® Pak Connectors". Anderson Power Products Inc. http://andersonpower.com/products/powerpak-powerpole-pak.html. Retrieved 16 June 2011. 
30. ^ Fixen, Edward L. and Vidar S. Landa,"Avoiding the Smell of Burning Data," Consulting-Specifying Engineer, May 2006, Vol. 39 Issue 5, p47-51
31. ^ 19 Ways to Build Physical Security Into a Data Center
32. ^ "Data Center Energy Consumption Trends". U.S. Department of Energy. http://www1.eere.energy.gov/femp/program/dc_energy_consumption.html. Retrieved 2010-06-10. 
33. ^ J Koomey, C. Belady, M. Patterson, A. Santos, K.D. Lange. Assessing Trends Over Time in Performance, Costs, and Energy Use for Servers Released on the web August 17th, 2009.
34. ^ "Quick Start Guide to Increase Data Center Energy Efficiency". U.S. Department of Energy. http://www1.eere.energy.gov/femp/pdfs/data_center_qsguide.pdf. Retrieved 2010-06-10. 
35. ^ ^{a b} "Smart 2020: Enabling the low carbon economy in the information age". The Climate Group for the Global e-Sustainability Initiative. http://www.smart2020.org/_assets/files/03_Smart2020Report_lo_res.pdf. Retrieved 2008-05-11. 
36. ^ ^{a b} "Report to Congress on Server and Data Center Energy Efficiency". U.S. Environmental Protection Agency ENERGY STAR Program. http://www.energystar.gov/ia/partners/prod_development/downloads/EPA_Datacenter_Report_Congress_Final1.pdf. 
37. ^ A calculation of data center electricity burden cited in the Report to Congress on Server and Data Center Energy Efficiency and electricity generation contributions to green house gas emissions published by the EPA in the Greenhouse Gas Emissions Inventory Report. Retrieved 2010-06-08.
38. ^ Canada Called Prime Real Estate for Massive Data Computers - Globe & Mail Retrieved June 29, 2011.
39. ^ Finland - First Choice for Siting Your Cloud Computing Data Center.. Retrieved 4 August 2010.
40. ^ Stockholm sets sights on data center customers. Accessed 4 August 2010.^{[dead link]}
41. ^ Swiss Carbon-Neutral Servers Hit the Cloud.. Retrieved 4 August 2010.
42. ^ Katrice R. Jalbuena (October 15, 2010). "Green business news.". EcoSeed. http://ecoseed.org/en/business-article-list/article/1-business/8219-i-t-industry-risks-output-cut-in-low-carbon-economy. Retrieved November 11, 2010. 
43. ^ "Data Center Energy Forecast". Silicon Valley Leadership Group. https://microsite.accenture.com/svlgreport/Documents/pdf/SVLG_Report.pdf. 
44. ^ "Google Efficiency Update". Data Center Knowledge. http://www.datacenterknowledge.com/archives/2009/10/15/google-efficiency-update-pue-of-1-22/. Retrieved 2010-06-08. 
45. ^ Commentary on introduction of Energy Star for Data Centers "Introducing EPA ENERGY STAR® for Data Centers" (Web site). Jack Pouchet. 2010-09-27. http://www.emerson.com/edc/post/2010/06/15/Introducing-EPA-ENERGY-STARc2ae-for-Data-Centers.aspx. Retrieved 2010-09-27. 
46. ^ EU Code of Conduct for Data Centres
47. ^ "Info and video about Cisco's solution". Datacentreknowledge. May 15, 2007. http://www.datacenterknowledge.com/archives/2008/May/15/ciscos_mobile_emergency_data_center.html. Retrieved 2008-05-11. 
48. ^ "Technical specs of Sun's Blackbox". Archived from the original on 2008-05-13. http://web.archive.org/web/20080513090300/http://www.sun.com/products/sunmd/s20/specifications.jsp. Retrieved 2008-05-11. 
49. ^ And English Wiki article on Sun's modular datacentre
50. ^ Kidger, Daniel. "Mobull Plug and Boot Datacenter". Bull. http://www.bull.com/extreme-computing/mobull.html. Retrieved 2011-05-24. 
51. ^ Kraemer, Brian (June 11, 2008). "IBM's Project Big Green Takes Second Step". ChannelWeb. http://www.crn.com/hardware/208403225. Retrieved 2008-05-11. 
52. ^ Modular/Container Data Centers Procurement Guide: Optimizing for Energy Efficiency and Quick Deployment

External links

• Lawrence Berkeley Lab - Research, development, demonstration, and deployment of energy-efficient technologies and practices for data centers
• The Uptime Institute - Organization that defines data center reliability and conducts site certifications.
• Timelapse BIT2BCD - timelapse video of a data centre building in Ede, Netherlands.
• The Neher-McGrath Institute - Organization that certifies data center underground duct bank installation to provide lower operating cost and increased up-time.
• DC Power For Data Centers Of The Future - FAQ: 380VDC testing and demonstration at a Sun data center.