Bringing Enterprise IT into the 21st Century: A Management and Sustainability Challenge

33
Bringing enterprise computing into the 21 st century: A management and sustainability challenge Jonathan Koomey, Ph.D. Research Fellow, Steyer-Taylor Center for Energy Policy and Finance, Stanford University http://www.koomey.com Webinar for the Corporate Eco Forum March 19, 2014 1

description

I gave this talk as a webinar on March 19th, 2014 for the Corporate Eco Forum. It discusses ways to improve the efficiency of enterprise IT, mainly focusing on institutional changes that are necessary to make modern IT organizations perform effectively. It draws upon our case study of eBay as well as my other work on data centers over the years.

Transcript of Bringing Enterprise IT into the 21st Century: A Management and Sustainability Challenge

Page 1: Bringing Enterprise IT into the 21st Century:  A Management and Sustainability Challenge

1

Bringing enterprise computing into the 21st century: A management and

sustainability challengeJonathan Koomey, Ph.D.

Research Fellow, Steyer-Taylor Center for Energy Policy and Finance, Stanford University

http://www.koomey.comWebinar for the Corporate Eco Forum

March 19, 2014

Page 2: Bringing Enterprise IT into the 21st Century:  A Management and Sustainability Challenge

2

For more details on the topic of this presentation, see article at

http://www.corporateecoforum.com/bringing-enterprise-computing-21st-

century-management-sustainability-challenge/

See presentation athttp://www.slideshare.net/jgkoomey/

Page 3: Bringing Enterprise IT into the 21st Century:  A Management and Sustainability Challenge

3

Key conclusion: In most companies, enterprise computing is designed

using decades old assumptions and techniques, and but fixing it is more

of a management problem than a technology problem

Page 4: Bringing Enterprise IT into the 21st Century:  A Management and Sustainability Challenge

4

Introduction to information technology (IT)

Page 5: Bringing Enterprise IT into the 21st Century:  A Management and Sustainability Challenge

5

The big picture view

Source: Ericsson and TeliaSonera (Malmodin et al. 2013) with support from CESC, KTH Sweden

Page 6: Bringing Enterprise IT into the 21st Century:  A Management and Sustainability Challenge

6

Delivery of IT services is increasing rapidly

Page 7: Bringing Enterprise IT into the 21st Century:  A Management and Sustainability Challenge

7

Network data flows over time

Source: 1986 to 2007 adapted from Hilbert et. al. 2011; 2014 extrapolated using Cisco VNI data compiled at http://en.wikipedia.org/wiki/Internet_trafficDoubling time 1986 to 2014 = 3 years, doubling time 2000 to 2014 = 1.5 years.

19861993

2000

2007

2014E

Mobile data

Fixed Internet

Voice

Page 8: Bringing Enterprise IT into the 21st Century:  A Management and Sustainability Challenge

8

At the same time, information technology is becoming more

energy efficient at a furious pace

Page 9: Bringing Enterprise IT into the 21st Century:  A Management and Sustainability Challenge

9

Computing efficiency at full load doubles every 1.6 years

Source: Koomey et al. 2011

Page 10: Bringing Enterprise IT into the 21st Century:  A Management and Sustainability Challenge

10

But growth in data use doesn’t necessarily imply growth in

electricity use

Page 11: Bringing Enterprise IT into the 21st Century:  A Management and Sustainability Challenge

11

Two opposing factors

• Equivalently

• So if Computations/Year goes up faster than Computations/kWh, then total kWh goes up!

Page 12: Bringing Enterprise IT into the 21st Century:  A Management and Sustainability Challenge

12

Kinds of data centers

• Hyperscale (e.g., Google, Facebook, Microsoft, eBay, others)

• Enterprise or “in-house” (vast majority)– Conventional– Internal cloud (similar to hyperscale)

• Co-location (my facility, your IT)• High Performance Computing (special case–

batch jobs, very high utilization)

Page 13: Bringing Enterprise IT into the 21st Century:  A Management and Sustainability Challenge

13

Electricity Flows in Data Centers

13

Source: Koomey/Mares

Page 14: Bringing Enterprise IT into the 21st Century:  A Management and Sustainability Challenge

Copyright Jonathan G. Koomey 2013 14

Annualized costs mostly IT, but infrastructure costs not trivial

Adapted from data in Koomey et al. 2007

Page 15: Bringing Enterprise IT into the 21st Century:  A Management and Sustainability Challenge

15

Data centers used1.3% of global electricity and 2% of

US electricityin 2010*

*For details see Koomey 2011

Page 16: Bringing Enterprise IT into the 21st Century:  A Management and Sustainability Challenge

16

Data center electricity use worldwide

Source: Koomey 2011. Graph shows worldwide numbers. For the US, the range for data centers in 2010 was 1.7 to 2.2% of the total.N.B. Infrastructure in this slide refers to cooling, fans, pumps, and power distribution inside data centers.

Page 17: Bringing Enterprise IT into the 21st Century:  A Management and Sustainability Challenge

17

Server installed base

Source: IDC 2013 Vernon Turner

Page 18: Bringing Enterprise IT into the 21st Century:  A Management and Sustainability Challenge

18

Many efficiency opportunities, particularly in IT equipment

Source: Masanet et al. 2011

Page 19: Bringing Enterprise IT into the 21st Century:  A Management and Sustainability Challenge

Copyright Jonathan G. Koomey 2013

Improving the energy efficiency of data centers is as much about people and institutions as it is

about technology

19

Page 20: Bringing Enterprise IT into the 21st Century:  A Management and Sustainability Challenge

20

Why asset management is key

Slide courtesy of Winston Saunders, Intel

Page 21: Bringing Enterprise IT into the 21st Century:  A Management and Sustainability Challenge

21

Idle power improving: Server power curves (via Intel)

• Usage Driven• Variable Utilization• Proportional Energy Use • Optimized Efficiency

• Technology Scope:• CPU and Memory• Power Delivery, Fans, etc. • Instrumentation

Approaching “Ideal” Server Behavior IN THEORYApproaching “Ideal” Server Behavior IN THEORY

Software and workloads used in performance tests may have been optimized for performance only on Intel microprocessors. Performance tests, such as SYSmark* and MobileMark*, are measured using specific computer systems, components, software, operations and functions.  Any change to any of those factors may cause the results to vary.  You should consult other information and performance tests to assist you in fully evaluating your contemplated purchases, including the performance of that product when combined with other products. Configurations: Dual Socket Server. For full configuration information, please see backup. For more information go to http://www.intel.com/performance

Xeon™ 5160

Xeon™ E5-2660

2012

2006

IDEAL

Data from spec.org

Source: Winston Saunders, Intel

Page 22: Bringing Enterprise IT into the 21st Century:  A Management and Sustainability Challenge

22

Appropriate metrics are critical for driving organizational change

• Need to focus on – reducing total costs per computation – increasing total value from computation

• Need to be able to “show back” the consequences of choices to every employee

• Need also to calculate Key Performance Indicators (KPIs) for management

Page 23: Bringing Enterprise IT into the 21st Century:  A Management and Sustainability Challenge

23

DSE http://dse.ebay.com

Page 24: Bringing Enterprise IT into the 21st Century:  A Management and Sustainability Challenge

24

After metrics, you also need to…

• combine budgets and responsibilities• move toward cloud deployment for many IT

functions– instant user access (not weeks or months)– easier forecasting of needs (commoditized computing)

• move from “sit down” IT deployment to “buffet style” for those who still need customized IT– reduce # of server SKUs and configurations– have standard configurations “in stock”

Page 25: Bringing Enterprise IT into the 21st Century:  A Management and Sustainability Challenge

25

Energy-related advantages of hyperscale/cloud computing

• Low PUE• Diversity of users• Economies of scale• Flexibility (because of abstraction/virtualization)• Easier provisioning for outside users

∑: Costs and energy use per computation much lower than conventional enterprise/colo installations

Page 26: Bringing Enterprise IT into the 21st Century:  A Management and Sustainability Challenge

26

Next, use mass production, predictive modeling, and integrated design

• Standardized IT deployments– Modular systems, or– Scalable infrastructure with commoditized and

homogeneous IT hardware• Measure, experiment, learn, and replicate• Use predictive models to understand air flows

before you alter your existing facilities• Focus on whole-system integrated design to

deliver computing services ever more effectively

Page 27: Bringing Enterprise IT into the 21st Century:  A Management and Sustainability Challenge

27

Example: How to tackle data center greenhouse gas emissions?

• DC GHG emissions affected by 3 factors– Infrastructure efficiency (PUE)– IT efficiency– Emissions intensity of electricity

• Best to focus on value, costs, and emissions per computation, not narrow efficiency metrics

• More computations means higher total business value, lower costs per computation, and higher profits

Page 28: Bringing Enterprise IT into the 21st Century:  A Management and Sustainability Challenge

28

PUE isn’t everything

0.0 0.2 0.4 0.6 0.8 1.00.0

0.2

0.4

0.6

0.8

1.0

Relative Data Center GHG Emissions (Baseline = 1)

Rela

tive

Dat

a Ce

nter

Ene

rgy

Use

(Bas

elin

e =

1)

[6]

[5]

[4]

[3]

[1]

[2]

PUE=1.8, minimal IT efficiency

PUE=1.5, minimal IT efficiency

PUE=1.3 (free cooling, warm climate), minimal IT efficiency

PUE=1.1 (free cooling, cool climate), minimal IT efficiency

Decreasing electric power CO2 intensity

Incr

easi

ng o

pera

tiona

l ene

rgy

effici

ency

High energy, high carbon region

High energy, low carbon region

Low energy, low carbon region

Baseline data center powered by coal: - Energy use = 92 GWh/yr - GHG emissions = 89 kt CO2e/yr

PUE=1.1, maximal IT efficiency

PUE=1.8, maximal IT efficiency

[D] Coal(0.96 kt CO2e/GWh)

[C] U.S. average electricity(0.6 kt CO2e/GWh)

[B] Natural gas SOFC(0.35 kt CO2e/GWh)

[A] Renewables(~0.02 kt CO2e/GWh)

Source: Masanet et al. 2013

Page 29: Bringing Enterprise IT into the 21st Century:  A Management and Sustainability Challenge

29

Data center lessons

• Biggest inefficiencies in enterprise data centers (cloud providers much better)

• Just adopting best practices will save 80+%• IT efficiency most important, followed by

infrastructure efficiency and sourcing of low-carbon electricity (embedded emissions not so important)

• Biggest impediments to efficiency are institutional and cognitive, not technical

Page 30: Bringing Enterprise IT into the 21st Century:  A Management and Sustainability Challenge

30

∑: IT should NOT be treated as a cost center, it should be a cost reducing profit center that also

improves corporate and customer environmental performance

Page 31: Bringing Enterprise IT into the 21st Century:  A Management and Sustainability Challenge

31

Suggested reading

Brynjolfsson, Erik, and Andrew McAffee. 2014. The Second Machine Age: Work, Progress, and Prosperity in a Time of Brilliant Technologies. New York, NY: W. W. Norton & Company. [http://amzn.to/1gYHEGk]

Page 32: Bringing Enterprise IT into the 21st Century:  A Management and Sustainability Challenge

32

References• Brynjolfsson, Erik, and Lorin M. Hitt. 2000. "Beyond Computation: Information Technology, Organizational Transformation and Business Performance."

Journal of Economic Perspectives. vol. 14, no. 4. Fall. pp. 23-48.

• Hilbert, Martin, and Priscila López. 2011. "The World's Technological Capacity to Store, Communicate, and Compute Information." Science. vol. 332, no. 6025. April 1. pp. 60-65.

• Hilbert, Martin, and Priscila López. 2012a. "Info Capacity| How to Measure the World’s Technological Capacity to Communicate, Store and Compute Information? Part I: Results and Scope." International Journal of Communication. vol. 6, pp. 956-979. [http://ijoc.org/ojs/index.php/ijoc/article/view/1562/742]

• Hilbert, Martin, and Priscila López. 2012b. "Info Capacity| How to Measure the World’s Technological Capacity to Communicate, Store and Compute Information? Part II: Measurement Unit and Conclusions." International Journal of Communication. vol. 6, pp. 936-955. [http://ijoc.org/ojs/index.php/ijoc/article/view/1563/741]

• Koomey et al. 2002. "Sorry, wrong number: The use and misuse of numerical facts in analysis and media reporting of energy issues." In Annual Review of Energy and the Environment 2002. Edited by R. H. Socolow, D. Anderson and J. Harte. Palo Alto, CA: Annual Reviews, Inc. (also LBNL-50499). pp. 119-158.

• Koomey, Jonathan, Kenneth G. Brill, W. Pitt Turner, John R. Stanley, and Bruce Taylor. 2007. A simple model for determining true total cost of ownership for data centers. Santa Fe, NM: The Uptime Institute. September. <http://www.uptimeinstitute.org/>

• Koomey, Jonathan. 2008. "Worldwide electricity used in data centers." Environmental Research Letters. vol. 3, no. 034008. September 23. <http://stacks.iop.org/1748-9326/3/034008>.

Page 33: Bringing Enterprise IT into the 21st Century:  A Management and Sustainability Challenge

33

References (continued)• Koomey, Jonathan G., Stephen Berard, Marla Sanchez, and Henry Wong. 2011. "Implications of Historical Trends in The Electrical Efficiency of

Computing." IEEE Annals of the History of Computing. vol. 33, no. 3. July-September. pp. 2-10. [http://www.computer.org/csdl/mags/an/2011/03/man2011030046-abs.html]

• Koomey, Jonathan. 2011. Growth in data center electricity use 2005 to 2010. Oakland, CA: Analytics Press. August 1. [http://www.analyticspress.com/datacenters.html]

• Koomey, Jonathan G. 2012. The Economics of Green DRAM in Servers. Burlingame, CA: Analytics Press. November 2. [http://www.mediafire.com/view/uj8j4ibos8cd9j3/Full_report_for_econ_of_green_RAM-v7.pdf]

• Koomey, Jonathan G., H. Scott Matthews, and Eric Williams. 2013. "Smart Everything: Will Intelligent Systems Reduce Resource Use?" The Annual Review of Environment and Resources.vol 38. October. pp. 311-343. [http://www.annualreviews.org/doi/abs/10.1146/annurev-environ-021512-110549].

• Masanet, Eric R., Richard E. Brown, Arman Shehabi, Jonathan G. Koomey, and Bruce Nordman. 2011. "Estimating the Energy Use and Efficiency Potential of U.S. Data Centers." Proceedings of the IEEE. vol. 99, no. 8. August.

• Masanet, Eric, Arman Shehabi, and Jonathan Koomey. 2013. "Characteristics of Low-Carbon Data Centers." Nature Climate Change. July. Vol. 3, No. 7. pp. 627-630. [http://dx.doi.org/10.1038/nclimate1786]

• Malmodin, Jens, Dag Lundén, Åsa Moberg, Greger Andersson, and Mikael Nilsson. 2013. "Life cycle assessment of ICT networks–carbon footprint and operational electricity use from the operator, national and subscriber perspective." Submitted to The Journal of Industrial Ecology. March 8.

• Traub, Todd. 2012. "Wal-mart used technology to become supply chain leader." In Arkansas Business. July 2. [http://www.arkansasbusiness.com/article/85508/wal-mart-used-technology-to-become-supply-chain-leader]

• Weber, Christopher, Jonathan G. Koomey, and Scott Matthews. 2010. "The Energy and Climate Change Impacts of Different Music Delivery Methods." The Journal of Industrial Ecology. vol. 14, no. 5. October. pp. 754–769. [http://dx.doi.org/10.1111/j.1530-9290.2010.00269.x]