How to Build, Refresh, or Rebuild Your Datacenter on Time and Under Budget.

How to Build, How to Build, Refresh, or Refresh, or

Rebuild Your Rebuild Your DatacenterDatacenteron Time and on Time and

Under BudgetUnder Budget

5 Keys to Success5 Keys to Success

Comprehensive budget and timeline

Careful design and capacity planning

Savvy equipment purchasing

Choosing your contractors wisely

Effective construction and project management

HostingCon 2005HostingCon 2005June 7, 2005June 7, 2005

Getting StartedGetting StartedPreliminary questions to ask yourself:

Why am I undertaking this project?

What are my growth projections for the next 3 years?●Revenue●Servers and equipment

How much can I realistically afford to spend?

How am I going to fund this project?

How soon do I need the center to be operational?

What server form factors will the datacenter house?


Budget and TimelineBudget and Timeline How much can I afford to spend?

How much do I want to spend?

Funding from operating cash vs. financing

Phases●Finding a location and signing a lease●Design●Purchasing equipment●Bid process and selecting contractors●Implementation and construction●Time to bring the center online after the last contractor finishes

Best and worst case timelines

Having a good “plan B”


Sample Budget FrameworkSample Budget Framework Construction

Generator●Equipment & Install

UPS●Equipment & Install

HVAC●Equipment & Installation●Electrical

Electrical Contractor●Transformers●Lights●Circuits & Panels●Miscellaneous

Raised Flooring

Fire Suppression●Gas system●Wet Sprinklers●Pre-action dry pipe sprinklers

Security●Keycard access●Alarm and monitoring

Architectural Services

Misc. Professional Services

Fiber and/or Telecom Construction

Delivery and Rigging


Choosing a LocationChoosing a LocationImportant Considerations:

Square footage requirements

Parking

Access to fiber / Internet connectivity

Electrical service capacity

Flex warehouse space vs. officeFlex warehouse space

●Much more affordable per sq. ft.●Be prepared to bear nearly all of the build-out costs

Office space●Landlord may bear some of the build-out space●Higher price per sq. ft. may be partially offset by lower upfront costs

Pitfall!

Choosing a location without affordable and readily available access

to fiber and Internet connectivity can greatly devalue your datacenter.


Space LayoutSpace Layout Do I need an architect?

●Sealed drawings for permit process

Basic rooms required●Workshop / staging area●Main datacenter (server room)●Power / infrastructure room●Bathrooms

Recommended●Office space●Shipping and receiving area●Secure storage


Capacity Planning & Design:Capacity Planning & Design: HVAC & HVAC &

Electrical SystemsElectrical SystemsHVAC Systems:HVAC Systems:

What types of servers do I use or plan to use?What types of servers do I use or plan to use?●What is their typical power draw (this relates to heat What is their typical power draw (this relates to heat dissipation)dissipation)●““Rated” heat dissipation vs. actualRated” heat dissipation vs. actual

Liebert vs. other brandsLiebert vs. other brands

Down flow air and raised floor vs. up flow air and ductworkDown flow air and raised floor vs. up flow air and ductwork

Split system vs. rooftopSplit system vs. rooftop

Choosing systems for main server and power rooms, staging Choosing systems for main server and power rooms, staging area, andarea, and offices offices

The bottom line – how many tons of cooling do I need?The bottom line – how many tons of cooling do I need?●N+1 redundancyN+1 redundancy



Electrical SystemsElectrical SystemsElectrical Systems:Electrical Systems:

What types of servers do I use or plan to use?What types of servers do I use or plan to use?●What is their typical power draw (this relates to heat dissipation)?What is their typical power draw (this relates to heat dissipation)?●““Rated” current draw vs. actual – empirical data is best if availableRated” current draw vs. actual – empirical data is best if available

480 volt vs. 208/120 volt power480 volt vs. 208/120 volt power●Powering HVAC equipmentPowering HVAC equipment●Transformers and harmonicsTransformers and harmonics

Sizing the generator(s)Sizing the generator(s)

UPS systemUPS system●Central vs. “in the rack”Central vs. “in the rack”●Sizing the UPSSizing the UPS●Runtime and expandabilityRuntime and expandability●Maintenance bypassMaintenance bypass



Electrical SystemsElectrical SystemsEssential Technologies:Essential Technologies:

K-Rated TransformersK-Rated Transformers●Handle non-linear loads Handle non-linear loads from computer power from computer power suppliessupplies●Standard transformer will Standard transformer will overheat and fail overheat and fail prematurelyprematurely●Manufactured with Manufactured with heavier gauge copper and heavier gauge copper and a double sized neutral a double sized neutral conductor conductor

Central UPS SystemCentral UPS System●More cost effective in the More cost effective in the long runlong run●More reliable than “in the More reliable than “in the rack” systemsrack” systems●More manageable – small More manageable – small units overload quickly units overload quickly



Electrical SystemsElectrical Systems

Pitfall! Underestimating the importance of properly sizing electrical and HVAC systems:

1) Do I need an engineer?2) How does this phase impact the rest of the project?3) How can I structure my build to minimize the impact of a mistake?


Capacity Planning & Design:Capacity Planning & Design: Raised Floor & Raised Floor &

Cable Mgmt.Cable Mgmt. Tightly tied to HVAC and electrical planningTightly tied to HVAC and electrical planning

Cost comparison vs. ductwork for air deliveryCost comparison vs. ductwork for air delivery

Fire suppression concernsFire suppression concerns●Fire code may require under floor suppression, especially Fire code may require under floor suppression, especially with gas systemswith gas systems

Ramps, steps, and ADA accessibility concernsRamps, steps, and ADA accessibility concerns●Impact on overall square footageImpact on overall square footage


Capacity Planning & Design:Capacity Planning & Design: Raised Floor & Raised Floor &

Cable Mgmt.Cable Mgmt.Essential Technology:Essential Technology:

Networking overhead, electrical under floorNetworking overhead, electrical under floor●Should I deliver networking cable under the floor?Should I deliver networking cable under the floor?

●Raised floors can become “cable graveyards”Raised floors can become “cable graveyards”●Overhead “ladders” recommended for network Overhead “ladders” recommended for network cablecable

●Excellent for delivering power circuits to racksExcellent for delivering power circuits to racks●Benefits for air distributionBenefits for air distribution


Capacity Planning & Design:Capacity Planning & Design: SecuritySecurity

Keycard accessKeycard access

Multi-room access restrictionsMulti-room access restrictions

Secure storage area for equipmentSecure storage area for equipment

Biometrics – worth the cost?Biometrics – worth the cost?

Essential Technology:Essential Technology:

Centralized monitoring of security, climate, and various sensorsCentralized monitoring of security, climate, and various sensors

Cost effective to outsourceCost effective to outsource

Under-floor water detectionUnder-floor water detection

Detect condensate leaks from air conditioningDetect condensate leaks from air conditioning

Catch problems early to prevent disasterCatch problems early to prevent disaster


Capacity Planning & Design:Capacity Planning & Design: Fire Detection & Fire Detection &

SuppressionSuppressionEssential Technology: Essential Technology:

Dual method smoke and fire detectionDual method smoke and fire detection●PhotoelectricPhotoelectric

●Chamber that gets clouded or obstructedChamber that gets clouded or obstructed●If light beam doesn't bounce back it alarmsIf light beam doesn't bounce back it alarms●““Sees" fireSees" fire

IonizationIonization●Invisible state of fireInvisible state of fire●No smoke but detects chemical change associated with fire No smoke but detects chemical change associated with fire in air moleculesin air molecules


Capacity Planning & Design:Capacity Planning & Design: Fire Detection & Fire Detection &

SuppressionSuppression Clean agent gas systemsClean agent gas systems

●FM 200, FE-227, FE-25 – Halon replacementsFM 200, FE-227, FE-25 – Halon replacements●Single zone vs. multiple zone systemsSingle zone vs. multiple zone systems●Inspection and “fan test”Inspection and “fan test”●Training staff on usage and response to alarmsTraining staff on usage and response to alarms

Wet pipe sprinklersWet pipe sprinklers

Dry pipe “pre-action” sprinkler systemsDry pipe “pre-action” sprinkler systems

Complying with fire code and passing inspectionComplying with fire code and passing inspection

Cost comparisonCost comparison


Savvy Equipment Purchasing:Savvy Equipment Purchasing: New vs. Used New vs. Used

New Equipment:New Equipment:

From manufacturers and resellersFrom manufacturers and resellers

Benefits of new equipmentBenefits of new equipment●Readily availableReadily available●Factory warrantiesFactory warranties●Latest technologyLatest technology●Less likely to have problems or be “DOA”Less likely to have problems or be “DOA”

Main drawback of new equipment – costMain drawback of new equipment – cost


Savvy Equipment Purchasing:Savvy Equipment Purchasing: New vs. Used New vs. Used

Used Equipment:Used Equipment:

Used equipment is ideal for all non-critical or highly redundant Used equipment is ideal for all non-critical or highly redundant systemssystems

Reconditioned equipment in “like new” condition is a great Reconditioned equipment in “like new” condition is a great optionoption

Used equipment is available for things you might not expectUsed equipment is available for things you might not expect

Used and reconditioned raised flooring systems are readily Used and reconditioned raised flooring systems are readily availableavailable


Savvy Equipment Purchasing:Savvy Equipment Purchasing: Sourcing Sourcing

Buying from your contractors vs. directBuying from your contractors vs. direct●What to procure yourselfWhat to procure yourself

●““Big” items – generator, datacenter HVAC units, Big” items – generator, datacenter HVAC units, central UPScentral UPS●Can save 10-20% on high cost itemsCan save 10-20% on high cost items

●What to let your contractors handleWhat to let your contractors handle●Miscellaneous electrical gear (panels, etc…), rooftop Miscellaneous electrical gear (panels, etc…), rooftop air conditioning units, construction materialsair conditioning units, construction materials

New equipment is also available on the secondary market New equipment is also available on the secondary market throughthrough vendors that also sell used vendors that also sell used

Creative sourcing on high dollar items can significantly reduce Creative sourcing on high dollar items can significantly reduce projectproject costs costs


Choosing Your Contractors WiselyChoosing Your Contractors Wisely Selecting the companies for bidsSelecting the companies for bids

Preparing your RFPPreparing your RFP

Bidding out the jobsBidding out the jobs

Pitfall! Failing to provide sufficient detail to contractors and failing to get detailed proposals in writing.1) Avoid costly change orders as a result of “miscommunication”.2) Give yourself solid footing in the event of a dispute.


Choosing Your Contractors WiselyChoosing Your Contractors Wisely Building solid relationshipsBuilding solid relationships

Interacting with and evaluating contractors during the bid Interacting with and evaluating contractors during the bid processprocess

How to evaluate bidsHow to evaluate bids●High and low bidsHigh and low bids●Evaluating “outliers”Evaluating “outliers”●Is the cheapest bid always the best?Is the cheapest bid always the best?


Effective ConstructionEffective Construction & & Project Project ManagementManagementDo I need a General Contractor (GC)?Do I need a General Contractor (GC)?

GC’s and construction management GC’s and construction management companiescompanies

●What they offerWhat they offer●What they costWhat they cost●Why you might want oneWhy you might want one●How you can avoid themHow you can avoid them

Pitfall! Permit and inspection processes can cause significant delays in

your build.

If you choose to bypass the GC, which can substantially reduce project costs, make sure you choose contractors that are well connected and have a

thorough knowledge of the permit processes in your area.Especially important with construction, electrical, and fire

suppression.


Effective ConstructionEffective Construction & & Project Project ManagementManagementCoordinating Contractors:Coordinating Contractors:

Project planningProject planning

Coordinating facility access for contractorsCoordinating facility access for contractors

Jobs are interdependentJobs are interdependent●ExamplesExamples

●Ductwork and sprinklers before Ductwork and sprinklers before ceilingsceilings●Electrical work required for Electrical work required for HVACHVAC●Electrical work before drywallElectrical work before drywall●Etc…Etc…

●Keeping things flowing in orderKeeping things flowing in order●Contractor meetingsContractor meetings


Effective ConstructionEffective Construction & & Project Project ManagementManagementManaging Disputes and Accidents:Managing Disputes and Accidents:

Handling a dispute with a contractorHandling a dispute with a contractor●When to disburse paymentsWhen to disburse payments●Taking a hard line when necessaryTaking a hard line when necessary●Contingency plansContingency plans

AccidentsAccidents●Broken equipment, damage to Broken equipment, damage to facilitiesfacilities●How to protect yourselfHow to protect yourself●Insurance requirementsInsurance requirements


Effective ConstructionEffective Construction & & Project Project ManagementManagement

Pitfall! Failing to hire a rigging company to manage delivery and placement of heavy equipment.

1) Hire a rigging company that is insured and experienced at receiving, handling, and delivering heavy machinery.2) Schedule delivery of large pieces to the rigging company.3) Have the rigging company deliver the equipment and set it in place in your datacenter.4) The rigging company should store the equipment until the proper time in the construction cycle


Effective ConstructionEffective Construction & & Project Project ManagementManagementAfter the job is done, the work begins.After the job is done, the work begins.

Walkthroughs and punch-lists Walkthroughs and punch-lists

Final payment disbursementsFinal payment disbursements

Once your contractors finish, your work Once your contractors finish, your work beginsbegins

Factoring this piece into your timelineFactoring this piece into your timeline●Installing your networking gearInstalling your networking gear●Network cablingNetwork cabling●Staffing and monitoringStaffing and monitoring


Must-have Technology SummaryMust-have Technology Summary

K-Rated TransformersK-Rated Transformers

Central UPS SystemCentral UPS System

Raised flooring with overhead network cablingRaised flooring with overhead network cabling

Central monitoring and under-floor water detectionCentral monitoring and under-floor water detection

Dual method smoke and fire detectionDual method smoke and fire detection


Pitfall SummaryPitfall Summary

Choosing a location without affordable and readily available access to fiber and Internet connectivity can greatly devalue your datacenter.

Underestimating the importance of properly sizing electrical and HVAC systems.

Failing to provide sufficient detail to contractors and failing to get detailed proposals in writing.

Failing to hire a rigging company to manage delivery and placement of heavy equipment.

Permit and inspection processes can cause significant delays in your build.


How to Build, Refresh, or Rebuild Your Datacenter on Time and Under Budget.

Documents

Transcript of How to Build, Refresh, or Rebuild Your Datacenter on Time and Under Budget.