Network Planning – How to Build & Sustain a 955 Miles of
29
Network Planning – How to Build & Sustain a 955 Miles of Fiber in less than 3Yrs! Internet2 Spring 2010 Member Meeting April 28, 2010 Internet2 Member Meeting
Transcript of Network Planning – How to Build & Sustain a 955 Miles of
Network Planning – How to Build & Sustain a
955 Miles of Fiber in less than 3Yrs!
Internet2 Spring 2010 Member Meeting
April 28, 2010
Internet2 Member Meeting
Elwood Downing VP, Member Relations, Communications,
Services & Professional Learning [email protected]
734-527-5702 &
Bob Stovall VP, Network Operations & Engineering
[email protected] 734-527-5704
Internet2 Member Meeting
Agenda Merit for Michigan REACH-3MC Scope Funded – Challenges Begin (36-Months)
● Learning the Bureaucracy! Engineering the Network Implementation & Delivery Sustainable Business Model Services – Leveraging the Infrastructure Measuring Success! Questions & Answers
The Michigan Education Research Information Triad (MERIT) formed in 1966 because, “significant benefits might be gained from sharing computing resources via an electronic linkage…”
Merit is a 501(c)3 non-profit organization. Merit operates the longest running Regional Optical Network
(RON) in the country. Established Affiliate Member program in 1990 to connect Higher
Education, K-12 Schools, Libraries, Government, Health Care, Research Organizations, and other Non-profit Organizations.
1969 NSF grant for computer networking with only comparable work at BBN (ARPANET)
Merit Embarks on a Fiber and Wireless Backbone Strategy in 2003
2010 ARRA grant to construct a middle-mile fiber optic infrastructure in rural areas of Michigan (REACH-3MC)
About Merit
Merit for Michigan
Merit’s Goal has been to interconnect the Upper Peninsula and Lower Peninsula by fiber
2008 Competed UP, Bridge, and most of Southern lower Peninsula
2009 ARRA Opportunity
How did we get here?
Merit for Michigan Paving the way: Grass Root Efforts/Communities
Lead to Geographical Communities Strengthening Collaborative Partnerships Public Relations Working with Communities to build Tomorrow’s Network Expanding the Merit branding Expanding Merit Service Offerings Changing the Conversation Goal:
Broadband = Capacity Planning Bandwidth = Connection
Merit for Michigan REACH-3MC – Awarded!
Rural, Education, Anchor, Community, Healthcare – Michigan Middle Mile Collaborative
Merit’s ARRA application was approved on 1/20/10.
Middle-mile network covering over 955 miles and reaching 33 counties.
72 strands of fiber 4 – For-Profit Partners
REACH-3MC Scope Routes are in four corridors:
● Southern Corridor, Monroe to Benton Harbor
● Western Corridor, Benton Harbor to Mackinaw City
● Central Corridor, Mount Pleasant to Hillman
● Eastern Corridor, Midland to Oscoda
Segment lengths are selected to match fiber loss verses optical system transmission capability
Intermediate cities were selected for “drive by” to allow future service to under served areas
REACH-3MC Scope Partner Relations:
4 For-Profit Partners 20% equity to the table for various segments and
corridors 72-strand bundle, Merit has a minimum of 24 –
remaining 48 are shared by various partners Concentrating on last-mile – homes and
businesses Weekly meeting scheduled to keep them updated
on progress Merit is grant administrator
REACH-3MC Scope Goals of Project: Interconnect the Upper Peninsula with the Lower
Peninsula by fiber optic cable Leverage Merit’s existing Network Lower Backhaul cost for Rural ISPs Provide a suite of transport services Breakdown economic barriers for rural ISPs to
deliver affordable new and expanded services Connect Anchor Tenants to create a statewide
K-20 Education Newtork
Funded – Opportunities Begin Learning the NTIA/BTOP Program Compliance
● Environmental Assessment ● State Historic Preservations Office ● Tribal Historic Preservations Office ● Quarterly Reports, 1st one due this Friday, 4/28/2010
How are we responding? ● Breaking down the process…keeping in mind the easy and
hard stuff. ● 1st Engineering, 2nd Construction, 3rd Materials
● Streamlining processes and managing the dollars ● Manage those easy wins!
Engineering the Network
Using one Engineering firm for the whole project ● Provides consistent documentation ● Consistent process ● Easier to project manage ● Control cost
● Unit pricing ● Utility management
Engineering the Network
Engineering & Build Process: ● 955+ Miles! ● Project Manager ● Environmental Assessment ● Engineering ● Permitting ● Materials ● Construction ● Equipment installation
Engineering the Network Environmental Assessment:
● Required by NEPA ● Must be completed within 6 months of notification ● Permitting and Construction cannot start until EA is
accepted
Permitting Process: ● Engineering firm creates the permit documentation ● Merit team will submit permits to the appropriate entities ● Control the process and priorities
Engineering the Network Construction:
● Bid out as per unit (cost per foot) ● Economies of scale ● Increased flexibility ● Ability to move construction crews as needed ● ~20 Crews – estimated to complete 1 mile per day, 20 miles a day,
estimated to take 50 work days to complete the outside plant work ● Critical part is permitting and make-ready
Materials: ● Purchase in bulk! ● Economies of scale ● Consistent materials through out the infrastructure ● Control deliver of materials ● Consistent operational management after installation
Engineering the Network Determining the fiber route/path:
● Drive the route early and often ● Early spring ● Learn something different with each drive
● Approach route in both directions ● Different direction, different perspective ● In urban areas walk the area
● Search for existing conduit and infrastructure ● Already disturbed surfaces ● Someone else has already figured it out
● Don’t believe the tools and documentation ● Visually verify each site
Implementation & Delivery
Implementation & Delivery
Documents
Project Plan & Timeline Info
Engineering Maps
Implementation & Delivery
Implementation & Delivery Community Outreach Meetings through-out the state Hired a Northern MI Member Relations Manager Web site updated within 24hrs Email list: [email protected] or
[email protected] or [email protected] or online form.
Webcasts – currently bi-monthly, planning minimum of each quarter.
Outreach and Engagement will be Key!
Implementation & Delivery
Services up 2.5% from June 2009
Growth in Membership: -- Connections: 200+ (48%) -- New Members: 189+ (83%)
Dedicated Attachments!
Membership Category!Member Count Connections!
% via Fiber!
% via Wireless!
% via Circuit! Internet2!
% using Merit
Services!
Number of k12! 63 47 61.7% 4.3% 34.0% 41 33.3%
Number of lib! 19 140 15.7% 0.0% 85.0% 16 36.8%
K12/Library Support Total! 82! 187! 27.3% 1.1% 72.2% 57! 34.1%
Governing Members! 19 58 19
Governing Member Support Total! 19 58 60.3% 1.7% 37.9% 19 47.37%
Community Colleges! 16 21 66.7% 0.0% 33.3% 16 37.5%
4-yr Colleges! 23 47 68.1% 6.4% 25.5% 18 34.8%
Higher Ed Support Total! 39 68 67.6% 4.4% 27.9% 34 35.9%
Total Commercial! 6 8 45.5% 27.3% 27.3% 0 16.7%
Total Peering! 3 3 N/A N/A N/A N/A N/A
Total Non-Profit! 28 30 53.3% 0.0% 46.7% 6 7.1%
Total Government! 38 26 34.6% 0.0% 65.4% 9 2.6%
Total Government/NFP and Commercial Support! 75! 67! 63.8% 4.5% 50.7% 15! 5.6%
Health Care! 11 29 0
Total Health Care Support! 11 29 62.1% 0.0% 37.9% 0 0.0%
Total Number of Supported Members! 226! 409! 44.0%! 2.2%! 54.0%! 125! 24.3%!
Sustainable Business Model
Sustainable Business Model Estimate ~ $3.1M Revenue ($2.8M new, $376K existing) New Members:
● Potential 390, Forecast is 195 43 Existing Members Revenue Forecast is for bandwidth/connection only, does
not include other services $761,028 Estimated gross annual savings on circuits,
which are limited in capacity $400K is estimated to be the Maintenance, Collocation, &
Operating annual cost. Savings of $361K annually
Fiber Utilization Plan: Merit will immediately light two pair of fiber
One fiber pair will be lit with long haul DWDM 10ge electronics and connect major sites ● Approximately 150 to 200 miles apart ● No mid segment node insertions planned
The second fiber pair will be lit with CWDM 1ge electronics ● This will be the access network ● Many mid segment insertions planned ● Driving signal both directions to nearest 10g node
Remaining dark fiber will be available for future network expansion and lease
10g North Node
10g South Node
1g Mid Node
1g Mid Node
Services – Leveraging the Infrastructure
Hardware Plan: Two overlaid networks on same fiber
footprint: ● DWDM optical transport, 80 wave capable ● CWDM optical Ethernet switch based
DWDM network is composed of Optical Add Drop Multiplexer nodes (OADM) ● Reconfigurable Optical Add Drop Multiplexer
nodes (ROADM) strategically placed to allow remote reroute of wavelengths
CWDM network is composed of Ethernet switch nodes ● Multiple 1ge waves can be configured to expand
bandwidth
Services – Leveraging the Infrastructure
Base services are Ethernet connections ● 1ge and 10ge paths available
Wave services available ● 2.5g and 10g waves ● LAN PHY, WAN PHY or SONET framing ● SONET is point to point, not full managed
service ● Distance insensitive pricing
Lease of dark fiber segment where available in full segment increments
Fiber lateral construction project management
Services – Leveraging the Infrastructure
Services – Leveraging the Infrastructure
Layer 2 Transport Service OnNet Service MeritFiber Plus
MeritDiverse Connection [back-up/redundant]
Inter-connecting with Round I & II BIP/BTOP awardees
Measuring Success # of Anchor Institutions connected, based on route # of MeToo’s to join and connect Meeting projected timeline NTIA Reporting Delivering on-time and within budget Meeting the expectations of the community
● Communication: Website, Webcasts, Outreach Meetings
State & Local Government Involvement Not to Harm
● ISPs, ILECs, CLECs
Discussion/Questions
More Information: http://www.merit.edu/meritformichigan/
