BNSF Railway Commuter Rail Technology Infrastructure€¦ · Commuter Rail System Eliminate Coded...
15
BNSF Railway Commuter Rail Technology Infrastructure Ralph Young, Manager Signal Engineering Greg Britz, Manager Technology Services, Telecom Engineering The Seattle Regional Transit Commuter Rail System and the Chicago Metra Commuter Rail System provides passenger service for both metropolitan areas. To best serve it’s growing signal and communications needs, BNSF has constructed a fiber optic based network, engineered to provide multiple levels of redundancy and transport of multiple protocols. Initial services of voice and data services (Vital and non Vital protocols) will be transported on this fiber optic network to serve Commuter Rail and traditional rail needs along the right of way. The integrated fiber optic solution eliminates issues involving outside electromagnetic interference and degradation of service due to moisture and lightning on conventional copper facilities. Reduction in infrastructure failure, reduction in maintenance activities and increased performance will be a result of this fault tolerant design. Todays systems include Standard VHLC Applications, Coded Track and ATCS Control. Commuter Rail System Eliminate Coded Track, enhances VHLC applications and allows integration of additional protocols. The primary system is a serial network of fiber modems installed by the Signal Department that will be used to transport non-vital and vital Signal traffic. The secondary system is a network of IP Ethernet switches and routers configured to transport non-vital, vital and voice traffic. The scope of the Seattle project covers 52+ miles BNSF double and triple track from Seattle to Tacoma Washington. The Chicago project involves 25 + miles of double and triple track between Cicero and Downers Grove Illinois. The projects span a 3 to 5 year timeline. Maps of Seattle and Chicago’s Commuter Rail Systems are attached to the end of this document. This project fits under the Strategic Initiatives of Service, Growth and Efficiency. Servicing the Metropolitan area growth by providing high speed switching systems will allow BNSF to manage growth and make high traffic corridors much more efficient and reliable. ROI is generated by the Department of Transportation (DOT) of each major city. Without these high-speed corridors the, DOT estimates for building additional highways is in the Billion dollar range, not to mention many years of continued congestion. BNSF is spending a fraction of that estimated cost, yielding an ROI in less that one-year. Customer reactions, Commuter Rail DOT employees and Signal personnel to the system include “wow” to the performance and disaster recovery testing that was done in November of 2002. Ralph Young, Manager Signal Engineering in Kansas City, stated “Getting off copper facilities and moving to fiber optics will enhance system performance and reduce maintenance time along the Commuter Rail Corridors”. Traditional Telecom and Signal Systems had used copper cable similar to what is provided to your home. Moisture, noise and low speed are all issues with copper cabling that are overcome by fiber optics based infrastructure.
Transcript of BNSF Railway Commuter Rail Technology Infrastructure€¦ · Commuter Rail System Eliminate Coded...
BNSF Railway Commuter Rail Technology Infrastructure Ralph Young, Manager Signal Engineering
Greg Britz, Manager Technology Services, Telecom Engineering
The Seattle Regional Transit Commuter Rail System and the Chicago Metra Commuter Rail System provides passenger service for both metropolitan areas. To best serve it’s growing signal and communications needs, BNSF has constructed a fiber optic based network, engineered to provide multiple levels of redundancy and transport of multiple protocols. Initial services of voice and data services (Vital and non Vital protocols) will be transported on this fiber optic network to serve Commuter Rail and traditional rail needs along the right of way. The integrated fiber optic solution eliminates issues involving outside electromagnetic interference and degradation of service due to moisture and lightning on conventional copper facilities. Reduction in infrastructure failure, reduction in maintenance activities and increased performance will be a result of this fault tolerant design. Todays systems include Standard VHLC Applications, Coded Track and ATCS Control. Commuter Rail System Eliminate Coded Track, enhances VHLC applications and allows integration of additional protocols. The primary system is a serial network of fiber modems installed by the Signal Department that will be used to transport non-vital and vital Signal traffic. The secondary system is a network of IP Ethernet switches and routers configured to transport non-vital, vital and voice traffic. The scope of the Seattle project covers 52+ miles BNSF double and triple track from Seattle to Tacoma Washington. The Chicago project involves 25 + miles of double and triple track between Cicero and Downers Grove Illinois. The projects span a 3 to 5 year timeline. Maps of Seattle and Chicago’s Commuter Rail Systems are attached to the end of this document. This project fits under the Strategic Initiatives of Service, Growth and Efficiency. Servicing the Metropolitan area growth by providing high speed switching systems will allow BNSF to manage growth and make high traffic corridors much more efficient and reliable. ROI is generated by the Department of Transportation (DOT) of each major city. Without these high-speed corridors the, DOT estimates for building additional highways is in the Billion dollar range, not to mention many years of continued congestion. BNSF is spending a fraction of that estimated cost, yielding an ROI in less that one-year. Customer reactions, Commuter Rail DOT employees and Signal personnel to the system include “wow” to the performance and disaster recovery testing that was done in November of 2002. Ralph Young, Manager Signal Engineering in Kansas City, stated “Getting off copper facilities and moving to fiber optics will enhance system performance and reduce maintenance time along the Commuter Rail Corridors”. Traditional Telecom and Signal Systems had used copper cable similar to what is provided to your home. Moisture, noise and low speed are all issues with copper cabling that are overcome by fiber optics based infrastructure.
A typical Signal and Rail Control Point along the Right of Way is shown below. Fiber enters on side of the Control point and leaves on the opposite side to provide disaster recovery in the event of a fiber optic cable cut. These control points provide shelter for hardware and software components used to control train traffic along the Commuter Rail route.
Typical Control Point along the Right of Way
Seattle Sounder Commuter Rail Train
Control Point Hardware
Chicago Metra Commuter Rail Network
Seattle Regional Transit Authority Commuter Rail System
The technology used to leverage the fiber optic network involves traditional fiber optic modems and IP based routers. BNSF uses Nortel routers, switches and hub components on this system. Transport of non-routable protocols over IP is facilitated by the Safetran packet switch through protocol conversion. The conventional ATCS or ARES architecture could not be used in these high traffic corridors due to frequency congestion, vital protocol transport and the requirement to not us copper facilities along these route. Infrastructure maintenance, fault toleranc and reliability of the system dictated the fiber solution for metropolitan areas.
Off the shelf components from traditional IP vendors was also a requirement of the design that led to the fiber solution as the ultimate 25+ year design. Propriatary solutions for the Railroad industry is typically provided due to the specialized, single industry requirements. Using IP based systems, allows utilization of open architectures that are available globally. Open systems typically are less costly, feature rich and scalable. All of these advantages are leverage in the Commuter rail solution. The attached diagram provides a network overview of the components and architecture involved in this strategic design.
Fort Worth
Dispatcher WAN
Downer'sGrove
ARN Router
Control Point x
Track 1VHLC
Transfer Switch
NonVitalPort
SRS232
Transfer Switch
NonVitalPort
SRS232
Transfer Switch
NonVitalPort
SRS232
Track 2VHLC
Track 3VHLC
TECH SVCS FIBER
SIGNAL FIBER
BPS Switch
WCC
Control Point x
Track 1VHLC
Transfer Switch
NonVitalPort
SRS232
Transfer Switch
NonVitalPort
SRS232
Transfer Switch
NonVitalPort
SRS232
Track 2VHLC
Track 3VHLC
TECH SVCS FIBER
SIGNAL FIBER
BPS Switch
WCC
Control Point x
Track 1VHLC
Transfer Switch
NonVitalPort
SRS232
Transfer Switch
NonVitalPort
SRS232
Transfer Switch
NonVitalPort
SRS232
Track 2VHLC
Track 3VHLC
SIGNAL FIBER
TECH SVCS FIBERBPS Switch
WCC
Control Point x
Track 1VHLC
Transfer Switch
NonVitalPort
SRS232
Transfer Switch
NonVitalPort
SRS232
Transfer Switch
NonVitalPort
SRS232
Track 2VHLC
Track 3VHLC
SIGNAL FIBER
TECH SVCS FIBERBPS Switch
WCC
Cicero
ARN Router T1 Lease
RS232
8600 Switch
Ethernet
Ethernet Ethernet
Ethernet
WCC
8600 Switch
Long Haul Fiber
Ethernet
RS232
WCC
Non-Vital Signal Flow
MasterFiber Modem
P
P
P
Track 1Fiber Modem
Track 2Fiber Modem
Track 3Fiber Modem
P
P
P
Track 1Fiber Modem
Track 2Fiber Modem
Track 3Fiber Modem
P
Track 1Fiber Modem
P
Track 2Fiber Modem
P
Track 3Fiber Modem
P
Track 1Fiber Modem
P
P
Track 3Fiber Modem
Track 2Fiber Modem
MasterFiber Modem
Figure 1
Cic
Downer'sGrove
ARN Router
ero
ARN Router T1 Lease
8600 Switch
Long Haul Fiber
EthernetEthernet
Control Point x
TECH SVCS FIBER
BPS Switch
Track 1VHLC
Transfer Switch
West VitalPort
East VitalPort
S S
Track 2VHLC
Transfer Switch
West VitalPort
East VitalPort
S S
Track 3VHLC
Transfer Switch
West VitalPort
East VitalPort
S S
ARN Router
RS232 RS232
Control Point x
TECH SVCS FIBER
BPS Switch
Track 1VHLC
Transfer Switch
West VitalPort
East VitalPort
S S
Track 2VHLC
Transfer Switch
West VitalPort
East VitalPort
S S
Track 3VHLC
Transfer Switch
West VitalPort
East VitalPort
S S
ARN Router
RS232 RS232
8600 Switch
SIGNAL FIBER
Control Point x
TECH SVCS FIBER
BPS Switch
Track 1VHLC
Transfer Switch
West VitalPort
East VitalPort
S S
Track 2VHLC
Transfer Switch
West VitalPort
East VitalPort
S S
Track 3VHLC
Transfer Switch
West VitalPort
East VitalPort
S S
ARN Router
RS232 RS232
Control Point x
TECH SVCS FIBER
BPS Switch
Track 1VHLC
Transfer Switch
West VitalPort
East VitalPort
S S
Track 2VHLC
Transfer Switch
West VitalPort
East VitalPort
S S
Track 3VHLC
Transfer Switch
West VitalPort
East VitalPort
S S
ARN Router
RS232 RS232
SIGNAL FIBER
SIGNAL FIBER SIGNAL FIBER
SIGNAL FIBER
SIGNAL FIBER
SIGNAL FIBER
SIGNAL FIBER
SIGNAL FIBER
Vital Signal Flow
Track 1 WestFiber Modem
Track 1 EastFiber Modem
P P
Track 2 WestFiber Modem
Track 2 EastFiber Modem
P P
Track 3 WestFiber Modem
Track 3 EastFiber Modem
P P
Track 1 WestFiber Modem
Track 1 EastFiber Modem
P P
Track 2 WestFiber Modem
Track 2 EastFiber Modem
P P
Track 3 WestFiber Modem
Track 3 EastFiber Modem
P P
Track 1 WestFiber Modem
Track 1 EastFiber Modem
P P
Track 2 WestFiber Modem
Track 2 EastFiber Modem
P P
Track 3 WestFiber Modem
Track 3 EastFiber Modem
P P
Track 1 WestFiber Modem
Track 1 EastFiber Modem
P P
Track 2 WestFiber Modem
Track 2 EastFiber Modem
P P
Track 3 WestFiber Modem
Track 3 EastFiber Modem
P P
Figure 2 Theory of Operation: The primary system utilizes TC Communications multi-drop fiber modems for the non-vital traffic and point to point fiber modems for the vital traffic. These fiber modems provide an interface that converts RS-232 data signals to fiber optics for transmission through the Interconnect fiber. Under normal operation (no fiber cuts) the primary signal path for the subscribers is through the this system. In the event of a fiber cut, the signal routes can traverse a routed IP network with leased T1 circuits. This route is called the "Secondary System" for the code systems project. The Secondary System consists of multiple IP networked devices configured to provide reliable and low-latency connections for both the non-vital and vital signal circuits. In this configuration, each wayside location is a member of the dispatcher IP network. The transport infrastructure for this system is the Long-Haul and the Interconnecting fiber paths. The dispatcher IP network is presented to the wayside system through high-speed switches interconnected by gigabit ethernet fiber connections. In the BNSF
physical environment, the configuration of the fiber ring consists of two paths installed in a common trench. To compensate for a complete cut through both the long-haul and interconnecting fibers at any one point in the system, a third path is provide via bridged T1 router connections between nodes. When operating on this secondary system, the non-vital controls are provided by an IP connected Wayside Communications Controller (WCC) located at the wayside location. The vital circuits are encapsulated into "Asynchronous Over TCP/IP (AOT)" packets for communication between wayside Signal Harmon Logic Controller (HLC) devices. The overall secondary system is configured as two logical IP networks. Spanning Tree protocol prevents routing loops and provides the function necessary to converge the routing when failures cause path changes. The Nortel 8603 high-speed switches located at specific nodes provide gateways to the dispatcher WAN/LAN. Virtual Router Redundancy Protocol (VRRP) is enabled in these switches to provide automatic default route backup should the primary gateway fail. Vital Systems enhancements are provided with this IP based design. Standard VHLC Application:
• Vital Failure Kills Plant • Requires Track & Time on all Tracks for Testing and Switch Maintenance • Entire Plant must be Tested for Vital Changes
Recommended Base Strategies:
• Eliminate Coded Track • Use Genisys Protocol for CTC • Link Locations with 128 bit Vital Data Circuit • Use VHLC at Every Location • Reduce Plant Sizes (Preliminary Engineering) • Avoid “Remote Locations” or “Bridge Houses” • Develop VHLC Vital Serial Port Test Unit (Similar to TIS unit) • Use Split Switch Crossover Logic (Developed by RPB)
• Advantages of Split Switch Crossover: • MOW can work on one switch while trains operate over others • Normal switch correspondence on both ends of a crossover is not
required to clear a Signal. • Develop High Reliability in VHLC Applications
• Coded Track Conflicts with Crossing Circuits • Additional Houses in Long Plants • Additional Equipment
• Increased Protocol Speed • Increased Reliability • Increased Predictability
Vital Design:
Vital Serial Ports Line Circuits
VRE C
VRE B
VRE A
VHLC B2
VHLC C
VHLC B1
VHLC AVRE A
VRE B
VRE C
Vital Link
Vital Link
Vital Link
Vital Link Vital Link
Vital LinkVital Link
Vital I/O
Vital I/O
Vital Serial Ports Line Circuits
VRE AVHLC AVRE A
Vital Link
Vital I/O
TPHFYY/YY/GGCAB ENLINK
TPHFYY/GGCAB ENLINK
VHLC B1
Vital Link
TPHFYY/GGCAB ENLINK
TPHFYY/YY/GGCAB ENLINK
Recommended Base Strategies• Eliminate Coded Track • Use Genisys Protocol for CTC• Link Locations with 128 bit Vital Data Circuit• Use VHLC at Every Location• Reduce Plant Sizes (Preliminary Engineering)• Avoid “Remote Locations” or “Bridge Houses”• Develop VHLC Vital Serial Port Test Unit
(Similar to TIS unit)• Use Split Switch Crossover Logic (Developed by
RPB)• Develop High Reliability in VHLC Applications
To support voice communications at the wayside, Voice over IP (VoIP) phones are provided at each wayside bungalow and connected to the network. These phones are supported by an NEC IVS2000 PBX system. A Virtual Local Area Network (VLAN) link, from the BNSF production network, will also be available at the bungalow to support a Laptop workstation. Also provided at the bungalow is a DPS Telecomm Netguardian monitoring unit. This unit will be connected to the production network VLAN to collect and deliver alarm information to the management system in Ft. Worth. It also provides terminal server functionality to allow console access to the HLC devices remotely over the IP network. The Diagram Labled Figure 3 and 4 depicts a fiber optic cable break and traffic reroute via microwave or Leased services.
Downer's
GroveARN Router
Cicero
ARN Router T1 Lease
8600 Switch
Long Haul Fiber
EthernetEthernet
Control Point x
TECH SVCS FIBER
BPS Switch
Track 1VHLC
Transfer Switch
West VitalPort
East VitalPort
S S
Track 2VHLC
Transfer Switch
West VitalPort
East VitalPort
S S
Track 3VHLC
Transfer Switch
West VitalPort
East VitalPort
S S
ARN Router
RS232 RS232
Control Point x
TECH SVCS FIBER
BPS Switch
Track 1VHLC
Transfer Switch
West VitalPort
East VitalPort
S S
Track 2VHLC
Transfer Switch
West VitalPort
East VitalPort
S S
Track 3VHLC
Transfer Switch
West VitalPort
East VitalPort
S S
ARN Router
RS232 RS232
8600 Switch
SIGNAL FIBER
Control Point x
TECH SVCS FIBER
BPS Switch
Track 1VHLC
Transfer Switch
West VitalPort
East VitalPort
S S
Track 2VHLC
Transfer Switch
West VitalPort
East VitalPort
S S
Track 3VHLC
Transfer Switch
West VitalPort
East VitalPort
S S
ARN Router
RS232 RS232
Control Point x
TECH SVCS FIBER
BPS Switch
Track 1VHLC
Transfer Switch
West VitalPort
East VitalPort
S S
Track 2VHLC
Transfer Switch
West VitalPort
East VitalPort
S S
Track 3VHLC
Transfer Switch
West VitalPort
East VitalPort
S S
ARN Router
RS232 RS232
SIGNAL FIBER
SIGNAL FIBER SIGNAL FIBER
SIGNAL FIBER
SIGNAL FIBER
SIGNAL FIBER
SIGNAL FIBER
SIGNAL FIBER
Vital Fiber Break
Track 1 WestFiber Modem
Track 1 EastFiber Modem
P P
Track 2 WestFiber Modem
Track 2 EastFiber Modem
P P
Track 3 WestFiber Modem
Track 3 EastFiber Modem
P P
Track 1 WestFiber Modem
Track 1 EastFiber Modem
P P
Track 2 WestFiber Modem
Track 2 EastFiber Modem
P P
Track 3 WestFiber Modem
Track 3 EastFiber Modem
P P
Track 1 WestFiber Modem
Track 1 EastFiber Modem
P P
Track 2 WestFiber Modem
Track 2 EastFiber Modem
P P
Track 3 WestFiber Modem
Track 3 EastFiber Modem
P P
Track 1 WestFiber Modem
Track 1 EastFiber Modem
P P
Track 2 WestFiber Modem
Track 2 EastFiber Modem
P P
Track 3 WestFiber Modem
Track 3 EastFiber Modem
P P
Figure 3
R
Fort Worth
Dispatcher WAN
Downer'sGrove
ARN Router
Control Point x
Track 1VHLC
Transfer Switch
NonVitalPort
SRS232
Transfer Switch
NonVitalPort
SRS232
Transfer Switch
NonVitalPort
SRS232
Track 2VHLC
Track 3VHLC
TECH SVCS FIBER
SIGNAL FIBER
BPS Switch
WCC
Control Point x
Track 1VHLC
Transfer Switch
NonVitalPort
SRS232
Transfer Switch
NonVitalPort
SRS232
Transfer Switch
NonVitalPort
SRS232
Track 2VHLC
Track 3VHLC
TECH SVCS FIBER
SIGNAL FIBER
BPS Switch
WCC
Control Point x
Track 1VHLC
Transfer Switch
NonVitalPort
SRS232
Transfer Switch
NonVitalPort
SRS232
Transfer Switch
NonVitalPort
SRS232
Track 2VHLC
Track 3VHLC
SIGNAL FIBER
TECH SVCS FIBERBPS Switch
WCC
Control Point x
Track 1VHLC
Transfer Switch
NonVitalPort
SRS232
Transfer Switch
NonVitalPort
SRS232
Transfer Switch
NonVitalPort
SRS232
Track 2VHLC
Track 3VHLC
SIGNAL FIBER
TECH SVCS FIBERBPS Switch
WCC
Cicero
ARN Router T1 Lease
S232
8600 Switch
Ethernet
Ethernet Ethernet
Ethernet
WCC
8600 Switch
Long Haul Fiber
Ethernet
RS232
WCC
Non-vital Fiber Break
MasterFiber Modem
P
P
P
Track 1Fiber Modem
Track 2Fiber Modem
Track 3Fiber Modem
P
P
P
Track 1Fiber Modem
Track 2Fiber Modem
Track 3Fiber Modem
P
Track 1Fiber Modem
P
Track 2Fiber Modem
P
Track 3Fiber Modem
P
Track 1Fiber Modem
P
P
Track 3Fiber Modem
Track 2Fiber Modem
MasterFiber Modem
Figure 4
The diagram below, Figure 5, outlines an expanded view of the control point components.
Control Point x
Track 1VHLC
Transfer Switch
NonVitalPort
SRS232
Transfer Switch
NonVitalPort
SRS232
Transfer Switch
NonVitalPort
SRS232
Track 2VHLC
Track 3VHLC
SIGNAL FIBER
TECH SVCS FIBERBPS Switch
WCC
Control Point x
Track 1VHLC
Transfer Switch
NonVitalPort
SRS232
Transfer Switch
NonVitalPort
SRS232
Transfer Switch
NonVitalPort
SRS232
Track 2VHLC
Track 3VHLC
SIGNAL FIBER
TECH SVCS FIBERBPS Switch
WCC
P
Track 1Fiber Modem
P
Track 2Fiber Modem
P
Track 3Fiber Modem
P
Track 1Fiber Modem
P
P
Track 3Fiber Modem
Track 2Fiber Modem
Figure 5
Summary: This type of design allows the industry to leverage “off the shelf” IP based components for voice and data delivery in high density traffic area. Wireless solutions that are IP capable will also augment and enhanced this fiber based solution. Offering Internet services to Commuters, employees and other user communities is possible with IP base infrastructure. Fault tolerant services and long term strategic advantages are available with these types of industry solutions.
