Risk Issue 3: Protection Systems - NERC Highlights and Minutes/Item... · 2013-05-15 ·...
21
Risk Issue 3: Protection Systems Jessica Bian, Director of Performance Analysis, NERC Reliability Issues Steering Committee Meeting January 24, 2013
Transcript of Risk Issue 3: Protection Systems - NERC Highlights and Minutes/Item... · 2013-05-15 ·...
Risk Issue 3 Protection Systems
Jessica Bian Director of Performance Analysis NERC Reliability Issues Steering Committee Meeting January 24 2013
2 RELIABILITY | ACCOUNTABILITY
Topics
bull Risk Measures
bull Supporting Data
bull Risk Analysis
Identifying patterns and risk issues
Reliability improving or deteriorating
Quantitatively improving reliability
bull Gaps and IncrementalNew Efforts
3 RELIABILITY | ACCOUNTABILITY
Risk Measures
4 RELIABILITY | ACCOUNTABILITY
Risk Measures
Event Driven Index (EDI)
Measures Risk from
Major System Events
Key Compliance Monitoring Index (KCMI) Measures Risks from Severe Impact Violations
Condition Driven Index (CDI)
Monitors Risk from
Key Reliability Metrics
Based on event severity risk index (SRI) values and turns into an availability index
Identify a subset of standards that have highest impact to reliability and create an index of standards compliance
Uses the roster of reliability
metrics developed by
RMWGPAS and approved by
OCPC
5 RELIABILITY | ACCOUNTABILITY
SRI and EDI
Likelihood
Impact
Avoid and
Mitigate
Learn and
Reduce
Accept
Reporting Threshold
Inverse CostBenefit
High Impact Low
Frequency (including
CIP)
Severity Risk Index (SRI) Curve
30
1060
SRI Component Weighting
Transmission Lines LostGeneration LostLoss of Load
6 RELIABILITY | ACCOUNTABILITY
Yearly SRI
NERC Annual Daily Severity Risk Index (SRI) Sorted Descending with Historic Benchmark Days
1029
22
827 427
98 828
630 44 711
428
7 RELIABILITY | ACCOUNTABILITY
Tiered Approach
View trends at httpwwwnerccompagephpcid=4|331
8 RELIABILITY | ACCOUNTABILITY
Reliability Metrics
ALR 1-3 Reserve Margin
ALR 1-4 BPS Transmission Related Events Resulting in Loss of Load
ALR 2-4 Disturbance Control Standard Failures (DCS Failures)
ALR 2-5 Disturbance Control Events Greater than Most Severe Single Contingency (MSSC)
ALR 3-5 IROLSOL Exceedance
ALR 4-1 Protection System Misoperations
ALR 6-1 Transmission Constraint Mitigation
ALR 6-2 Energy Emergency Alert 3 (EEA 3)
ALR 6-3 Energy Emergency Alert 2 (EEA 2)
9 RELIABILITY | ACCOUNTABILITY
Reliability Metrics (contrsquod)
ALR1-5 System Voltage Performance
ALR1-12 Interconnection Frequency Response
ALR2-3 UFLS and UVLS Usage
ALR6-11 Automatic AC Transmission Outages Initiated by Failed Protection System Equipment
ALR6-12 Automatic AC Transmission Outages Initiated by Human Error
ALR6-13 Automatic AC Transmission Outages Initiated by Failed AC Substation Equipment
ALR6-14 Automatic AC Circuit Outages Initiated by Failed AC Circuit Equipment
ALR 6-15 Element Availability Percentage
ALR 6-16 Transmission System Unavailability due to Automatic Outages
10 RELIABILITY | ACCOUNTABILITY
Supporting Data
11 RELIABILITY | ACCOUNTABILITY
Supporting Data
12 RELIABILITY | ACCOUNTABILITY
Risk Analysis
13 RELIABILITY | ACCOUNTABILITY
Study 1 Risk Patterns
Weather excluding lightning 17
Unknown 14
Lightning 12
Human Error 11
Failed AC Substation and Circuit Equipment
20
Failed Protection System Equipment
8
Power System Condition 4
Foreign Interference 4
Other 4 Biggest contributor to transmission severity - Failed AC Substation Equip - Statistically significant and positively correlated
AC Circuit Sustained Automatic Outages by Initiating Cause Code
14 RELIABILITY | ACCOUNTABILITY
Metric - BPS Transmission Related Events Resulting in Loss of Load
Transmission Related Events Resulting in Load Loss (2011)
Date Generation Loss (MW)
Transmission Loss
Load Loss
(MW)
Equipment Failure
Protection System
Misoperation
Human Error
1132011 0 3 lines 135
3272011 260 13 lines 295
4252011 0 5 lines
1 transformer 140
5102011 300 10 lines 462
662011 106 4 lines 450
6302011 1 3 transformers 797
7132011 599
14 lines 1 back to back
converter 2 transformers
665
7222011 0 1 line 206
982011 6981 32 lines
4 transformers 7835
15 RELIABILITY | ACCOUNTABILITY
Study 2 PRC-005 Effect
Violations
Misops
T Outages
Investigations
Is PRC-005 responsive to
control reliability risks
1331 entities 95 had no violations
2230 misops in 2011
Companies with more misoperations tend to have more failed protection system equipment outages
There is no statistically significant correlation between the number of violations and the number of misoperations
4 violations
359 outages
16 RELIABILITY | ACCOUNTABILITY
Current Efforts
Expert Review
bull PCrsquos Protection System Misoperations Task Force (PSMTF) started in March 2012 to review bull Regional data prior to January 1 2011 bull NERC data from January 1 2011 through March 31 2012
bull Developed a draft report for approval at March 2013 PC meeting bull General observations and conclusions bull Preliminary recommendations
Reporting Enhancements
bull Collecting the total number of operations beginning 4Q2012 bull ALR4-1 is a performance metric or misoperations as a ratio
of total protection system operations bull Coordinating reporting enhancements with the Project 2010-
05 SDT (PRC-003 and PRC-004)
17 RELIABILITY | ACCOUNTABILITY RELIABILITY | ACCOUNTABILITY
Common Patterns and Gaps
As bull Incorrect Settings ndash Protective Function This sub-cause represents 306 (67) of the 458 misoperations
related to settings
These misoperations are engineering errors in general protection applications and are common to all relay technologies
bull More than 24 of the records Either categorized incorrectly or had insufficient information to
identify a sub-cause or root cause
bull Evaluate whether adding sub-cause codes to the reporting
18 RELIABILITY | ACCOUNTABILITY RELIABILITY | ACCOUNTABILITY
Tracking and Potential Solutions
As bull Measure ndash ALR4-1 Misoperation Rate
bull Benchmark ndash Average rate reduction over time 20 rate reduction in 2 years
bull Information Sharing ndash Highlight success stories
bull Targeted training on protective function settings bull Work with Regional Entities and subject matter experts
bull Revise PRC-005 to a results-based standard Establish a performance requirement
oUse a 90 quantile
19 RELIABILITY | ACCOUNTABILITY RELIABILITY | ACCOUNTABILITY
New Risk Issue and Effort
As bull AC Substation Equipment Failure High Priority Issue
Biggest contributor to severity risk index
Statistically significant and positively correlated
bull Measure ndash ALR6-11 bull Automatic AC Transmission Outages initiated by
Failed AC Substation Equipment
bull Add sub-cause codes to the reporting bull Identify common patterns
20 RELIABILITY | ACCOUNTABILITY
Questions and Answers
21 RELIABILITY | ACCOUNTABILITY
Standard PRC-005
bull Title ndash
Transmission and Generation Protection System Maintenance and Testing
bull Purpose ndash To ensure all transmission and generation
Protection Systems affecting the reliability of the Bulk Electric System (BES) are maintained and tested
- Slide Number 1
- Topics
- Slide Number 3
- Risk Measures
- SRI and EDI
- Yearly SRI
- Tiered Approach
- Reliability Metrics
- Reliability Metrics (contrsquod)
- Slide Number 10
- Supporting Data
- Slide Number 12
- Study 1 Risk Patterns
- Metric - BPS Transmission Related Events Resulting in Loss of Load
- Study 2 PRC-005 Effect
- Current Efforts
- Common Patterns and Gaps
- Tracking and Potential Solutions
- New Risk Issue and Effort
- Slide Number 20
- Standard PRC-005
-
2 RELIABILITY | ACCOUNTABILITY
Topics
bull Risk Measures
bull Supporting Data
bull Risk Analysis
Identifying patterns and risk issues
Reliability improving or deteriorating
Quantitatively improving reliability
bull Gaps and IncrementalNew Efforts
3 RELIABILITY | ACCOUNTABILITY
Risk Measures
4 RELIABILITY | ACCOUNTABILITY
Risk Measures
Event Driven Index (EDI)
Measures Risk from
Major System Events
Key Compliance Monitoring Index (KCMI) Measures Risks from Severe Impact Violations
Condition Driven Index (CDI)
Monitors Risk from
Key Reliability Metrics
Based on event severity risk index (SRI) values and turns into an availability index
Identify a subset of standards that have highest impact to reliability and create an index of standards compliance
Uses the roster of reliability
metrics developed by
RMWGPAS and approved by
OCPC
5 RELIABILITY | ACCOUNTABILITY
SRI and EDI
Likelihood
Impact
Avoid and
Mitigate
Learn and
Reduce
Accept
Reporting Threshold
Inverse CostBenefit
High Impact Low
Frequency (including
CIP)
Severity Risk Index (SRI) Curve
30
1060
SRI Component Weighting
Transmission Lines LostGeneration LostLoss of Load
6 RELIABILITY | ACCOUNTABILITY
Yearly SRI
NERC Annual Daily Severity Risk Index (SRI) Sorted Descending with Historic Benchmark Days
1029
22
827 427
98 828
630 44 711
428
7 RELIABILITY | ACCOUNTABILITY
Tiered Approach
View trends at httpwwwnerccompagephpcid=4|331
8 RELIABILITY | ACCOUNTABILITY
Reliability Metrics
ALR 1-3 Reserve Margin
ALR 1-4 BPS Transmission Related Events Resulting in Loss of Load
ALR 2-4 Disturbance Control Standard Failures (DCS Failures)
ALR 2-5 Disturbance Control Events Greater than Most Severe Single Contingency (MSSC)
ALR 3-5 IROLSOL Exceedance
ALR 4-1 Protection System Misoperations
ALR 6-1 Transmission Constraint Mitigation
ALR 6-2 Energy Emergency Alert 3 (EEA 3)
ALR 6-3 Energy Emergency Alert 2 (EEA 2)
9 RELIABILITY | ACCOUNTABILITY
Reliability Metrics (contrsquod)
ALR1-5 System Voltage Performance
ALR1-12 Interconnection Frequency Response
ALR2-3 UFLS and UVLS Usage
ALR6-11 Automatic AC Transmission Outages Initiated by Failed Protection System Equipment
ALR6-12 Automatic AC Transmission Outages Initiated by Human Error
ALR6-13 Automatic AC Transmission Outages Initiated by Failed AC Substation Equipment
ALR6-14 Automatic AC Circuit Outages Initiated by Failed AC Circuit Equipment
ALR 6-15 Element Availability Percentage
ALR 6-16 Transmission System Unavailability due to Automatic Outages
10 RELIABILITY | ACCOUNTABILITY
Supporting Data
11 RELIABILITY | ACCOUNTABILITY
Supporting Data
12 RELIABILITY | ACCOUNTABILITY
Risk Analysis
13 RELIABILITY | ACCOUNTABILITY
Study 1 Risk Patterns
Weather excluding lightning 17
Unknown 14
Lightning 12
Human Error 11
Failed AC Substation and Circuit Equipment
20
Failed Protection System Equipment
8
Power System Condition 4
Foreign Interference 4
Other 4 Biggest contributor to transmission severity - Failed AC Substation Equip - Statistically significant and positively correlated
AC Circuit Sustained Automatic Outages by Initiating Cause Code
14 RELIABILITY | ACCOUNTABILITY
Metric - BPS Transmission Related Events Resulting in Loss of Load
Transmission Related Events Resulting in Load Loss (2011)
Date Generation Loss (MW)
Transmission Loss
Load Loss
(MW)
Equipment Failure
Protection System
Misoperation
Human Error
1132011 0 3 lines 135
3272011 260 13 lines 295
4252011 0 5 lines
1 transformer 140
5102011 300 10 lines 462
662011 106 4 lines 450
6302011 1 3 transformers 797
7132011 599
14 lines 1 back to back
converter 2 transformers
665
7222011 0 1 line 206
982011 6981 32 lines
4 transformers 7835
15 RELIABILITY | ACCOUNTABILITY
Study 2 PRC-005 Effect
Violations
Misops
T Outages
Investigations
Is PRC-005 responsive to
control reliability risks
1331 entities 95 had no violations
2230 misops in 2011
Companies with more misoperations tend to have more failed protection system equipment outages
There is no statistically significant correlation between the number of violations and the number of misoperations
4 violations
359 outages
16 RELIABILITY | ACCOUNTABILITY
Current Efforts
Expert Review
bull PCrsquos Protection System Misoperations Task Force (PSMTF) started in March 2012 to review bull Regional data prior to January 1 2011 bull NERC data from January 1 2011 through March 31 2012
bull Developed a draft report for approval at March 2013 PC meeting bull General observations and conclusions bull Preliminary recommendations
Reporting Enhancements
bull Collecting the total number of operations beginning 4Q2012 bull ALR4-1 is a performance metric or misoperations as a ratio
of total protection system operations bull Coordinating reporting enhancements with the Project 2010-
05 SDT (PRC-003 and PRC-004)
17 RELIABILITY | ACCOUNTABILITY RELIABILITY | ACCOUNTABILITY
Common Patterns and Gaps
As bull Incorrect Settings ndash Protective Function This sub-cause represents 306 (67) of the 458 misoperations
related to settings
These misoperations are engineering errors in general protection applications and are common to all relay technologies
bull More than 24 of the records Either categorized incorrectly or had insufficient information to
identify a sub-cause or root cause
bull Evaluate whether adding sub-cause codes to the reporting
18 RELIABILITY | ACCOUNTABILITY RELIABILITY | ACCOUNTABILITY
Tracking and Potential Solutions
As bull Measure ndash ALR4-1 Misoperation Rate
bull Benchmark ndash Average rate reduction over time 20 rate reduction in 2 years
bull Information Sharing ndash Highlight success stories
bull Targeted training on protective function settings bull Work with Regional Entities and subject matter experts
bull Revise PRC-005 to a results-based standard Establish a performance requirement
oUse a 90 quantile
19 RELIABILITY | ACCOUNTABILITY RELIABILITY | ACCOUNTABILITY
New Risk Issue and Effort
As bull AC Substation Equipment Failure High Priority Issue
Biggest contributor to severity risk index
Statistically significant and positively correlated
bull Measure ndash ALR6-11 bull Automatic AC Transmission Outages initiated by
Failed AC Substation Equipment
bull Add sub-cause codes to the reporting bull Identify common patterns
20 RELIABILITY | ACCOUNTABILITY
Questions and Answers
21 RELIABILITY | ACCOUNTABILITY
Standard PRC-005
bull Title ndash
Transmission and Generation Protection System Maintenance and Testing
bull Purpose ndash To ensure all transmission and generation
Protection Systems affecting the reliability of the Bulk Electric System (BES) are maintained and tested
- Slide Number 1
- Topics
- Slide Number 3
- Risk Measures
- SRI and EDI
- Yearly SRI
- Tiered Approach
- Reliability Metrics
- Reliability Metrics (contrsquod)
- Slide Number 10
- Supporting Data
- Slide Number 12
- Study 1 Risk Patterns
- Metric - BPS Transmission Related Events Resulting in Loss of Load
- Study 2 PRC-005 Effect
- Current Efforts
- Common Patterns and Gaps
- Tracking and Potential Solutions
- New Risk Issue and Effort
- Slide Number 20
- Standard PRC-005
-
3 RELIABILITY | ACCOUNTABILITY
Risk Measures
4 RELIABILITY | ACCOUNTABILITY
Risk Measures
Event Driven Index (EDI)
Measures Risk from
Major System Events
Key Compliance Monitoring Index (KCMI) Measures Risks from Severe Impact Violations
Condition Driven Index (CDI)
Monitors Risk from
Key Reliability Metrics
Based on event severity risk index (SRI) values and turns into an availability index
Identify a subset of standards that have highest impact to reliability and create an index of standards compliance
Uses the roster of reliability
metrics developed by
RMWGPAS and approved by
OCPC
5 RELIABILITY | ACCOUNTABILITY
SRI and EDI
Likelihood
Impact
Avoid and
Mitigate
Learn and
Reduce
Accept
Reporting Threshold
Inverse CostBenefit
High Impact Low
Frequency (including
CIP)
Severity Risk Index (SRI) Curve
30
1060
SRI Component Weighting
Transmission Lines LostGeneration LostLoss of Load
6 RELIABILITY | ACCOUNTABILITY
Yearly SRI
NERC Annual Daily Severity Risk Index (SRI) Sorted Descending with Historic Benchmark Days
1029
22
827 427
98 828
630 44 711
428
7 RELIABILITY | ACCOUNTABILITY
Tiered Approach
View trends at httpwwwnerccompagephpcid=4|331
8 RELIABILITY | ACCOUNTABILITY
Reliability Metrics
ALR 1-3 Reserve Margin
ALR 1-4 BPS Transmission Related Events Resulting in Loss of Load
ALR 2-4 Disturbance Control Standard Failures (DCS Failures)
ALR 2-5 Disturbance Control Events Greater than Most Severe Single Contingency (MSSC)
ALR 3-5 IROLSOL Exceedance
ALR 4-1 Protection System Misoperations
ALR 6-1 Transmission Constraint Mitigation
ALR 6-2 Energy Emergency Alert 3 (EEA 3)
ALR 6-3 Energy Emergency Alert 2 (EEA 2)
9 RELIABILITY | ACCOUNTABILITY
Reliability Metrics (contrsquod)
ALR1-5 System Voltage Performance
ALR1-12 Interconnection Frequency Response
ALR2-3 UFLS and UVLS Usage
ALR6-11 Automatic AC Transmission Outages Initiated by Failed Protection System Equipment
ALR6-12 Automatic AC Transmission Outages Initiated by Human Error
ALR6-13 Automatic AC Transmission Outages Initiated by Failed AC Substation Equipment
ALR6-14 Automatic AC Circuit Outages Initiated by Failed AC Circuit Equipment
ALR 6-15 Element Availability Percentage
ALR 6-16 Transmission System Unavailability due to Automatic Outages
10 RELIABILITY | ACCOUNTABILITY
Supporting Data
11 RELIABILITY | ACCOUNTABILITY
Supporting Data
12 RELIABILITY | ACCOUNTABILITY
Risk Analysis
13 RELIABILITY | ACCOUNTABILITY
Study 1 Risk Patterns
Weather excluding lightning 17
Unknown 14
Lightning 12
Human Error 11
Failed AC Substation and Circuit Equipment
20
Failed Protection System Equipment
8
Power System Condition 4
Foreign Interference 4
Other 4 Biggest contributor to transmission severity - Failed AC Substation Equip - Statistically significant and positively correlated
AC Circuit Sustained Automatic Outages by Initiating Cause Code
14 RELIABILITY | ACCOUNTABILITY
Metric - BPS Transmission Related Events Resulting in Loss of Load
Transmission Related Events Resulting in Load Loss (2011)
Date Generation Loss (MW)
Transmission Loss
Load Loss
(MW)
Equipment Failure
Protection System
Misoperation
Human Error
1132011 0 3 lines 135
3272011 260 13 lines 295
4252011 0 5 lines
1 transformer 140
5102011 300 10 lines 462
662011 106 4 lines 450
6302011 1 3 transformers 797
7132011 599
14 lines 1 back to back
converter 2 transformers
665
7222011 0 1 line 206
982011 6981 32 lines
4 transformers 7835
15 RELIABILITY | ACCOUNTABILITY
Study 2 PRC-005 Effect
Violations
Misops
T Outages
Investigations
Is PRC-005 responsive to
control reliability risks
1331 entities 95 had no violations
2230 misops in 2011
Companies with more misoperations tend to have more failed protection system equipment outages
There is no statistically significant correlation between the number of violations and the number of misoperations
4 violations
359 outages
16 RELIABILITY | ACCOUNTABILITY
Current Efforts
Expert Review
bull PCrsquos Protection System Misoperations Task Force (PSMTF) started in March 2012 to review bull Regional data prior to January 1 2011 bull NERC data from January 1 2011 through March 31 2012
bull Developed a draft report for approval at March 2013 PC meeting bull General observations and conclusions bull Preliminary recommendations
Reporting Enhancements
bull Collecting the total number of operations beginning 4Q2012 bull ALR4-1 is a performance metric or misoperations as a ratio
of total protection system operations bull Coordinating reporting enhancements with the Project 2010-
05 SDT (PRC-003 and PRC-004)
17 RELIABILITY | ACCOUNTABILITY RELIABILITY | ACCOUNTABILITY
Common Patterns and Gaps
As bull Incorrect Settings ndash Protective Function This sub-cause represents 306 (67) of the 458 misoperations
related to settings
These misoperations are engineering errors in general protection applications and are common to all relay technologies
bull More than 24 of the records Either categorized incorrectly or had insufficient information to
identify a sub-cause or root cause
bull Evaluate whether adding sub-cause codes to the reporting
18 RELIABILITY | ACCOUNTABILITY RELIABILITY | ACCOUNTABILITY
Tracking and Potential Solutions
As bull Measure ndash ALR4-1 Misoperation Rate
bull Benchmark ndash Average rate reduction over time 20 rate reduction in 2 years
bull Information Sharing ndash Highlight success stories
bull Targeted training on protective function settings bull Work with Regional Entities and subject matter experts
bull Revise PRC-005 to a results-based standard Establish a performance requirement
oUse a 90 quantile
19 RELIABILITY | ACCOUNTABILITY RELIABILITY | ACCOUNTABILITY
New Risk Issue and Effort
As bull AC Substation Equipment Failure High Priority Issue
Biggest contributor to severity risk index
Statistically significant and positively correlated
bull Measure ndash ALR6-11 bull Automatic AC Transmission Outages initiated by
Failed AC Substation Equipment
bull Add sub-cause codes to the reporting bull Identify common patterns
20 RELIABILITY | ACCOUNTABILITY
Questions and Answers
21 RELIABILITY | ACCOUNTABILITY
Standard PRC-005
bull Title ndash
Transmission and Generation Protection System Maintenance and Testing
bull Purpose ndash To ensure all transmission and generation
Protection Systems affecting the reliability of the Bulk Electric System (BES) are maintained and tested
- Slide Number 1
- Topics
- Slide Number 3
- Risk Measures
- SRI and EDI
- Yearly SRI
- Tiered Approach
- Reliability Metrics
- Reliability Metrics (contrsquod)
- Slide Number 10
- Supporting Data
- Slide Number 12
- Study 1 Risk Patterns
- Metric - BPS Transmission Related Events Resulting in Loss of Load
- Study 2 PRC-005 Effect
- Current Efforts
- Common Patterns and Gaps
- Tracking and Potential Solutions
- New Risk Issue and Effort
- Slide Number 20
- Standard PRC-005
-
4 RELIABILITY | ACCOUNTABILITY
Risk Measures
Event Driven Index (EDI)
Measures Risk from
Major System Events
Key Compliance Monitoring Index (KCMI) Measures Risks from Severe Impact Violations
Condition Driven Index (CDI)
Monitors Risk from
Key Reliability Metrics
Based on event severity risk index (SRI) values and turns into an availability index
Identify a subset of standards that have highest impact to reliability and create an index of standards compliance
Uses the roster of reliability
metrics developed by
RMWGPAS and approved by
OCPC
5 RELIABILITY | ACCOUNTABILITY
SRI and EDI
Likelihood
Impact
Avoid and
Mitigate
Learn and
Reduce
Accept
Reporting Threshold
Inverse CostBenefit
High Impact Low
Frequency (including
CIP)
Severity Risk Index (SRI) Curve
30
1060
SRI Component Weighting
Transmission Lines LostGeneration LostLoss of Load
6 RELIABILITY | ACCOUNTABILITY
Yearly SRI
NERC Annual Daily Severity Risk Index (SRI) Sorted Descending with Historic Benchmark Days
1029
22
827 427
98 828
630 44 711
428
7 RELIABILITY | ACCOUNTABILITY
Tiered Approach
View trends at httpwwwnerccompagephpcid=4|331
8 RELIABILITY | ACCOUNTABILITY
Reliability Metrics
ALR 1-3 Reserve Margin
ALR 1-4 BPS Transmission Related Events Resulting in Loss of Load
ALR 2-4 Disturbance Control Standard Failures (DCS Failures)
ALR 2-5 Disturbance Control Events Greater than Most Severe Single Contingency (MSSC)
ALR 3-5 IROLSOL Exceedance
ALR 4-1 Protection System Misoperations
ALR 6-1 Transmission Constraint Mitigation
ALR 6-2 Energy Emergency Alert 3 (EEA 3)
ALR 6-3 Energy Emergency Alert 2 (EEA 2)
9 RELIABILITY | ACCOUNTABILITY
Reliability Metrics (contrsquod)
ALR1-5 System Voltage Performance
ALR1-12 Interconnection Frequency Response
ALR2-3 UFLS and UVLS Usage
ALR6-11 Automatic AC Transmission Outages Initiated by Failed Protection System Equipment
ALR6-12 Automatic AC Transmission Outages Initiated by Human Error
ALR6-13 Automatic AC Transmission Outages Initiated by Failed AC Substation Equipment
ALR6-14 Automatic AC Circuit Outages Initiated by Failed AC Circuit Equipment
ALR 6-15 Element Availability Percentage
ALR 6-16 Transmission System Unavailability due to Automatic Outages
10 RELIABILITY | ACCOUNTABILITY
Supporting Data
11 RELIABILITY | ACCOUNTABILITY
Supporting Data
12 RELIABILITY | ACCOUNTABILITY
Risk Analysis
13 RELIABILITY | ACCOUNTABILITY
Study 1 Risk Patterns
Weather excluding lightning 17
Unknown 14
Lightning 12
Human Error 11
Failed AC Substation and Circuit Equipment
20
Failed Protection System Equipment
8
Power System Condition 4
Foreign Interference 4
Other 4 Biggest contributor to transmission severity - Failed AC Substation Equip - Statistically significant and positively correlated
AC Circuit Sustained Automatic Outages by Initiating Cause Code
14 RELIABILITY | ACCOUNTABILITY
Metric - BPS Transmission Related Events Resulting in Loss of Load
Transmission Related Events Resulting in Load Loss (2011)
Date Generation Loss (MW)
Transmission Loss
Load Loss
(MW)
Equipment Failure
Protection System
Misoperation
Human Error
1132011 0 3 lines 135
3272011 260 13 lines 295
4252011 0 5 lines
1 transformer 140
5102011 300 10 lines 462
662011 106 4 lines 450
6302011 1 3 transformers 797
7132011 599
14 lines 1 back to back
converter 2 transformers
665
7222011 0 1 line 206
982011 6981 32 lines
4 transformers 7835
15 RELIABILITY | ACCOUNTABILITY
Study 2 PRC-005 Effect
Violations
Misops
T Outages
Investigations
Is PRC-005 responsive to
control reliability risks
1331 entities 95 had no violations
2230 misops in 2011
Companies with more misoperations tend to have more failed protection system equipment outages
There is no statistically significant correlation between the number of violations and the number of misoperations
4 violations
359 outages
16 RELIABILITY | ACCOUNTABILITY
Current Efforts
Expert Review
bull PCrsquos Protection System Misoperations Task Force (PSMTF) started in March 2012 to review bull Regional data prior to January 1 2011 bull NERC data from January 1 2011 through March 31 2012
bull Developed a draft report for approval at March 2013 PC meeting bull General observations and conclusions bull Preliminary recommendations
Reporting Enhancements
bull Collecting the total number of operations beginning 4Q2012 bull ALR4-1 is a performance metric or misoperations as a ratio
of total protection system operations bull Coordinating reporting enhancements with the Project 2010-
05 SDT (PRC-003 and PRC-004)
17 RELIABILITY | ACCOUNTABILITY RELIABILITY | ACCOUNTABILITY
Common Patterns and Gaps
As bull Incorrect Settings ndash Protective Function This sub-cause represents 306 (67) of the 458 misoperations
related to settings
These misoperations are engineering errors in general protection applications and are common to all relay technologies
bull More than 24 of the records Either categorized incorrectly or had insufficient information to
identify a sub-cause or root cause
bull Evaluate whether adding sub-cause codes to the reporting
18 RELIABILITY | ACCOUNTABILITY RELIABILITY | ACCOUNTABILITY
Tracking and Potential Solutions
As bull Measure ndash ALR4-1 Misoperation Rate
bull Benchmark ndash Average rate reduction over time 20 rate reduction in 2 years
bull Information Sharing ndash Highlight success stories
bull Targeted training on protective function settings bull Work with Regional Entities and subject matter experts
bull Revise PRC-005 to a results-based standard Establish a performance requirement
oUse a 90 quantile
19 RELIABILITY | ACCOUNTABILITY RELIABILITY | ACCOUNTABILITY
New Risk Issue and Effort
As bull AC Substation Equipment Failure High Priority Issue
Biggest contributor to severity risk index
Statistically significant and positively correlated
bull Measure ndash ALR6-11 bull Automatic AC Transmission Outages initiated by
Failed AC Substation Equipment
bull Add sub-cause codes to the reporting bull Identify common patterns
20 RELIABILITY | ACCOUNTABILITY
Questions and Answers
21 RELIABILITY | ACCOUNTABILITY
Standard PRC-005
bull Title ndash
Transmission and Generation Protection System Maintenance and Testing
bull Purpose ndash To ensure all transmission and generation
Protection Systems affecting the reliability of the Bulk Electric System (BES) are maintained and tested
- Slide Number 1
- Topics
- Slide Number 3
- Risk Measures
- SRI and EDI
- Yearly SRI
- Tiered Approach
- Reliability Metrics
- Reliability Metrics (contrsquod)
- Slide Number 10
- Supporting Data
- Slide Number 12
- Study 1 Risk Patterns
- Metric - BPS Transmission Related Events Resulting in Loss of Load
- Study 2 PRC-005 Effect
- Current Efforts
- Common Patterns and Gaps
- Tracking and Potential Solutions
- New Risk Issue and Effort
- Slide Number 20
- Standard PRC-005
-
5 RELIABILITY | ACCOUNTABILITY
SRI and EDI
Likelihood
Impact
Avoid and
Mitigate
Learn and
Reduce
Accept
Reporting Threshold
Inverse CostBenefit
High Impact Low
Frequency (including
CIP)
Severity Risk Index (SRI) Curve
30
1060
SRI Component Weighting
Transmission Lines LostGeneration LostLoss of Load
6 RELIABILITY | ACCOUNTABILITY
Yearly SRI
NERC Annual Daily Severity Risk Index (SRI) Sorted Descending with Historic Benchmark Days
1029
22
827 427
98 828
630 44 711
428
7 RELIABILITY | ACCOUNTABILITY
Tiered Approach
View trends at httpwwwnerccompagephpcid=4|331
8 RELIABILITY | ACCOUNTABILITY
Reliability Metrics
ALR 1-3 Reserve Margin
ALR 1-4 BPS Transmission Related Events Resulting in Loss of Load
ALR 2-4 Disturbance Control Standard Failures (DCS Failures)
ALR 2-5 Disturbance Control Events Greater than Most Severe Single Contingency (MSSC)
ALR 3-5 IROLSOL Exceedance
ALR 4-1 Protection System Misoperations
ALR 6-1 Transmission Constraint Mitigation
ALR 6-2 Energy Emergency Alert 3 (EEA 3)
ALR 6-3 Energy Emergency Alert 2 (EEA 2)
9 RELIABILITY | ACCOUNTABILITY
Reliability Metrics (contrsquod)
ALR1-5 System Voltage Performance
ALR1-12 Interconnection Frequency Response
ALR2-3 UFLS and UVLS Usage
ALR6-11 Automatic AC Transmission Outages Initiated by Failed Protection System Equipment
ALR6-12 Automatic AC Transmission Outages Initiated by Human Error
ALR6-13 Automatic AC Transmission Outages Initiated by Failed AC Substation Equipment
ALR6-14 Automatic AC Circuit Outages Initiated by Failed AC Circuit Equipment
ALR 6-15 Element Availability Percentage
ALR 6-16 Transmission System Unavailability due to Automatic Outages
10 RELIABILITY | ACCOUNTABILITY
Supporting Data
11 RELIABILITY | ACCOUNTABILITY
Supporting Data
12 RELIABILITY | ACCOUNTABILITY
Risk Analysis
13 RELIABILITY | ACCOUNTABILITY
Study 1 Risk Patterns
Weather excluding lightning 17
Unknown 14
Lightning 12
Human Error 11
Failed AC Substation and Circuit Equipment
20
Failed Protection System Equipment
8
Power System Condition 4
Foreign Interference 4
Other 4 Biggest contributor to transmission severity - Failed AC Substation Equip - Statistically significant and positively correlated
AC Circuit Sustained Automatic Outages by Initiating Cause Code
14 RELIABILITY | ACCOUNTABILITY
Metric - BPS Transmission Related Events Resulting in Loss of Load
Transmission Related Events Resulting in Load Loss (2011)
Date Generation Loss (MW)
Transmission Loss
Load Loss
(MW)
Equipment Failure
Protection System
Misoperation
Human Error
1132011 0 3 lines 135
3272011 260 13 lines 295
4252011 0 5 lines
1 transformer 140
5102011 300 10 lines 462
662011 106 4 lines 450
6302011 1 3 transformers 797
7132011 599
14 lines 1 back to back
converter 2 transformers
665
7222011 0 1 line 206
982011 6981 32 lines
4 transformers 7835
15 RELIABILITY | ACCOUNTABILITY
Study 2 PRC-005 Effect
Violations
Misops
T Outages
Investigations
Is PRC-005 responsive to
control reliability risks
1331 entities 95 had no violations
2230 misops in 2011
Companies with more misoperations tend to have more failed protection system equipment outages
There is no statistically significant correlation between the number of violations and the number of misoperations
4 violations
359 outages
16 RELIABILITY | ACCOUNTABILITY
Current Efforts
Expert Review
bull PCrsquos Protection System Misoperations Task Force (PSMTF) started in March 2012 to review bull Regional data prior to January 1 2011 bull NERC data from January 1 2011 through March 31 2012
bull Developed a draft report for approval at March 2013 PC meeting bull General observations and conclusions bull Preliminary recommendations
Reporting Enhancements
bull Collecting the total number of operations beginning 4Q2012 bull ALR4-1 is a performance metric or misoperations as a ratio
of total protection system operations bull Coordinating reporting enhancements with the Project 2010-
05 SDT (PRC-003 and PRC-004)
17 RELIABILITY | ACCOUNTABILITY RELIABILITY | ACCOUNTABILITY
Common Patterns and Gaps
As bull Incorrect Settings ndash Protective Function This sub-cause represents 306 (67) of the 458 misoperations
related to settings
These misoperations are engineering errors in general protection applications and are common to all relay technologies
bull More than 24 of the records Either categorized incorrectly or had insufficient information to
identify a sub-cause or root cause
bull Evaluate whether adding sub-cause codes to the reporting
18 RELIABILITY | ACCOUNTABILITY RELIABILITY | ACCOUNTABILITY
Tracking and Potential Solutions
As bull Measure ndash ALR4-1 Misoperation Rate
bull Benchmark ndash Average rate reduction over time 20 rate reduction in 2 years
bull Information Sharing ndash Highlight success stories
bull Targeted training on protective function settings bull Work with Regional Entities and subject matter experts
bull Revise PRC-005 to a results-based standard Establish a performance requirement
oUse a 90 quantile
19 RELIABILITY | ACCOUNTABILITY RELIABILITY | ACCOUNTABILITY
New Risk Issue and Effort
As bull AC Substation Equipment Failure High Priority Issue
Biggest contributor to severity risk index
Statistically significant and positively correlated
bull Measure ndash ALR6-11 bull Automatic AC Transmission Outages initiated by
Failed AC Substation Equipment
bull Add sub-cause codes to the reporting bull Identify common patterns
20 RELIABILITY | ACCOUNTABILITY
Questions and Answers
21 RELIABILITY | ACCOUNTABILITY
Standard PRC-005
bull Title ndash
Transmission and Generation Protection System Maintenance and Testing
bull Purpose ndash To ensure all transmission and generation
Protection Systems affecting the reliability of the Bulk Electric System (BES) are maintained and tested
- Slide Number 1
- Topics
- Slide Number 3
- Risk Measures
- SRI and EDI
- Yearly SRI
- Tiered Approach
- Reliability Metrics
- Reliability Metrics (contrsquod)
- Slide Number 10
- Supporting Data
- Slide Number 12
- Study 1 Risk Patterns
- Metric - BPS Transmission Related Events Resulting in Loss of Load
- Study 2 PRC-005 Effect
- Current Efforts
- Common Patterns and Gaps
- Tracking and Potential Solutions
- New Risk Issue and Effort
- Slide Number 20
- Standard PRC-005
-
6 RELIABILITY | ACCOUNTABILITY
Yearly SRI
NERC Annual Daily Severity Risk Index (SRI) Sorted Descending with Historic Benchmark Days
1029
22
827 427
98 828
630 44 711
428
7 RELIABILITY | ACCOUNTABILITY
Tiered Approach
View trends at httpwwwnerccompagephpcid=4|331
8 RELIABILITY | ACCOUNTABILITY
Reliability Metrics
ALR 1-3 Reserve Margin
ALR 1-4 BPS Transmission Related Events Resulting in Loss of Load
ALR 2-4 Disturbance Control Standard Failures (DCS Failures)
ALR 2-5 Disturbance Control Events Greater than Most Severe Single Contingency (MSSC)
ALR 3-5 IROLSOL Exceedance
ALR 4-1 Protection System Misoperations
ALR 6-1 Transmission Constraint Mitigation
ALR 6-2 Energy Emergency Alert 3 (EEA 3)
ALR 6-3 Energy Emergency Alert 2 (EEA 2)
9 RELIABILITY | ACCOUNTABILITY
Reliability Metrics (contrsquod)
ALR1-5 System Voltage Performance
ALR1-12 Interconnection Frequency Response
ALR2-3 UFLS and UVLS Usage
ALR6-11 Automatic AC Transmission Outages Initiated by Failed Protection System Equipment
ALR6-12 Automatic AC Transmission Outages Initiated by Human Error
ALR6-13 Automatic AC Transmission Outages Initiated by Failed AC Substation Equipment
ALR6-14 Automatic AC Circuit Outages Initiated by Failed AC Circuit Equipment
ALR 6-15 Element Availability Percentage
ALR 6-16 Transmission System Unavailability due to Automatic Outages
10 RELIABILITY | ACCOUNTABILITY
Supporting Data
11 RELIABILITY | ACCOUNTABILITY
Supporting Data
12 RELIABILITY | ACCOUNTABILITY
Risk Analysis
13 RELIABILITY | ACCOUNTABILITY
Study 1 Risk Patterns
Weather excluding lightning 17
Unknown 14
Lightning 12
Human Error 11
Failed AC Substation and Circuit Equipment
20
Failed Protection System Equipment
8
Power System Condition 4
Foreign Interference 4
Other 4 Biggest contributor to transmission severity - Failed AC Substation Equip - Statistically significant and positively correlated
AC Circuit Sustained Automatic Outages by Initiating Cause Code
14 RELIABILITY | ACCOUNTABILITY
Metric - BPS Transmission Related Events Resulting in Loss of Load
Transmission Related Events Resulting in Load Loss (2011)
Date Generation Loss (MW)
Transmission Loss
Load Loss
(MW)
Equipment Failure
Protection System
Misoperation
Human Error
1132011 0 3 lines 135
3272011 260 13 lines 295
4252011 0 5 lines
1 transformer 140
5102011 300 10 lines 462
662011 106 4 lines 450
6302011 1 3 transformers 797
7132011 599
14 lines 1 back to back
converter 2 transformers
665
7222011 0 1 line 206
982011 6981 32 lines
4 transformers 7835
15 RELIABILITY | ACCOUNTABILITY
Study 2 PRC-005 Effect
Violations
Misops
T Outages
Investigations
Is PRC-005 responsive to
control reliability risks
1331 entities 95 had no violations
2230 misops in 2011
Companies with more misoperations tend to have more failed protection system equipment outages
There is no statistically significant correlation between the number of violations and the number of misoperations
4 violations
359 outages
16 RELIABILITY | ACCOUNTABILITY
Current Efforts
Expert Review
bull PCrsquos Protection System Misoperations Task Force (PSMTF) started in March 2012 to review bull Regional data prior to January 1 2011 bull NERC data from January 1 2011 through March 31 2012
bull Developed a draft report for approval at March 2013 PC meeting bull General observations and conclusions bull Preliminary recommendations
Reporting Enhancements
bull Collecting the total number of operations beginning 4Q2012 bull ALR4-1 is a performance metric or misoperations as a ratio
of total protection system operations bull Coordinating reporting enhancements with the Project 2010-
05 SDT (PRC-003 and PRC-004)
17 RELIABILITY | ACCOUNTABILITY RELIABILITY | ACCOUNTABILITY
Common Patterns and Gaps
As bull Incorrect Settings ndash Protective Function This sub-cause represents 306 (67) of the 458 misoperations
related to settings
These misoperations are engineering errors in general protection applications and are common to all relay technologies
bull More than 24 of the records Either categorized incorrectly or had insufficient information to
identify a sub-cause or root cause
bull Evaluate whether adding sub-cause codes to the reporting
18 RELIABILITY | ACCOUNTABILITY RELIABILITY | ACCOUNTABILITY
Tracking and Potential Solutions
As bull Measure ndash ALR4-1 Misoperation Rate
bull Benchmark ndash Average rate reduction over time 20 rate reduction in 2 years
bull Information Sharing ndash Highlight success stories
bull Targeted training on protective function settings bull Work with Regional Entities and subject matter experts
bull Revise PRC-005 to a results-based standard Establish a performance requirement
oUse a 90 quantile
19 RELIABILITY | ACCOUNTABILITY RELIABILITY | ACCOUNTABILITY
New Risk Issue and Effort
As bull AC Substation Equipment Failure High Priority Issue
Biggest contributor to severity risk index
Statistically significant and positively correlated
bull Measure ndash ALR6-11 bull Automatic AC Transmission Outages initiated by
Failed AC Substation Equipment
bull Add sub-cause codes to the reporting bull Identify common patterns
20 RELIABILITY | ACCOUNTABILITY
Questions and Answers
21 RELIABILITY | ACCOUNTABILITY
Standard PRC-005
bull Title ndash
Transmission and Generation Protection System Maintenance and Testing
bull Purpose ndash To ensure all transmission and generation
Protection Systems affecting the reliability of the Bulk Electric System (BES) are maintained and tested
- Slide Number 1
- Topics
- Slide Number 3
- Risk Measures
- SRI and EDI
- Yearly SRI
- Tiered Approach
- Reliability Metrics
- Reliability Metrics (contrsquod)
- Slide Number 10
- Supporting Data
- Slide Number 12
- Study 1 Risk Patterns
- Metric - BPS Transmission Related Events Resulting in Loss of Load
- Study 2 PRC-005 Effect
- Current Efforts
- Common Patterns and Gaps
- Tracking and Potential Solutions
- New Risk Issue and Effort
- Slide Number 20
- Standard PRC-005
-
7 RELIABILITY | ACCOUNTABILITY
Tiered Approach
View trends at httpwwwnerccompagephpcid=4|331
8 RELIABILITY | ACCOUNTABILITY
Reliability Metrics
ALR 1-3 Reserve Margin
ALR 1-4 BPS Transmission Related Events Resulting in Loss of Load
ALR 2-4 Disturbance Control Standard Failures (DCS Failures)
ALR 2-5 Disturbance Control Events Greater than Most Severe Single Contingency (MSSC)
ALR 3-5 IROLSOL Exceedance
ALR 4-1 Protection System Misoperations
ALR 6-1 Transmission Constraint Mitigation
ALR 6-2 Energy Emergency Alert 3 (EEA 3)
ALR 6-3 Energy Emergency Alert 2 (EEA 2)
9 RELIABILITY | ACCOUNTABILITY
Reliability Metrics (contrsquod)
ALR1-5 System Voltage Performance
ALR1-12 Interconnection Frequency Response
ALR2-3 UFLS and UVLS Usage
ALR6-11 Automatic AC Transmission Outages Initiated by Failed Protection System Equipment
ALR6-12 Automatic AC Transmission Outages Initiated by Human Error
ALR6-13 Automatic AC Transmission Outages Initiated by Failed AC Substation Equipment
ALR6-14 Automatic AC Circuit Outages Initiated by Failed AC Circuit Equipment
ALR 6-15 Element Availability Percentage
ALR 6-16 Transmission System Unavailability due to Automatic Outages
10 RELIABILITY | ACCOUNTABILITY
Supporting Data
11 RELIABILITY | ACCOUNTABILITY
Supporting Data
12 RELIABILITY | ACCOUNTABILITY
Risk Analysis
13 RELIABILITY | ACCOUNTABILITY
Study 1 Risk Patterns
Weather excluding lightning 17
Unknown 14
Lightning 12
Human Error 11
Failed AC Substation and Circuit Equipment
20
Failed Protection System Equipment
8
Power System Condition 4
Foreign Interference 4
Other 4 Biggest contributor to transmission severity - Failed AC Substation Equip - Statistically significant and positively correlated
AC Circuit Sustained Automatic Outages by Initiating Cause Code
14 RELIABILITY | ACCOUNTABILITY
Metric - BPS Transmission Related Events Resulting in Loss of Load
Transmission Related Events Resulting in Load Loss (2011)
Date Generation Loss (MW)
Transmission Loss
Load Loss
(MW)
Equipment Failure
Protection System
Misoperation
Human Error
1132011 0 3 lines 135
3272011 260 13 lines 295
4252011 0 5 lines
1 transformer 140
5102011 300 10 lines 462
662011 106 4 lines 450
6302011 1 3 transformers 797
7132011 599
14 lines 1 back to back
converter 2 transformers
665
7222011 0 1 line 206
982011 6981 32 lines
4 transformers 7835
15 RELIABILITY | ACCOUNTABILITY
Study 2 PRC-005 Effect
Violations
Misops
T Outages
Investigations
Is PRC-005 responsive to
control reliability risks
1331 entities 95 had no violations
2230 misops in 2011
Companies with more misoperations tend to have more failed protection system equipment outages
There is no statistically significant correlation between the number of violations and the number of misoperations
4 violations
359 outages
16 RELIABILITY | ACCOUNTABILITY
Current Efforts
Expert Review
bull PCrsquos Protection System Misoperations Task Force (PSMTF) started in March 2012 to review bull Regional data prior to January 1 2011 bull NERC data from January 1 2011 through March 31 2012
bull Developed a draft report for approval at March 2013 PC meeting bull General observations and conclusions bull Preliminary recommendations
Reporting Enhancements
bull Collecting the total number of operations beginning 4Q2012 bull ALR4-1 is a performance metric or misoperations as a ratio
of total protection system operations bull Coordinating reporting enhancements with the Project 2010-
05 SDT (PRC-003 and PRC-004)
17 RELIABILITY | ACCOUNTABILITY RELIABILITY | ACCOUNTABILITY
Common Patterns and Gaps
As bull Incorrect Settings ndash Protective Function This sub-cause represents 306 (67) of the 458 misoperations
related to settings
These misoperations are engineering errors in general protection applications and are common to all relay technologies
bull More than 24 of the records Either categorized incorrectly or had insufficient information to
identify a sub-cause or root cause
bull Evaluate whether adding sub-cause codes to the reporting
18 RELIABILITY | ACCOUNTABILITY RELIABILITY | ACCOUNTABILITY
Tracking and Potential Solutions
As bull Measure ndash ALR4-1 Misoperation Rate
bull Benchmark ndash Average rate reduction over time 20 rate reduction in 2 years
bull Information Sharing ndash Highlight success stories
bull Targeted training on protective function settings bull Work with Regional Entities and subject matter experts
bull Revise PRC-005 to a results-based standard Establish a performance requirement
oUse a 90 quantile
19 RELIABILITY | ACCOUNTABILITY RELIABILITY | ACCOUNTABILITY
New Risk Issue and Effort
As bull AC Substation Equipment Failure High Priority Issue
Biggest contributor to severity risk index
Statistically significant and positively correlated
bull Measure ndash ALR6-11 bull Automatic AC Transmission Outages initiated by
Failed AC Substation Equipment
bull Add sub-cause codes to the reporting bull Identify common patterns
20 RELIABILITY | ACCOUNTABILITY
Questions and Answers
21 RELIABILITY | ACCOUNTABILITY
Standard PRC-005
bull Title ndash
Transmission and Generation Protection System Maintenance and Testing
bull Purpose ndash To ensure all transmission and generation
Protection Systems affecting the reliability of the Bulk Electric System (BES) are maintained and tested
- Slide Number 1
- Topics
- Slide Number 3
- Risk Measures
- SRI and EDI
- Yearly SRI
- Tiered Approach
- Reliability Metrics
- Reliability Metrics (contrsquod)
- Slide Number 10
- Supporting Data
- Slide Number 12
- Study 1 Risk Patterns
- Metric - BPS Transmission Related Events Resulting in Loss of Load
- Study 2 PRC-005 Effect
- Current Efforts
- Common Patterns and Gaps
- Tracking and Potential Solutions
- New Risk Issue and Effort
- Slide Number 20
- Standard PRC-005
-
8 RELIABILITY | ACCOUNTABILITY
Reliability Metrics
ALR 1-3 Reserve Margin
ALR 1-4 BPS Transmission Related Events Resulting in Loss of Load
ALR 2-4 Disturbance Control Standard Failures (DCS Failures)
ALR 2-5 Disturbance Control Events Greater than Most Severe Single Contingency (MSSC)
ALR 3-5 IROLSOL Exceedance
ALR 4-1 Protection System Misoperations
ALR 6-1 Transmission Constraint Mitigation
ALR 6-2 Energy Emergency Alert 3 (EEA 3)
ALR 6-3 Energy Emergency Alert 2 (EEA 2)
9 RELIABILITY | ACCOUNTABILITY
Reliability Metrics (contrsquod)
ALR1-5 System Voltage Performance
ALR1-12 Interconnection Frequency Response
ALR2-3 UFLS and UVLS Usage
ALR6-11 Automatic AC Transmission Outages Initiated by Failed Protection System Equipment
ALR6-12 Automatic AC Transmission Outages Initiated by Human Error
ALR6-13 Automatic AC Transmission Outages Initiated by Failed AC Substation Equipment
ALR6-14 Automatic AC Circuit Outages Initiated by Failed AC Circuit Equipment
ALR 6-15 Element Availability Percentage
ALR 6-16 Transmission System Unavailability due to Automatic Outages
10 RELIABILITY | ACCOUNTABILITY
Supporting Data
11 RELIABILITY | ACCOUNTABILITY
Supporting Data
12 RELIABILITY | ACCOUNTABILITY
Risk Analysis
13 RELIABILITY | ACCOUNTABILITY
Study 1 Risk Patterns
Weather excluding lightning 17
Unknown 14
Lightning 12
Human Error 11
Failed AC Substation and Circuit Equipment
20
Failed Protection System Equipment
8
Power System Condition 4
Foreign Interference 4
Other 4 Biggest contributor to transmission severity - Failed AC Substation Equip - Statistically significant and positively correlated
AC Circuit Sustained Automatic Outages by Initiating Cause Code
14 RELIABILITY | ACCOUNTABILITY
Metric - BPS Transmission Related Events Resulting in Loss of Load
Transmission Related Events Resulting in Load Loss (2011)
Date Generation Loss (MW)
Transmission Loss
Load Loss
(MW)
Equipment Failure
Protection System
Misoperation
Human Error
1132011 0 3 lines 135
3272011 260 13 lines 295
4252011 0 5 lines
1 transformer 140
5102011 300 10 lines 462
662011 106 4 lines 450
6302011 1 3 transformers 797
7132011 599
14 lines 1 back to back
converter 2 transformers
665
7222011 0 1 line 206
982011 6981 32 lines
4 transformers 7835
15 RELIABILITY | ACCOUNTABILITY
Study 2 PRC-005 Effect
Violations
Misops
T Outages
Investigations
Is PRC-005 responsive to
control reliability risks
1331 entities 95 had no violations
2230 misops in 2011
Companies with more misoperations tend to have more failed protection system equipment outages
There is no statistically significant correlation between the number of violations and the number of misoperations
4 violations
359 outages
16 RELIABILITY | ACCOUNTABILITY
Current Efforts
Expert Review
bull PCrsquos Protection System Misoperations Task Force (PSMTF) started in March 2012 to review bull Regional data prior to January 1 2011 bull NERC data from January 1 2011 through March 31 2012
bull Developed a draft report for approval at March 2013 PC meeting bull General observations and conclusions bull Preliminary recommendations
Reporting Enhancements
bull Collecting the total number of operations beginning 4Q2012 bull ALR4-1 is a performance metric or misoperations as a ratio
of total protection system operations bull Coordinating reporting enhancements with the Project 2010-
05 SDT (PRC-003 and PRC-004)
17 RELIABILITY | ACCOUNTABILITY RELIABILITY | ACCOUNTABILITY
Common Patterns and Gaps
As bull Incorrect Settings ndash Protective Function This sub-cause represents 306 (67) of the 458 misoperations
related to settings
These misoperations are engineering errors in general protection applications and are common to all relay technologies
bull More than 24 of the records Either categorized incorrectly or had insufficient information to
identify a sub-cause or root cause
bull Evaluate whether adding sub-cause codes to the reporting
18 RELIABILITY | ACCOUNTABILITY RELIABILITY | ACCOUNTABILITY
Tracking and Potential Solutions
As bull Measure ndash ALR4-1 Misoperation Rate
bull Benchmark ndash Average rate reduction over time 20 rate reduction in 2 years
bull Information Sharing ndash Highlight success stories
bull Targeted training on protective function settings bull Work with Regional Entities and subject matter experts
bull Revise PRC-005 to a results-based standard Establish a performance requirement
oUse a 90 quantile
19 RELIABILITY | ACCOUNTABILITY RELIABILITY | ACCOUNTABILITY
New Risk Issue and Effort
As bull AC Substation Equipment Failure High Priority Issue
Biggest contributor to severity risk index
Statistically significant and positively correlated
bull Measure ndash ALR6-11 bull Automatic AC Transmission Outages initiated by
Failed AC Substation Equipment
bull Add sub-cause codes to the reporting bull Identify common patterns
20 RELIABILITY | ACCOUNTABILITY
Questions and Answers
21 RELIABILITY | ACCOUNTABILITY
Standard PRC-005
bull Title ndash
Transmission and Generation Protection System Maintenance and Testing
bull Purpose ndash To ensure all transmission and generation
Protection Systems affecting the reliability of the Bulk Electric System (BES) are maintained and tested
- Slide Number 1
- Topics
- Slide Number 3
- Risk Measures
- SRI and EDI
- Yearly SRI
- Tiered Approach
- Reliability Metrics
- Reliability Metrics (contrsquod)
- Slide Number 10
- Supporting Data
- Slide Number 12
- Study 1 Risk Patterns
- Metric - BPS Transmission Related Events Resulting in Loss of Load
- Study 2 PRC-005 Effect
- Current Efforts
- Common Patterns and Gaps
- Tracking and Potential Solutions
- New Risk Issue and Effort
- Slide Number 20
- Standard PRC-005
-
9 RELIABILITY | ACCOUNTABILITY
Reliability Metrics (contrsquod)
ALR1-5 System Voltage Performance
ALR1-12 Interconnection Frequency Response
ALR2-3 UFLS and UVLS Usage
ALR6-11 Automatic AC Transmission Outages Initiated by Failed Protection System Equipment
ALR6-12 Automatic AC Transmission Outages Initiated by Human Error
ALR6-13 Automatic AC Transmission Outages Initiated by Failed AC Substation Equipment
ALR6-14 Automatic AC Circuit Outages Initiated by Failed AC Circuit Equipment
ALR 6-15 Element Availability Percentage
ALR 6-16 Transmission System Unavailability due to Automatic Outages
10 RELIABILITY | ACCOUNTABILITY
Supporting Data
11 RELIABILITY | ACCOUNTABILITY
Supporting Data
12 RELIABILITY | ACCOUNTABILITY
Risk Analysis
13 RELIABILITY | ACCOUNTABILITY
Study 1 Risk Patterns
Weather excluding lightning 17
Unknown 14
Lightning 12
Human Error 11
Failed AC Substation and Circuit Equipment
20
Failed Protection System Equipment
8
Power System Condition 4
Foreign Interference 4
Other 4 Biggest contributor to transmission severity - Failed AC Substation Equip - Statistically significant and positively correlated
AC Circuit Sustained Automatic Outages by Initiating Cause Code
14 RELIABILITY | ACCOUNTABILITY
Metric - BPS Transmission Related Events Resulting in Loss of Load
Transmission Related Events Resulting in Load Loss (2011)
Date Generation Loss (MW)
Transmission Loss
Load Loss
(MW)
Equipment Failure
Protection System
Misoperation
Human Error
1132011 0 3 lines 135
3272011 260 13 lines 295
4252011 0 5 lines
1 transformer 140
5102011 300 10 lines 462
662011 106 4 lines 450
6302011 1 3 transformers 797
7132011 599
14 lines 1 back to back
converter 2 transformers
665
7222011 0 1 line 206
982011 6981 32 lines
4 transformers 7835
15 RELIABILITY | ACCOUNTABILITY
Study 2 PRC-005 Effect
Violations
Misops
T Outages
Investigations
Is PRC-005 responsive to
control reliability risks
1331 entities 95 had no violations
2230 misops in 2011
Companies with more misoperations tend to have more failed protection system equipment outages
There is no statistically significant correlation between the number of violations and the number of misoperations
4 violations
359 outages
16 RELIABILITY | ACCOUNTABILITY
Current Efforts
Expert Review
bull PCrsquos Protection System Misoperations Task Force (PSMTF) started in March 2012 to review bull Regional data prior to January 1 2011 bull NERC data from January 1 2011 through March 31 2012
bull Developed a draft report for approval at March 2013 PC meeting bull General observations and conclusions bull Preliminary recommendations
Reporting Enhancements
bull Collecting the total number of operations beginning 4Q2012 bull ALR4-1 is a performance metric or misoperations as a ratio
of total protection system operations bull Coordinating reporting enhancements with the Project 2010-
05 SDT (PRC-003 and PRC-004)
17 RELIABILITY | ACCOUNTABILITY RELIABILITY | ACCOUNTABILITY
Common Patterns and Gaps
As bull Incorrect Settings ndash Protective Function This sub-cause represents 306 (67) of the 458 misoperations
related to settings
These misoperations are engineering errors in general protection applications and are common to all relay technologies
bull More than 24 of the records Either categorized incorrectly or had insufficient information to
identify a sub-cause or root cause
bull Evaluate whether adding sub-cause codes to the reporting
18 RELIABILITY | ACCOUNTABILITY RELIABILITY | ACCOUNTABILITY
Tracking and Potential Solutions
As bull Measure ndash ALR4-1 Misoperation Rate
bull Benchmark ndash Average rate reduction over time 20 rate reduction in 2 years
bull Information Sharing ndash Highlight success stories
bull Targeted training on protective function settings bull Work with Regional Entities and subject matter experts
bull Revise PRC-005 to a results-based standard Establish a performance requirement
oUse a 90 quantile
19 RELIABILITY | ACCOUNTABILITY RELIABILITY | ACCOUNTABILITY
New Risk Issue and Effort
As bull AC Substation Equipment Failure High Priority Issue
Biggest contributor to severity risk index
Statistically significant and positively correlated
bull Measure ndash ALR6-11 bull Automatic AC Transmission Outages initiated by
Failed AC Substation Equipment
bull Add sub-cause codes to the reporting bull Identify common patterns
20 RELIABILITY | ACCOUNTABILITY
Questions and Answers
21 RELIABILITY | ACCOUNTABILITY
Standard PRC-005
bull Title ndash
Transmission and Generation Protection System Maintenance and Testing
bull Purpose ndash To ensure all transmission and generation
Protection Systems affecting the reliability of the Bulk Electric System (BES) are maintained and tested
- Slide Number 1
- Topics
- Slide Number 3
- Risk Measures
- SRI and EDI
- Yearly SRI
- Tiered Approach
- Reliability Metrics
- Reliability Metrics (contrsquod)
- Slide Number 10
- Supporting Data
- Slide Number 12
- Study 1 Risk Patterns
- Metric - BPS Transmission Related Events Resulting in Loss of Load
- Study 2 PRC-005 Effect
- Current Efforts
- Common Patterns and Gaps
- Tracking and Potential Solutions
- New Risk Issue and Effort
- Slide Number 20
- Standard PRC-005
-
10 RELIABILITY | ACCOUNTABILITY
Supporting Data
11 RELIABILITY | ACCOUNTABILITY
Supporting Data
12 RELIABILITY | ACCOUNTABILITY
Risk Analysis
13 RELIABILITY | ACCOUNTABILITY
Study 1 Risk Patterns
Weather excluding lightning 17
Unknown 14
Lightning 12
Human Error 11
Failed AC Substation and Circuit Equipment
20
Failed Protection System Equipment
8
Power System Condition 4
Foreign Interference 4
Other 4 Biggest contributor to transmission severity - Failed AC Substation Equip - Statistically significant and positively correlated
AC Circuit Sustained Automatic Outages by Initiating Cause Code
14 RELIABILITY | ACCOUNTABILITY
Metric - BPS Transmission Related Events Resulting in Loss of Load
Transmission Related Events Resulting in Load Loss (2011)
Date Generation Loss (MW)
Transmission Loss
Load Loss
(MW)
Equipment Failure
Protection System
Misoperation
Human Error
1132011 0 3 lines 135
3272011 260 13 lines 295
4252011 0 5 lines
1 transformer 140
5102011 300 10 lines 462
662011 106 4 lines 450
6302011 1 3 transformers 797
7132011 599
14 lines 1 back to back
converter 2 transformers
665
7222011 0 1 line 206
982011 6981 32 lines
4 transformers 7835
15 RELIABILITY | ACCOUNTABILITY
Study 2 PRC-005 Effect
Violations
Misops
T Outages
Investigations
Is PRC-005 responsive to
control reliability risks
1331 entities 95 had no violations
2230 misops in 2011
Companies with more misoperations tend to have more failed protection system equipment outages
There is no statistically significant correlation between the number of violations and the number of misoperations
4 violations
359 outages
16 RELIABILITY | ACCOUNTABILITY
Current Efforts
Expert Review
bull PCrsquos Protection System Misoperations Task Force (PSMTF) started in March 2012 to review bull Regional data prior to January 1 2011 bull NERC data from January 1 2011 through March 31 2012
bull Developed a draft report for approval at March 2013 PC meeting bull General observations and conclusions bull Preliminary recommendations
Reporting Enhancements
bull Collecting the total number of operations beginning 4Q2012 bull ALR4-1 is a performance metric or misoperations as a ratio
of total protection system operations bull Coordinating reporting enhancements with the Project 2010-
05 SDT (PRC-003 and PRC-004)
17 RELIABILITY | ACCOUNTABILITY RELIABILITY | ACCOUNTABILITY
Common Patterns and Gaps
As bull Incorrect Settings ndash Protective Function This sub-cause represents 306 (67) of the 458 misoperations
related to settings
These misoperations are engineering errors in general protection applications and are common to all relay technologies
bull More than 24 of the records Either categorized incorrectly or had insufficient information to
identify a sub-cause or root cause
bull Evaluate whether adding sub-cause codes to the reporting
18 RELIABILITY | ACCOUNTABILITY RELIABILITY | ACCOUNTABILITY
Tracking and Potential Solutions
As bull Measure ndash ALR4-1 Misoperation Rate
bull Benchmark ndash Average rate reduction over time 20 rate reduction in 2 years
bull Information Sharing ndash Highlight success stories
bull Targeted training on protective function settings bull Work with Regional Entities and subject matter experts
bull Revise PRC-005 to a results-based standard Establish a performance requirement
oUse a 90 quantile
19 RELIABILITY | ACCOUNTABILITY RELIABILITY | ACCOUNTABILITY
New Risk Issue and Effort
As bull AC Substation Equipment Failure High Priority Issue
Biggest contributor to severity risk index
Statistically significant and positively correlated
bull Measure ndash ALR6-11 bull Automatic AC Transmission Outages initiated by
Failed AC Substation Equipment
bull Add sub-cause codes to the reporting bull Identify common patterns
20 RELIABILITY | ACCOUNTABILITY
Questions and Answers
21 RELIABILITY | ACCOUNTABILITY
Standard PRC-005
bull Title ndash
Transmission and Generation Protection System Maintenance and Testing
bull Purpose ndash To ensure all transmission and generation
Protection Systems affecting the reliability of the Bulk Electric System (BES) are maintained and tested
- Slide Number 1
- Topics
- Slide Number 3
- Risk Measures
- SRI and EDI
- Yearly SRI
- Tiered Approach
- Reliability Metrics
- Reliability Metrics (contrsquod)
- Slide Number 10
- Supporting Data
- Slide Number 12
- Study 1 Risk Patterns
- Metric - BPS Transmission Related Events Resulting in Loss of Load
- Study 2 PRC-005 Effect
- Current Efforts
- Common Patterns and Gaps
- Tracking and Potential Solutions
- New Risk Issue and Effort
- Slide Number 20
- Standard PRC-005
-
11 RELIABILITY | ACCOUNTABILITY
Supporting Data
12 RELIABILITY | ACCOUNTABILITY
Risk Analysis
13 RELIABILITY | ACCOUNTABILITY
Study 1 Risk Patterns
Weather excluding lightning 17
Unknown 14
Lightning 12
Human Error 11
Failed AC Substation and Circuit Equipment
20
Failed Protection System Equipment
8
Power System Condition 4
Foreign Interference 4
Other 4 Biggest contributor to transmission severity - Failed AC Substation Equip - Statistically significant and positively correlated
AC Circuit Sustained Automatic Outages by Initiating Cause Code
14 RELIABILITY | ACCOUNTABILITY
Metric - BPS Transmission Related Events Resulting in Loss of Load
Transmission Related Events Resulting in Load Loss (2011)
Date Generation Loss (MW)
Transmission Loss
Load Loss
(MW)
Equipment Failure
Protection System
Misoperation
Human Error
1132011 0 3 lines 135
3272011 260 13 lines 295
4252011 0 5 lines
1 transformer 140
5102011 300 10 lines 462
662011 106 4 lines 450
6302011 1 3 transformers 797
7132011 599
14 lines 1 back to back
converter 2 transformers
665
7222011 0 1 line 206
982011 6981 32 lines
4 transformers 7835
15 RELIABILITY | ACCOUNTABILITY
Study 2 PRC-005 Effect
Violations
Misops
T Outages
Investigations
Is PRC-005 responsive to
control reliability risks
1331 entities 95 had no violations
2230 misops in 2011
Companies with more misoperations tend to have more failed protection system equipment outages
There is no statistically significant correlation between the number of violations and the number of misoperations
4 violations
359 outages
16 RELIABILITY | ACCOUNTABILITY
Current Efforts
Expert Review
bull PCrsquos Protection System Misoperations Task Force (PSMTF) started in March 2012 to review bull Regional data prior to January 1 2011 bull NERC data from January 1 2011 through March 31 2012
bull Developed a draft report for approval at March 2013 PC meeting bull General observations and conclusions bull Preliminary recommendations
Reporting Enhancements
bull Collecting the total number of operations beginning 4Q2012 bull ALR4-1 is a performance metric or misoperations as a ratio
of total protection system operations bull Coordinating reporting enhancements with the Project 2010-
05 SDT (PRC-003 and PRC-004)
17 RELIABILITY | ACCOUNTABILITY RELIABILITY | ACCOUNTABILITY
Common Patterns and Gaps
As bull Incorrect Settings ndash Protective Function This sub-cause represents 306 (67) of the 458 misoperations
related to settings
These misoperations are engineering errors in general protection applications and are common to all relay technologies
bull More than 24 of the records Either categorized incorrectly or had insufficient information to
identify a sub-cause or root cause
bull Evaluate whether adding sub-cause codes to the reporting
18 RELIABILITY | ACCOUNTABILITY RELIABILITY | ACCOUNTABILITY
Tracking and Potential Solutions
As bull Measure ndash ALR4-1 Misoperation Rate
bull Benchmark ndash Average rate reduction over time 20 rate reduction in 2 years
bull Information Sharing ndash Highlight success stories
bull Targeted training on protective function settings bull Work with Regional Entities and subject matter experts
bull Revise PRC-005 to a results-based standard Establish a performance requirement
oUse a 90 quantile
19 RELIABILITY | ACCOUNTABILITY RELIABILITY | ACCOUNTABILITY
New Risk Issue and Effort
As bull AC Substation Equipment Failure High Priority Issue
Biggest contributor to severity risk index
Statistically significant and positively correlated
bull Measure ndash ALR6-11 bull Automatic AC Transmission Outages initiated by
Failed AC Substation Equipment
bull Add sub-cause codes to the reporting bull Identify common patterns
20 RELIABILITY | ACCOUNTABILITY
Questions and Answers
21 RELIABILITY | ACCOUNTABILITY
Standard PRC-005
bull Title ndash
Transmission and Generation Protection System Maintenance and Testing
bull Purpose ndash To ensure all transmission and generation
Protection Systems affecting the reliability of the Bulk Electric System (BES) are maintained and tested
- Slide Number 1
- Topics
- Slide Number 3
- Risk Measures
- SRI and EDI
- Yearly SRI
- Tiered Approach
- Reliability Metrics
- Reliability Metrics (contrsquod)
- Slide Number 10
- Supporting Data
- Slide Number 12
- Study 1 Risk Patterns
- Metric - BPS Transmission Related Events Resulting in Loss of Load
- Study 2 PRC-005 Effect
- Current Efforts
- Common Patterns and Gaps
- Tracking and Potential Solutions
- New Risk Issue and Effort
- Slide Number 20
- Standard PRC-005
-
12 RELIABILITY | ACCOUNTABILITY
Risk Analysis
13 RELIABILITY | ACCOUNTABILITY
Study 1 Risk Patterns
Weather excluding lightning 17
Unknown 14
Lightning 12
Human Error 11
Failed AC Substation and Circuit Equipment
20
Failed Protection System Equipment
8
Power System Condition 4
Foreign Interference 4
Other 4 Biggest contributor to transmission severity - Failed AC Substation Equip - Statistically significant and positively correlated
AC Circuit Sustained Automatic Outages by Initiating Cause Code
14 RELIABILITY | ACCOUNTABILITY
Metric - BPS Transmission Related Events Resulting in Loss of Load
Transmission Related Events Resulting in Load Loss (2011)
Date Generation Loss (MW)
Transmission Loss
Load Loss
(MW)
Equipment Failure
Protection System
Misoperation
Human Error
1132011 0 3 lines 135
3272011 260 13 lines 295
4252011 0 5 lines
1 transformer 140
5102011 300 10 lines 462
662011 106 4 lines 450
6302011 1 3 transformers 797
7132011 599
14 lines 1 back to back
converter 2 transformers
665
7222011 0 1 line 206
982011 6981 32 lines
4 transformers 7835
15 RELIABILITY | ACCOUNTABILITY
Study 2 PRC-005 Effect
Violations
Misops
T Outages
Investigations
Is PRC-005 responsive to
control reliability risks
1331 entities 95 had no violations
2230 misops in 2011
Companies with more misoperations tend to have more failed protection system equipment outages
There is no statistically significant correlation between the number of violations and the number of misoperations
4 violations
359 outages
16 RELIABILITY | ACCOUNTABILITY
Current Efforts
Expert Review
bull PCrsquos Protection System Misoperations Task Force (PSMTF) started in March 2012 to review bull Regional data prior to January 1 2011 bull NERC data from January 1 2011 through March 31 2012
bull Developed a draft report for approval at March 2013 PC meeting bull General observations and conclusions bull Preliminary recommendations
Reporting Enhancements
bull Collecting the total number of operations beginning 4Q2012 bull ALR4-1 is a performance metric or misoperations as a ratio
of total protection system operations bull Coordinating reporting enhancements with the Project 2010-
05 SDT (PRC-003 and PRC-004)
17 RELIABILITY | ACCOUNTABILITY RELIABILITY | ACCOUNTABILITY
Common Patterns and Gaps
As bull Incorrect Settings ndash Protective Function This sub-cause represents 306 (67) of the 458 misoperations
related to settings
These misoperations are engineering errors in general protection applications and are common to all relay technologies
bull More than 24 of the records Either categorized incorrectly or had insufficient information to
identify a sub-cause or root cause
bull Evaluate whether adding sub-cause codes to the reporting
18 RELIABILITY | ACCOUNTABILITY RELIABILITY | ACCOUNTABILITY
Tracking and Potential Solutions
As bull Measure ndash ALR4-1 Misoperation Rate
bull Benchmark ndash Average rate reduction over time 20 rate reduction in 2 years
bull Information Sharing ndash Highlight success stories
bull Targeted training on protective function settings bull Work with Regional Entities and subject matter experts
bull Revise PRC-005 to a results-based standard Establish a performance requirement
oUse a 90 quantile
19 RELIABILITY | ACCOUNTABILITY RELIABILITY | ACCOUNTABILITY
New Risk Issue and Effort
As bull AC Substation Equipment Failure High Priority Issue
Biggest contributor to severity risk index
Statistically significant and positively correlated
bull Measure ndash ALR6-11 bull Automatic AC Transmission Outages initiated by
Failed AC Substation Equipment
bull Add sub-cause codes to the reporting bull Identify common patterns
20 RELIABILITY | ACCOUNTABILITY
Questions and Answers
21 RELIABILITY | ACCOUNTABILITY
Standard PRC-005
bull Title ndash
Transmission and Generation Protection System Maintenance and Testing
bull Purpose ndash To ensure all transmission and generation
Protection Systems affecting the reliability of the Bulk Electric System (BES) are maintained and tested
- Slide Number 1
- Topics
- Slide Number 3
- Risk Measures
- SRI and EDI
- Yearly SRI
- Tiered Approach
- Reliability Metrics
- Reliability Metrics (contrsquod)
- Slide Number 10
- Supporting Data
- Slide Number 12
- Study 1 Risk Patterns
- Metric - BPS Transmission Related Events Resulting in Loss of Load
- Study 2 PRC-005 Effect
- Current Efforts
- Common Patterns and Gaps
- Tracking and Potential Solutions
- New Risk Issue and Effort
- Slide Number 20
- Standard PRC-005
-
13 RELIABILITY | ACCOUNTABILITY
Study 1 Risk Patterns
Weather excluding lightning 17
Unknown 14
Lightning 12
Human Error 11
Failed AC Substation and Circuit Equipment
20
Failed Protection System Equipment
8
Power System Condition 4
Foreign Interference 4
Other 4 Biggest contributor to transmission severity - Failed AC Substation Equip - Statistically significant and positively correlated
AC Circuit Sustained Automatic Outages by Initiating Cause Code
14 RELIABILITY | ACCOUNTABILITY
Metric - BPS Transmission Related Events Resulting in Loss of Load
Transmission Related Events Resulting in Load Loss (2011)
Date Generation Loss (MW)
Transmission Loss
Load Loss
(MW)
Equipment Failure
Protection System
Misoperation
Human Error
1132011 0 3 lines 135
3272011 260 13 lines 295
4252011 0 5 lines
1 transformer 140
5102011 300 10 lines 462
662011 106 4 lines 450
6302011 1 3 transformers 797
7132011 599
14 lines 1 back to back
converter 2 transformers
665
7222011 0 1 line 206
982011 6981 32 lines
4 transformers 7835
15 RELIABILITY | ACCOUNTABILITY
Study 2 PRC-005 Effect
Violations
Misops
T Outages
Investigations
Is PRC-005 responsive to
control reliability risks
1331 entities 95 had no violations
2230 misops in 2011
Companies with more misoperations tend to have more failed protection system equipment outages
There is no statistically significant correlation between the number of violations and the number of misoperations
4 violations
359 outages
16 RELIABILITY | ACCOUNTABILITY
Current Efforts
Expert Review
bull PCrsquos Protection System Misoperations Task Force (PSMTF) started in March 2012 to review bull Regional data prior to January 1 2011 bull NERC data from January 1 2011 through March 31 2012
bull Developed a draft report for approval at March 2013 PC meeting bull General observations and conclusions bull Preliminary recommendations
Reporting Enhancements
bull Collecting the total number of operations beginning 4Q2012 bull ALR4-1 is a performance metric or misoperations as a ratio
of total protection system operations bull Coordinating reporting enhancements with the Project 2010-
05 SDT (PRC-003 and PRC-004)
17 RELIABILITY | ACCOUNTABILITY RELIABILITY | ACCOUNTABILITY
Common Patterns and Gaps
As bull Incorrect Settings ndash Protective Function This sub-cause represents 306 (67) of the 458 misoperations
related to settings
These misoperations are engineering errors in general protection applications and are common to all relay technologies
bull More than 24 of the records Either categorized incorrectly or had insufficient information to
identify a sub-cause or root cause
bull Evaluate whether adding sub-cause codes to the reporting
18 RELIABILITY | ACCOUNTABILITY RELIABILITY | ACCOUNTABILITY
Tracking and Potential Solutions
As bull Measure ndash ALR4-1 Misoperation Rate
bull Benchmark ndash Average rate reduction over time 20 rate reduction in 2 years
bull Information Sharing ndash Highlight success stories
bull Targeted training on protective function settings bull Work with Regional Entities and subject matter experts
bull Revise PRC-005 to a results-based standard Establish a performance requirement
oUse a 90 quantile
19 RELIABILITY | ACCOUNTABILITY RELIABILITY | ACCOUNTABILITY
New Risk Issue and Effort
As bull AC Substation Equipment Failure High Priority Issue
Biggest contributor to severity risk index
Statistically significant and positively correlated
bull Measure ndash ALR6-11 bull Automatic AC Transmission Outages initiated by
Failed AC Substation Equipment
bull Add sub-cause codes to the reporting bull Identify common patterns
20 RELIABILITY | ACCOUNTABILITY
Questions and Answers
21 RELIABILITY | ACCOUNTABILITY
Standard PRC-005
bull Title ndash
Transmission and Generation Protection System Maintenance and Testing
bull Purpose ndash To ensure all transmission and generation
Protection Systems affecting the reliability of the Bulk Electric System (BES) are maintained and tested
- Slide Number 1
- Topics
- Slide Number 3
- Risk Measures
- SRI and EDI
- Yearly SRI
- Tiered Approach
- Reliability Metrics
- Reliability Metrics (contrsquod)
- Slide Number 10
- Supporting Data
- Slide Number 12
- Study 1 Risk Patterns
- Metric - BPS Transmission Related Events Resulting in Loss of Load
- Study 2 PRC-005 Effect
- Current Efforts
- Common Patterns and Gaps
- Tracking and Potential Solutions
- New Risk Issue and Effort
- Slide Number 20
- Standard PRC-005
-
14 RELIABILITY | ACCOUNTABILITY
Metric - BPS Transmission Related Events Resulting in Loss of Load
Transmission Related Events Resulting in Load Loss (2011)
Date Generation Loss (MW)
Transmission Loss
Load Loss
(MW)
Equipment Failure
Protection System
Misoperation
Human Error
1132011 0 3 lines 135
3272011 260 13 lines 295
4252011 0 5 lines
1 transformer 140
5102011 300 10 lines 462
662011 106 4 lines 450
6302011 1 3 transformers 797
7132011 599
14 lines 1 back to back
converter 2 transformers
665
7222011 0 1 line 206
982011 6981 32 lines
4 transformers 7835
15 RELIABILITY | ACCOUNTABILITY
Study 2 PRC-005 Effect
Violations
Misops
T Outages
Investigations
Is PRC-005 responsive to
control reliability risks
1331 entities 95 had no violations
2230 misops in 2011
Companies with more misoperations tend to have more failed protection system equipment outages
There is no statistically significant correlation between the number of violations and the number of misoperations
4 violations
359 outages
16 RELIABILITY | ACCOUNTABILITY
Current Efforts
Expert Review
bull PCrsquos Protection System Misoperations Task Force (PSMTF) started in March 2012 to review bull Regional data prior to January 1 2011 bull NERC data from January 1 2011 through March 31 2012
bull Developed a draft report for approval at March 2013 PC meeting bull General observations and conclusions bull Preliminary recommendations
Reporting Enhancements
bull Collecting the total number of operations beginning 4Q2012 bull ALR4-1 is a performance metric or misoperations as a ratio
of total protection system operations bull Coordinating reporting enhancements with the Project 2010-
05 SDT (PRC-003 and PRC-004)
17 RELIABILITY | ACCOUNTABILITY RELIABILITY | ACCOUNTABILITY
Common Patterns and Gaps
As bull Incorrect Settings ndash Protective Function This sub-cause represents 306 (67) of the 458 misoperations
related to settings
These misoperations are engineering errors in general protection applications and are common to all relay technologies
bull More than 24 of the records Either categorized incorrectly or had insufficient information to
identify a sub-cause or root cause
bull Evaluate whether adding sub-cause codes to the reporting
18 RELIABILITY | ACCOUNTABILITY RELIABILITY | ACCOUNTABILITY
Tracking and Potential Solutions
As bull Measure ndash ALR4-1 Misoperation Rate
bull Benchmark ndash Average rate reduction over time 20 rate reduction in 2 years
bull Information Sharing ndash Highlight success stories
bull Targeted training on protective function settings bull Work with Regional Entities and subject matter experts
bull Revise PRC-005 to a results-based standard Establish a performance requirement
oUse a 90 quantile
19 RELIABILITY | ACCOUNTABILITY RELIABILITY | ACCOUNTABILITY
New Risk Issue and Effort
As bull AC Substation Equipment Failure High Priority Issue
Biggest contributor to severity risk index
Statistically significant and positively correlated
bull Measure ndash ALR6-11 bull Automatic AC Transmission Outages initiated by
Failed AC Substation Equipment
bull Add sub-cause codes to the reporting bull Identify common patterns
20 RELIABILITY | ACCOUNTABILITY
Questions and Answers
21 RELIABILITY | ACCOUNTABILITY
Standard PRC-005
bull Title ndash
Transmission and Generation Protection System Maintenance and Testing
bull Purpose ndash To ensure all transmission and generation
Protection Systems affecting the reliability of the Bulk Electric System (BES) are maintained and tested
- Slide Number 1
- Topics
- Slide Number 3
- Risk Measures
- SRI and EDI
- Yearly SRI
- Tiered Approach
- Reliability Metrics
- Reliability Metrics (contrsquod)
- Slide Number 10
- Supporting Data
- Slide Number 12
- Study 1 Risk Patterns
- Metric - BPS Transmission Related Events Resulting in Loss of Load
- Study 2 PRC-005 Effect
- Current Efforts
- Common Patterns and Gaps
- Tracking and Potential Solutions
- New Risk Issue and Effort
- Slide Number 20
- Standard PRC-005
-
15 RELIABILITY | ACCOUNTABILITY
Study 2 PRC-005 Effect
Violations
Misops
T Outages
Investigations
Is PRC-005 responsive to
control reliability risks
1331 entities 95 had no violations
2230 misops in 2011
Companies with more misoperations tend to have more failed protection system equipment outages
There is no statistically significant correlation between the number of violations and the number of misoperations
4 violations
359 outages
16 RELIABILITY | ACCOUNTABILITY
Current Efforts
Expert Review
bull PCrsquos Protection System Misoperations Task Force (PSMTF) started in March 2012 to review bull Regional data prior to January 1 2011 bull NERC data from January 1 2011 through March 31 2012
bull Developed a draft report for approval at March 2013 PC meeting bull General observations and conclusions bull Preliminary recommendations
Reporting Enhancements
bull Collecting the total number of operations beginning 4Q2012 bull ALR4-1 is a performance metric or misoperations as a ratio
of total protection system operations bull Coordinating reporting enhancements with the Project 2010-
05 SDT (PRC-003 and PRC-004)
17 RELIABILITY | ACCOUNTABILITY RELIABILITY | ACCOUNTABILITY
Common Patterns and Gaps
As bull Incorrect Settings ndash Protective Function This sub-cause represents 306 (67) of the 458 misoperations
related to settings
These misoperations are engineering errors in general protection applications and are common to all relay technologies
bull More than 24 of the records Either categorized incorrectly or had insufficient information to
identify a sub-cause or root cause
bull Evaluate whether adding sub-cause codes to the reporting
18 RELIABILITY | ACCOUNTABILITY RELIABILITY | ACCOUNTABILITY
Tracking and Potential Solutions
As bull Measure ndash ALR4-1 Misoperation Rate
bull Benchmark ndash Average rate reduction over time 20 rate reduction in 2 years
bull Information Sharing ndash Highlight success stories
bull Targeted training on protective function settings bull Work with Regional Entities and subject matter experts
bull Revise PRC-005 to a results-based standard Establish a performance requirement
oUse a 90 quantile
19 RELIABILITY | ACCOUNTABILITY RELIABILITY | ACCOUNTABILITY
New Risk Issue and Effort
As bull AC Substation Equipment Failure High Priority Issue
Biggest contributor to severity risk index
Statistically significant and positively correlated
bull Measure ndash ALR6-11 bull Automatic AC Transmission Outages initiated by
Failed AC Substation Equipment
bull Add sub-cause codes to the reporting bull Identify common patterns
20 RELIABILITY | ACCOUNTABILITY
Questions and Answers
21 RELIABILITY | ACCOUNTABILITY
Standard PRC-005
bull Title ndash
Transmission and Generation Protection System Maintenance and Testing
bull Purpose ndash To ensure all transmission and generation
Protection Systems affecting the reliability of the Bulk Electric System (BES) are maintained and tested
- Slide Number 1
- Topics
- Slide Number 3
- Risk Measures
- SRI and EDI
- Yearly SRI
- Tiered Approach
- Reliability Metrics
- Reliability Metrics (contrsquod)
- Slide Number 10
- Supporting Data
- Slide Number 12
- Study 1 Risk Patterns
- Metric - BPS Transmission Related Events Resulting in Loss of Load
- Study 2 PRC-005 Effect
- Current Efforts
- Common Patterns and Gaps
- Tracking and Potential Solutions
- New Risk Issue and Effort
- Slide Number 20
- Standard PRC-005
-
16 RELIABILITY | ACCOUNTABILITY
Current Efforts
Expert Review
bull PCrsquos Protection System Misoperations Task Force (PSMTF) started in March 2012 to review bull Regional data prior to January 1 2011 bull NERC data from January 1 2011 through March 31 2012
bull Developed a draft report for approval at March 2013 PC meeting bull General observations and conclusions bull Preliminary recommendations
Reporting Enhancements
bull Collecting the total number of operations beginning 4Q2012 bull ALR4-1 is a performance metric or misoperations as a ratio
of total protection system operations bull Coordinating reporting enhancements with the Project 2010-
05 SDT (PRC-003 and PRC-004)
17 RELIABILITY | ACCOUNTABILITY RELIABILITY | ACCOUNTABILITY
Common Patterns and Gaps
As bull Incorrect Settings ndash Protective Function This sub-cause represents 306 (67) of the 458 misoperations
related to settings
These misoperations are engineering errors in general protection applications and are common to all relay technologies
bull More than 24 of the records Either categorized incorrectly or had insufficient information to
identify a sub-cause or root cause
bull Evaluate whether adding sub-cause codes to the reporting
18 RELIABILITY | ACCOUNTABILITY RELIABILITY | ACCOUNTABILITY
Tracking and Potential Solutions
As bull Measure ndash ALR4-1 Misoperation Rate
bull Benchmark ndash Average rate reduction over time 20 rate reduction in 2 years
bull Information Sharing ndash Highlight success stories
bull Targeted training on protective function settings bull Work with Regional Entities and subject matter experts
bull Revise PRC-005 to a results-based standard Establish a performance requirement
oUse a 90 quantile
19 RELIABILITY | ACCOUNTABILITY RELIABILITY | ACCOUNTABILITY
New Risk Issue and Effort
As bull AC Substation Equipment Failure High Priority Issue
Biggest contributor to severity risk index
Statistically significant and positively correlated
bull Measure ndash ALR6-11 bull Automatic AC Transmission Outages initiated by
Failed AC Substation Equipment
bull Add sub-cause codes to the reporting bull Identify common patterns
20 RELIABILITY | ACCOUNTABILITY
Questions and Answers
21 RELIABILITY | ACCOUNTABILITY
Standard PRC-005
bull Title ndash
Transmission and Generation Protection System Maintenance and Testing
bull Purpose ndash To ensure all transmission and generation
Protection Systems affecting the reliability of the Bulk Electric System (BES) are maintained and tested
- Slide Number 1
- Topics
- Slide Number 3
- Risk Measures
- SRI and EDI
- Yearly SRI
- Tiered Approach
- Reliability Metrics
- Reliability Metrics (contrsquod)
- Slide Number 10
- Supporting Data
- Slide Number 12
- Study 1 Risk Patterns
- Metric - BPS Transmission Related Events Resulting in Loss of Load
- Study 2 PRC-005 Effect
- Current Efforts
- Common Patterns and Gaps
- Tracking and Potential Solutions
- New Risk Issue and Effort
- Slide Number 20
- Standard PRC-005
-
17 RELIABILITY | ACCOUNTABILITY RELIABILITY | ACCOUNTABILITY
Common Patterns and Gaps
As bull Incorrect Settings ndash Protective Function This sub-cause represents 306 (67) of the 458 misoperations
related to settings
These misoperations are engineering errors in general protection applications and are common to all relay technologies
bull More than 24 of the records Either categorized incorrectly or had insufficient information to
identify a sub-cause or root cause
bull Evaluate whether adding sub-cause codes to the reporting
18 RELIABILITY | ACCOUNTABILITY RELIABILITY | ACCOUNTABILITY
Tracking and Potential Solutions
As bull Measure ndash ALR4-1 Misoperation Rate
bull Benchmark ndash Average rate reduction over time 20 rate reduction in 2 years
bull Information Sharing ndash Highlight success stories
bull Targeted training on protective function settings bull Work with Regional Entities and subject matter experts
bull Revise PRC-005 to a results-based standard Establish a performance requirement
oUse a 90 quantile
19 RELIABILITY | ACCOUNTABILITY RELIABILITY | ACCOUNTABILITY
New Risk Issue and Effort
As bull AC Substation Equipment Failure High Priority Issue
Biggest contributor to severity risk index
Statistically significant and positively correlated
bull Measure ndash ALR6-11 bull Automatic AC Transmission Outages initiated by
Failed AC Substation Equipment
bull Add sub-cause codes to the reporting bull Identify common patterns
20 RELIABILITY | ACCOUNTABILITY
Questions and Answers
21 RELIABILITY | ACCOUNTABILITY
Standard PRC-005
bull Title ndash
Transmission and Generation Protection System Maintenance and Testing
bull Purpose ndash To ensure all transmission and generation
Protection Systems affecting the reliability of the Bulk Electric System (BES) are maintained and tested
- Slide Number 1
- Topics
- Slide Number 3
- Risk Measures
- SRI and EDI
- Yearly SRI
- Tiered Approach
- Reliability Metrics
- Reliability Metrics (contrsquod)
- Slide Number 10
- Supporting Data
- Slide Number 12
- Study 1 Risk Patterns
- Metric - BPS Transmission Related Events Resulting in Loss of Load
- Study 2 PRC-005 Effect
- Current Efforts
- Common Patterns and Gaps
- Tracking and Potential Solutions
- New Risk Issue and Effort
- Slide Number 20
- Standard PRC-005
-
18 RELIABILITY | ACCOUNTABILITY RELIABILITY | ACCOUNTABILITY
Tracking and Potential Solutions
As bull Measure ndash ALR4-1 Misoperation Rate
bull Benchmark ndash Average rate reduction over time 20 rate reduction in 2 years
bull Information Sharing ndash Highlight success stories
bull Targeted training on protective function settings bull Work with Regional Entities and subject matter experts
bull Revise PRC-005 to a results-based standard Establish a performance requirement
oUse a 90 quantile
19 RELIABILITY | ACCOUNTABILITY RELIABILITY | ACCOUNTABILITY
New Risk Issue and Effort
As bull AC Substation Equipment Failure High Priority Issue
Biggest contributor to severity risk index
Statistically significant and positively correlated
bull Measure ndash ALR6-11 bull Automatic AC Transmission Outages initiated by
Failed AC Substation Equipment
bull Add sub-cause codes to the reporting bull Identify common patterns
20 RELIABILITY | ACCOUNTABILITY
Questions and Answers
21 RELIABILITY | ACCOUNTABILITY
Standard PRC-005
bull Title ndash
Transmission and Generation Protection System Maintenance and Testing
bull Purpose ndash To ensure all transmission and generation
Protection Systems affecting the reliability of the Bulk Electric System (BES) are maintained and tested
- Slide Number 1
- Topics
- Slide Number 3
- Risk Measures
- SRI and EDI
- Yearly SRI
- Tiered Approach
- Reliability Metrics
- Reliability Metrics (contrsquod)
- Slide Number 10
- Supporting Data
- Slide Number 12
- Study 1 Risk Patterns
- Metric - BPS Transmission Related Events Resulting in Loss of Load
- Study 2 PRC-005 Effect
- Current Efforts
- Common Patterns and Gaps
- Tracking and Potential Solutions
- New Risk Issue and Effort
- Slide Number 20
- Standard PRC-005
-
19 RELIABILITY | ACCOUNTABILITY RELIABILITY | ACCOUNTABILITY
New Risk Issue and Effort
As bull AC Substation Equipment Failure High Priority Issue
Biggest contributor to severity risk index
Statistically significant and positively correlated
bull Measure ndash ALR6-11 bull Automatic AC Transmission Outages initiated by
Failed AC Substation Equipment
bull Add sub-cause codes to the reporting bull Identify common patterns
20 RELIABILITY | ACCOUNTABILITY
Questions and Answers
21 RELIABILITY | ACCOUNTABILITY
Standard PRC-005
bull Title ndash
Transmission and Generation Protection System Maintenance and Testing
bull Purpose ndash To ensure all transmission and generation
Protection Systems affecting the reliability of the Bulk Electric System (BES) are maintained and tested
- Slide Number 1
- Topics
- Slide Number 3
- Risk Measures
- SRI and EDI
- Yearly SRI
- Tiered Approach
- Reliability Metrics
- Reliability Metrics (contrsquod)
- Slide Number 10
- Supporting Data
- Slide Number 12
- Study 1 Risk Patterns
- Metric - BPS Transmission Related Events Resulting in Loss of Load
- Study 2 PRC-005 Effect
- Current Efforts
- Common Patterns and Gaps
- Tracking and Potential Solutions
- New Risk Issue and Effort
- Slide Number 20
- Standard PRC-005
-
20 RELIABILITY | ACCOUNTABILITY
Questions and Answers
21 RELIABILITY | ACCOUNTABILITY
Standard PRC-005
bull Title ndash
Transmission and Generation Protection System Maintenance and Testing
bull Purpose ndash To ensure all transmission and generation
Protection Systems affecting the reliability of the Bulk Electric System (BES) are maintained and tested
- Slide Number 1
- Topics
- Slide Number 3
- Risk Measures
- SRI and EDI
- Yearly SRI
- Tiered Approach
- Reliability Metrics
- Reliability Metrics (contrsquod)
- Slide Number 10
- Supporting Data
- Slide Number 12
- Study 1 Risk Patterns
- Metric - BPS Transmission Related Events Resulting in Loss of Load
- Study 2 PRC-005 Effect
- Current Efforts
- Common Patterns and Gaps
- Tracking and Potential Solutions
- New Risk Issue and Effort
- Slide Number 20
- Standard PRC-005
-
21 RELIABILITY | ACCOUNTABILITY
Standard PRC-005
bull Title ndash
Transmission and Generation Protection System Maintenance and Testing
bull Purpose ndash To ensure all transmission and generation
Protection Systems affecting the reliability of the Bulk Electric System (BES) are maintained and tested
- Slide Number 1
- Topics
- Slide Number 3
- Risk Measures
- SRI and EDI
- Yearly SRI
- Tiered Approach
- Reliability Metrics
- Reliability Metrics (contrsquod)
- Slide Number 10
- Supporting Data
- Slide Number 12
- Study 1 Risk Patterns
- Metric - BPS Transmission Related Events Resulting in Loss of Load
- Study 2 PRC-005 Effect
- Current Efforts
- Common Patterns and Gaps
- Tracking and Potential Solutions
- New Risk Issue and Effort
- Slide Number 20
- Standard PRC-005
-
