02 CIMug GID Redmond Dec 2008

1 Copyright 2005 SISCO, Inc.

CIMug Meeting 15 December 2008Redmond, WAGID Tutorial

Copyright 2008 SISCO, Inc.

Generic Interface Definition (GID) Tutorial

Ralph Mackiewicz, Vice PresidentSISCO, Inc.6605 19 Mile RoadSterling Heights, MI 48314 USA

Tel: +1-586-254-0020 x103Fax: +1-586-254-0053E-Mail: [email protected]


2

GID Tutorial RedmondGID Tutorial Redmond

Acronyms

O Acronyms are unavoidable when discussing integration technology.

O It was my objective to define all acronyms before using them. Please excuse any oversights.

O If you are not certain, please ask a question immediately.


3


Definitions:

InteroperabilityInteroperability

The ability of computer systems to exchange information with other systems.

IntegrationIntegrationThe ability of computer based applications to interact with

other systems in order to perform a useful function for the user.


4


O Easy to Achieve:

Interoperability and Integration


5


A Better Way

O Interoperability and Integration without having to program it all yourself:

Where applications and devices are inherently capable of interoperating with other systems and performing integrated application functions in a cooperative and distributed manner.

O This is only possible if there are standards to enable it.

This work is progressing. This is what IEC TC57 working groups are all about




What About Interface Standards?


7


An Interface Standard

O Defines a standard for the interface between applications: Independent of the

means of communication (if any)

Independent of the specific application (generic)

Independent of the data exchanged (generic)

Independent of the developer (open)

Communications InfrastructureCommunications Infrastructure

ClientApplication

Client Interface

Server Proxy

ClientApplication

Client Interface

ServerApplication

Server Interface

Client Proxy

ServerApplication

Server Interface

LocalApplications

RemoteApplications


8


Genesis of the Interface Standard

Device 1

Breaker

Transformer Monitoring SCADA

Device 2

Transformer

Protocol 1

Driver 1 Driver 2

Protocol 1

Two Applications:Two Different Drivers


9


Lack of Interface Standard

O Each application developer had to develop interfaces for any protocol that a user needs supported.

O Application developers spend considerable resources on drivers instead of applications.

O Fewer users per driver increases maintenance cost per user

O Result: Less functionality Higher costs Proprietary solutions


10


Genesis of the Interface Standard

Device 1

Breaker


Device 2

Transformer

Protocol 1

Driver 1 Driver 1

Protocol 1

Two Applications:ONE DRIVER


11


Impact of Interface Standards

O Allows developers to focus on applications because client application development can occur independent of the server application

O Enables sharing of interface development and maintenance costs across a larger user base

O Enables 3rd party development of add-ons, plug-ins, etc. Enables niche application players to exist

O Results More Functionality More Choice Less Proprietary Lower Costs


12


Existing Widely Used Interface Standard: OPC

O OPC Foundation (http://www.opcfoundation.org) developed application programming interfaces to enable plug and play of applications and drivers called OLE for Process Control (OPC).

OPC Foundation: 362 member companies (end users and OEMs) 1500+ companies developing OPC applications (est. OPC Foundation)

O OPC is dominant in the industrial automation and process controlindustries providing connectivity to hundreds of key applications.

7500+ different OPC applications (est. OPC Foundation)

O Nearly ALL users in the industrial space expect and demand that their real-time application support OPC to simplify integration and ALL major application providers support OPC.


13


Some OPC Facts

O OPC is NOT a protocol OPC is an INTERFACE

O Microsofts legacy approach to client/server distribution was DCOM DCOM is not required for OPC Alternatives to DCOM exist (including web services)

O Installing OPC does not automatically install DCOM or expose systems to DCOM vulnerabilities.

O Typical OPC installation is between client and server on the same computer with NO network between them.


14


OPC Interfaces

O Data Access (DA) Client/Server Interface for reading, writing, and reporting real-time data

O Historical Data Access (HDA) Client/Server Interface for accessing data archives

O Alarms & Events (AE) Publish/Subscribe Interface for alarms and events


15


OPC Client/Server Architecture

Client Application

OPC Client Interface

Server Application

OPC Server Interface

Data

Request Reply(ies)


16


OPC Features

O Existing OPC Features Based on Microsoft COM technology C++, C#, Visual Basic, Java (3rd Party), and 1 WS Bindings OPC Servers expose a namespace determined by the OPC Server itself

O Existing OPC Shortcomings Microsoft specific OPC Servers expose a namespace determined by the OPC server itself

Applications must adapt to each unique namespace presented by each OPC server depending on interface developer, device, application, protocol, etc.

OPC NEEDS A STANDARDIZED & TECHNOLOGY NEUTRAL METHOD OF REPRESENTING DATA


17


Common Information Model (CIM) is an object-oriented information model of the power system

Central GeneratingStation

Step-Up Transformer

DistributionSubstation

ReceivingStation



Commercial

Industrial Commercial

Gas Turbine

RecipEngine

Cogeneration

RecipEngine

Fuel cell

Micro-turbine

Flywheel

Residential

Photovoltaics

Batteries


18


Class v.s. Instance

O Class information describes the objects and their properties and the relationships with other objects (e.g transformers are contained within substations, transformers have names, voltages, ratings, etc.).

O Instance information describes the specific objects of a given class that exist within the system.

10


19


The Common Information Model Defines Objects and Relationships

O How is the CIM used to reference a specific measurement of a specific voltage of a specific transformer in a specific substation when there are many thousands of such voltages and they change every second?

XFMRWinding

Substation

Transformer

VoltageLevels

Measurement

Has

SuperClassof

Has

Associated with

Power System Resource (logical)

SuperClassof

Equipment Container

Conducting Equipment

SuperClassof

Has


20


The Common Information Model As An Instance Model

Has

SuperClassof

Has

Associated with


SuperClassof

Equipment Container


SuperClassof

Has

RealizedBy

RealizedBy

RealizedByRealizedBy

Airport Substation

Has

13KV

HasRealizedBy

Instances of Specific Power System Components

XFR 123 Has

Winding ABC

Tag 567

Measurement

XFMRWinding

Transformer

VoltageLevels

Substation

11


21


IEC 61970 and IEC 61968: Standards for Integration

O Provide a common agreement on What data is exchanged The Common Information Model (CIM)

O Provide a common agreement on How to exchange the data The Generic Interface Definition (GID)

O GID is a platform independent version of interface standards supporting model driven services capable of being used on any computing platform.

O EPRI CCAPI project submitted the Generic Interface Definition (GID) to the IEC WG13 for standardization in IEC 61970.


22


GID provides standardized interface services

O GID interfaces reference data in the context of a common data exchange model, the CIM.

O GID Services: Generic Data Access (GDA): For model management and distribution of updates. High-Speed Data Access (HSDA): For access to real-time measurement data. Time Series Data Access (TSDA): For access to historical measurement data. Generic Events and Subscriptions (GES): For pub/sub of generic XML messages.

O GID is based on existing open standards for both energy and industrial automation markets

12


23


GID Service Names And Lineage

IEC (Platform neutral)

OPC(Windows)

OMG(CORBA)

Generic Data Access(GDA)

High Speed Data Access

(HSDA)

Generic Eventing and Subscription

(GES)

Time Series Data Access

(TSDA)

OPC Historical Data Access(OPC HDA)

OPC Alarms and Events

(OPC A&E and A&E XML)

OPC Data Access

(OPC DA)

Historical Data Access From

Industrial Systems (HDAIS)

Data Access From Industrial

Systems (DAIS)Data Access Facility (DAF)

Extended

GID: How data is exchanged

Unified Architecture Query (UA)


24


GID and OPC

O GID is platform independent AND model-driven: OPC uses vendor determined namespace for data GID uses a namespace derived from the CIM for all data

AEAlarms & Events

GESGeneric Eventing and Subscriptions

UA QueryUnified Architecture

GDAGeneric Data Access

HDAHistorical Data Access

TSDATime Series Data Access

DAData Access

HSDAHigh Speed Data Access

OPCGID Service

13


25


GID Standards

O IEC 61970 4XX A Platform Independent Model (PIM) that describes with text and the Unified

Modeling Language (UML)) the functionality of the GID

O IEC 61970 5XX A Platform Specific Models (PSM) that applies the 61970-4xx series of

specifications to particular platforms


26


GID Standard IEC 61970-4xx

Time Series Data Access (TSDA)407

Generic Eventing and Subscription (GES)405

High Speed Data Access (HSDA)404

Generic Data Access (GDA)403

Common Services: Base functionality of PIM402

Component Interface Specification (CIS): Functional requirements and use cases for information exchange interfaces

401

DescriptionPart -4XX

14


27


GID Standard IEC 61970-5xx Platform Specific Models

C language profile for TSDA (-407)507-7

Web services profile for GES (-405)505-8

Web services profile for HSDA (-404)504-8

Web services profile for TSDA (-407)507-8

C language profile for GES (-405)505-7

C Language Profile for HSDA (-404)504-7

Web services profile for GDA (-403)503-8

C language profile for GDA (-403)503-7

C language Profile for Common Services (-402)502-7

DescriptionPart -5XX- Y


28


Common Services (-402): Identifiers

O Resource Identifiers (RID) A 128-bit binary number that uniquely identifies a specific resource/object. The numbering may have meaning defined by the GDA server. May also be a Globally Unique Identifier (GUID). Each CIM object in an instance file is given a GUID/RID.

O Uniform Resource Identifiers (URI) A name that identifies a resource per IETF standard RFC2396.

mailto:[email protected] - mailto scheme for the speaker http://rfc.net/rfc2396.html - http scheme for RFC2396 http://utility.com/Planning/Production/CIM-schema-cimu09a#Transformer

definition of a transformer class object in a CIM model A URI can change as the location of the object changes while the RID/GUID

would not change as long as the object exists.

15


29


Common Services (-402): Views

O View is a method of representing a hierarchy determined by the model (CIM) Can be used to derive a URI namespace

O GID supports 3 views:

TC57ClassView

TC57EventingView

TC57Physical View


30


Example of TC57ClassView

Power System Resource

Equipment

Name

Status

IECTC57ClassView

NumberOfTrips

Breaker

Switch

Asset

Document

Name

Path


Rating

Naming

16


31


Example of TC57EventingView

WorkOrder

PreventiveMaintenanceWorkOrder

Asset

BreakerTestReport

IECTC57EventingView

ReliabilityIndex

BreakerName

ProceedureID

WorkOrderID

Description

Same asset as in TC57ClassView. Just a different view of the same object.


32


Example of TC57PhysicalView

TC57PhysicalModel

Main

North SubControlArea

Airport Substation

Breaker 12

Transformer 22

Status

Telemetered.Value

Phase A Voltage

Estimated.Value

17


33


TC57PhysicalView Namespace Example

O A namespace is created by collapsing a hierarchical view into a string that can be used as a Universal Resource Identifier (URI) to an object within that view.

O For Example:TC57PhysicalModel

Main

North SubControlArea

Airport Substation

Breaker 12

Transformer 22

Status

Telemetered.Value

Phase A Voltage

Estimated.Value

utility.com/TC57Physical/Main/North/Airport/Transformer22/PhaseAVoltage/Estimated.Value


34


Generic Data Access (GDA), Part -403

O GDA provides generic request/reply services that are typically used to expose the model of a server (CIM) to clients.

O Typically used to access the model information (class and instance info) of a server that contains the common data exchange model (CIM) used by the system.

O GDA is a query interface that is independent of how data is stored For instance, SQL is a query language that requires knowledge of table and

column names, etc.

O Designed for an object oriented system such as CIM

18


35


GDA Features

O GDA services enable clients to: Read the data model (complete or partial) Determine the hierarchy, relationships, associations, and attributes for the objects

contained in the data model

Find objects in the data model via query Interactively browse the model hierarchy. Write/Create objects in the data model Receive notifications when updates to the model are made.


36


GDA Resource Query Services

O get_values Get a description of a resource specified by its ID.

O get_extent_values Get a description of each resource for a given class

O get_related_values Get description of resources associated to a given resource

O get_decendent_values Generic form of a query encompassing the above queries that can be optimized

for a specific type of query.

19


37


GDA Resource Query Services

PsrName

Substation

PSRNameSwitchOnCount

Breaker

CompanyNameDescription

Company1*

*

1

Name

Class

NameDescription

Measurement

QualityMValue

StateEstimator*1 1 *

getDescendentValues

getValues

getChild

Values

getChildValues

getValuesgetExtentValues

getValues getChildValues


38


GDA Advanced Queries

O Filtered Queries extend the Resource Query interface with the ability to specify property values that are used to qualify queries with operators like: AND OR EQUAL LESS/GREATER THAN LIKE

O Extended Queries enable joining of data across multiple paths For example, a client can ask for query data about breakers in a substation and

for data about the substation itself in a single query

20


39


GDA Updates

O Enables a client to: Create, delete, and update resources (objects) and their properties Create, delete, and update object class definitions

O Supports concurrency and difference models

O Services: create_resource_ids create_resource set_values delete_resource apply_updates


40


GDA Events

O Enables clients to be notified when changes to the model are done to a GDA server.

O Clients are informed of: Resource IDs that have changed Verbs defining the kind of change that occurred (deleted, created, etc.) Version number to identify each unique change that occurred

O Clients use this information: To update their internal configuration minimizing maintenance activities as the

system evolves.

Can be used to drive additional queries to obtain detailed information to automate reconfiguration.

21


41


High Speed Data Access (HSDA) Part 404

O Platform independent model (PIM) of the Platform specific model (PSM) of OPC Data Access (DA) for Microsoft Windows and Data Access for Industrial Systems (DAIS) for CORBA that was done by the Object Management Group (OMG http://www.omg.org)

O Provides access to real-time data (current value) including quality and timestamp

O Uses a variety of services for data access: Client browsing of data defined in server to use for access Synchronous and asynchronous reads and writes Group based asynchronous updates

Client defines groups that it is interested in Server sends updates to the group to the client in an unsolicited manner


42


HSDA Group Update

Client

Server

Client browses for data then defines groups

and asks for updates

Server sends updates to clients as data or quality changes

22


43


HSDA Browsing Functions

O Enables a client to browse the data model of the server to find items (data comprising value, quality and timestamp)

O Browse attributes mapped to CIM with item names returned as URIs:

O Handles returned are RID/GUID Used in read, write, and update services to identify data

O Example Services node_home() item_home() find_by_parent()

find_by_type() get_pathname() get_ids()

utility.com/TC57Physical/Main/North/Airport/Transformer22/Phase%20A%20Voltage/Estimated.Value


44


Time Series Data Access (TSDA) Part 407

O Platform independent model (PIM) of OPC Historical Data Access (HDA) for Microsoft Windows and Historical Data Access for Industrial Systems (HDAIS) for CORBA that was done by the Object Management Group (OMG http://www.omg.org)

O Provides access to data, including quality and timestamp, based on the item description and the range of time for which the data is requested

O Used for historical data access

O Similar services and usage as HSDA

23


45


Generic Eventing & Subscriptions (GES) Part 405

O Interface for publishing and subscribing to generic XML messages

O Does not specify message payload Determined by application/system or standard (IEC 61968)

O Supplies utility specific features Model driven publish/subscribe to generic XML messages using object

references in the CIM context

O Middleware independent pub/sub interface enables application portability across platforms

O Based on OPC Alarms & Events (AE) using HSDA like browsing features


46


GES Services

O Superset of OPC alarms and events Alarms may be CIM elements Events consist of CIM objects (e.g. Work order)

O Example services

get_filter () set_filter () get_state()

set_state () query_available_filters () set_subscription ()

24


47


GES

Subscriber

Server

Subscriber finds data in which it is interested by browsing for messages available based on CIM

Publisher is independently publishing messages that the subscriber can enroll to receive




GID Example Usage

25


49


Example of GDA Application

Has

SuperClassof

Has

Associated with


SuperClassof

Equipment Container


SuperClassof

Has

RealizedBy

RealizedBy

RealizedBy

RealizedBy

Airport Substation

Has

13KV

Has

RealizedByXFR 123 Has

Winding ABC

Tag 567

Measurement

XFMRWinding

Transformer

VoltageLevels

Substation

O Discover the relationships and associations between CIM classes


50



Has

SuperClassof

Has

Associated with


SuperClassof

Equipment Container


SuperClassof

Has

RealizedBy

RealizedBy

RealizedBy

RealizedBy

Airport Substation

Has

13KV

HasRealizedBy

XFR 123 Has

Winding ABC

Tag 567

Measurement

XFMRWinding

Transformer

VoltageLevels

Substation

O Query for a list of power systems resources of class substation

26


51



Has

SuperClassof

Has

Associated with


SuperClassof

Equipment Container


SuperClassof

Has

RealizedBy

RealizedBy

RealizedBy

RealizedBy

Airport Substation

Has

13KV

HasRealizedBy

XFR 123 Has

Winding ABC

Tag 567

Measurement

XFMRWinding

Transformer

VoltageLevels

Substation

O Query connectivity and containment to find specific transformers in specific substations and find the identifier for a specific measurement.


52



Has

SuperClassof

Has

Associated with


SuperClassof

Equipment Container


SuperClassof

Has

RealizedBy

RealizedBy

RealizedBy

RealizedBy

Airport Substation

Has

13KV

HasRealizedBy

XFR 123 Has

Winding ABC

Tag 567

Measurement

XFMRWinding

Transformer

VoltageLevels

Substation

O Create (or delete) new Instances in the model and notify others of their existence.

45KV XFR 456

Winding ABC

Tag 123NotifyEvent

27


53


Example of HSDA Application

Has

SuperClassof

Has

Associated with


SuperClassof

Equipment Container


SuperClassof

Has

RealizedBy

RealizedBy

RealizedBy

RealizedBy

Airport Substation

Has

13KV

HasRealizedBy

XFR 123 Has

Winding ABC

Tag 567

Measurement

XFMRWinding

Transformer

VoltageLevels

Substation

O Browse a hierarchical view of the model to find specific measurement values to get an identifier.


54


Example of HSDA Application

Has

SuperClassof

Has

Associated with


SuperClassof

Equipment Container


SuperClassof

Has

RealizedBy

RealizedBy

RealizedBy

RealizedBy

Airport Substation

Has

13KV

HasRealizedBy

XFR 123 Has

Winding ABC

Tag 567

Measurement

XFMRWinding

Transformer

VoltageLevels

Substation

O Once the identifier is known, ask to receive updates to that measurement value

ReadAdvise

Write

28


55


Example of TSDA Application

Has

SuperClassof

Has

Associated with


SuperClassof

Equipment Container


SuperClassof

Has

RealizedBy

RealizedBy

RealizedBy

RealizedBy

Airport Substation

Has

13KV

HasRealizedBy

XFR 123 Has

Winding ABC

Tag 567

Measurement

XFMRWinding

Transformer

VoltageLevels

Substation

O Browse a hierarchical view of the model to find specific measurement values to get an identifier.


56


Example of TSDA Application

Has

SuperClassof

Has

Associated with


SuperClassof

Equipment Container


SuperClassof

Has

RealizedBy

RealizedBy

RealizedBy

RealizedBy

Airport Substation

Has

13KV

HasRealizedBy

XFR 123 Has

Winding ABC

Tag 567

Measurement

XFMRWinding

Transformer

VoltageLevels

Substation

O Once the identifier is known, ask to read the value that existed at a specific point of time or a sequence of values over a period of time.

ReadValue @

6 January, 2004 11:01AM GMT

29


57


Why not use GDA for Browsing Measurements?

O You Can. The GDA service can support this.

O Typically, the model server does not contain the measurements.

O Typically, the system with the measurements does not expose the model.

O Use the appropriate GID service for the Job


58


Why not use HSDA/TSDA Browsing to get Model Info?

O You can, BUT:

HSDA/TSDA Browsing only traverses a hierarchical view of the full-mesh CIM model.

Does not enable discovery of all possible relationships. Only the relationships that exist in the chosen view are exposed.

Does not enable distribution of model update notices or updating or modifying the model.

O Use the appropriate GID service for the Job

30


59


Some GID Applications

O Enable model information to be shared and exposed over a message bus to provide a unified data exchange model for applications. Eliminate application dependencies on internal data representations of systems. Enable self-configuring clients. Simplify propagation of system changes across enterprise.

O Expose models and data from legacy systems as CIM data Eliminates dependencies on legacy table formats from applications needing data Enables lower cost application migrations and enhancements Enables data trapped in inflexible legacy systems to be exposed and leveraged

without copying/reproduction of the data


60


How is CIM Used?

O Power System Model Exchange between neighboring utilities and ISO/RTOs

O Definition of Messages for exchange over an ESB

O Common Data Exchange Model for Application Integration

31


61


CIM Files and How They Are Used With the GID

O UML Model File Used by development tools to design the model Edit the model to suit your purposes based on your use case

Delete unused attributes and classes Extend the CIM with missing attributes and classes

Generate a schema file: CIM:XML schema using Resource Description Framework Specification

format (RDFS). XML Schema Description file using XSD format.


62


CIM Files and How They Are Used

O Schema File Describes all the object classes, their class relationships, and attributes Essentially it is the UML file transformed into an XML file. How it is used:

Used by message development and processing tools Used by Enterprise Service Bus (ESB) for message transformations Used to configure applications with understanding of models to interpret the

content of instance files

32


63


CIM As Populated Instance Model

XFMRWinding

Substation

Transformer

VoltageLevels

Measurement

Has

SuperClassof

Has

Associated with


SuperClassof

Equipment Container


SuperClassof

Has

RealizedBy

RealizedBy


Airport Substatio

n

Has

13KV

HasRealizedBy

Object Instances

XFR 123 Has

Winding ABC

Tag 567


64


CIM Files and How They Are Used

O Instance File CIM:XML format based on RDFS A list of all the CIM objects contained within a given application

All objects are related to the classes in the schema file All objects are indentified by a unique master resource identifier (MRID) or

globally unique identifier (GUID).

Used to exchange data between applications Power System Model Exchange Application Data Exchange Configure application adapters for application integration

33


65


GID Application

ModelManager(populatedinstancemodel)

ServerApplication

An application that provides some

data about a CIM object. e.g.:

1. Asset Mgt. that provides information about breaker maintenance

2. Historian that provides information about breaker operations.

Client Application that

wants information on a

CIM object.


66


Initial Configuration

O Schema and Instance Download Can Occur:

CIM-XML File transfer and import Using GDA Services over a message bus

ModelServer

ServerApplication

Schema Download

Server relates CIM classes to the data

it serves (e.g. breakers)

Server maps the CIM data to its own internal representation

Instance Download

34


67


Using GID: GDA Application

GDAServer

GDA Client

HSDA ServerApplication

UserEntersNew

Breakerinto

PowerSystemModel

GDA Event: New Breaker

GDA Query: Get Parents/properties

Model Data on Breaker

HSDA server determines if new breaker is in its

scope and configures itself

HSDAServer


68


Using GID: GDA and HSDA Application

GDAServer

GDA Client

HSDA ServerApplication

UserEntersNew

Breakerinto

PowerSystemModel


GDA Query: Get Parents/properties

Model Data on Breaker

HSDA server determines if new breaker is in its

scope and configures itself

HSDAServer

HSDAClient

HSDA Create Group w/new Breaker


HSDA Advise: New Breaker Status

35




Web Services and Interface Standards:

What are they and why we need them


70


What are Web Services?

O A structured integration architecture using XML messaging over a similar network architecture as the world-wide web (WWW)

O Web Services: Can reuse existing network infrastructure used by the WWW (Internet, Intranet) Allows a client to discover the services and data supported by a server. Defined by the World Wide Web Consortium: http://www.w3c.org Uses a standard framework for integration development using widely deployed

tools (Java (etc.), .Net, etc.)

36


71


Web Services is Based on the WWW

URL HTML HTTP

UDDI WSDL SOAP

Web Services

World Wide Web

O World Wide Web (WWW)

Uniform Resource Identifiers (URI) or locator (URL)

Hyper-Text Markup Language (HTML) and the eXtensible Markup Language (XML)

Hyper-Text Transport Protocol (HTTP)

O Web Services

Universal Description, Discovery, and Integration (UDDI)

Web Services Description Language (WSDL) using XML

Simple Object Access Protocol (SOAP)


72


Basic Web Services Architecture

37


73


Service-Oriented Architecture (SOA)

O A service-oriented architecture (SOA) is an application framework that takes applications and breaks them down into individual business functions and processes, called services.

O Services are the building blocks of an SOA. A service can be a business function, such as find the location of an asset, or

determine a voltage level at a certain time, or a system capability such as authenticate user.

SOAs enable packaging business functions from new and existing applications in a simple and standardized way.

An SOA increases flexibility by treating elements of business processes and the underlying IT infrastructure as components (services) that can be reused and combined to address changing business priorities.


74


Basic Web Service Integration Architecture

SCADA

Asset/WorkManagement

EMSData

Warehouse

GIS

PortalN*(N-1) Different client/server

service combinations requiring coding

Typically no agreement on common messages, models, services, etc.

38


75


Flexible connectivity infrastructure for integrating applications and services to power SOA

` CONVERTING transport protocols between requestor and service

` ROUTING messages between services

` TRANSFORMING message format between requestor and service

` HANDLING business events from disparate sources

What is an Enterprise Service Bus (ESB)?


76


Ad-Hoc Integration Using Web Services

SCADA


EMS Data Warehouse

GISPortal

Enterprise Service Bus

Application wrappers/ adapters

39


77


SOA using ad-hoc web services with an ESB

O Significant benefits due to use of widely deployed technology: SOAP HTTP for transport WSDL to describe the services and messages supported Numerous development and middleware tools and products

O Ad-hoc because each application specifies its own services Each service provider independently defines their own SPECIFIC web services

O Get Customer RecordO Create Customer Record, etc.

Each client needing to access a service must discover and adapt to each unique web service provider. Application integration still requires significant programming effort unique to:

The specific application functions involved The developer/brand of the applications

O Result: integration is customized and unique to each and every system


78


Ad-Hoc Integration: Every User Writes a Standard

Standards are great. Everyone should have one.

Bob Metcalfe, Co-inventor of Ethernet

Too Many Standards is No Standard

40


79


Solution to Proliferating Web Services

O Standards of course Proper Mix Standardize on Common Functions Make use of SOA/ESB for Required Custom Functions

O Some services are generic and common to many different systems: Read and Write real-time data (HSDA) Query Historical information (TSDA) Query and write to a model store to find out which objects exist, create new

objects, and maintain existing objects. (GDA)

Publish and Subscribe to other specific/custom messages (GES)


80


Same Problem.Only Worse

Device 1

Breaker


Device 2

Transformer

Protocol 1

Driver 1 Driver 2

Protocol 1

Two Applications:Two Different Drivers

41


81


Web Service Architecture

O Web service tools and development environments are very good at maximizing the productivity of developing and consuming web services

O But, without agreement and detailed standards on generic services that all applications can use, integration is ad-hoc and unique to each system

O GID can be mapped to WSDL to create standardized and generic webservices that are: Developer independent Application function independent Middleware independent User independent

O Can enable off-the-shelf reusable application adapters from third parties


82


CIM and GID - Enable More Interoperability in a Web Services Environment

O Provide a common agreement on WHAT data is exchanged The Common Information Model (CIM) Standardized Data

O Provide a common agreement on HOW to exchange the data The Generic Interface Definition (GID) Standardized Interface Services to Exchange Data

42


83


Ad-Hoc Integration Using Web Services

SCADA


EMS Data Warehouse

GISPortal


Application wrappers/ adapters


84


GID Simplifies Integration using Common Generic Services

SCADA



EMS Data Warehouse

GISPortal

= GID Services

43


85


Data Warehouse

GIS

EMS

Portal

SCADA


GID Enables Real Plug n Play for Integration


= Reusable-Productizable Adapters




Why Isnt Meta-Data Modeling Enough for the Power System

Operations of Utilities?

What makes utilities so special?

44


87


GeneratingStations

Step-Up Transformer


ReceivingStation



Commercial

Industrial Commercial

Gas Turbine

RecipEngine

Cogeneration

RecipEngine

Fuel cell

Micro-turbine

Flywheel

Residential

Photovoltaics

Batteries

Small Municipally Owned Utility

O 370 Miles of transmission wiring (hundreds of towers, thousands of insulators and connections)

O 3,600 miles of distribution wiring (many thousands of towers, tens of thousands of insulators, connections)

O 7 transmission substations with several hundred separate assets including devices, transformers, switches, insulators, breakers, controls, capacitor banks, etc. Each asset can have hundreds (sometimes thousands) of real-time measurements and hundreds of attributes to describe the asset.

O 40 distribution substations with 1,300 distribution devices (see above).O Several generation stations each with its own transformers, breakers, and process controls.


88


Scaled Up: A Medium to Large Utility

O Hundreds of transmission substations with thousands of miles of wire and thousands of towers

O Thousands of distribution substations with tens of thousands of miles of wire and many tens of thousands of poles, transformers, breakers, etc.

O Numerous Generation stations

O Tens of thousands of devices

O Many hundreds of thousands of measurements possible and needed for even simple distribution automation smart grid applications.

O Add Metering to this mix: Millions of measurements every few minutes

O All of this information is CRITICAL to the business

45


89


Business Applications

O A typical business application uses objects like: Purchase Orders Assets Customers Invoices Payments Etc.

O There are a large number of objects whose structure changes infrequently.

O There are numerous transactions and business interactions (processes) that must be managed by the integration infrastructure


90


Operational Applications

O Typical operational application will have objects like: Feeders Breakers Transformers Lines Switches

O There are a large number of these objects and their attribute values, in many cases, change constantly (e.g. once per second).

O Many attributes like voltages, currents, and operations are monitored constantly resulting in many thousands (millions) of transactions (data value updates) every day for many of these objects.

46


91


The Common Information Model As An Instance Model

XFMRWinding

Substation

Transformer

VoltageLevels

Measurement

Has

SuperClassof

Has

Associated with


SuperClassof

Equipment Container


SuperClassof

Has

RealizedBy

RealizedBy


Airport Substatio

n

Has

13KV

HasRealizedBy

Object Instances MANY, MANY, MANY, MANY INSTANCES

XFR 123 Has

Winding ABC

Tag 567


92


The Impact of Instance Models on Integration Technology

O The normal object mapping and transformation tools of an ESB that work so well for transaction oriented systems are not optimized for this.

O Efficient instance mapping at the application adapter is needed. The instance mapping only needs to be done by applications that serve data to

other client applications.

O Client applications find the name they need by invoking GID services with a model server that has instance knowledge.

O Client applications then invoke GID services to obtain the data from the application adapter (server).

O Client applications dont need to be configured with knowledge of the instance mapping in the servers and dont have to be changed as the server applications change.

47




Application of GID to Web Services


94


GID Web Services

C language profile for TSDA (-407)507-7

Web services profile for GES (-405)5058

Web services profile for HSDA (-404)5048

Web services profile for TSDA (-407)5078

C language profile for GES (-405)505-7

C Language Profile for HSDA (-404)504-7

Web services profile for GDA (-403)5038

C language profile for GDA (-403)503-7

C language Profile for Common Services (-402)502-7

DescriptionPart -5XX- Y

48


95


HSDA in C language OPC PSM (-504-7)


96


HSDA in WSDL for Web Services PSM (-504-8)

49


97


Use GID as Appropriate

ESB message bus provides reliable transportHSDA C LanguageGID Client Proxy

OPC UA XML

HSDA C LanguageGID Server Proxy

OPC UA XML

OPC UA XML

HSDA C LanguageServer

OPC UA XML

HSDA C LanguageClient

Server

Client

HSDA C LanguageGID Client Proxy

OPC COM


OPC COM

OPC COM


OPC COM


Server

Client





Server

Client

Transport technology can change without rewriting component adapters

Web Service interface means

consumer or publisher can be remotely

hosted





Server

Client

Proprietary messaging

InteroperabilitySpeed


98


OPC Unified Architecture (UA) GID Web Services

O OPC Foundation was aware of the limitations of COM based OPC OPC XML was a first pass of a technology neutral version

O OPC Foundation has released a Unified Architecture that provides a comprehensive set of unified web services for: Data Access Historical Data Access Event/Alarm subscriptions Commands Model Query

O IEC TC57 WG13 GID web service mappings are being migrated to OPC UA specifications in support of VLPGO initiative, industry trends, and CIGR(D2.24) activities.

50


99


GID Service Names And Lineage

GID: How data is exchanged

IEC (Platform

neutral): GID

OPC(Windows)

OMG(CORBA)

Generic Data Access(GDA)

High Speed Data Access(HSDA)

Generic Eventing and Subscription

(GES)

Time Series Data Access(TSDA)

OPC Historical Data Access(OPC HDA)

OPC Alarms and Events

(OPC A&E and A&E XML)

OPC Data Access(OPC DA)

Historical Data Access From

Industrial Systems (HDAIS)

Data Access From Industrial Systems

(DAIS)Data Access Facility (DAF)

Extended

New WebServices

OPC Unified Architecture


100


OPC Unified Architecture

OPC UA Base Services All Necessary Services

Vendor Information Model

DA A&E HDA CMDs OPC Information Model

Information Model Specifications IEC, ISA, OAGi, EDDL

O Clients can still discover access all data from the derived layers

O Single Set of Unified Services: Query, read, write, subscribe, event, etc.

51


101


OPC UA Layering

Abstract UA Specifications

WSDL / SOAPor TCP / BinaryServices Binding

Proxy /Stubs

APITool orLanguageDependent(e.g. .NET)

Scalable Platform Independent Messaging Model with Security and Authentication

OPC Foundation Members Get:

.NET VersionC/C++ VersionJava Version

Business Model, Adaptable to Platform Independent Messaging Models (e.g. WSDL)




Example

52


103


PowerPool

Sample Project 1

Integration Bus

Model Mgr.GDA

GDA

Power System Models

State Est. etc.

Planning/Engineering

GDA

GDA

HSDA

HSDA

TSDA

TSDA

EMS

CCPGateway (Red.)

CIMXML

ICCPGateway(Redundant)

HSDA

HSDA

ICCP-TASE.2

ICCP-TASE.2 Adapter

Historian

GID

HSDA

HSDA

To BeDone

byUser

GDA

GDA

GDA

GDA


104


System Overview

O Model Management Separated with Exposed GID Interface Enables sharing of models across functional boundaries.

Weeks to days to get extensions operational. Enables use of models for external integration. Isolates changes in data base formats from other applications.

O Use of GID services for model and data Enables model data to be used in configuration of the data exchange links. Model changes can be detected and ICCP links configured semi-automatically. Enables off-the-shelf products from other companies to plug-in to the environment

using off-the-shelf adapters.

Enables user development and expansion.

53


105



106


54


107


GID




Business Process Automation

What is it and why is it important?

55


109


Application Integration Challenges

O Our Goal: Applications are inherently capable of interoperating with other systems and performing integrated application functions in a cooperative and distributed manner.

O Getting data to/from applications is only the first step (interoperation).

O Getting applications to cooperate in a distributed manner (integration) means that they must be aware of and implement your business process.

O Your business process is the procedures, steps, and rules that you follow every day to accomplish a business objective.


110


Step 1: Start with a simple process

O Hypothetical existing business process start out simple

Utility

Process paymentsMail billsPrint billsCalculate billsValidate and enter data into systemTransfer meter data to data entryRead meterDispatch meter reader

56


111


Integration for simple meter reading process

Meterdispatching

DataEntry

CIS andbilling

Paymentprocessing

Customadapter

Customadapter Custom

adapter

Customadapter

Integration tool

Middleware


112


The inevitable happens: CHANGE

Utility

AMR

Meter Data Management

OutsourcedPrinting

OutsourcedMailing

Bank

57


113


Impact of Change rewrite, revise, re-everything

Meterdispatching

DataEntry

CIS andbilling

Paymentprocessing

Customadapter

Customadapter Custom

adapter

Customadapter

Integration tool


114


Why did it break?

O The logic of the business process is embedded in the application adapters

O When the process changes the adapters must change Applications adapters become dependent on the rules and processes defined in

the other adapters

O If the process changes too much, the entire system can be broken

O BUSINESS PROCESS AUTOMATION is needed

58


115


Model Driven Development Accelerates Results

Reconciliation Assistants

O Raise the level of communication

O Reduce complexity Create and manage abstract

representations

O Improve quality and time to value through automation Seamless model integration

reduces translation errors

O Manage change Maintain traceability across

artifacts

Model the Business Domain

Use existing services or create new services if needed

Complete implementation details

Apply Mapping-Transformation

To Generate Implementation

Map to a common dataexchange model & services


116


Remove the Business Logic from Adapters to Enable Model Driven Integration

59


117


Modeling Business Logic


118


Model Driven Integration: Building for the Future

Meterdispatching

DataEntry

CIS andbilling

Paymentprocessing

CustomadapterOff-the-shelf

Adapter

ESB

Off-the-shelfAdapter CIM/GID

Services

CustomadapterCIM/GIDServices

BusinessProcessModeler

BusinessProcess

ExecutionServer

Utility

60


119


Work Mgmt

Customadapter

CIM/GIDServices

Meterdispatching

CustomadapterCIM/GIDServices

Model Driven Integration: Building for the Future

DataEntry

CIS andbilling

ExternalSupplier

Portal

ESB

Off-the-shelfAdapter Portal

BusinessProcessModeler

BusinessProcess

ExecutionServer

Utility

AMR

Meter Data Management

OutsourcedPrinting

OutsourcedMailing

Bank

AMR

Customadapter

CIM/GIDServices


120


E01-EDI

Data Warehouse(Interfaces to and from the

Data Warehouse are notdisplayed on this diagram)

DRAFT Best Buy - Application Diagram V4 DRAFTNovember 10, 1999

G02 - GeneralLedger

A05 - AP

S01 - SalesCorrections

I01 POReceiving

I03 Return toVendor

I06 WarehouseManagement

Mainframe apps - BluePC/NT apps - GreenUnix apps - Yellow3rd party interface - OrangeLines: Colors have no special meaning.They are to help make the diagram easier toread.For More Information: See the databasecontaining information about eachapplication: Application V4.mdb

S06 - Credit App

P15 EES EmployeeChange Notice

OTHER APPS - PCAP - Collections/Credit

TM - Credit Card DB

ACCTS REC APPS - PC990CORBad Debt

Benefical FeesBeneficial Reconcil

JEAXFJEBFAJEBKAJEDVAJESOAJEVSAJEVSF

NSFTeleCredit Fees

INVENTORY CONTROL APPS - PCCode Alarm

Debit ReceivingsDevo Sales

Display InventoryIn HomeJunkouts

Merchandise WithdrawlPromo CreditsRTV Accrual

ShrinkAP Research - Inv CntrlAP Research-Addl Rpts

Book to Perpetual InventoryClose Out Reporting

Computer Intelligence DataCount Corrections

Cross Ref for VCB DnldsDamage Write OffDebit Receivings

DFI Vendor DatabaseDisplay Inventory Reconcil

Display Inventory Reporting

INVENTORY CONTROL APPS - PCDPI/CPI

IC BatchingInventory Adj/Count CorrectInventory Control Reports

Inventory LevelsInventory Roll

Merchandise WithdrawlOpen ReceivingsPI Count Results

PI Time Results from InvPrice Protection

Sales Flash ReportingShrink Reporting

SKU Gross MarginSKU Shrink Level Detail

USMVCB Downloads

Journal Entry Tool Kit

Scorecard - HR

L02-ResourceScheduling(Campbell)

P09 - P17Cyborg

M02 - Millennium

M03 - Millennuim 3.0

Banks - ACH and Pos toPay

Cobra

B01 - StockStatus

S03-Polling

P14 On-line NewHire Entry

CTS

Plan Administrators(401K, PCS, Life,Unicare, Solomon

Smith Barney)

D01 Post LoadBilling

I04 HomeDeliveries

I02 -Transfers

Arthur Planning

I07 PurchaseOrder

I12 EntertainmentSoftware

I05Inventory Info

E13E3 Interface

S04 - Sales Posting

V01-Price ManagementSystem

I10 Cycle PhysicalInventory

I55 SKUInformation

K02Customer Repair

Tracking I35 Early WarningSystem

B02 MerchandiseAnalysis

I13- AutoReplenishment

U18 - CTO

Intercept

I09 Cycle Counts

E02-EmployeePurchase

Texlon 3.5

ACH

Stock Options

I17 Customer PerceivedIn-Stock

U16-Texlon

SiteSeer

C02 - CapitalProjects

F06 - FixedAssets

US Bank ReconFile

Star Repair

EDICoordinator

Mesa DataNEW Soundscan

NPD GroupAIG Warranty Guard

Resumix

Optika

Store BudgetReporting

P16 - Tally Sheet

Cash Receipts/Credit

S05 - HouseCharges

Ad Expense

L01-PromoAnalysis

V02-PriceMarketingSupport

BMP - Busperformance Mngt

StoreScorecard

I11 PriceTesting

Valley Media

P09Bonus/HR

I15 Hand ScanApps

Roadshow

POS

S08 - VertexSalesTax

A04 - CustRefund Chks

Equifax

ICMS Credit

CellularRollover

S09 - DigitalSatelliteSystem

NPD,SoundScan

Sterling VANMailbox (Value)

I18SKU Rep

X92-X96Host to AS400

Communication

S02 -Layaways

Washington,RGIS,

Ntl Bus Systems

V04-SignSystem

I14 Count CorrectionsNARM

P01-EmployeeMasterfile

I06 - CustomerOrder

FrickCo

UAR - Universal AccountReconcilliation

DepositoryBanks

S07 - CellPhones

S11 - ISPTracking

AAS

Fringe PO

Cash Over/Short

L60 MDFCoop SKU Selection

Tool

SKUPerformance

SupplierCompliance

1

I35 - CEI

ASIS

Misc Accounting/Finance Apps - PC/NTCOBA (Corp office Budget Assistant)PCBS(Profit Center Budget System)

Merchandising Budget

AIMSMerch Mngr Approval

Batch ForcastingAd Measurement

AIMS Admin

AIMSReportingAd

Launcher

V03- MktReactions

SpecSource

CTO2.Bestbuy.com

RebateTransfer

SignSystem

CopyWriter'sWorkspace

ELTPowerSuite

StoreMonitor

AIS Calendar

Stores & Mrkts

Due Dates

Smart Plus

InsertionsOrders

BudgetAnalysis Tool

Print CostingInvoice App

AIS Reports

BroadcastFilter

Smart PlusLauncher

GeneralMaintenance

Printer PO

PrinterMaintenance

VendorMaintenance

Vendor Setup

Connect 3

Connect 3Reports

Connect 3PDF Transfe

Spec SourceSKU Tracking

S20-SalesPolling

Prodigy

PSP

In-HomeRepair

WarrantyBillingSystem

Process Servers(Imaging)

Prepared by Michelle Mills

Page 1 of 2Actual Business Process

61


121


Benefits of Model Driven Business Process Automation

O Reduce/Eliminate inter-adapter dependencies enables independent incremental integration of applications

O Enables changes to business process to be implemented with minimal disruption to existing integration

O Changes to business process done via modeling and not programming reducing adapter development and maintenance costs

O Enables monitoring of the execution of the business process to enable business performance improvements State of the business process can be displayed/monitored/reported automatically

to anyone who needs the information. Enables identification of bottleneck and barriers to improving key performance

indicators to identify and implement incremental improvements without disrupting the custom adapter code


122


Questions - Discussion

WHAT?

WHY? HOW?

62




Conclusion


124


GID Enables Independent Development

O An open interface standard enables development and support of application adapters independent of the applications and independent of a specific user data (a GENERIC approach):

Makes off-the-shelf application adapters viable which can reduce or even eliminate the need for application adapter development.

Enables 3rd parties to provide niche off-the-shelf interface products that application vendors are either uninterested or too expensive.

Generic adapters using generic services can be used cross industry increasing product availability and competition lowering costs.

63


125


Do Interface Standards Work?

O The use of generic interface standards is widely used, accepted, and demanded in the industrial automation industry based on the OPC Foundation Standards. 300+ members of vendors and users 1500+ plus companies supporting OPC products 7500+ plus products available Tens of Thousands of installations in mission critical systems

O OPC Unified Architecture (UA) is a secure web service based version of the OPC MS-COM based interfaces with hundreds of companies implementing.

O IEC 61970 is expected to include new PSMs for GID referencing OPC UA mappings.


126


Obstacles are those frightful things that appear when you take your eyes off your objective.

- Henry Ford

O Ralphs Corollaries: If you dont set out on the path, you will never make any progress. The first on the path will reap the most reward.

There is no reason that the energy industry cant take advantage of standardized interface services to lower integration costs.

64


127


Questions - Discussion

WHAT?

WHY? HOW?




Thank You

Ralph MackiewiczSISCO, Inc.6605 19 Mile RoadSterling Heights, MI 48314-1408 USATel: +1-586-254-0020 x103Fax: +1-586-254-0053Email: [email protected]

02 CIMug GID Redmond Dec 2008

Documents

Transcript of 02 CIMug GID Redmond Dec 2008