BPMBPM

Promises andPromises andPromises and Promises and ChallengesChallengesChallengesChallenges

How did we get here?How did we get here?How did we get here?How did we get here?

BPM is an old discipline that allows you to model theBPM is an old discipline that allows you to model theBPM is an old discipline that allows you to model the BPM is an old discipline that allows you to model the organizational structure, define the business processes, organizational structure, define the business processes, and show their interactions. and show their interactions. The design and automation of business processes evenThe design and automation of business processes evenThe design and automation of business processes even The design and automation of business processes even warrants its own field of study, known as BPM warrants its own field of study, known as BPM (Business Process Management).(Business Process Management).T diti ll t ht i b i h l it i t i tT diti ll t ht i b i h l it i t i tTraditionally taught in business schools, it is put into Traditionally taught in business schools, it is put into practice with varying degrees of success. practice with varying degrees of success. Hammer and Champy, the authors of the widely read Hammer and Champy, the authors of the widely read py, ypy, y“Reengineering the Corporation”, focused their attention “Reengineering the Corporation”, focused their attention on business processes as a root cause of inefficiency on business processes as a root cause of inefficiency and also the source of potential competitive advantage.and also the source of potential competitive advantage.p p gp p g

Over the last two decades, the public and privateOver the last two decades, the public and privateOver the last two decades, the public and private Over the last two decades, the public and private sectors have been giving increasing attention to sectors have been giving increasing attention to business processes.business processes.This interest grows out of the requirements toThis interest grows out of the requirements toThis interest grows out of the requirements to This interest grows out of the requirements to streamline business operations and overhead, streamline business operations and overhead, consolidate organizations, and save costs.consolidate organizations, and save costs.Wh t i diff t t d i th l f tiWh t i diff t t d i th l f tiWhat is different today is the novel use of computing What is different today is the novel use of computing technology to drive the analysis and automation of technology to drive the analysis and automation of business processes.business processes.Hence, the level of interest and the marketing Hence, the level of interest and the marketing hyperbole around BPM has reached a crescendo. hyperbole around BPM has reached a crescendo.

Innovations in technology such as XML, Web Services, Innovations in technology such as XML, Web Services, Service Oriented Architecture, Service Catalogs, Service Oriented Architecture, Service Catalogs, , g ,, g ,componentcomponent--based deployment, and information based deployment, and information messaging have fueled the current interest in BPM.messaging have fueled the current interest in BPM.Vendors have developed Business Process Management Vendors have developed Business Process Management p gp gSystems (Systems (BPMSBPMS) that provide the fine) that provide the fine--grained grained integration of systems and data needed to automate integration of systems and data needed to automate business processes. business processes. BPMS li k l d i f iBPMS li k l d i f iBPMS links people and systems, manages information BPMS links people and systems, manages information access and transformation, handles exceptions, and access and transformation, handles exceptions, and orchestrates the flow of the process.orchestrates the flow of the process.Th t th l t d dTh t th l t d dThat was the last decade.That was the last decade.

Today, organizations are looking to BPM to help solve Today, organizations are looking to BPM to help solve problems, like:problems, like:

To be competitive, a supplier needs to cut its costs To be competitive, a supplier needs to cut its costs for fulfilling customer orders, for fulfilling customer orders, by 70 percentby 70 percent..A pharmaceutical company seeks to extend theA pharmaceutical company seeks to extend theA pharmaceutical company seeks to extend the A pharmaceutical company seeks to extend the patent life of its drugs by bringing new products to patent life of its drugs by bringing new products to market, market, one month earlierone month earlier..A government agencyA government agency forced to reduce staff byforced to reduce staff byA government agency, A government agency, forced to reduce staff by forced to reduce staff by 30 percent30 percent, must find a way to consolidate and , must find a way to consolidate and streamline its unemployment benefits services.streamline its unemployment benefits services.P ll bl d h S bP ll bl d h S b O lO lPersonally accountable under the SarbanesPersonally accountable under the Sarbanes--Oxley Oxley Act, company executives Act, company executives need to control and need to control and verify the processverify the process used to produce financial used to produce financial statements. statements.

As an example, Gartner announced that BPM "wins the As an example, Gartner announced that BPM "wins the 'Triple Crown' of saving money, saving time, and adding 'Triple Crown' of saving money, saving time, and adding p g y, g , gp g y, g , gvalue.“value.“Is this promise being fulfilled? Is this promise being fulfilled? BPM technologies are becoming more mature and BPMBPM technologies are becoming more mature and BPMBPM technologies are becoming more mature and BPM BPM technologies are becoming more mature and BPM does have the potential to deliver significant value.does have the potential to deliver significant value.But there are still elements that are missing that limit its But there are still elements that are missing that limit its effectiveness. effectiveness. e ect e esse ect e essThus, many Developers and Business Analysts still find Thus, many Developers and Business Analysts still find themselves asking the basic questions: themselves asking the basic questions:

What is it?What is it?What is it? What is it? Why should we care?Why should we care?

This presentation provides a highThis presentation provides a high--level overview of BPM level overview of BPM p p gp p gand where it is today. and where it is today. It also touches on some of the core technologies and It also touches on some of the core technologies and standards.standards.Its focus is on the four specific “Challenges” facing BPM Its focus is on the four specific “Challenges” facing BPM and they are aligned to the four phases of the typical and they are aligned to the four phases of the typical application development life cycle. application development life cycle.

DiscoveryDiscoveryDesignDesignDevelopmentDevelopmentDevelopmentDevelopmentDeploymentDeployment

The Discovery ChallengeThe Discovery ChallengeThe Discovery ChallengeThe Discovery Challenge

Typically, Business Analysts, needing to discover the Typically, Business Analysts, needing to discover the yp y, y , gyp y, y , gcurrent state of things, try to visually represent the current state of things, try to visually represent the various processes of the business. various processes of the business. The approach taken by many BPM products fails to The approach taken by many BPM products fails to pp y y ppp y y paddress this challenge adequately.address this challenge adequately.

They employ a drawing “metaphor” in which a They employ a drawing “metaphor” in which a Business Analyst or Developer sketches the process Business Analyst or Developer sketches the process

l f d dl f d dusing a palette of standard icons.using a palette of standard icons.This assumes the existing process is known in This assumes the existing process is known in advance.advance.

Most organizations however, simply Most organizations however, simply do not know do not know their their endend--toto--end processes accurately or in detail.end processes accurately or in detail.Their process knowledge is tacit and decentralizedTheir process knowledge is tacit and decentralized——not not p gp gexplicit and centralized.explicit and centralized.

How can you discover, How can you discover, h b i t ?h b i t ?

Classical manufacturing processes have been analyzedClassical manufacturing processes have been analyzed

how a business operates?how a business operates?Classical manufacturing processes have been analyzed Classical manufacturing processes have been analyzed extensively in quantitative and qualitative terms. extensively in quantitative and qualitative terms. Discovering general business processes is somewhat Discovering general business processes is somewhat less straightforward. You can adopt either a Topless straightforward. You can adopt either a Top--down down or Bottomor Bottom--up approach.up approach.

The TopThe Top--down approachdown approachpp pppp

The TopThe Top--down discovery approach typically begins withdown discovery approach typically begins withThe TopThe Top down discovery approach typically begins with down discovery approach typically begins with the organization chart. It lists the responsibilities of the organization chart. It lists the responsibilities of each department in the organization and identifies the each department in the organization and identifies the hi hhi h l l th t t th ibilitil l th t t th ibilitihighhigh--level processes that support these responsibilities.level processes that support these responsibilities.The advantage of this approach is that it provides a The advantage of this approach is that it provides a broad, organizational perspective.broad, organizational perspective.broad, organizational perspective. broad, organizational perspective. Its disadvantage is a lack of detail and a questionable Its disadvantage is a lack of detail and a questionable degree of accuracy.degree of accuracy.

The BottomThe Bottom--up approachup approach

The BottomThe Bottom--up approach begins by interviewing up approach begins by interviewing

The BottomThe Bottom up approachup approach

p pp g y gp pp g y gemployees about their dayemployees about their day--toto--day activities and attempts day activities and attempts to integrate this information into coherent endto integrate this information into coherent end--toto--end end processes. processes. ppThis approach can be extremely accurate but you can This approach can be extremely accurate but you can easily get lost in the details.easily get lost in the details.These processes are then decomposed into lowerThese processes are then decomposed into lower levellevelThese processes are then decomposed into lowerThese processes are then decomposed into lower--level level processes, which are decomposed further, until the processes, which are decomposed further, until the lowest level is reached. lowest level is reached.

The Hybrid approachThe Hybrid approachy ppy pp

Some hybrid TopSome hybrid Top--down/Bottomdown/Bottom--up approaches seek to up approaches seek to achieve the advantages of both methodsachieve the advantages of both methodsachieve the advantages of both methods.achieve the advantages of both methods.Since no two organizations are exactly alike in how they Since no two organizations are exactly alike in how they operate, different discovery methods are probably more operate, different discovery methods are probably more appropriate.appropriate.appropriate.appropriate.Further, a single capture of business processes is likely Further, a single capture of business processes is likely to be woefully inadequate. As is so often the case, later to be woefully inadequate. As is so often the case, later discoveries inform earlier ones, and an iterativediscoveries inform earlier ones, and an iterativediscoveries inform earlier ones, and an iterative discoveries inform earlier ones, and an iterative discovery methodology that continually enhances and discovery methodology that continually enhances and updates the processes may yield better results. updates the processes may yield better results. Regardless of the methodology followed, there is of Regardless of the methodology followed, there is of g gy ,g gy ,course the course the key requirementkey requirement that management that management support and drive the businesssupport and drive the business--process discovery. process discovery. Without this support, the chance of success is minimal.Without this support, the chance of success is minimal.pp ,pp ,

Business ConsequencesBusiness Consequencesus ss Co s qu sus ss Co s qu sAs awareness of the importance of business processes As awareness of the importance of business processes grows many are attempting to capture their currentgrows many are attempting to capture their current--grows, many are attempting to capture their currentgrows, many are attempting to capture their currentstate business environment. They form workshops of state business environment. They form workshops of business users, sketch the processes, and try to achieve business users, sketch the processes, and try to achieve consensus within the team. consensus within the team. Unfortunately, they have no way to ensure the accuracy Unfortunately, they have no way to ensure the accuracy or completeness of the resulting diagrams. Often the or completeness of the resulting diagrams. Often the underlying complexity of existing business processes is underlying complexity of existing business processes is

i lifi d b h k hi lifi d b h k hoversimplified by such workshops. oversimplified by such workshops. Much of the important metaMuch of the important meta--data about the processes, data about the processes, such as cost, cycle time, and information flow, cannot such as cost, cycle time, and information flow, cannot b il fit i t “Vi i ” di M thb il fit i t “Vi i ” di M thbe easily fit into “Visio” diagrams. Moreover, the be easily fit into “Visio” diagrams. Moreover, the information contained in the processes cannot be easily information contained in the processes cannot be easily changed or analyzed effectively in these diagrams.changed or analyzed effectively in these diagrams.

Technical ConsequencesTechnical Consequencesa Co s qu sa Co s qu sAccurately capturing the current or “asAccurately capturing the current or “as--is” process is a is” process is a prerequisite for defining the structure and rules of theprerequisite for defining the structure and rules of theprerequisite for defining the structure and rules of the prerequisite for defining the structure and rules of the “to“to--be” process. be” process. Without this level of understanding, a BPMS Without this level of understanding, a BPMS “Developer” may produce a sub“Developer” may produce a sub--optimal solution withoptimal solution withDeveloper may produce a subDeveloper may produce a sub optimal solution with optimal solution with the tool or, worse, a solution to the wrong problem. the tool or, worse, a solution to the wrong problem. BPMS tools were designed to “automate processes”, not BPMS tools were designed to “automate processes”, not to analyze business.to analyze business.to analyze business. to analyze business. The process automation, implemented using BPMS may The process automation, implemented using BPMS may therefore, fall short of the true goals of the business. therefore, fall short of the true goals of the business. Why not ask the Business Analysts to use the BPMSWhy not ask the Business Analysts to use the BPMSWhy not ask the Business Analysts to use the BPMS Why not ask the Business Analysts to use the BPMS products to discover and analyze business processes? products to discover and analyze business processes? This would seem to solve this problem. This would seem to solve this problem.

Unfortunately, most BPMS products have been designed Unfortunately, most BPMS products have been designed f b D l t f th b if b D l t f th b ifor use by Developers, not for the business.for use by Developers, not for the business.They provide few, if any, capabilities for process They provide few, if any, capabilities for process discovery, defining metadiscovery, defining meta--data, simulation, or analyzingdata, simulation, or analyzingdiscovery, defining metadiscovery, defining meta data, simulation, or analyzing data, simulation, or analyzing process costs or cycle times.process costs or cycle times.

The Design ChallengeThe Design Challengeg gg g

The ultimate purpose of BPM is to improve and optimize The ultimate purpose of BPM is to improve and optimize th ti f i tith ti f i tithe operations of an organization.the operations of an organization.Its scope, necessarily, comprises not a single process Its scope, necessarily, comprises not a single process but but all processes all processes across the organization. across the organization. pp ggUnfortunately, most BPMS products are designed to Unfortunately, most BPMS products are designed to work on one process at a time. The “Developer” draws work on one process at a time. The “Developer” draws the process, adds implementation constructs, and thenthe process, adds implementation constructs, and thenthe process, adds implementation constructs, and then the process, adds implementation constructs, and then executes the process. executes the process. There is no way in these tools to: look across multiple There is no way in these tools to: look across multiple processes examine process interconnections makeprocesses examine process interconnections makeprocesses, examine process interconnections, make processes, examine process interconnections, make comparisons, or perform analysis. comparisons, or perform analysis.

Process LaboratoryProcess LaboratoryWhat is needed is a “process laboratory”, where What is needed is a “process laboratory”, where Business Analysts can collaborate exploring the processBusiness Analysts can collaborate exploring the process

Process LaboratoryProcess Laboratory

Business Analysts can collaborate, exploring the process Business Analysts can collaborate, exploring the process space, testing ideas, measuring, analyzing, and space, testing ideas, measuring, analyzing, and comparing processes, and generally performing comparing processes, and generally performing business thought experiments and scenarios. business thought experiments and scenarios. g pg pThis laboratory would give analysts the tools to design This laboratory would give analysts the tools to design new processes, view the processes from multiple points new processes, view the processes from multiple points of view, extract analytical reports across the processes, of view, extract analytical reports across the processes,

i d f i l ii d f i l igenerate system requirements, and perform simulation generate system requirements, and perform simulation or “what if” experiments. or “what if” experiments. It would allow them to create centralized reusable It would allow them to create centralized reusable

th t b i k d b i diff tth t b i k d b i diff tprocesses that can be invoked by processes in different processes that can be invoked by processes in different operating unitsoperating unitsObviously, one key element in such a laboratory is a Obviously, one key element in such a laboratory is a “process language” to express ideas“process language” to express ideas“process language” to express ideas. “process language” to express ideas.

Process LanguageProcess LanguageThis “process language” would be used to define the This “process language” would be used to define the basic entities of business processes (processesbasic entities of business processes (processes

g gg g

basic entities of business processes (processes, basic entities of business processes (processes, participants, activities, links, etc.) and the rules for their participants, activities, links, etc.) and the rules for their operation and interaction.operation and interaction.A standard process language would allow customers toA standard process language would allow customers toA standard process language would allow customers to A standard process language would allow customers to use products from different vendors for defining and use products from different vendors for defining and implementing business processes. implementing business processes. Processes defined in one product could be executed onProcesses defined in one product could be executed onProcesses defined in one product could be executed on Processes defined in one product could be executed on another product.another product.Over the past three years, various organizational groups Over the past three years, various organizational groups have made numerous attempts to define standards for have made numerous attempts to define standards for ppWeb services and business processes.Web services and business processes.

Organizational GroupsOrganizational GroupsThe relevant organizations are:The relevant organizations are:

W kfl M t C liti (W kfl M t C liti (WfMCWfMC))

g pg p

Workflow Management Coalition (Workflow Management Coalition (WfMCWfMC))Object Management Group’s Object Management Group’s -- Business Process Business Process Management Initiative (Management Initiative (BPMIBPMI))g (g ( ))World Wide Web Consortium (World Wide Web Consortium (W3CW3C))OASISOASIS..

BPELBPELAn important XMLAn important XML--based language for defining business based language for defining business processes is the Business Process Execution Languageprocesses is the Business Process Execution Languageprocesses is the Business Process Execution Language processes is the Business Process Execution Language for Web Services (WSBPEL, BPEL4WS, etc.)for Web Services (WSBPEL, BPEL4WS, etc.)The underlying assumption behind the BPEL The underlying assumption behind the BPEL

ifi ti i th t b i ill bifi ti i th t b i ill bspecification is that business processes will be specification is that business processes will be composed of a series of interacting Web services. composed of a series of interacting Web services. Since WSDL (Web Services Description Language) is the Since WSDL (Web Services Description Language) is the ( p g g )( p g g )natural language for describing Web services, BPEL is natural language for describing Web services, BPEL is an extension of WSDL. an extension of WSDL. Each activity in a BPEL process is implemented by aEach activity in a BPEL process is implemented by aEach activity in a BPEL process is implemented by a Each activity in a BPEL process is implemented by a Web Service, which is defined by its port types, Web Service, which is defined by its port types, operations, and messages.operations, and messages.

In BPEL, a business process is composed of a central In BPEL, a business process is composed of a central process engine that interacts with a set of businessprocess engine that interacts with a set of businessprocess engine that interacts with a set of business process engine that interacts with a set of business partners.partners.

message messagepartner partnerprocessengine

Each WebEach Web--Service operation is performed either by Service operation is performed either by one of the partners or by the central process engine one of the partners or by the central process engine itselfitself

engine

itself.itself.The process engine communicates with its partners by The process engine communicates with its partners by exchanging messages. The process engine and exchanging messages. The process engine and partner send messages across a communicationspartner send messages across a communicationspartner send messages across a communications partner send messages across a communications channel called a “service link.channel called a “service link.

To make this more concrete, let’s consider a stock broker To make this more concrete, let’s consider a stock broker i t ti ith t k h (St k B k P )i t ti ith t k h (St k B k P )

buyerLink

interacting with a stock exchange (Stock Broker Process).interacting with a stock exchange (Stock Broker Process).

process stockexchange

role:buy requestor

role:buy service

stock orderport type

stocktransaction

port type

The service link is a bilateral contract between the The service link is a bilateral contract between the Stock Broker “Stock Broker “process” and the “” and the “stock exchange” that ” that defines the services each offers to the other.defines the services each offers to the other.The process and the partner play different roles acrossThe process and the partner play different roles acrossThe process and the partner play different roles across The process and the partner play different roles across the service link. the service link. The process, in its role, exposes a WSDL port typeThe process, in its role, exposes a WSDL port type——that is, a set of operations that it agrees to offer. that is, a set of operations that it agrees to offer. Similarly, the partner, in its role, exposes another set of Similarly, the partner, in its role, exposes another set of

titioperations.operations.

Having defined the conceptual framework for partner Having defined the conceptual framework for partner interaction BPEL then specifies the building blocks ofinteraction BPEL then specifies the building blocks ofinteraction, BPEL then specifies the building blocks of interaction, BPEL then specifies the building blocks of processes: activities, flows, links, data containers, and processes: activities, flows, links, data containers, and assignment operations. assignment operations. These are defined in terms of their XML structure butThese are defined in terms of their XML structure butThese are defined in terms of their XML structure, but These are defined in terms of their XML structure, but without a graphical model for representing them.without a graphical model for representing them.BPEL also addresses technical constructs required for BPEL also addresses technical constructs required for proper execution of the business processproper execution of the business processproper execution of the business process. proper execution of the business process. These include correlation, fault handling, and These include correlation, fault handling, and compensation.compensation.

CorrelationCorrelation -- is the technique used to create is the technique used to create associations between process instances by using theassociations between process instances by using theassociations between process instances by using the associations between process instances by using the data fields as identifiers. data fields as identifiers. For example, a field “order number” might be used to For example, a field “order number” might be used to correlate a purchase order and a purchasecorrelate a purchase order and a purchase--orderordercorrelate a purchase order and a purchasecorrelate a purchase order and a purchase--order order acknowledgment. acknowledgment. Fault handlingFault handling and Cand Compensationompensation specify the specify the procedures to be followed when an error occurs in theprocedures to be followed when an error occurs in theprocedures to be followed when an error occurs in the procedures to be followed when an error occurs in the process. process. For longFor long--running processes, the idea is to “undo” a running processes, the idea is to “undo” a complex series of activities with a compensating seriescomplex series of activities with a compensating seriescomplex series of activities with a compensating series complex series of activities with a compensating series of activities. of activities.

For example, if you want to specify that activity 1 must For example, if you want to specify that activity 1 must d ti it 2 h t t dd ti it 2 h t t dprecede activity 2, you have two ways to do so. precede activity 2, you have two ways to do so.

1.1. Use the structured activity called “sequence.” Use the structured activity called “sequence.” 22 Connect these activities through a link within aConnect these activities through a link within a2.2. Connect these activities through a link within a Connect these activities through a link within a

flow. flow. The BPEL specification provides no hints as to when to The BPEL specification provides no hints as to when to use one technique or the otheruse one technique or the otheruse one technique or the other.use one technique or the other.In BPEL, each process is an assemblage of Web In BPEL, each process is an assemblage of Web services, but the process is itself a largeservices, but the process is itself a large--scale Web scale Web

i Thi f t li Thi f t l lik h bl li it dlik h bl li it dservice. This fractalservice. This fractal--like approach enables unlimited like approach enables unlimited composition and decomposition of Web services.composition and decomposition of Web services.

BPEL is a significant achievement, but it has several BPEL is a significant achievement, but it has several weaknesses that limit its widespread adoption:weaknesses that limit its widespread adoption:weaknesses that limit its widespread adoption:weaknesses that limit its widespread adoption:

It addresses only processes composed exclusively It addresses only processes composed exclusively of Web services.of Web services.It h hi l d i T d t il blIt h hi l d i T d t il blIt has no graphical rendering. To date, no available It has no graphical rendering. To date, no available products generate process graphics from a BPEL products generate process graphics from a BPEL document or vice versa.document or vice versa.It does not include a framework for performingIt does not include a framework for performingIt does not include a framework for performing It does not include a framework for performing TopTop--down designdown design——that is, for creating a process in that is, for creating a process in a series of layers with successive refinement.a series of layers with successive refinement.It provides no capabilities for process analysisIt provides no capabilities for process analysisIt provides no capabilities for process analysis.It provides no capabilities for process analysis.It is a vendorIt is a vendor--driven process definitions language driven process definitions language that has not yet been reflected in a royaltythat has not yet been reflected in a royalty--free free standard published by a universally recognizedstandard published by a universally recognizedstandard published by a universally recognized standard published by a universally recognized standards group.standards group.

The major competitor to BPEL as a process language The major competitor to BPEL as a process language based on Web services is BPML (Business Processbased on Web services is BPML (Business Processbased on Web services is BPML (Business Process based on Web services is BPML (Business Process Management Language). Management Language). Both BPEL and BPML are ultimately based on the Both BPEL and BPML are ultimately based on the ππcalculus but the Business Process Managementcalculus but the Business Process Managementcalculus, but the Business Process Management calculus, but the Business Process Management Initiative introduced BPML two years earlier than BPEL. Initiative introduced BPML two years earlier than BPEL. BPEL has actually incorporated many BPML concepts BPEL has actually incorporated many BPML concepts and with the support of Microsoft and IBM it has theand with the support of Microsoft and IBM it has theand, with the support of Microsoft and IBM, it has the and, with the support of Microsoft and IBM, it has the advantage of industry momentum. advantage of industry momentum. Microsoft, IBM, and BEA Systems have introduced BPEL Microsoft, IBM, and BEA Systems have introduced BPEL in their products but as expected with proprietaryin their products but as expected with proprietaryin their products, but as expected, with proprietary in their products, but as expected, with proprietary language extensions and some tools to aid in process language extensions and some tools to aid in process design. design.

Business ConsequencesBusiness ConsequencesThe goal is to translate the process information The goal is to translate the process information

th d i Di i t t d d lth d i Di i t t d d l

Business ConsequencesBusiness Consequences

gathered in Discovery into a standard process language, gathered in Discovery into a standard process language, such as BPEL. But Business Analysts can’t use BPEL, at such as BPEL. But Business Analysts can’t use BPEL, at least not in its current form. least not in its current form. Gi BPEL d fi iti ill fi d it lGi BPEL d fi iti ill fi d it lGiven a BPEL process definition, you will find it nearly Given a BPEL process definition, you will find it nearly impossible to disentangle the business logic from the impossible to disentangle the business logic from the details of the implementation. details of the implementation. The business semantics are obscured by the technicalThe business semantics are obscured by the technicalThe business semantics are obscured by the technical The business semantics are obscured by the technical details required for execution. details required for execution. What is lacking is a way to layer BPEL, to filter out such What is lacking is a way to layer BPEL, to filter out such technical constructs as fault handling correlation andtechnical constructs as fault handling correlation andtechnical constructs as fault handling, correlation, and technical constructs as fault handling, correlation, and transaction management. transaction management.

It should be possible for a Business Analyst to use a It should be possible for a Business Analyst to use a l t d i th b i l il t d i th b i l iprocess language to design the business logic. process language to design the business logic.

Once the business logic is mapped out, a Developer can Once the business logic is mapped out, a Developer can insert the technical constructs. insert the technical constructs. Business Analysts generally prefer a visual way to Business Analysts generally prefer a visual way to design processes.design processes.They would also likely benefit from a way to design They would also likely benefit from a way to design

f hf h d b h h hd b h h h l ll lprocesses from the Topprocesses from the Top--down, beginning with highdown, beginning with high--level level processes and refining them to lowprocesses and refining them to low--level processes. level processes.

Technical ConsequencesTechnical ConsequencesIn many cases the Business Analysts will design the In many cases the Business Analysts will design the business process using an analysis toolbusiness process using an analysis tool

Technical ConsequencesTechnical Consequences

business process using an analysis tool. business process using an analysis tool. If BPEL is not used by the business process analysis tool If BPEL is not used by the business process analysis tool as well as by the BPMS, then a custom mapping will be as well as by the BPMS, then a custom mapping will be required to translate between the XML dialects of therequired to translate between the XML dialects of therequired to translate between the XML dialects of the required to translate between the XML dialects of the two products. two products. In its current form, BPEL will be of limited use since it is In its current form, BPEL will be of limited use since it is designed for processes that are implemented using Webdesigned for processes that are implemented using Webdesigned for processes that are implemented using Web designed for processes that are implemented using Web services. services. A key goal of businessA key goal of business--process design is to define and process design is to define and communicate requirementscommunicate requirementscommunicate requirements. communicate requirements. For example, suppose a new system will be used in For example, suppose a new system will be used in multiple processes, supporting different users and multiple processes, supporting different users and systems performing different functions.systems performing different functions.systems performing different functions. systems performing different functions.

Ideally, the business processes are defined in such a Ideally, the business processes are defined in such a way that the functional requirements can simply beway that the functional requirements can simply beway that the functional requirements can simply be way that the functional requirements can simply be extracted from the process definitions. extracted from the process definitions. If a new system performs 25 activities across 17 If a new system performs 25 activities across 17 processes then these activities can be summarized byprocesses then these activities can be summarized byprocesses, then these activities can be summarized by processes, then these activities can be summarized by an appropriate query. an appropriate query. This procedure is precisely analogous to extracting data This procedure is precisely analogous to extracting data from a relational database Unfortunately there isfrom a relational database Unfortunately there isfrom a relational database. Unfortunately, there is from a relational database. Unfortunately, there is currently no searchable knowledge base of BPEL currently no searchable knowledge base of BPEL processes. processes. Moreover since BPEL has no notion of “participant” orMoreover since BPEL has no notion of “participant” orMoreover, since BPEL has no notion of participant or Moreover, since BPEL has no notion of participant or “actor” to identify the proposed system, it will not be “actor” to identify the proposed system, it will not be able to support this important goal of the process able to support this important goal of the process laboratory.laboratory.yy

The Development ChallengeThe Development ChallengeThe Development ChallengeThe Development ChallengeA successful development project is the result of many A successful development project is the result of many favorable conditions one of the most important beingfavorable conditions one of the most important beingfavorable conditions, one of the most important being favorable conditions, one of the most important being close collaboration between Business Analysts (define close collaboration between Business Analysts (define the needs of the business) and Developers (implement the needs of the business) and Developers (implement systems that meet these needs)systems that meet these needs)systems that meet these needs). systems that meet these needs). Business Analysts and Developers are driven by Business Analysts and Developers are driven by different goals, speak different languages, and work at different goals, speak different languages, and work at diff l l f i idiff l l f i idifferent levels of precision. different levels of precision. In the domain of BPM this gap is manifested by In the domain of BPM this gap is manifested by automated business processes whose execution does automated business processes whose execution does ppnot match the original business requirements. not match the original business requirements. Business Analysts typically communicate business needs Business Analysts typically communicate business needs (in the form of requirements) to the Developers who(in the form of requirements) to the Developers who(in the form of requirements) to the Developers, who (in the form of requirements) to the Developers, who may interpret the needs rather differently. may interpret the needs rather differently.

Using a BPMS tool, the developers implement the Using a BPMS tool, the developers implement the automated solution as they understand it. automated solution as they understand it. yyWhy not have the Business Analysts define the business Why not have the Business Analysts define the business process using the BPMS tools? process using the BPMS tools? This is not realistic since BPMS products are generallyThis is not realistic since BPMS products are generallyThis is not realistic since BPMS products are generally This is not realistic since BPMS products are generally intended for use by developers, not by Business intended for use by developers, not by Business Analysts. Analysts. They enable developers to create technical con-structs, They enable developers to create technical con-structs, ey e ab e de e ope s to c eate tec ca co st ucts,ey e ab e de e ope s to c eate tec ca co st ucts,not business requirements.not business requirements.Tools based on UML (Unified Modeling Language) are Tools based on UML (Unified Modeling Language) are sometimes suggested as an alternative. UML is well sometimes suggested as an alternative. UML is well ggggsuited for developers who need to design class diagrams suited for developers who need to design class diagrams and lay out the interactions between method calls. and lay out the interactions between method calls. The UML suite of diagrams is, however, not so well The UML suite of diagrams is, however, not so well ggsuited for Business Analysts working with business suited for Business Analysts working with business processes. processes.

Business ConsequencesBusiness ConsequencesThe business consequences of the gap between The business consequences of the gap between

Business ConsequencesBusiness Consequences

Business Analysts and Developers are: Business Analysts and Developers are: increased risk of failureincreased risk of failurel l d ti f d l tl l d ti f d l tlonger lead times for development.longer lead times for development.

The Standish Group discovered:The Standish Group discovered:31 percent of all software development projects are31 percent of all software development projects are31 percent of all software development projects are 31 percent of all software development projects are cancelled before they are completed.cancelled before they are completed.53 percent are either not completed on time, budget, 53 percent are either not completed on time, budget, or fail to deliver the projected functionality. or fail to deliver the projected functionality. 16 percent of projects are completed on time and on 16 percent of projects are completed on time and on budgetbudgetbudget. budget.

Technical ConsequencesTechnical Consequences

The classical requirements documentation leaves The classical requirements documentation leaves

Technical ConsequencesTechnical Consequences

qqconsiderable room for interpretation. considerable room for interpretation. It rarely provides the level of precision needed by IT It rarely provides the level of precision needed by IT D l h d t kD l h d t kDevelopers, who need to know:Developers, who need to know:

Each activity that must be performed by the systemEach activity that must be performed by the systemThe stepThe step--byby--step control logic of the envelopingstep control logic of the envelopingThe stepThe step byby step control logic of the enveloping step control logic of the enveloping business processbusiness processThe specific data required at each step of the The specific data required at each step of the processprocessThe business rules that govern changes to the data. The business rules that govern changes to the data.

This lack of precision leads to misunderstandings This lack of precision leads to misunderstandings p gp gbetween the analysis and the development teams. between the analysis and the development teams. Redefining requirements, redesigning, and recoding Redefining requirements, redesigning, and recoding midstream are expensive and timemidstream are expensive and time--consuming.consuming.pp ggWhat’s missing is a seamless way to integrate design What’s missing is a seamless way to integrate design and development. and development. Business Analysts should create process designs at theBusiness Analysts should create process designs at theBusiness Analysts should create process designs at the Business Analysts should create process designs at the business level within their process laboratory and then business level within their process laboratory and then export these designs in XML form to the BPMS.export these designs in XML form to the BPMS.Developers will then refine the design, adding the Developers will then refine the design, adding the p g , gp g , gtechnical constructs needed for implementation. technical constructs needed for implementation. This eliminates any ambiguity about the requirements This eliminates any ambiguity about the requirements and business need.and business need.

The Deployment ChallengeThe Deployment ChallengeThe Deployment Challenge The Deployment Challenge

The whole point of automating business processes is to The whole point of automating business processes is to p g pp g pimprove operationsimprove operations——in cost, time, or quality. in cost, time, or quality. Once a process has been developed and deployed, how Once a process has been developed and deployed, how can we know if it is meeting the intended goals? can we know if it is meeting the intended goals? g gg gWe know how to instrument IT systems and monitor We know how to instrument IT systems and monitor them with a high degree of precision. them with a high degree of precision. These statistics, however, do not generally provide aThese statistics, however, do not generally provide aThese statistics, however, do not generally provide a These statistics, however, do not generally provide a businessbusiness--process context around this information.process context around this information.The challenge is to aggregate and present execution The challenge is to aggregate and present execution data at the businessdata at the business--process level.process level.ppGartner coined the term Gartner coined the term business activity monitoring business activity monitoring (BAM) for this capability (BAM) for this capability

Business ConsequencesBusiness Consequences

Without BAM, operational managers have no way of Without BAM, operational managers have no way of

Business ConsequencesBusiness Consequences

, p g y, p g ydetermining whether the processes, for which they are determining whether the processes, for which they are responsible, are meeting their objectives. responsible, are meeting their objectives. For example,For example, they will not be aware that the cost of the they will not be aware that the cost of the p ,p , yyorder fulfillment process has increased 20 percent order fulfillment process has increased 20 percent above average, or that the time required for handling above average, or that the time required for handling new benefits claims declined by 10 percent, or that the new benefits claims declined by 10 percent, or that the outage optimization process for web portal is in troubleoutage optimization process for web portal is in troubleoutage optimization process for web portal is in trouble. outage optimization process for web portal is in trouble. Lacking this information, executives have no way to Lacking this information, executives have no way to determine which action to take. determine which action to take. A t t ti t ti tiA t t ti t ti ti iiA way to aggregate execution statistics A way to aggregate execution statistics in process in process context context would help the business manager better would help the business manager better manage these types of exceptions.manage these types of exceptions.

Recently, several vendors have developed BAM Recently, several vendors have developed BAM y, py, pproducts, but in many cases they are “discrete event products, but in many cases they are “discrete event monitors” that lack overall process context. monitors” that lack overall process context. To achieve true process context, you must link To achieve true process context, you must link p , yp , yindividual activities into a process to provide information individual activities into a process to provide information on what is done in that process and by whom. on what is done in that process and by whom. For exampleFor example, you can group process instances by , you can group process instances by

hhgg

geography, customer, or organization. geography, customer, or organization. Finally you need to “chain” processes that logically Finally you need to “chain” processes that logically belong together, such as an order process and an belong together, such as an order process and an i ii iinvoice process. invoice process. All this information is then summarized and presented All this information is then summarized and presented on an executive dashboard on the enterprise portal.on an executive dashboard on the enterprise portal.

Technical ConsequencesTechnical Consequences

Most organizations recognize the importance of BAM Most organizations recognize the importance of BAM

Technical ConsequencesTechnical Consequences

g g pg g pbut have no effective way to collect, aggregate, and but have no effective way to collect, aggregate, and analyze execution statistics. analyze execution statistics. Often it is done in an ad hoc manner, in which reports Often it is done in an ad hoc manner, in which reports , p, pfrom legacy systems are combined into a data from legacy systems are combined into a data warehouse from which summary reports can be warehouse from which summary reports can be generated. generated.

bl d l h lbl d l h lIt is possible to determine quite precisely the utilization It is possible to determine quite precisely the utilization of each disk drive, server, and network component in of each disk drive, server, and network component in the IT environment. the IT environment. F h t ti ti h ill t k hi hF h t ti ti h ill t k hi hFrom such statistics, however, you will not know which From such statistics, however, you will not know which resources need to be expanded, consolidated, or resources need to be expanded, consolidated, or upgraded to support the business objectives.upgraded to support the business objectives.

For exampleFor example, you simply may not know whether or not , you simply may not know whether or not pp , y p y y, y p y yincreasing the capacity of a specific disk will affect the increasing the capacity of a specific disk will affect the orderorder--fulfillmentfulfillment--cycle time.cycle time.With BAM, we come full cycle. With BAM, we come full cycle. , y, yThe results of process monitoring will enable the The results of process monitoring will enable the rediscovery and redesign of business processes. rediscovery and redesign of business processes. Executives will know about hotspots that demand theirExecutives will know about hotspots that demand theirExecutives will know about hotspots that demand their Executives will know about hotspots that demand their immediate attention. In the longer term, the execution immediate attention. In the longer term, the execution will keep pace with the business needs and the process will keep pace with the business needs and the process designs. designs.

This figure summarizes this lifeThis figure summarizes this life--cycle concept.cycle concept.

analysis

ProcessMaps Requirements

discovery design

XML ImportsBAM

execution

pDashboards

ConclusionConclusionConclusionConclusion

Any enterprise can be viewed as the sum of its business Any enterprise can be viewed as the sum of its business y py pprocesses. processes. Each process delivers value to customers, suppliers, Each process delivers value to customers, suppliers, employees, or other stakeholders. employees, or other stakeholders. p y ,p y ,BPM, the discipline for enabling and automating BPM, the discipline for enabling and automating business processes, is in a period of rapid growth and business processes, is in a period of rapid growth and will fundamentally change the way computing power is will fundamentally change the way computing power is

l dl dg gg g

applied in organizations. applied in organizations. Whereas BPM has already delivered considerable value Whereas BPM has already delivered considerable value in many companies, the components of the full BPM in many companies, the components of the full BPM

l ti till l i d th bj t f il ti till l i d th bj t f isolution are still evolving and are the subject of ongoing solution are still evolving and are the subject of ongoing research and development. research and development.

One noteworthy advance has been BPEL, an XMLOne noteworthy advance has been BPEL, an XML--basedbasedOne noteworthy advance has been BPEL, an XMLOne noteworthy advance has been BPEL, an XML based based language for describing business processes composed language for describing business processes composed of Web services.of Web services.This presentation has focused on four immediateThis presentation has focused on four immediateThis presentation has focused on four immediate This presentation has focused on four immediate challenges: challenges: 1.1. Process discovery is the beginning of any BPM Process discovery is the beginning of any BPM

l ti d i t th t thl ti d i t th t thsolution and is necessary to ensure that the solution and is necessary to ensure that the solution matches the real business needs. solution matches the real business needs.

2.2. Business Analysts lack a process laboratory in Business Analysts lack a process laboratory in y p yy p ywhich to design, analyze, and simulate business which to design, analyze, and simulate business processes.processes.

3.3. Integration is missing between the tools used for Integration is missing between the tools used for g gg gbusiness process design and the tools used for business process design and the tools used for execution. execution.

4.4. BPM generates valuable performance statistics from BPM generates valuable performance statistics from g pg pexecuting business processes. Businesses need to executing business processes. Businesses need to monitor these execution statistics, organize them monitor these execution statistics, organize them into their process context, and present them in the into their process context, and present them in the form of alarms reports and executive dashboardsform of alarms reports and executive dashboardsform of alarms, reports, and executive dashboards.form of alarms, reports, and executive dashboards.

There has been significant progress in BPM in this There has been significant progress in BPM in this decade and many challenges will, and are being decade and many challenges will, and are being addressed in the futureaddressed in the futureaddressed in the future. addressed in the future. Others may prove less tractable and will take a little Others may prove less tractable and will take a little longer to solve.longer to solve.

Once this happens, for the first time we will have a Once this happens, for the first time we will have a complete closedcomplete closed--loop approach to business processes:loop approach to business processes:complete, closedcomplete, closed loop approach to business processes: loop approach to business processes: from conception to execution and back. from conception to execution and back. This gives executives the ability to design their business This gives executives the ability to design their business processes, automate them, and judge quantitativelyprocesses, automate them, and judge quantitativelyprocesses, automate them, and judge quantitatively processes, automate them, and judge quantitatively how well they are doing against their plan. how well they are doing against their plan. With this information, they can then redesign or With this information, they can then redesign or optimize the processes.optimize the processes.optimize the processes. optimize the processes. Gradually, the technologies and techniques described Gradually, the technologies and techniques described here will change the way businesses and governmental here will change the way businesses and governmental agencies apply technology. agencies apply technology. g pp y gyg pp y gyIn the words of Howard Smith, “ThirdIn the words of Howard Smith, “Third--wave business wave business process management methods and systems will utterly process management methods and systems will utterly transform the way companies conceive, build, and transform the way companies conceive, build, and y p , ,y p , ,operate automated systems.”operate automated systems.”