SENACOR TECHNOLOGIES AG VORDERE CRAMERGASSE 11 D-90478 NÜRNBERG
-
Upload
vance-ball -
Category
Documents
-
view
46 -
download
1
description
Transcript of SENACOR TECHNOLOGIES AG VORDERE CRAMERGASSE 11 D-90478 NÜRNBERG
SENACOR TECHNOLOGIES AG SEITE 1
SENACOR TECHNOLOGIES AG
VORDERE CRAMERGASSE 11
D-90478 NÜRNBERG
WWW.SENACOR.COM
Florian Springer
Business IT Consultant
Dr. Rainer v. AmmonManaging Director
CENTRUM FÜR INFORMATIONS-TECHNOLOGIE-TRANSFER (CITT) GmbHKONRAD-ADENAUERALLE 30D-93051 REGENSBURG
+49 171 756 [email protected]
SENACOR TECHNOLOGIES AG
Event-Driven Busines Process Management taking the example of DHLR. v. Ammon, C. Emmersberger, F. Springer, C. Wolff
Vienna 08/09/28
SENACOR TECHNOLOGIES AG SEITE 3
The forecast of ED-BPM for the next decades
EDBPM – a combination of two disciplines: Business Process Management (BPM) and Complex Event Processing (CEP)
A reference model for ED-BPM – how its components work together
The business modeller and the event modeller – different qualifications not in personal union
DHL Use Case - First experiences from the DHL-Project
Agenda
SENACOR TECHNOLOGIES AG SEITE 4
Forecast of Prof. David Luckham:
we need skilled people at least up to 2050…
we are only at the end of the period of Simple CEP
Forcast of ED-BPM for the next decades
SENACOR TECHNOLOGIES AG SEITE 5
The forecast of ED-BPM for the next decades
The warning of Roy Schulte (VP of Gartner) since 2006…
…we won‘t have enough skilled people who would be able to do all the jobs and projects
The statement of Prof. Mani Chandy (California Techical University) at the Gartner Event Processing Summit 2007…
…The work of IT during the next twenty years will be to complete the evolution of business processes from sequences of slow-moving, disjointed applications to more responsive end-to-end, event-based straight-through flows of action.
SENACOR TECHNOLOGIES AG SEITE 6
monitoring of time-critical bottleneck factors
and transaction control
transparency over integrated represented
processes
representation of the effects of system availabilities and
-disturbances
process and system-linked emergency and
disturbance management
monitoring of SLA-compliance
WorkflowManagement
BusinessProcess
Monitoring
Managing and monitoring of processes means ...
SENACOR TECHNOLOGIES AG SEITE 7
passwdchange
account login
account login
depositactivity history
withdrawal
logout
account balance
transferdeposit new auto pay
enquiry
enquirylogout
passwdchange
new auto payaccount login
account login
depositactivity history
withdrawal
logout
account login
transferdeposit new auto pay
enquiry
enquiry
logout
event cloud with thousands of events per sec…
…e.g. above a bank
event patterns and complex event processing…
The important steps: 1. Redesign the business processes for SOA and BPM 2. Make a SOA, identify services, build WSDL-interfaces…3. Precise description of patterns of events4. Detecting patterns in the event cloud5. Abstraction of complex event pattern instances to higher level events
Senso
r
Senso
r
Big Picture: Monitoring Business Proceses and Activities
SENACOR TECHNOLOGIES AG SEITE 8
…
…
Business Process 1
genCBE (start,service1)
genCBE (exit,service1)
genCBE (start,service2)
genCBE (exit,service2)
genCBE (start,service3)
genCBE (exit,service3)
…
exitService_1startedService_1
startedService_3exitService_3
startedService_2
exitService_2
startedService_4exitService_4
startedService_6
exitService_6
startedService_5
exitService_5
startedService_7
exitService_7
startedService_8exitService_8
Low level events without semantics
Visualization of the processed/correlated events via Business Activity Monitoring
The Pain Point: The Event Cloud, todays IT-Blindness and the „Event Tornado“
Business Process n
SENACOR TECHNOLOGIES AG SEITE 9
The Challenge and the Principle of BPM/BAM/CEP
AppServer
Monitor / Analyze / Act
WorkflowModeler
EventModeler
Enterprise cockpit
EventStore
• realize scenarioprocess instances
• set parameters
analysehistory…
Low Level Event Clouds / Streams
Adapterse.g. RFID, topics of Pub/Sub, …
Normalized events,build business level events
Workflow Enginebased on BPEL
Rules Engine
„special“ SQLresp. other languages
IF …AND …FOLLOWED BY…WITHIN…ACTION
Scenario
e.g. credit offers (completed)e.g. payments
calculate pott, offer rates, profit…
workflows
Domain specific reference models for event patterns
SENACOR TECHNOLOGIES AG SEITE 10
A proposal for a curriculum of a new Master course of study “Event-Driven Business Process Management”
Draft V0.1
Mastercourse-EDBPM-v01.doc(www.citt-online.com)
The business modeller and the event modeller – different qualifications not in personal union
Description: Curriculum together with required credits and examinations
Certificate: Master of Science
Programme Duration: Four Semesters (120 credits/cr)
SENACOR TECHNOLOGIES AG SEITE 11
The business modeller and the event modeller – different qualifications not in personal union
Concept:
The course consists of the fields of study Business Process Management, Complex Event Processing, Business Activity Montoring included Business Intelligence and Data Warehousing, Computer Networks, Messaging as well as several application disciplines like Algorithmic Trading, Supply Chain Management in the retail domain, fraud detection in the banking and insurance domain etc.
All courses are completed with course-related tests and Credits (cr) according to European Credit Transfer System (ECTS) are awarded. All courses are given in English and are designed as distance learning/eLearning courses.
SENACOR TECHNOLOGIES AG SEITE 12
Current research work and projects in ED-BPM
Previous Tasks
Several Proof of Concept (PoC) Implementations
PoC in the logistics domain in cooperation with Deutsche Post AG and Oracle
Event Driven Business Process Management taking the Example of Deutsche Post AG, An evaluation of the Approach of Oracle and the SOPERA Open Source SOA Framework(C. Emmersberger, F. Springer; September 07 – March 08)
PoC in the finance domain in cooperation with TeambankMonitoring Application for monitoring the credit application easyCredit of Team Bank and the evaluation of several CEP approaches(H.-M. Brands, D. Guschakowski; 2007)
SENACOR TECHNOLOGIES AG SEITE 13
DHL Use Case – A Logistics Use Case for EDBPM
Event-Driven Business Process Management (EDBPM) is a combination of two different disciplines:
– Business Process Management (BPM): Deals with the management of business processes with the approach to increase the efficiency, flexibility and technology integration of the business.Business Processes describe the unique way of doing business. Today they are seen as the most valuable asset of a corporation.
– Complex Event Processing (CEP): Event processing concept that deals with handling multiple events within an event cloud to identify meaningful event patterns.It is an emerging technology for obtaining relevant situation knowledge from distributed systems in realtime (= event time + processing time)
EDBPM Background and Definition
SENACOR TECHNOLOGIES AG SEITE 14
DHL Use Case – A Logistics Use Case for EDBPM
Deutsche Post AG is the world largest logistic company
Investigates the feasibility of combining Oracles tools for BPEL, CEP and BAM with the latest Sopera Enterprise Service Bus (ESB)
Use case serves a PoC implementation for a solution combing the goals of service-oriented architecture (SOA) with the advantages of CEP
Use case contains a typical business process at Deutsche Post addressing “shipping”, “monitoring/investigation” and “claim”
Sopera services are orchestrated through Oracle’s BPEL engine and implement the process functionalities. They are capable to send events.
Oracle’s CEP Engine queries the events and sends results to the BAM application for displaying and alerting purpose
Logistics Use Case for EDBPM
allocate package to
transportation
XOR
Transport by truck
Transport by ...
Transport by plane
Move and check in
Move and check in
...
XOR
Start Shipment
...
Traffic events
RFID events
Weather events
...
C. Emmersberger, F. Springer: Event Driven Business Process Management taking the Example of Deutsche Post AG, An evaluation of the Approach of Oracle and the SOPERA Open Source SOA Framework
Example: extract of shipment process
SENACOR TECHNOLOGIES AG SEITE 15
DHL Use Case – A Logistics Use Case for EDBPM
Logistics Use Case for EDBPM
Shipment
Investigation
Claim
SENACOR TECHNOLOGIES AG SEITE 16
DHL Use Case – A Logistics Use Case for EDBPM
Development:
Service development in SOPERA
Service orchestration in Oracle BPEL
Setup events, which should be sent from the Notification Receiver (event service). Settings are defined within SOPERA policies (XML)
Development of CEP patterns in Oracle CEP with CQL
Design of reports for the BAM dashboard in Oracle BAM
External events (e.g. traffic)
Runtime:
Execution of a business process in the BPEL Engine
Notification Receiver deals as event service. Creates and sends business and technical events to a specified endpoint (BAM, CEP), depending on the settings.
Complex Event Processing in Oracle CEP
Process reporting in Oracle BAM
Simplified Illustration of Components and Interaction
SENACOR TECHNOLOGIES AG SEITE 17
DHL Use Case – A Logistics Use Case for EDBPM
Hurdle: Oracle BPEL Engine and SOPERA are running isolated from each other The SOPERA Web service has no information about the process which has executed the service CEP has no chance to connect events coming directly from BPEL with SOPERA Service events
Task: Connect the independent events
Solution: Enhancing the message payload with BPEL process information. BPELContent includes the filed “ProcessID” as an unique identifier for an executed process BPELContent is sent every time when a service is called during process execution. This mechanism closes
the gap between Oracle and SOPERA
Merging Event Information of Oracle and SOPERA
BPELContent
BPEL event
Service event
SENACOR TECHNOLOGIES AG SEITE 18
DHL Use Case – A Logistics Use Case for EDBPM
Intrusive generated events:
Service has to implement code for event generation
Disadvantage:
– Existing code has to be changed (e.g. a bank would not allow to change existing code)
– Business functionality and monitoring have to work independent. Service should provide only business functionality.
Advantage:
– Information which is not part of the payload can be used
Non-intrusive generated events:
Information is extracted out of the payload and the service with adapters and sensors. The extracted information has to be merged to an event.
Disadvantage:
Only payload and public service information can be part of an event
Advantage:
Service Code has not to be changed
Service has not to deal with monitoring functionality
SOPERA SOPERA
Differences in Event Generation
SENACOR TECHNOLOGIES AG SEITE 19
DHL Use Case – A Logistics Use Case for EDBPM
Aggregation and correlation to business level complex events
Complex Event
Traffic jam
Service executed
External EventProcess Event
Process started
Technical event Weather
Highway No.1, Monterey
Highway 101, Redwood City
Co
mp
lexi
ty
high
low
Business event
Package X delivered
Customer claim
Several event types influence the business process:
Process events: happening during process execution and Business events: providing business content, e. g. parcel allocated to truck Technical events: providing technical content, e. g. service not available
External events: events occur outside the business process, but also influencing the process, e. g. weather, traffic
SENACOR TECHNOLOGIES AG SEITE 20
CONCLUSION
The Paper Provides:
– First link between BPM and CEP
– Main concepts of both technologies in a general reference model for EDBPM
Summary:
– EDBPM is able to detect possible errors within a business process using CEP technology and alert responsible persons using BAM
– Added business value compared to pure BPM solutions
Perspective:
– Automatic reaction on errors has to be implemented in future solutions, e.g. conditional decision and reaction logic
– Additional use cases can be defined for various domains and first projects on the basis of such “Event Driven BPM” platforms start in 2008
– Research projects for a faster set-up of EDBPM are currently under preparation
Detailed Information:
– Further information about the PoC can be seen on www.citt-online.com in a video presentation hold on the 6th CEP/BAM expert meeting in Regensburg
SENACOR TECHNOLOGIES AG SEITE 21
Current research work and projects in ED-BPM
Tasks for the future
Analyzing different domains and provide CEP patterns and
best practices for each domain
Current PhD thesis:
Domain Specific Reference Models for Complex Event Processing Patterns in the domain of Finance/Banking (F. Springer)
Domain Specific Reference Models for Complex Event Processing Patterns in the Automotive Domain (C. Emmersberger)
Domain Specific Reference Models for Complex Event Processing Patterns in the Retail Domain (T. Paulus)
SENACOR TECHNOLOGIES AG SEITE 22
Backup
Backup
SENACOR TECHNOLOGIES AG SEITE 23
Architectural Project Overview
Complete Component Overview plus Event Could
SENACOR TECHNOLOGIES AG SEITE 24
Architectural Project Overview
SOPERA provides a standards-based framework for SOA solutions
A central Service Registry manages all services
Services can be deployed in Tomcat, JEE Application Servers
Service interfaces and bindings are described by plain WSDL documents instead of using the proprietary SOPERA descriptions
SOPERA Service
SENACOR TECHNOLOGIES AG SEITE 25
Architectural Project Overview
Oracle AS 10g contains the BPEL engine
Services are orchestrated through a BPEL process which is deployed on the BPEL Engine
SOPERA services are invoked by using partner links
Oracle BPEL
SENACOR TECHNOLOGIES AG SEITE 26
Architectural Project Overview
It is the binding component between SOPERA services and Oracle JMS Provider
Runs as a service within a Tomcat server Registered in the SOPERA service registry Passes events, generated by the service back
bone as well as the services to JMS provider
SOPERA Notification Receiver
SENACOR TECHNOLOGIES AG SEITE 27
Architectural Project Overview
Oracle BAM 10g runs within a Microsoft IIS environment
It pulls events from the JMS Provider through Enterprise Message Sources (EMS) and stores them into Data Sinks (DS)
Plans contain the description how the events are processed between an EMS and a DS
On top of the DS, BAM offers the ability to create real time dashboards
Oracle Business Activity Monitoring
SENACOR TECHNOLOGIES AG SEITE 28
Architectural Project Overview
Oracle Business Activity Monitoring
SENACOR TECHNOLOGIES AG SEITE 29
Architectural Project Overview
Oracle CEP offers the ability to fetch events from different event sources
Incoming events are queried in a SQL like language called CQL (Continous Query Language)
Based on the query result new events can be generated
The generated events are pushed on to output streams to be able to react on these events
Oracle Complex Event Processing
SENACOR TECHNOLOGIES AG SEITE 30
Financial Use Case for EDBPM
Financial Use Case for EDBPM
– Intended as a test of functionality demonstrating the applicability and usability of EDBPM for real-time monitoring of online business processes
– Application domain is monitoring the credit application easyCredit of Team Bank(German online credit system featuring instant credit application confirmation for customers)
– Focus on real-time monitoring of potential credit process cancellations
– Front-end components based on metrics and key performance indicators (KPIs) visualized in BAM dashboards
– For prototypical implementation, different CEP, BAM and Event Processing Languages (EPLs) have been analyzed, among them: Coral8, Systar, StreamBase, Tibco
H.-M. Brands, D. Guschakowski: Complex Event Processing in the context of Business Activity Monitoring, An evaluation of different approaches and tools taking the example of the Next Generation easyCredit
SENACOR TECHNOLOGIES AG SEITE 31
Open Source-Approach
AppServer BPM CEP Dashboard Comments
jBoss jBPM Esper Macromedia?
Packaged Approaches
AppServer BPM CEP Dashboard Comments
WebSphere ProcessServer
AMiT BusinessMonitor
Oracle Fusion Oracle Fusion Oracle Fusion Oracle Fusion
Tibco ESB Tibco BPM BE BE
BEA Weblogic ALBPM Coral8 ALBPM
______ _____ ______ Packaged or Best-of-Breed Approaches: Is predictive Business a Multi Vendors-Approach?
SENACOR TECHNOLOGIES AG SEITE 32
Best-of-Breed-Approaches
AppServer BPM CEP Dashboard Comments
jBoss jBPM AMiT BusinessMonitor
Weblogic ALBPM/WLI AptSoft AptSoft
Business Bridge
BusinessBridge
Coral8 IDS PPM or BAM
StreamBase StreamBase
Apama Apama
TEST
Packaged or Best-of-Breed Approaches: Is predictive Business a Multi Vendors-Approach?
SENACOR TECHNOLOGIES AG SEITE 33
EPL-Approaches Example
Pseudo-SQL INSERT INTO RawAlertsSELECT XMLElement("Events", XMLAgg(XMLElement("event", XMLAttributes(TO_STRING(BigQuotes.quote) AS "Quote", TO_STRING(BigQuotes.volume) AS "Volume", TO_STRING(BigQuotes.Ts, 'YYYY-MM-DD HH:MI') AS "EventTimeStamp"))) ) AS Events, InQuote.Quote AS Quote, SUM(BigQuotes.Quote) AS SumOfQuotesFROM InQuote AS BigQuotes KEEP 1 HOUR KEEP 3 ROWS , InQuoteHAVING InQuote.Volume > 300000 AND COUNT(*) >= 3OUTPUT EVERY 1 HOUR;
Special Rules Languages 1. u.<sell,x,y,q,h>.v.<buy,x,y',q',p> => u.v :-> <settlement,x,y',y,min(q,q'),h,p> if p>=h and nmatches(v , u'.<sell,x,_,_,h'>.v' if p>=h') = 02. u.<buy,x,y,q,p> => u if nmatches(u,<sell,x,_,_,h> if p<h) /*get rid of of bids that cannot be settled*/3. u.<sell,x,y,_,_>.v.<sell,x,y,q,p> => u.v.<sell,x,y,q,p> /*override sell requests by the same customer on the same item*/
Java- or other 3GL generated Code
Proprietary 4GL-based approaches
GUI-based approaches (graphical editors) and code generation
Packaged or Best-of-Breed Approaches: Is predictive Business a Multi Vendors-Approach?
SENACOR TECHNOLOGIES AG SEITE 34
EPL-Approaches CEP-platform Usability
Pseudo-SQL - Coral8 (CCL)- StreamBase (StreamSQL)- Esper (EQL)- Aleri- ?Oracle?
Special Rules Languages - AMiT- ?Apama?- Tibco- ?Oracle?
Java- or other 3GL generated Code - Tibco- Apama- ?Esper?- Aleri Studio- ?Oracle?
Proprietary 4GL-based approaches - ?Aleri XML?- ?
GUI-based approaches (graphical editors) and code generation
- ?AMIT?- ?Apama?- AptSoft- StreamBase
Packaged or Best-of-Breed Approaches: Is predictive Business a Multi Vendors-Approach?
SENACOR TECHNOLOGIES AG SEITE 35
EPL-Approaches CEP-platform Usability / User Type
Pseudo-SQL - Coral8 (CCL)- StreamBase (StreamSQL)- Esper (EQL)- Aleri- ?Oracle?
- skilled EPL-programmers- not the community of SQL-programmers?!
Special Rules Languages - AMiT- ?Apama?- Tibco- ?Oracle?
- skilled proprietary EPL-programmers- will never be a community
Java- or other 3GL generated Code - Tibco- Apama- Esper?- Aleri Studio- ?Oracle?
- community of Java-programmers
Proprietary 4GL-based approaches - ?Aleri XML?- ?
- skilled proprietary 4GL-programmers- will never be a community
GUI-based approaches (graphical editors) and code generation
- ?AMIT?- ?Apama?- AptSoft- StreamBase
- C-level managers?- marketing employees?- appropriate for all requirements of
applications?- only GUI or additionally to a EPL?
Packaged or Best-of-Breed Approaches: Is predictive Business a Multi Vendors-Approach?
SENACOR TECHNOLOGIES AG SEITE 36
Complex Event Processing in the retail domain
Scenario: Complex, heterogenous and distributed IT Landscape Multiple vendor-independent hard- and softwaresystems Multiplicator effect generates high ammount of bussines data Crossing with other domains ( Logistics, Finance, etc.)
Benefits: Shorter response time in case of failures and deviation;
based on event driven realtime-analysis of business-data and historical data
Proactive and predictive acting; based on combination of reference, historical and realtime data for detecting failures and deviation in realtime
Usecases: Realtime – Marketing Stock- and Order-Management Supply-Chain-Management Customer – Binding Hard- and Software-Monitoring
SENACOR TECHNOLOGIES AG SEITE 37
Analyzing historical data and
process dataCEP Lifecycle
React on errors within
business processes
Create CEP patterns detecting potential
errors
Company Strategy
Results of
Analysis
congnition of daily
operation