Why and how to engage a Complex Event Processor from a Java Web Application
3 likes451 views
This document discusses the integration of complex event processing (CEP) within Java web applications to analyze and manage real-time event streams from various sources. It explains how CEP can detect patterns, exceptions, and calculate aggregates by using continuous query language (CQL) on incoming event data. The document also provides examples of practical applications, such as monitoring temperature sensors and analyzing user interactions in a webshop, emphasizing the benefits of CEP for real-time insights and business intelligence.
1 of 39
![Derive intelligence from WebShop eventsActual Metrics: #searches in last 5 minutes, #buyers in the last 24 hours, #search-to-views drilldownsTop 10 search terms (in last [24] hour)Top 10 useless search termsAfter search on term there is no view eventMost Effective search termsSearch is followed by (one or more) view events and subsequently a buy eventItems frequently viewed but not often bought#buy/#views is ranks low](https://image.slidesharecdn.com/complexeventprocessinginjavaapps-100921182219-phpapp01/85/Why-and-how-to-engage-a-Complex-Event-Processor-from-a-Java-Web-Application-36-320.jpg)
Ad
Recommended
Oracle Cep Xstreams adapter
Oracle Cep Xstreams adapterMohit Thatte An XStreams adapter allows Oracle CEP to ingest and process events from an XStreams data stream. The adapter plugs into an event processing network to enable CEP queries over the streaming data. It can be used for applications like algorithmic trading, telecommunications monitoring, and RFID tracking where low latency event processing is important. A demo uses the adapter to run the Linear Road benchmark over sensor data from a simulated variable toll expressway system.
Data warehouse system and its concepts
Data warehouse system and its conceptsGaurav Garg The document provides a comprehensive overview of data warehousing, highlighting its definition, architecture, and the differences between operational databases and data warehouses. It discusses the key concepts of OLAP, data marts, and the backend processes involved in data extraction, transformation, and loading (ETL). Additionally, it covers schema types, multidimensional data models, and partitioning techniques for optimizing performance in large data warehouses.
OBIEE 11g: Configuring LDAP Server
OBIEE 11g: Configuring LDAP Server adivasoft The document provides a comprehensive guide on configuring an LDAP server for OBIEE 11g, detailing prerequisites, backup procedures, and potential troubleshooting steps. It outlines how to integrate an OpenLDAP directory, including adding a new LDAP provider in the WebLogic server and essential configurations required for successful authentication. Additionally, it emphasizes the importance of marking control flags as optional to prevent administrative lockout during the setup process.
OBIEE11g Multi User Development - MUD
OBIEE11g Multi User Development - MUDadivasoft The document outlines the Multi User Development (MUD) process for Oracle Business Intelligence Enterprise Edition (OBIEE) 11g, which allows multiple developers to work on application metadata stored in a centralized repository without overwriting each other's changes. It details the steps for setting up MUD, including defining projects, managing shared directories, and using command utilities for extracting and merging metadata changes. Additionally, it provides options for comparing, merging, and publishing changes within the MUD environment to ensure consistency and collaboration among developers.
ADF Worst Practices (UKOUG Tech2013)
ADF Worst Practices (UKOUG Tech2013)Wilfred van der Deijl The document outlines best and worst practices for developing ADF applications, focusing on challenges faced by various roles including developers and graphic designers. Key issues highlighted include adherence to coding guidelines, proper use of memory scopes, and effective debugging techniques. It emphasizes the importance of collaboration among team members to maintain quality and performance in ADF projects.
Obiee and database performance tuning
Obiee and database performance tuningAmit Sharma The document discusses performance tuning techniques for Oracle Business Intelligence Enterprise Edition (OBIEE) dashboards, highlighting that most performance issues stem from database inefficiencies rather than OBIEE itself. It details various tuning methods such as gathering statistics, enabling star transformations, and utilizing bitmap indexes, along with the outcomes of performance tests conducted on fabricated data models. The results demonstrate varying degrees of success, with some techniques leading to significant improvements while others proved detrimental or had minimal impact.
Complex Event Processor 3.0.0 - An overview of upcoming features
Complex Event Processor 3.0.0 - An overview of upcoming features WSO2 This document provides an overview of upcoming features in WSO2 Complex Event Processor 3.0.0. It discusses the Siddhi CEP engine, event processing queries including filters, windows, joins, patterns and event tables. It also covers high availability, persistence, scaling, integration with BAM, and performance comparisons with Esper. The document concludes with a demo of monitoring stock prices and tweets to detect significant stock price changes when a company is highly discussed on Twitter.
Complex Event Processing
Complex Event ProcessingJohn Plummer Complex Event Processing (CEP) involves detecting patterns in streams of event data. CEP tools analyze multiple simple events to identify complex events inferred from simpler ones. Typical applications of CEP include monitoring for business anomalies, detecting fraud or security threats. CEP augments service-oriented architectures by allowing services to trigger from events and generate new event streams. Event processing engines use techniques like filtering, windows, and correlation to detect patterns across events over time.
WSO2 Product Release Webinar - WSO2 Complex Event Processor
WSO2 Product Release Webinar - WSO2 Complex Event ProcessorWSO2 This document provides an overview and agenda for a webinar on the WSO2 CEP 3.1.0 product release. It introduces the presenters, Sriskandarajah Suhothayan and Lasantha Fernando. It also provides background on WSO2, an overview of the WSO2 CEP architecture including event streams, execution plans, and the Siddhi query language. The agenda outlines topics like event processing scenarios, new features in 3.1.0, high availability, and a demo.
WSO2 Product Release Webinar - Introducing the WSO2 Complex Event Processor
WSO2 Product Release Webinar - Introducing the WSO2 Complex Event Processor WSO2 - The document summarizes a webinar about WSO2 Complex Event Processor (CEP) 2.0.1.
- It introduces CEP and the Siddhi runtime engine, describes the WSO2 CEP architecture including brokers, buckets, and management UI.
- Performance tests show WSO2 CEP can process a high throughput of events. Features like high availability, persistence, scaling, and integration with BAM are covered.
- A demo scenario is presented to detect significant stock price changes and high Twitter mentions within a minute using CEP queries.
Real Time Event Processing and In-memory analysis of Big Data - StampedeCon ...
Real Time Event Processing and In-memory analysis of Big Data - StampedeCon ...StampedeCon The document discusses the importance of event processing in managing big data, highlighting its ability to handle high throughput, low latency processing, and real-time analysis of continuous data streams. It explains how event processing infrastructure supports improved data management by filtering, aggregating, and correlating data to provide relevant insights, thus facilitating better decision-making across various industries like transportation, utilities, and customer experience. The architecture leverages in-memory data grids and integrates with existing technologies to optimize responsiveness and efficiency in processing real-time events.
st - demystifying complext event processing
st - demystifying complext event processingGeoffrey De Smet This document provides an overview and definitions of key concepts related to complex event processing (CEP). It defines events, complex events, CEP, event-driven architecture (EDA), and how CEP relates to EDA and service-oriented architecture (SOA). It also outlines common CEP requirements, how events are viewed from a business rules perspective, characteristics of CEP scenarios, and major CEP market players. The document is intended as a crash course on CEP concepts for business technology professionals.
Introducing the WSO2 Complex Event Processor
Introducing the WSO2 Complex Event ProcessorWSO2 This document provides an overview of complex event processing (CEP) and the WSO2 CEP server. It discusses CEP concepts like event streams, queries, and patterns. It also describes the Siddhi query language and runtime that is used by WSO2 CEP to process events. Finally, it demonstrates how WSO2 CEP can be used to monitor stock exchange and social media data to detect market moving events.
eBiz#3: CEP
eBiz#3: CEPYulian Slobodyan The document outlines the fundamentals and applications of Complex Event Processing (CEP), explaining its significance in various systems like patient monitoring and fraud detection. It distinguishes CEP from other event-processing frameworks, such as Business Rule Management Systems (BRMS) and Business Process Management (BPM), and discusses event handling principles including stateful and stateless processing. Additionally, it covers industry trends and key engineering players in the CEP landscape.
Data to Insight in a Flash: Introduction to Real-Time Analytics with WSO2 Com...
Data to Insight in a Flash: Introduction to Real-Time Analytics with WSO2 Com...WSO2 The document provides a comprehensive overview of real-time analytics using WSO2 Complex Event Processor (CEP), detailing its capabilities in processing events from various sources, defining event streams, and executing complex queries. It covers architecture, event processing patterns, Siddhi query structures, and integration with machine learning and natural language processing. Additionally, it includes case studies demonstrating the application of WSO2 CEP in smart energy and real-time soccer analytics.
EDA With Glassfish ESB Jfall IEP Intelligent Event Processing
EDA With Glassfish ESB Jfall IEP Intelligent Event ProcessingEugene Bogaart The document provides an introduction to event-driven architecture (EDA) and complex event processing (CEP) using GlassFish ESB, aiming to demonstrate how EDA helps in producing, detecting, consuming, and acting upon events. It covers the fundamentals of EDA, differences between CEP and event stream processing (ESP), and includes practical examples such as stock fraud detection and suspicious activity in lotteries. It emphasizes the importance of EDA alongside service-oriented architecture (SOA) to address modern challenges.
Complex Event Processing with Esper
Complex Event Processing with EsperTed Won The document explains complex event processing (CEP), emphasizing its ability to analyze and respond to real-time data streams, often measured in nanoseconds. It highlights various application use cases across industries such as retail and finance, and differentiates between terminology like event stream processing (ESP) and simple event processing (SEP). Additionally, it outlines CEP architecture, event types, processing languages, and key considerations for developing high-performance CEP applications.
Applying complex event processing (2010-10-11)
Applying complex event processing (2010-10-11)Geoffrey De Smet The document discusses Complex Event Processing (CEP) and its associated terminology, techniques, and applications, particularly emphasizing how CEP identifies meaningful events from large data streams. It covers concepts like event correlation, temporal reasoning, and the integration between CEP and Event Stream Processing (ESP), presenting practical examples such as fraud detection and logistics solutions. Additionally, it introduces Drools Fusion, a platform enabling the modeling of complex event scenarios, focusing on characteristics like event semantics, temporal constraints, and memory management.
Enabling predictive analysis in service oriented BPM solutions.
Enabling predictive analysis in service oriented BPM solutions.Mindtree Ltd. The document discusses Complex Event Processing (CEP) as a mechanism for real-time event analysis and correlation, designed to enhance Service-Oriented Business Process Management (BPM) solutions. It highlights the role of CEP in predicting high-level events from low-level factors, supports automated decision-making processes, and integrates with Business Activity Monitoring (BAM) for proactive enterprise risk and opportunity management. The paper further explores the relationship between CEP and Service-Oriented Architecture (SOA), detailing its applications in areas such as financial services and security, while also examining the current market status of CEP platforms.
Microsoft SQL Server - StreamInsight Overview Presentation
Microsoft SQL Server - StreamInsight Overview PresentationMicrosoft Private Cloud This document provides an overview of Microsoft's StreamInsight Complex Event Processing (CEP) platform. It discusses CEP concepts and benefits, the StreamInsight architecture and development environment, and deployment scenarios. The presentation aims to introduce IT professionals to CEP and Microsoft's StreamInsight solution for building event-driven applications that process streaming data with low latency.
FIWARE CEP GE introduction, ICT 2015
FIWARE CEP GE introduction, ICT 2015ishkin The document discusses complex event processing (CEP) technology and the CEP GE instance available in FIWARE. It provides an overview of CEP's event-condition-action paradigm and how it can detect patterns over incoming events. It also describes how to define event types, processing rules, contexts and producers/consumers in the CEP GE's web interface. Finally, it provides an example of detecting a denial of service attack by defining an event processing agent to detect increasing traffic report events over time.
Event Stream Processing SAP
Event Stream Processing SAPGaurav Ahluwalia This document provides an introduction to Sybase Event Stream Processing (ESP). ESP is a technology for analyzing streams of event data in real-time to derive continuous intelligence. It allows defining logic to combine data sources, compute values, detect patterns, and produce summaries. The ESP runtime continuously processes incoming event streams before storing to disk, enabling low latency analysis. It is not a replacement for databases but rather complements them by supporting continuous, real-time analysis of fast data streams. ESP uses data-flow programming where streams and operations on the data are defined as it flows from sources to outputs.
Processing Patterns for Predictive Business
Processing Patterns for Predictive BusinessTim Bass The document discusses processing patterns for predictive business event processing. It introduces an event-decision architecture with multiple levels of inference including event refinement, situation refinement, impact assessment, and process refinement. Common inference algorithms like Bayesian belief networks are described. Finally, recurring patterns are mapped that apply classical inference techniques like Bayesian networks to business contexts like fraud detection, intrusion detection, and opportunistic trading.
Combating Fraud and Intrusion Threats with Event Processing
Combating Fraud and Intrusion Threats with Event ProcessingTim Bass The document discusses the application of Complex Event Processing (CEP) in Security Event Management (SEM) to enhance threat detection and response capabilities for businesses. It outlines the weaknesses in existing SEM architectures, such as lack of secure communication infrastructure and insufficient analytics, while proposing a more scalable and automated framework using CEP. It also highlights the importance of real-time event processing and correlation of data from multiple sources to improve situational awareness and threat management.
Moteur CEP
Moteur CEPFawaz Fernand PARAISO Complex Event Processing (CEP) is a technique that analyzes events to detect complex patterns. CEP engines receive events from producers, filter and transform them, detect patterns across events, and send derived events to consumers. CEP with Canopsis allows for real-time event analysis, flexible monitoring of services, and better scaling of infrastructure by processing events quickly in memory.
Open Source Event Processing for Sensor Fusion Applications
Open Source Event Processing for Sensor Fusion Applicationsguestc4ce526 The document outlines key concepts in sensor fusion and complex event processing (CEP) relevant to robotics, emphasizing the need for integrating diverse sensory data to improve situational awareness and decision-making. It introduces principles for dynamic world modeling, the predict-match-update cycle for fusing sensor readings, and contrasts service-oriented architecture with event-driven architecture in software development. Additionally, it presents the Esper CEP engine as a robust open-source tool for real-time event processing and provides examples of event patterns and queries using its event processing language.
Processing Patterns for PredictiveBusiness
Processing Patterns for PredictiveBusinessTim Bass The document discusses predictive business and complex event processing (CEP), highlighting the need for advanced event-decision architecture due to the computationally intensive nature of CEP. It outlines various scenarios where predictive business can be applied, such as fraud detection and network monitoring, and emphasizes the importance of distributed computing and real-time processing. Additionally, it explores the hierarchical nature of inference processing and the necessity for specialized systems to handle data in motion and data at rest.
CEP: Event-Decision Architecture for PredictiveBusiness, July 2006
CEP: Event-Decision Architecture for PredictiveBusiness, July 2006Tim Bass The document discusses the event-decision architecture for complex event processing (CEP) as applied in various business scenarios, emphasizing the need for a common vocabulary and functional architecture due to the computational intensity and complexity of CEP. It reviews various use cases, such as fraud detection in finance and other industries, while illustrating a multi-level inference approach for real-time data processing. TIBCO's solutions are positioned to meet these CEP challenges and enhance decision-making processes in businesses.
Introduction to web application development with Vue (for absolute beginners)...
Introduction to web application development with Vue (for absolute beginners)...Lucas Jellema The document provides a rapid introduction to web application development with Vue 3, assuming basic knowledge of HTML and JavaScript, and outlines the course agenda, including components, reactive data binding, and state management. Participants will develop a modern web application and learn how to publish it on GitHub pages. The content emphasizes Vue's ease of use, popularity, and the benefits of component-based architecture.
Making the Shift Left - Bringing Ops to Dev before bringing applications to p...
Making the Shift Left - Bringing Ops to Dev before bringing applications to p...Lucas Jellema The document discusses bringing operations considerations into the development process earlier, referred to as "shifting left." It advocates designing applications with operations in mind from the beginning. This includes understanding operational objectives, constraints, and service level agreements. Application telemetry and monitoring are also important to incorporate from the start. The document provides examples of how to implement operational practices like deployments, health checks, and incident response processes in a shifted left model where development and operations work more closely together.
More Related Content
Similar to Why and how to engage a Complex Event Processor from a Java Web Application (20)
WSO2 Product Release Webinar - WSO2 Complex Event Processor
WSO2 Product Release Webinar - WSO2 Complex Event ProcessorWSO2 This document provides an overview and agenda for a webinar on the WSO2 CEP 3.1.0 product release. It introduces the presenters, Sriskandarajah Suhothayan and Lasantha Fernando. It also provides background on WSO2, an overview of the WSO2 CEP architecture including event streams, execution plans, and the Siddhi query language. The agenda outlines topics like event processing scenarios, new features in 3.1.0, high availability, and a demo.
WSO2 Product Release Webinar - Introducing the WSO2 Complex Event Processor
WSO2 Product Release Webinar - Introducing the WSO2 Complex Event Processor WSO2 - The document summarizes a webinar about WSO2 Complex Event Processor (CEP) 2.0.1.
- It introduces CEP and the Siddhi runtime engine, describes the WSO2 CEP architecture including brokers, buckets, and management UI.
- Performance tests show WSO2 CEP can process a high throughput of events. Features like high availability, persistence, scaling, and integration with BAM are covered.
- A demo scenario is presented to detect significant stock price changes and high Twitter mentions within a minute using CEP queries.
Real Time Event Processing and In-memory analysis of Big Data - StampedeCon ...
Real Time Event Processing and In-memory analysis of Big Data - StampedeCon ...StampedeCon The document discusses the importance of event processing in managing big data, highlighting its ability to handle high throughput, low latency processing, and real-time analysis of continuous data streams. It explains how event processing infrastructure supports improved data management by filtering, aggregating, and correlating data to provide relevant insights, thus facilitating better decision-making across various industries like transportation, utilities, and customer experience. The architecture leverages in-memory data grids and integrates with existing technologies to optimize responsiveness and efficiency in processing real-time events.
st - demystifying complext event processing
st - demystifying complext event processingGeoffrey De Smet This document provides an overview and definitions of key concepts related to complex event processing (CEP). It defines events, complex events, CEP, event-driven architecture (EDA), and how CEP relates to EDA and service-oriented architecture (SOA). It also outlines common CEP requirements, how events are viewed from a business rules perspective, characteristics of CEP scenarios, and major CEP market players. The document is intended as a crash course on CEP concepts for business technology professionals.
Introducing the WSO2 Complex Event Processor
Introducing the WSO2 Complex Event ProcessorWSO2 This document provides an overview of complex event processing (CEP) and the WSO2 CEP server. It discusses CEP concepts like event streams, queries, and patterns. It also describes the Siddhi query language and runtime that is used by WSO2 CEP to process events. Finally, it demonstrates how WSO2 CEP can be used to monitor stock exchange and social media data to detect market moving events.
eBiz#3: CEP
eBiz#3: CEPYulian Slobodyan The document outlines the fundamentals and applications of Complex Event Processing (CEP), explaining its significance in various systems like patient monitoring and fraud detection. It distinguishes CEP from other event-processing frameworks, such as Business Rule Management Systems (BRMS) and Business Process Management (BPM), and discusses event handling principles including stateful and stateless processing. Additionally, it covers industry trends and key engineering players in the CEP landscape.
Data to Insight in a Flash: Introduction to Real-Time Analytics with WSO2 Com...
Data to Insight in a Flash: Introduction to Real-Time Analytics with WSO2 Com...WSO2 The document provides a comprehensive overview of real-time analytics using WSO2 Complex Event Processor (CEP), detailing its capabilities in processing events from various sources, defining event streams, and executing complex queries. It covers architecture, event processing patterns, Siddhi query structures, and integration with machine learning and natural language processing. Additionally, it includes case studies demonstrating the application of WSO2 CEP in smart energy and real-time soccer analytics.
EDA With Glassfish ESB Jfall IEP Intelligent Event Processing
EDA With Glassfish ESB Jfall IEP Intelligent Event ProcessingEugene Bogaart The document provides an introduction to event-driven architecture (EDA) and complex event processing (CEP) using GlassFish ESB, aiming to demonstrate how EDA helps in producing, detecting, consuming, and acting upon events. It covers the fundamentals of EDA, differences between CEP and event stream processing (ESP), and includes practical examples such as stock fraud detection and suspicious activity in lotteries. It emphasizes the importance of EDA alongside service-oriented architecture (SOA) to address modern challenges.
Complex Event Processing with Esper
Complex Event Processing with EsperTed Won The document explains complex event processing (CEP), emphasizing its ability to analyze and respond to real-time data streams, often measured in nanoseconds. It highlights various application use cases across industries such as retail and finance, and differentiates between terminology like event stream processing (ESP) and simple event processing (SEP). Additionally, it outlines CEP architecture, event types, processing languages, and key considerations for developing high-performance CEP applications.
Applying complex event processing (2010-10-11)
Applying complex event processing (2010-10-11)Geoffrey De Smet The document discusses Complex Event Processing (CEP) and its associated terminology, techniques, and applications, particularly emphasizing how CEP identifies meaningful events from large data streams. It covers concepts like event correlation, temporal reasoning, and the integration between CEP and Event Stream Processing (ESP), presenting practical examples such as fraud detection and logistics solutions. Additionally, it introduces Drools Fusion, a platform enabling the modeling of complex event scenarios, focusing on characteristics like event semantics, temporal constraints, and memory management.
Enabling predictive analysis in service oriented BPM solutions.
Enabling predictive analysis in service oriented BPM solutions.Mindtree Ltd. The document discusses Complex Event Processing (CEP) as a mechanism for real-time event analysis and correlation, designed to enhance Service-Oriented Business Process Management (BPM) solutions. It highlights the role of CEP in predicting high-level events from low-level factors, supports automated decision-making processes, and integrates with Business Activity Monitoring (BAM) for proactive enterprise risk and opportunity management. The paper further explores the relationship between CEP and Service-Oriented Architecture (SOA), detailing its applications in areas such as financial services and security, while also examining the current market status of CEP platforms.
Microsoft SQL Server - StreamInsight Overview Presentation
Microsoft SQL Server - StreamInsight Overview PresentationMicrosoft Private Cloud This document provides an overview of Microsoft's StreamInsight Complex Event Processing (CEP) platform. It discusses CEP concepts and benefits, the StreamInsight architecture and development environment, and deployment scenarios. The presentation aims to introduce IT professionals to CEP and Microsoft's StreamInsight solution for building event-driven applications that process streaming data with low latency.
FIWARE CEP GE introduction, ICT 2015
FIWARE CEP GE introduction, ICT 2015ishkin The document discusses complex event processing (CEP) technology and the CEP GE instance available in FIWARE. It provides an overview of CEP's event-condition-action paradigm and how it can detect patterns over incoming events. It also describes how to define event types, processing rules, contexts and producers/consumers in the CEP GE's web interface. Finally, it provides an example of detecting a denial of service attack by defining an event processing agent to detect increasing traffic report events over time.
Event Stream Processing SAP
Event Stream Processing SAPGaurav Ahluwalia This document provides an introduction to Sybase Event Stream Processing (ESP). ESP is a technology for analyzing streams of event data in real-time to derive continuous intelligence. It allows defining logic to combine data sources, compute values, detect patterns, and produce summaries. The ESP runtime continuously processes incoming event streams before storing to disk, enabling low latency analysis. It is not a replacement for databases but rather complements them by supporting continuous, real-time analysis of fast data streams. ESP uses data-flow programming where streams and operations on the data are defined as it flows from sources to outputs.
Processing Patterns for Predictive Business
Processing Patterns for Predictive BusinessTim Bass The document discusses processing patterns for predictive business event processing. It introduces an event-decision architecture with multiple levels of inference including event refinement, situation refinement, impact assessment, and process refinement. Common inference algorithms like Bayesian belief networks are described. Finally, recurring patterns are mapped that apply classical inference techniques like Bayesian networks to business contexts like fraud detection, intrusion detection, and opportunistic trading.
Combating Fraud and Intrusion Threats with Event Processing
Combating Fraud and Intrusion Threats with Event ProcessingTim Bass The document discusses the application of Complex Event Processing (CEP) in Security Event Management (SEM) to enhance threat detection and response capabilities for businesses. It outlines the weaknesses in existing SEM architectures, such as lack of secure communication infrastructure and insufficient analytics, while proposing a more scalable and automated framework using CEP. It also highlights the importance of real-time event processing and correlation of data from multiple sources to improve situational awareness and threat management.
Moteur CEP
Moteur CEPFawaz Fernand PARAISO Complex Event Processing (CEP) is a technique that analyzes events to detect complex patterns. CEP engines receive events from producers, filter and transform them, detect patterns across events, and send derived events to consumers. CEP with Canopsis allows for real-time event analysis, flexible monitoring of services, and better scaling of infrastructure by processing events quickly in memory.
Open Source Event Processing for Sensor Fusion Applications
Open Source Event Processing for Sensor Fusion Applicationsguestc4ce526 The document outlines key concepts in sensor fusion and complex event processing (CEP) relevant to robotics, emphasizing the need for integrating diverse sensory data to improve situational awareness and decision-making. It introduces principles for dynamic world modeling, the predict-match-update cycle for fusing sensor readings, and contrasts service-oriented architecture with event-driven architecture in software development. Additionally, it presents the Esper CEP engine as a robust open-source tool for real-time event processing and provides examples of event patterns and queries using its event processing language.
Processing Patterns for PredictiveBusiness
Processing Patterns for PredictiveBusinessTim Bass The document discusses predictive business and complex event processing (CEP), highlighting the need for advanced event-decision architecture due to the computationally intensive nature of CEP. It outlines various scenarios where predictive business can be applied, such as fraud detection and network monitoring, and emphasizes the importance of distributed computing and real-time processing. Additionally, it explores the hierarchical nature of inference processing and the necessity for specialized systems to handle data in motion and data at rest.
CEP: Event-Decision Architecture for PredictiveBusiness, July 2006
CEP: Event-Decision Architecture for PredictiveBusiness, July 2006Tim Bass The document discusses the event-decision architecture for complex event processing (CEP) as applied in various business scenarios, emphasizing the need for a common vocabulary and functional architecture due to the computational intensity and complexity of CEP. It reviews various use cases, such as fraud detection in finance and other industries, while illustrating a multi-level inference approach for real-time data processing. TIBCO's solutions are positioned to meet these CEP challenges and enhance decision-making processes in businesses.
More from Lucas Jellema (20)
Introduction to web application development with Vue (for absolute beginners)...
Introduction to web application development with Vue (for absolute beginners)...Lucas Jellema The document provides a rapid introduction to web application development with Vue 3, assuming basic knowledge of HTML and JavaScript, and outlines the course agenda, including components, reactive data binding, and state management. Participants will develop a modern web application and learn how to publish it on GitHub pages. The content emphasizes Vue's ease of use, popularity, and the benefits of component-based architecture.
Making the Shift Left - Bringing Ops to Dev before bringing applications to p...
Making the Shift Left - Bringing Ops to Dev before bringing applications to p...Lucas Jellema The document discusses bringing operations considerations into the development process earlier, referred to as "shifting left." It advocates designing applications with operations in mind from the beginning. This includes understanding operational objectives, constraints, and service level agreements. Application telemetry and monitoring are also important to incorporate from the start. The document provides examples of how to implement operational practices like deployments, health checks, and incident response processes in a shifted left model where development and operations work more closely together.
Lightweight coding in powerful Cloud Development Environments (DigitalXchange...
Lightweight coding in powerful Cloud Development Environments (DigitalXchange...Lucas Jellema The document discusses lightweight coding in powerful cloud development environments using Gitpod. It describes Gitpod as providing a preconfigured Linux development environment in the browser or on local machine. The document outlines key Gitpod features like open source project collaboration, costs which are free for 50 hours per month, and benefits like clean environments and efficient resource usage. It also briefly mentions other tools like GitHub Codespaces.
Apache Superset - open source data exploration and visualization (Conclusion ...
Apache Superset - open source data exploration and visualization (Conclusion ...Lucas Jellema Apache Superset is an open-source data exploration and visualization platform that allows users to connect to any SQL data source and create visualizations and dashboards. Originally developed at Airbnb, it has evolved with a robust technology stack and is widely used in various companies. Its features include customizable visualizations, dashboard publishing, user-friendly interfaces, and fine-grained security controls.
CONNECTING THE REAL WORLD TO ENTERPRISE IT – HOW IoT DRIVES OUR ENERGY TRANSI...
CONNECTING THE REAL WORLD TO ENTERPRISE IT – HOW IoT DRIVES OUR ENERGY TRANSI...Lucas Jellema The document discusses the integration of Internet of Things (IoT) technologies within enterprise IT systems, focusing on their application in energy management, particularly for curtailing electricity production and optimizing heat distribution. It highlights the necessity of real-time data measurement and processing to enhance operational efficiency, alongside the architectural choices and operational needs of IoT systems within the energy sector. The conclusion emphasizes that IoT represents a significant advancement in data integration, promising increased speed and reliability in operations while illustrating the potential for rapid growth in relevant use cases.
Help me move away from Oracle - or not?! (Oracle Community Tour EMEA - LVOUG...
Help me move away from Oracle - or not?! (Oracle Community Tour EMEA - LVOUG...Lucas Jellema The document discusses the challenges and considerations for organizations looking to migrate away from Oracle technology. It highlights the complexity of such migrations, including the importance of analyzing costs and benefits, as well as the necessity of modernizing application architecture and leveraging new technologies. The author provides recommendations for organizations to manage their technical debt and enhance business value through IT systems.
Op je vingers tellen... tot 1000!
Op je vingers tellen... tot 1000!Lucas Jellema Een korte introductie in het binair (tweetallig) stelsel uitmondend in een tip om op je vingers te tellen tot 1023 (en met een truc tot 2047).
IoT - from prototype to enterprise platform (DigitalXchange 2022)
IoT - from prototype to enterprise platform (DigitalXchange 2022)Lucas Jellema The document discusses the transition of IoT from prototype to an enterprise platform, focusing on its application in the energy sector over three years with multiple business cases. It emphasizes the importance of real-time data measurement and the integration of operational technology with enterprise IT systems to enhance energy management processes. Additionally, it outlines the architecture principles and the scalability of the IoT platform implemented on Microsoft Azure.
Who Wants to Become an IT Architect-A Look at the Bigger Picture - DigitalXch...
Who Wants to Become an IT Architect-A Look at the Bigger Picture - DigitalXch...Lucas Jellema The document provides an overview of the role and responsibilities of an IT architect, highlighting the importance of understanding technology, managing technical debt, and collaborating effectively with teams. It emphasizes the necessity for architects to stay updated with trends and technologies while balancing various constraints such as budget and time. Additionally, the document discusses methodologies for achieving successful architecture in agile environments and the need for continuous improvement in technical practices.
Steampipe - use SQL to retrieve data from cloud, platforms and files (Code Ca...
Steampipe - use SQL to retrieve data from cloud, platforms and files (Code Ca...Lucas Jellema Steampipe is a tool that provides a SQL interface to external data sources, allowing users to retrieve and visualize metadata from various services through PostgreSQL. It offers features such as querying multiple data formats (CSV, JSON, etc.), creating dashboards, and running benchmarks for security and compliance. Overall, it is valuable for development and operations but not intended for runtime data retrieval in applications.
Automation of Software Engineering with OCI DevOps Build and Deployment Pipel...
Automation of Software Engineering with OCI DevOps Build and Deployment Pipel...Lucas Jellema The document provides an overview of automating software engineering with OCI DevOps during the APAC OCI Days 2022. It covers deployment pipelines, build processes, and the integration of various tools like container image registries and code repositories within OCI. The conclusion emphasizes the importance of automation for efficient software build and deployment, highlighting the features and benefits of OCI DevOps.
Introducing Dapr.io - the open source personal assistant to microservices and...
Introducing Dapr.io - the open source personal assistant to microservices and...Lucas Jellema The document provides an overview of Dapr, an open-source distributed application runtime designed to simplify building applications and microservices. It covers Dapr's capabilities, including state management, service invocation, pub/sub messaging, and observability features, along with practical examples of HTTP and gRPC interactions. Additionally, it discusses the integration of Dapr with various components and its deployment in different environments like Kubernetes and Docker.
How and Why you can and should Participate in Open Source Projects (AMIS, Sof...
How and Why you can and should Participate in Open Source Projects (AMIS, Sof...Lucas Jellema The document outlines the importance and methods for contributing to open-source projects, highlighting various well-known products and the process of participation. It covers motivations for contribution, barriers faced by potential contributors, practical engagement steps with projects like Dapr, and experiences from the author's contributions to state store components for Oracle Cloud. Additionally, it emphasizes the learning opportunities and community interactions that arise from active involvement in open-source development.
Microservices, Apache Kafka, Node, Dapr and more - Part Two (Fontys Hogeschoo...
Microservices, Apache Kafka, Node, Dapr and more - Part Two (Fontys Hogeschoo...Lucas Jellema The document discusses the implementation and concepts of microservices using Apache Kafka, Node.js, and Dapr, focusing on system interactions and real-world use cases. It outlines Kafka's role as a reliable event broker, enabling asynchronous communication and efficient data processing across various applications. The content emphasizes hands-on experiences with setup, programming, and practical applications in data engineering and system integration.
Microservices, Node, Dapr and more - Part One (Fontys Hogeschool, Spring 2022)
Microservices, Node, Dapr and more - Part One (Fontys Hogeschool, Spring 2022)Lucas Jellema The document discusses the implementation and benefits of microservices architecture using Node.js and Dapr, highlighting their design, interaction, and operational advantages. It covers essential topics like state management, communication via HTTP/gRPC, and asynchronous message handling with Apache Kafka. The content is oriented towards developers, providing practical insights and hands-on sessions for efficiently utilizing these technologies in real-world applications.
6Reinventing Oracle Systems in a Cloudy World (RMOUG Trainingdays, February 2...
6Reinventing Oracle Systems in a Cloudy World (RMOUG Trainingdays, February 2...Lucas Jellema The document discusses the challenges faced by a Dutch company with legacy Oracle systems and their ongoing cloud transformation using hybrid and multi-cloud strategies. It details various migration options under the '6R' framework (Retire, Retain, Rehost, Replatform, Refactor, Repurchase) to modernize legacy applications and infrastructure while considering factors like TCO, security, and technical debt. The conclusion emphasizes that transitioning to the cloud is complex and requires thoughtful planning to ensure alignment with business goals and technology evolution.
Help me move away from Oracle! (RMOUG Training Days 2022, February 2022)
Help me move away from Oracle! (RMOUG Training Days 2022, February 2022)Lucas Jellema The document discusses the challenges and strategies for organizations looking to transition away from Oracle technologies. It emphasizes the importance of evaluating current systems, managing technical debt, modernizing application architectures, and leveraging new technologies. Recommendations include focusing on business value, automating IT processes, and embracing contemporary development practices.
Tech Talks 101 - DevOps (jan 2022)
Tech Talks 101 - DevOps (jan 2022)Lucas Jellema DevOps is a term used in many places and unfortunately also to mean many different things. This presentation (largely in Dutch) paints the DevOps picture. While it may not give a clear cut definition (there does not seem to be one) it certainly makes clear what DevOps is about, what objectives and origins are and which factors enable and drive DevOps.
Conclusion Code Cafe - Microcks for Mocking and Testing Async APIs (January 2...
Conclusion Code Cafe - Microcks for Mocking and Testing Async APIs (January 2...Lucas Jellema The document discusses the use of Microcks for testing and mocking asynchronous APIs with AsyncAPI definitions. It outlines how Microcks can generate mock implementations, validate API contracts, and facilitate testing of event-driven architectures across various protocols like Kafka, MQTT, and WebSocket. Key features include automatic message structure validation, documentation generation, and the ability to publish and consume mock messages in development environments.
Cloud Native Application Development - build fast, low TCO, scalable & agile ...
Cloud Native Application Development - build fast, low TCO, scalable & agile ...Lucas Jellema The document provides a comprehensive overview of cloud-native application development using Oracle Cloud, highlighting its infrastructure, services, and capabilities for building scalable, agile software solutions. It discusses various components such as serverless functions, data management, and integration with APIs, emphasizing the importance of automated processes and security. Additionally, it addresses best practices for leveraging cloud services while maintaining flexibility and minimizing vendor lock-in.
Ad
Recently uploaded (20)
“MPU+: A Transformative Solution for Next-Gen AI at the Edge,” a Presentation...
“MPU+: A Transformative Solution for Next-Gen AI at the Edge,” a Presentation...Edge AI and Vision Alliance For the full video of this presentation, please visit: https://www.edge-ai-vision.com/2025/06/mpu-a-transformative-solution-for-next-gen-ai-at-the-edge-a-presentation-from-fotonation/
Petronel Bigioi, CEO of FotoNation, presents the “MPU+: A Transformative Solution for Next-Gen AI at the Edge” tutorial at the May 2025 Embedded Vision Summit.
In this talk, Bigioi introduces MPU+, a novel programmable, customizable low-power platform for real-time, localized intelligence at the edge. The platform includes an AI-augmented image signal processor that enables leading image and video quality.
In addition, it integrates ultra-low-power object and motion detection capabilities to enable always-on computer vision. A programmable neural processor provides flexibility to efficiently implement new neural networks. And additional specialized engines facilitate image stabilization and audio enhancements.
Coordinated Disclosure for ML - What's Different and What's the Same.pdf
Coordinated Disclosure for ML - What's Different and What's the Same.pdfPriyanka Aash Coordinated Disclosure for ML - What's Different and What's the Same
The Future of Technology: 2025-2125 by Saikat Basu.pdf
The Future of Technology: 2025-2125 by Saikat Basu.pdfSaikat Basu A peek into the next 100 years of technology. From Generative AI to Global AI networks to Martian Colonisation to Interstellar exploration to Industrial Nanotechnology to Artificial Consciousness, this is a journey you don't want to miss. Which ones excite you the most? Which ones are you apprehensive about? Feel free to comment! Let the conversation begin!
Connecting Data and Intelligence: The Role of FME in Machine Learning
Connecting Data and Intelligence: The Role of FME in Machine LearningSafe Software In this presentation, we want to explore powerful data integration and preparation for Machine Learning. FME is known for its ability to manipulate and transform geospatial data, connecting diverse data sources into efficient and automated workflows. By integrating FME with Machine Learning techniques, it is possible to transform raw data into valuable insights faster and more accurately, enabling intelligent analysis and data-driven decision making.
Salesforce Summer '25 Release Frenchgathering.pptx.pdf
Salesforce Summer '25 Release Frenchgathering.pptx.pdfyosra Saidani Salesforce Summer '25 Release Frenchgathering.pptx.pdf
UserCon Belgium: Honey, VMware increased my bill
UserCon Belgium: Honey, VMware increased my billstijn40 VMware’s pricing changes have forced organizations to rethink their datacenter cost management strategies. While FinOps is commonly associated with cloud environments, the FinOps Foundation has recently expanded its framework to include Scopes—and Datacenter is now officially part of the equation. In this session, we’ll map the FinOps Framework to a VMware-based datacenter, focusing on cost visibility, optimization, and automation. You’ll learn how to track costs more effectively, rightsize workloads, optimize licensing, and drive efficiency—all without migrating to the cloud. We’ll also explore how to align IT teams, finance, and leadership around cost-aware decision-making for on-prem environments. If your VMware bill keeps increasing and you need a new approach to cost management, this session is for you!
The Future of Product Management in AI ERA.pdf
The Future of Product Management in AI ERA.pdfAlyona Owens Hi, I’m Aly Owens, I have a special pleasure to stand here as over a decade ago I graduated from CityU as an international student with an MBA program. I enjoyed the diversity of the school, ability to work and study, the network that came with being here, and of course the price tag for students here has always been more affordable than most around.
Since then I have worked for major corporations like T-Mobile and Microsoft and many more, and I have founded a startup. I've also been teaching product management to ensure my students save time and money to get to the same level as me faster avoiding popular mistakes. Today as I’ve transitioned to teaching and focusing on the startup, I hear everybody being concerned about Ai stealing their jobs… We’ll talk about it shortly.
But before that, I want to take you back to 1997. One of my favorite movies is “Fifth Element”. It wowed me with futuristic predictions when I was a kid and I’m impressed by the number of these predictions that have already come true. Self-driving cars, video calls and smart TV, personalized ads and identity scanning. Sci-fi movies and books gave us many ideas and some are being implemented as we speak. But we often get ahead of ourselves:
Flying cars,Colonized planets, Human-like AI: not yet, Time travel, Mind-machine neural interfaces for everyone: Only in experimental stages (e.g. Neuralink).
Cyberpunk dystopias: Some vibes (neon signs + inequality + surveillance), but not total dystopia (thankfully).
On the bright side, we predict that the working hours should drop as Ai becomes our helper and there shouldn’t be a need to work 8 hours/day. Nobody knows for sure but we can require that from legislation. Instead of waiting to see what the government and billionaires come up with, I say we should design our own future.
So, we as humans, when we don’t know something - fear takes over. The same thing happened during the industrial revolution. In the Industrial Era, machines didn’t steal jobs—they transformed them but people were scared about their jobs. The AI era is making similar changes except it feels like robots will take the center stage instead of a human. First off, even when it comes to the hottest space in the military - drones, Ai does a fraction of work. AI algorithms enable real-time decision-making, obstacle avoidance, and mission optimization making drones far more autonomous and capable than traditional remote-controlled aircraft. Key technologies include computer vision for object detection, GPS-enhanced navigation, and neural networks for learning and adaptation. But guess what? There are only 2 companies right now that utilize Ai in drones to make autonomous decisions - Skydio and DJI.
Cracking the Code - Unveiling Synergies Between Open Source Security and AI.pdf
Cracking the Code - Unveiling Synergies Between Open Source Security and AI.pdfPriyanka Aash Cracking the Code - Unveiling Synergies Between Open Source Security and AI
Mastering AI Workflows with FME by Mark Döring
Mastering AI Workflows with FME by Mark DöringSafe Software Harness the full potential of AI with FME: From creating high-quality training data to optimizing models and utilizing results, FME supports every step of your AI workflow. Seamlessly integrate a wide range of models, including those for data enhancement, forecasting, image and object recognition, and large language models. Customize AI models to meet your exact needs with FME’s powerful tools for training, optimization, and seamless integration
9-1-1 Addressing: End-to-End Automation Using FME
9-1-1 Addressing: End-to-End Automation Using FMESafe Software This session will cover a common use case for local and state/provincial governments who create and/or maintain their 9-1-1 addressing data, particularly address points and road centerlines. In this session, you'll learn how FME has helped Shelby County 9-1-1 (TN) automate the 9-1-1 addressing process; including automatically assigning attributes from disparate sources, on-the-fly QAQC of said data, and reporting. The FME logic that this presentation will cover includes: Table joins using attributes and geometry, Looping in custom transformers, Working with lists and Change detection.
GenAI Opportunities and Challenges - Where 370 Enterprises Are Focusing Now.pdf
GenAI Opportunities and Challenges - Where 370 Enterprises Are Focusing Now.pdfPriyanka Aash GenAI Opportunities and Challenges - Where 370 Enterprises Are Focusing Now
CapCut Pro Crack For PC Latest Version {Fully Unlocked} 2025
CapCut Pro Crack For PC Latest Version {Fully Unlocked} 2025pcprocore 👉𝗡𝗼𝘁𝗲:𝗖𝗼𝗽𝘆 𝗹𝗶𝗻𝗸 & 𝗽𝗮𝘀𝘁𝗲 𝗶𝗻𝘁𝗼 𝗚𝗼𝗼𝗴𝗹𝗲 𝗻𝗲𝘄 𝘁𝗮𝗯> https://pcprocore.com/ 👈◀
CapCut Pro Crack is a powerful tool that has taken the digital world by storm, offering users a fully unlocked experience that unleashes their creativity. With its user-friendly interface and advanced features, it’s no wonder why aspiring videographers are turning to this software for their projects.
AI vs Human Writing: Can You Tell the Difference?
AI vs Human Writing: Can You Tell the Difference?Shashi Sathyanarayana, Ph.D This slide illustrates a side-by-side comparison between human-written, AI-written, and ambiguous content. It highlights subtle cues that help readers assess authenticity, raising essential questions about the future of communication, trust, and thought leadership in the age of generative AI.
2025_06_18 - OpenMetadata Community Meeting.pdf
2025_06_18 - OpenMetadata Community Meeting.pdfOpenMetadata The community meetup was held Wednesday June 18, 2025 @ 9:00 AM PST.
Catch the next OpenMetadata Community Meetup @ https://www.meetup.com/openmetadata-meetup-group/
In this month's OpenMetadata Community Meetup, "Enforcing Quality & SLAs with OpenMetadata Data Contracts," we covered data contracts, why they matter, and how to implement them in OpenMetadata to increase the quality of your data assets!
Agenda Highlights:
👋 Introducing Data Contracts: An agreement between data producers and consumers
📝 Data Contracts key components: Understanding a contract and its purpose
🧑🎨 Writing your first contract: How to create your own contracts in OpenMetadata
🦾 An OpenMetadata MCP Server update!
➕ And More!
"Database isolation: how we deal with hundreds of direct connections to the d...
"Database isolation: how we deal with hundreds of direct connections to the d...Fwdays What can go wrong if you allow each service to access the database directly? In a startup, this seems like a quick and easy solution, but as the system scales, problems appear that no one could have guessed.
In my talk, I'll share Solidgate's experience in transforming its architecture: from the chaos of direct connections to a service-based data access model. I will talk about the transition stages, bottlenecks, and how isolation affected infrastructure support. I will honestly show what worked and what didn't. In short, we will analyze the controversy of this talk.
AI VIDEO MAGAZINE - June 2025 - r/aivideo
AI VIDEO MAGAZINE - June 2025 - r/aivideo1pcity Studios, Inc AI VIDEO MAGAZINE - r/aivideo community newsletter – Exclusive Tutorials: How to make an AI VIDEO from scratch, PLUS: How to make AI MUSIC, Hottest ai videos of 2025, Exclusive Interviews, New Tools, Previews, and MORE - JUNE 2025 ISSUE -
You are not excused! How to avoid security blind spots on the way to production
You are not excused! How to avoid security blind spots on the way to productionMichele Leroux Bustamante We live in an ever evolving landscape for cyber threats creating security risk for your production systems. Mitigating these risks requires participation throughout all stages from development through production delivery - and by every role including architects, developers QA and DevOps engineers, product owners and leadership. No one is excused! This session will cover examples of common mistakes or missed opportunities that can lead to vulnerabilities in production - and ways to do better throughout the development lifecycle.
Wenn alles versagt - IBM Tape schützt, was zählt! Und besonders mit dem neust...
Wenn alles versagt - IBM Tape schützt, was zählt! Und besonders mit dem neust...Josef Weingand IBM LTO10
WebdriverIO & JavaScript: The Perfect Duo for Web Automation
WebdriverIO & JavaScript: The Perfect Duo for Web Automationdigitaljignect In today’s dynamic digital landscape, ensuring the quality and dependability of web applications is essential. While Selenium has been a longstanding solution for automating browser tasks, the integration of WebdriverIO (WDIO) with Selenium and JavaScript marks a significant advancement in automation testing. WDIO enhances the testing process by offering a robust interface that improves test creation, execution, and management. This amalgamation capitalizes on the strengths of both tools, leveraging Selenium’s broad browser support and WDIO’s modern, efficient approach to test automation. As automation testing becomes increasingly vital for faster development cycles and superior software releases, WDIO emerges as a versatile framework, particularly potent when paired with JavaScript, making it a preferred choice for contemporary testing teams.
“MPU+: A Transformative Solution for Next-Gen AI at the Edge,” a Presentation...
“MPU+: A Transformative Solution for Next-Gen AI at the Edge,” a Presentation...Edge AI and Vision Alliance
You are not excused! How to avoid security blind spots on the way to production
You are not excused! How to avoid security blind spots on the way to productionMichele Leroux Bustamante
Ad
Why and how to engage a Complex Event Processor from a Java Web Application
- 1. Why and How to Engage a Complex Event Processor from a Java Web ApplicationLucas JellemaCTO, AMIS (The Netherlands)Oracle ACE Director
- 2. An EventA factWhen it becomes a factTimestamp!Of potential interest to anyoneWith some information associated with itWhen the fact is changed, that too may constitute an eventNote that even when no change occurs, that could be considered an event (absence of expected event)
- 3. The Data AvalancheThe league of real time eventsContinuous stream of a multitude of tiny events with hardly any payload, most of which are not interesting at allSent from physical sensors (temperature, pressure, RFID, security gates), process sensors, Twitter, manufacturing equipment, database triggers, web servers, ESBs, stock trade tickers, sport statistics, RSS, network switches, …
- 4. Most of these events….
- 5. Making Sense of Non-senseComplex Event ProcessingUseful information could be hidden in those streams of events – and CEP extracts itBy detecting patterns, deviations, aggregations in these event streamsCEP publishes ‘meaningful’ (business) events to report its findings – by executing some Event Processing LangugaeeventsComplex Event Processor
- 6. Continuous Query Language (CQL)Standard extension/complement to SQLFor handling large volumes of continuously arriving eventsExecuting the queries continuouslyOperates on streams of continually arriving events instead of static relational data setsEvents can be enriched with contextResults keep being produced as event streamIs used for comparing events of same type, to findTrends and PatternsExceptionsAggregatesComplex Event ProcessorCQL
- 7. Example CQL QueryReport the average temperatureAggregated over last 60 secondsReported every 30 secondsDetermined per ClusterTemperaturereadingsComplex Event ProcessorAverage temperature values (over 60s, per cluster, every 30s)
- 8. Event Processing NetworkAdapters – consuming or producing eventsChannels – carrying specific event typesProcessors – running CQL
- 9. Complex Event ProcessingAlertJMSDashboardSOA ApplicationDBData WarehouseWebServiceFileeventsComplex Event ProcessorJMSHTTPJMXFileDBEvent Consumer
- 10. eventseventseventsJava Applications interacting with a complex event processor Complex Event ProcessorJava applicationJMS132
- 11. Various CEP offerings availableProgress Software (Apama)Aleri (Aleri and Coral8)IBM (WebSphere Business Events, System S/InfoSphere Streams, ILog rule engine)StreamBase Systems, TIBCO Software (Tibco Business Events) Oracle (CEP - fka BEA WLEvs - and Glassfish OpenESB IEP) UC4 (Senactive) EsperTechJBoss Drools Fusion
- 12. Oracle CEP 11g Architecturefka BEA WLEVS(erver)Design TimeRun TimeCEP Visualizer(web console)Other WebAppEclipsehttpCEPpluginWeb (Bayeux)ServerCEP ServerDBJMS
- 13. Demo: HelloWorld
- 14. The EPN source side of things
- 15. Java Application as Event ConsumereventsComplex Event ProcessorJava applicationJMS
- 17. Case of TemperatureHospitalTemperature sensorsCooling unitsMaternity Ward and Intensive Care unitsFire detectionFrequent readings (subsecond)Monitoring for: trends of threshold crossing, fire!, fault detection
- 18. Demo: Temperature SensorsApplication should display a dashboard for temperature sensor readingsThe user is interested in cluster aggregates , deviations from pre-set values and broken sensorsHow would a Java Application process thousands of events per secondextract and report aggregatesdetect and report missing valuesNote: user wants real time updates – but not more frequently than once per minute
- 19. Technical LayoutTemperature Sensors are all over the placeClustered per room or locationTemperature Readings arrive over JMSResults are sent through JMS to dashboardJMS queue for temperature aggregatesPer cluster, once every 30 secondsJMS queue for failed sensor detection
- 20. Demo of Temperature Aggregations
- 21. Event Processor for aggregationGroup by ClusterReport once every 30 secondsOver all events in the last 60 seconds
- 23. Sensor FailureWhen a sensor has not reported for 30 seconds, we consider it failedAnd potentially broken downCEP needs to trap the missing events and report those
- 24. Demo of Sensor Failure detection
- 26. Feeding Temperature Aggregate Findings into real time BAMCEP publishes result events on JMSCEP is not aware of Business Activity MonitoringBAM creates an enterprise message sourceBased on JMS and MapMessagesFeeding into a Data Object in the Active Data CacheBAM listens on the JMS Queue and maps the messages to the ADC Data Object
- 28. Java Application as Event ProducereventsComplex Event ProcessorJava applicationJMS3
- 29. Java Application producing the events to processThe user interaction with an application produces many eventsNavigation, Selection, Submission (scroll, expand/collapse, drill down)Most events are not recorded persistentlyThe events can reveal interesting information about the application, the data and the usersFor example in a web shopThe information could be used to improve the effectiveness of the application
- 30. Product DetailsSearchBuy ProductmarioMario Kart (WII)€24,992010Rating:****oDetails:1 article in shoppingbasket:€24,99Mario Kart
- 31. Super Mario
- 34. Super Mario Bros.SearchEvent‘mario’ViewEvent‘Mario Kart’BuyEvent‘Mario Kart’User interaction events in a WebShop
- 36. Derive intelligence from WebShop eventsActual Metrics: #searches in last 5 minutes, #buyers in the last 24 hours, #search-to-views drilldownsTop 10 search terms (in last [24] hour)Top 10 useless search termsAfter search on term there is no view eventMost Effective search termsSearch is followed by (one or more) view events and subsequently a buy eventItems frequently viewed but not often bought#buy/#views is ranks low
- 37. WebShop & CEPWebShop sends JMS events to single queueWhenever a user in a session searches, drills down or buysType of event, search term or item identifier, session idCEP reads from JMS channelRoutes based on event typeProcesses events using CQL processorEmits derived events to JMS queueWebShop listens to JMS queueUpdates application scope ‘top10’ beansProvides dashboard based on ‘top10’ beansPotentially using Server Push (or periodic poll)
- 38. Webshop feeding into CEP and receiving refined feedbackWebShopTop 10 Popular Search TermsTop 10 Useless Search TermsMost Effective Search Termssearchviewbuy
- 39. Popular useless search terms(missing viewevent following the search)
- 40. Real Time Event Driven Dashboard in WebShop application
- 41. SummaryComplex Event ProcessingFor analysis of real time, high volume, continuous streams of fine grained, non-persistent eventsUsed for detecting patterns, spotting exceptions, calculating aggregates and tracking trendsCEP uses CQL queries to derive information from event streams – continuously, as events continue to arriveResults are published as (higher level) events – often to JMS queues
- 42. Summary[Java] Applications can have CEP pre-process eventsto do complex analysis and filteringproducing business events that applications can understandJava Applications produce events that CEP can processAnd possibly feed back into the applicationsJMS and http are primary communication channels
- 43. ResourcesPresentation and demos are on our bloghttp://technology.amis.nl/blogContact me at:[email protected]: Chapter 19 in Oracle SOA Suite 11gHandbook describesOracle CEP and BAM
Editor's Notes
- #7: Demo in plain SQL: http://technology.amis.nl/blog/3569/simple-event-processing-using-sql-with-analytical-functions-to-detect-traffic-patterns
- #33: Wat zijn de populairste zoektermen van dit moment (bijvoorbeeld de top 10 van de afgelopen 24 uur) – dit is een vrij eenvoudige aggregatie – gegroepeerd op zoekterm en met om de zoveel uur een rapportage in de vorm van tien events voor de top zoek-termenWat zijn de populairste waardeloze zoektermen? Dat zjin zoektermen die de gebruikers kennelijk niet de door hen gewenste resultaten opleveren omdat na het zoek-event met die term niet een bekijk-event volgt, maar een nieuw zoek-event of helemaal geen event meer.Wat zijn kennelijk de meest succevolle zoektermen? Hier zoeken we naar het patroon van zoek-event gevolgd door een of meerdere bekijk–events en leidend tot een koop-event zonder dat er nog een ander zoek-event tussen zitWat zijn items die wel vaak bekeken maar niet vaak gekocht worden? Dat zijn producten waarvoor het percentage kijk+koop van het totaal aantal kijk-events laag is. Ook deze lijst kan bijvoorbeeld iedere 12 of 24 uur worden opgehoest door CEP