SlideShare a Scribd company logo
SQL Server 2008 R2 StreamInsight OverviewNameTitleMicrosoft Corporation
Presentation Outline (hidden slide)Technical Level: 200
Intended Audience: ITDMs,DBAs, Database Developers, Database Architects, BI specialists
Objectives (what do you want the audience to take away):
Introduction to Complex Event Processing (CEP) and Microsoft’s StreamInsight solution
Technical overview of CEP architecture and development environment
Presentation Outline:
Overview - Information Platform Vision, SQL Server 2008 Foundation, SQL Server 2008 R2 Value Proposition
Introduction to Complex Event Processing (CEP)
Business Challenges and key CEP benefits
Platform Architecture
CEP and LINQ Queries
CEP Development Environment
Query Binding & Configuration
CEP Platform Summary
Deployment Scenarios
RoadmapInformation Platform VisionPervasive InsightEmpowered ITDynamic DevelopmentMISSION CRITICAL PLATFORMDesktop & MobileCloudServer & Datacenter
Scalable relational database platformConsistent, familiar model & toolsSelf-managed, highly available cloud servicesMPP support for 10s to 100s TB DWHighly scalable appliancesSeamless integration with Microsoft BI A Comprehensive PlatformManaged Self-Service BIMulti-server managementVirtualization & Live Migration
TRUSTED, SCALABLE PLATFORMIT & DEVELOPER EFFICIENCYMANAGED SELF-SERVICE BIEnterprise-level security, scalabilityHigh-scale, complex event processingData consistency across heterogeneous systemsMulti-server managementVirtualization & Live Migration Accelerated development& deploymentSelf-service analyticsSelf-service reportingStreamlined collaboration& managementCOMPREHENSIVE PLATFORM FOR IT VALUEMPP support for 10s-100s TB DWHighly scalable appliancesSeamless BI IntegrationScalable relational database platformConsistent, familiar model & toolsSelf-managed, highly available cloud service
What is CEP?EventComplex Event Processing (CEP) is the continuous and incremental processing of event streams from multiple sources based on declarative query and pattern specifications with near-zero latency. requestoutput streaminput streamresponse6
LatencyScenarios for Event ProcessingRelational Database ApplicationsCEP Target ScenariosOperational Analytics Applications, e.g., Logistics, etc.Data Warehousing ApplicationsWeb Analytics ApplicationsManufacturing Applications        Financial trading ApplicationsMonitoring ApplicationsAggregate Data Rate (Events/sec.)7
Example CEP ScenariosPower, Utilities:Energy consumption
Outages
Smart grids
100,000 events/secManufacturing:Sensor on plant floor
React through device controllers
Aggregated data
10,000 events/secWeb Analytics:Click-stream data
Online customer behavior

More Related Content

PDF
Part 0.5: 事例を中心としたユースケース (製造リファレンス・アーキテクチャ勉強会)
PDF
Part 0: 製造リファレンス・アーキテクチャとは?(製造リファレンス・アーキテクチャ勉強会)
PDF
Azure Update Summary (App) 202008
PDF
打造 AIoT 智慧物聯網時代解決方案
PDF
World of Watson 2016 - Put your Analytics on Cloud 9
PDF
Cloud Computing Use Cases Whitepaper 3 0
PPTX
Servizi Cloud Computing: Scenario, Strategia e Mercato Nicoletta Maggiore
PDF
Tiarrah Computing: The Next Generation of Computing
Part 0.5: 事例を中心としたユースケース (製造リファレンス・アーキテクチャ勉強会)
Part 0: 製造リファレンス・アーキテクチャとは?(製造リファレンス・アーキテクチャ勉強会)
Azure Update Summary (App) 202008
打造 AIoT 智慧物聯網時代解決方案
World of Watson 2016 - Put your Analytics on Cloud 9
Cloud Computing Use Cases Whitepaper 3 0
Servizi Cloud Computing: Scenario, Strategia e Mercato Nicoletta Maggiore
Tiarrah Computing: The Next Generation of Computing

What's hot (20)

PDF
Shape the Cloud
PDF
Microsoft Telecommunications Newsletter | September 2021
PDF
Smart, Secure and Efficient Data Sharing in IoT
PDF
복잡한 기존 시스템에 피쳐 애드업 후기 - 김태웅(브랜디) :: AWS Community Day Online 2021
PDF
Enterprise Search Case Study: Ericsson
PPTX
Cloud computing
PDF
Azure IoT - A Practical Entry to New Retail
PPTX
Cloud Computing, SDN, Big Data and Internet of Everything - Lew Tucker
PPTX
VSD Zurich 2018: The Data Opportunity
PDF
INTRODUCTION TO INTERNET OF THINGS
PPTX
VSD Zurich 2018: 360 Data Management and Take Control Over the Most Valuable ...
PDF
VSD Istanbul 2018
PDF
8. 9590 1-pb
PPTX
ClientSummit2010_CloudWorkshop
PPTX
Virtual Instruments Presentation
PPTX
Cloud based cyber-physical systems in manufacturing
PDF
Microsoft Telecommunications Industry News | October 2020
PPTX
Executive Summit for ISV & Application builders - January 2015
PDF
Enhanced Integrity Preserving Homomorphic Scheme for Cloud Storage
PDF
Recapitulation Workshop Cloud Reliability Resilience 2016
Shape the Cloud
Microsoft Telecommunications Newsletter | September 2021
Smart, Secure and Efficient Data Sharing in IoT
복잡한 기존 시스템에 피쳐 애드업 후기 - 김태웅(브랜디) :: AWS Community Day Online 2021
Enterprise Search Case Study: Ericsson
Cloud computing
Azure IoT - A Practical Entry to New Retail
Cloud Computing, SDN, Big Data and Internet of Everything - Lew Tucker
VSD Zurich 2018: The Data Opportunity
INTRODUCTION TO INTERNET OF THINGS
VSD Zurich 2018: 360 Data Management and Take Control Over the Most Valuable ...
VSD Istanbul 2018
8. 9590 1-pb
ClientSummit2010_CloudWorkshop
Virtual Instruments Presentation
Cloud based cyber-physical systems in manufacturing
Microsoft Telecommunications Industry News | October 2020
Executive Summit for ISV & Application builders - January 2015
Enhanced Integrity Preserving Homomorphic Scheme for Cloud Storage
Recapitulation Workshop Cloud Reliability Resilience 2016
Ad

Viewers also liked (13)

PDF
Microsoft Cloud OS - Unlock Data Insights Presented by Atidan
PDF
Microsoft StreamInsight
PPTX
SQL Server 2008 R2 StreamInsight
PPTX
Tackling variety in event based systems
PPTX
StreamInsight Breakthrough
PPT
Complex Event Processing
PPTX
Introduction to microsoft sql server 2008 r2
PDF
Dynamic Complex Event Processing for Hybrid Telecommunication Networks and Sm...
PDF
Semantic Complex Event Processing with Reaction RuleML 1.0 and Prova 3.0
PPT
Complex Event Processing: What?, Why?, How?
PDF
Semantic Complex Event Processing at Sem Tech 2010
KEY
SIFMA 2010 June 23 - Real Time Risk Management with Microsoft’s StreamInsight
PDF
Semantic Complex Event Processing
Microsoft Cloud OS - Unlock Data Insights Presented by Atidan
Microsoft StreamInsight
SQL Server 2008 R2 StreamInsight
Tackling variety in event based systems
StreamInsight Breakthrough
Complex Event Processing
Introduction to microsoft sql server 2008 r2
Dynamic Complex Event Processing for Hybrid Telecommunication Networks and Sm...
Semantic Complex Event Processing with Reaction RuleML 1.0 and Prova 3.0
Complex Event Processing: What?, Why?, How?
Semantic Complex Event Processing at Sem Tech 2010
SIFMA 2010 June 23 - Real Time Risk Management with Microsoft’s StreamInsight
Semantic Complex Event Processing
Ad

Similar to Microsoft SQL Server - StreamInsight Overview Presentation (20)

PDF
Replicate Salesforce Data in Real Time with Change Data Capture
PPTX
Unify Analytics: Combine Strengths of Data Lake and Data Warehouse
PDF
Combining Logs, Metrics, and Traces for Unified Observability
PPTX
SplunkLive! Munich 2018: Data Onboarding Overview
PPTX
Azure Stream Analytics : Analyse Data in Motion
PPTX
SplunkLive! Frankfurt 2018 - Data Onboarding Overview
PPTX
WebAction-Sami Abkay
PDF
Observability foundations in dynamically evolving architectures
PDF
Stream Processing – Concepts and Frameworks
PPT
Event Driven Architecture (EDA), November 2, 2006
PDF
Streaming Visualization
PDF
Unifying Analytics
PDF
Introduction to Stream Processing
PDF
EDA Meets Data Engineering – What's the Big Deal?
PDF
Enterprise guide to building a Data Mesh
PPT
Ogf20 Gmb Chris Swan
PDF
Introduction to Stream Processing
PDF
Io t data streaming
PPTX
Introduction to Time Series Analytics with Microsoft Azure
PPTX
Machine Data 101 Hands-on
Replicate Salesforce Data in Real Time with Change Data Capture
Unify Analytics: Combine Strengths of Data Lake and Data Warehouse
Combining Logs, Metrics, and Traces for Unified Observability
SplunkLive! Munich 2018: Data Onboarding Overview
Azure Stream Analytics : Analyse Data in Motion
SplunkLive! Frankfurt 2018 - Data Onboarding Overview
WebAction-Sami Abkay
Observability foundations in dynamically evolving architectures
Stream Processing – Concepts and Frameworks
Event Driven Architecture (EDA), November 2, 2006
Streaming Visualization
Unifying Analytics
Introduction to Stream Processing
EDA Meets Data Engineering – What's the Big Deal?
Enterprise guide to building a Data Mesh
Ogf20 Gmb Chris Swan
Introduction to Stream Processing
Io t data streaming
Introduction to Time Series Analytics with Microsoft Azure
Machine Data 101 Hands-on

More from Microsoft Private Cloud (20)

DOCX
Hyper-V improves appliance manufacturer’s productivity
DOCX
AcXess saves U.S.$5 million in hardware with Hyper V
DOCX
Microsoft at No. 1 Spot In Customer Satisfaction Audit - Data Quest
PDF
Cloud Computing Myth Busters - Know the Cloud
PDF
Economics of the Cloud - A Report Based On CFO Survey
PDF
Assess The Economics Of The Cloud By Using In Depth Modeling
PDF
A Guide To Finding Your Cloud Power
DOCX
TicTacTi Advertising Improves by 400% by Adopting to Cloud Computing Case Study
DOC
REEDS Jeweller Moves to Online Services to Boost Productivity and Cut Costs b...
DOCX
Godiva Chocolatier Saves $250,000 Annually by Moving Email to Cloud Case Study
DOC
Aviva Insurance Enhanced its Global Communication and Collaboration with Micr...
DOCX
Microsoft Windows Server 2008 R2 - Upgrading from Windows 2000 to Server 2008...
DOC
Simplify Your IT Management with Microsoft SharePoint Online: Whitepaper
DOCX
Engage Customers through Real Time Meetings with Microsoft Office Live Meetin...
DOC
Get Instant Messaging and Presence Functionality with Microsoft Office Commun...
PDF
Deployment Guide for Business Productivity Online Standard Suite: Whitepaper
DOCX
Communicate Easily with Others in Different Locations with Microsoft Office C...
PPTX
Introduction to Microsoft SharePoint Online Capabilities, Security, Deploymen...
PPTX
Cloud Based Communications Solutions from Microsoft
PPTX
Reduce Capital & Operational Expenses with Business Productivity Online Suite
Hyper-V improves appliance manufacturer’s productivity
AcXess saves U.S.$5 million in hardware with Hyper V
Microsoft at No. 1 Spot In Customer Satisfaction Audit - Data Quest
Cloud Computing Myth Busters - Know the Cloud
Economics of the Cloud - A Report Based On CFO Survey
Assess The Economics Of The Cloud By Using In Depth Modeling
A Guide To Finding Your Cloud Power
TicTacTi Advertising Improves by 400% by Adopting to Cloud Computing Case Study
REEDS Jeweller Moves to Online Services to Boost Productivity and Cut Costs b...
Godiva Chocolatier Saves $250,000 Annually by Moving Email to Cloud Case Study
Aviva Insurance Enhanced its Global Communication and Collaboration with Micr...
Microsoft Windows Server 2008 R2 - Upgrading from Windows 2000 to Server 2008...
Simplify Your IT Management with Microsoft SharePoint Online: Whitepaper
Engage Customers through Real Time Meetings with Microsoft Office Live Meetin...
Get Instant Messaging and Presence Functionality with Microsoft Office Commun...
Deployment Guide for Business Productivity Online Standard Suite: Whitepaper
Communicate Easily with Others in Different Locations with Microsoft Office C...
Introduction to Microsoft SharePoint Online Capabilities, Security, Deploymen...
Cloud Based Communications Solutions from Microsoft
Reduce Capital & Operational Expenses with Business Productivity Online Suite

Recently uploaded (20)

PDF
MIND Revenue Release Quarter 2 2025 Press Release
PDF
Unlocking AI with Model Context Protocol (MCP)
PPT
“AI and Expert System Decision Support & Business Intelligence Systems”
PPTX
Big Data Technologies - Introduction.pptx
PDF
Network Security Unit 5.pdf for BCA BBA.
PDF
Assigned Numbers - 2025 - Bluetooth® Document
PPT
Teaching material agriculture food technology
PPTX
Spectroscopy.pptx food analysis technology
PDF
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
PDF
Approach and Philosophy of On baking technology
PDF
The Rise and Fall of 3GPP – Time for a Sabbatical?
PDF
Reach Out and Touch Someone: Haptics and Empathic Computing
PDF
Machine learning based COVID-19 study performance prediction
PDF
Mobile App Security Testing_ A Comprehensive Guide.pdf
PPTX
20250228 LYD VKU AI Blended-Learning.pptx
PPTX
Programs and apps: productivity, graphics, security and other tools
PDF
Advanced methodologies resolving dimensionality complications for autism neur...
PDF
Empathic Computing: Creating Shared Understanding
PDF
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
PDF
NewMind AI Weekly Chronicles - August'25-Week II
MIND Revenue Release Quarter 2 2025 Press Release
Unlocking AI with Model Context Protocol (MCP)
“AI and Expert System Decision Support & Business Intelligence Systems”
Big Data Technologies - Introduction.pptx
Network Security Unit 5.pdf for BCA BBA.
Assigned Numbers - 2025 - Bluetooth® Document
Teaching material agriculture food technology
Spectroscopy.pptx food analysis technology
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
Approach and Philosophy of On baking technology
The Rise and Fall of 3GPP – Time for a Sabbatical?
Reach Out and Touch Someone: Haptics and Empathic Computing
Machine learning based COVID-19 study performance prediction
Mobile App Security Testing_ A Comprehensive Guide.pdf
20250228 LYD VKU AI Blended-Learning.pptx
Programs and apps: productivity, graphics, security and other tools
Advanced methodologies resolving dimensionality complications for autism neur...
Empathic Computing: Creating Shared Understanding
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
NewMind AI Weekly Chronicles - August'25-Week II

Microsoft SQL Server - StreamInsight Overview Presentation

  • 1. SQL Server 2008 R2 StreamInsight OverviewNameTitleMicrosoft Corporation
  • 2. Presentation Outline (hidden slide)Technical Level: 200
  • 3. Intended Audience: ITDMs,DBAs, Database Developers, Database Architects, BI specialists
  • 4. Objectives (what do you want the audience to take away):
  • 5. Introduction to Complex Event Processing (CEP) and Microsoft’s StreamInsight solution
  • 6. Technical overview of CEP architecture and development environment
  • 8. Overview - Information Platform Vision, SQL Server 2008 Foundation, SQL Server 2008 R2 Value Proposition
  • 9. Introduction to Complex Event Processing (CEP)
  • 10. Business Challenges and key CEP benefits
  • 12. CEP and LINQ Queries
  • 14. Query Binding & Configuration
  • 17. RoadmapInformation Platform VisionPervasive InsightEmpowered ITDynamic DevelopmentMISSION CRITICAL PLATFORMDesktop & MobileCloudServer & Datacenter
  • 18. Scalable relational database platformConsistent, familiar model & toolsSelf-managed, highly available cloud servicesMPP support for 10s to 100s TB DWHighly scalable appliancesSeamless integration with Microsoft BI A Comprehensive PlatformManaged Self-Service BIMulti-server managementVirtualization & Live Migration
  • 19. TRUSTED, SCALABLE PLATFORMIT & DEVELOPER EFFICIENCYMANAGED SELF-SERVICE BIEnterprise-level security, scalabilityHigh-scale, complex event processingData consistency across heterogeneous systemsMulti-server managementVirtualization & Live Migration Accelerated development& deploymentSelf-service analyticsSelf-service reportingStreamlined collaboration& managementCOMPREHENSIVE PLATFORM FOR IT VALUEMPP support for 10s-100s TB DWHighly scalable appliancesSeamless BI IntegrationScalable relational database platformConsistent, familiar model & toolsSelf-managed, highly available cloud service
  • 20. What is CEP?EventComplex Event Processing (CEP) is the continuous and incremental processing of event streams from multiple sources based on declarative query and pattern specifications with near-zero latency. requestoutput streaminput streamresponse6
  • 21. LatencyScenarios for Event ProcessingRelational Database ApplicationsCEP Target ScenariosOperational Analytics Applications, e.g., Logistics, etc.Data Warehousing ApplicationsWeb Analytics ApplicationsManufacturing Applications Financial trading ApplicationsMonitoring ApplicationsAggregate Data Rate (Events/sec.)7
  • 22. Example CEP ScenariosPower, Utilities:Energy consumption
  • 26. React through device controllers
  • 31. 100,000 events /secFinancial Services:Stock & news feeds
  • 35. 100,000 events /secAsset Instrumentation for Data Acquisition, Subscriptions to Data FeedsData StreamData StreamVisual trend-line and KPI monitoringBatch & product managementAutomated anomaly detectionReal-time customer segmentation Algorithmic tradingProactive condition-based maintenanceStream Data Store & ArchiveEvent Processing EngineAsset Specs & ParametersThreshold queries
  • 36. Event correlation from multiple sources
  • 38. Virtuous Cycle: Monitor, Manage, Mine9
  • 39. Microsoft’s CEP SolutionData Sources, Operations, Assets, Feeds, Sensors, DevicesInput Data StreamsOutputData StreamsInput Data StreamsCEP EngineMonitor & RecordManage& BenefitMine& Designf(x)f'(x)g(y)h(x,y)ResultsDeployHistoryOperational Data Store & ArchiveCEP Enginef(x)g(y)f'(x)h(x,y)10
  • 40. CEP Deployment AlternativesCEP CEP for lightweight processing and filteringCEP CEP for aggregation and correlation of in-flight eventsCEP CEP for complex analytics including historical dataEvent processing engines are deployed at multiple places on different scalesAt the edge – close to the data source
  • 41. In the mid-tier – consolidate related data sources,
  • 42. In the data center – historical archive, mining, large scale correlationWeb serversSensorsCEP CEP FeedsDevicesCEP CEP CEP CEP CEP CEP CEP Complex Analytics &Mining11
  • 43. Platform from Microsoft for continuous and incremental processing of event streams from multiple sources based on declarative query and pattern specifications with low latencyEVENT TARGETSEVENT SOURCESAPPLICATIONPagers & Monitoring devicesDevices, SensorsMSFT CEP EngineInput AdaptersOutput AdaptersWeb serversKPI Dashboards, SharePoint UIEvent stores & DatabasesTrading stationsOverview: CEP Platform from MicrosoftBloomberg.comReference dataStock tickers & News feedsEvent stores & DatabasesPLATFORM FOR KEY MARKET OPPORTUNITIESKEY SOLUTION REQUIREMENTSEvent driven
  • 44. Low latency processing (< milliseconds)
  • 45. High volume (>100,000 events /second)
  • 46. Correlated events from multiple sources
  • 47. Time interval oriented standing queries
  • 48. Manufacturing: Process monitoring i.e. scheduling, control, inventory
  • 49. Financial: algorithmic trading, compliance monitoring, fraud detection
  • 50. Web: Click stream analysis ,ad-delivery model
  • 53. Networking: traffic monitoring ,security intrusion detection
  • 55. Oil and Gas: Geological data analysis, process control EventsEvents expose different temporal characteristicsPoint in time eventsInterval events with fixed durationInterval events with initially unknown durationRich payloads capture all properties of an eventdcePayload/ value bat5t3t4t1t2Time 
  • 56. Event TypesEvents in Microsoft’s CEP platform use the .NET type systemEvents are structured and can have multiple fieldsFields are typed using the .NET framework types CEP engine provisioned timestamp fields capture all the different temporal event characteristicsEvent sources populate time stamp fields
  • 57. Event StreamsA stream is a possibly infinite sequence of eventsInsertions of new eventsChanges to event durationsExamples: time series sensor data, log entriesStream characteristics:Event/data arrival patternsSteady rate with end-of-stream indication Examples: files, tables
  • 58. Intermittent, random, or in burstsExample: retail scanners, web, weather telemetryOut of order eventsOrder of arrival of events does not match the order of theirapplication timestampsTakeaway: CEP engine does the heavy lifting for you when dealing with out-of-order data15
  • 59. Event Stream AdaptersDesign time specification of an adapterfor a particular event type and particular source/sink
  • 60. methods to handle event and stream behavior, and
  • 61. properties to indicate adapter features to the engineAdapter featuresFeatureProblem16
  • 62. Core CEP Query EngineEventEventEventEventEventEventEventEventEventCEP EngineHosts “standing queries”Operators consume and produce streamsQueries are composableQuery results are computed incrementallyStanding QueriesOutput AdaptersInput AdaptersQuery instance management:Submit, start, stopRuntime statisticsTakeaway: CEP engine does the heavy lifting for you when processing temporal event data17
  • 63. Typical CEP QueriesTypical CEP queries require combination of functionalityComplex type describes event propertiesCalculations introduce additional event propertiesGrouping by one or more event propertiesAggregation for each event group over a pre-defined period of time, typically a windowMultiple event groups monitored by the same queryCorrelate event streams Check for absence of activity with a data sourceEnrich events with reference dataCollection of assets may change over timeWe want to make writing and maintaining those queries easy or even effortless
  • 64. CEP Query FeaturesOperators over streamsCalculations (PROJECT)Correlation of streams from different data sources (JOIN)Check for absence of activity with a data source (EXISTS)Selection of events from streams (FILTER)Stream partitioning (GROUP & APPLY)Aggregation (SUM, COUNT, …) Ranking and heavy hitters (TOP-K)Temporal operations: hopping window, sliding windowExtensibility – to add new domain-specific operatorsQueries are written over specific event typesThey can be evaluated on all data sources with the same event typeSupport for streaming data, reference data (lookup), and historical data (replay)
  • 65. LINQ Query ExamplesLINQ Example – JOIN, PROJECT, FILTER:frome1inMyStream1joine2inMyStream2e1.IDequalse2.IDwheree1.f2 = “foo”select new { e1.f1, e2.f4 };FilterProjectWindowGroupingJoinLINQ Example – GROUP&APPLY, WINDOW:frome3inMyStream3groupe3bye3.iinto SubStreamsfroms4inSubStreamsfrome4ins4.SlidingWindow(FiveMinutes,ThreeSeconds)select new { pl =newMyNewPayload(e4.i, e4.f)};
  • 66. Extensibility Built-in operators do not cover all functionalityNeed for domain-specific extensionsIntegrate with functionality available in existing librariesSupport for extensions in the CEP platform:User-defined operators, functions, aggregatesCode written in .NET, deployed as .NET assemblyQuery operators can refer to functionality of the assemblyLINQ queries can easily refer to user-defined functionalityTemporal snap-shot operator frameworkInterface to implement user-defined operatorsManages operator state and snapshot changesFramework does the heavy lifting to deal with intricate temporal behavior such as out-of-order events
  • 67. Developer Experience with the CEP PlatformGoalsEasy to use and highly productive Most comprehensive toolsetSupports various deployment models for CEP applicationsEmbedded applications
  • 68. Server applicationsCompelling story for domain-specific extensionsCEP development environmentBuilds on top of .NETMicrosoft Visual Studio as IDEApplications written in C#Queries written in LINQLINQ:varqueryFilter = fromcinTestEventStreamwherec.Field1 > 1selectc;22
  • 69. Managing CEP Data Sources & QueriesTypical CEP ApplicationMultiple different data sources and adapters
  • 70. Several queriesIntellectual property is in the queriesProtect investment in queries over timeRe-use existing queries as newer version of an asset, device or data source become available
  • 71. Re-use existing queries for new data source types
  • 72. Seamlessly switch between live data feeds and historical dataQuery BindingEventEventEventEventEventEventAnalytics & QueriesData SourcesQT1CEP EngineAT1Standing QueriesQ1Input AdaptersOutput AdaptersAT2Q1’AT3Q1’’Binding a query with data sources yields a query instanceConfigure multiple query instances for a querySimilar to data independence: the same query can be bound to different data sources as long as they deliver the required event type
  • 73. CEP Query ConfigurationQueryQuery binding:Coupling adapters with a queryEvent types required by the query need to be matched by types delivered by adaptersQuery can be re-used for all data sources of the same typeNo changes to query necessary for re-useOutput AdapterTypeTypeQueryTemplateProj.JoinTypeTypeTypeTypeInputAdapterInputAdapter
  • 74. Recap: CEP Platform from MicrosoftEventEventEventEventEventEventEventEventEventDevelopment experience with .NET, C#, LINQ and Visual Studio 2008CEP Application DevelopmentCEP platform from Microsoft to build event-driven applicationsEvent targetsEvent sourcesEvent-driven applications are fundamentally different from traditional database applications: queries are continuous, consume and produce streams, and compute results incrementallyCEP EngineStanding QueriesOutput AdaptersInput AdaptersFlexible adapter SDK with high performance to connect to different event sources and sinksThe CEP platform does the heavy lifting for you to deal with temporal characteristics of event stream dataStatic reference data26
  • 75. CEP Deployment ScenariosCustom CEP ApplicationScenario 1: Custom CEP Application DevScenario 2: Embed CEP in ApplicationISV Application with CEP Engine.NET, C#, LINQCEP EngineCEP EngineKPIsKPI miningETL Pipeline with CEP engineCEP EngineCEPCEPCEPCEPScenario 4: Operational Intelligence w/ CEPScenario 3: CEP Enabled DeviceReference dataDevice with Embedded CEP EngineReference dataMadisonCEP Engine
  • 76. CEP Platform RoadmapFocus on Custom development platform for CEP applicationsCEP platform for Microsoft partnersTAP (Technology Adopter Program) will launch in July 2009Product availability targeted for 2010 CTP2TAP programCTP3TAP continuesGeneral Availabilitytime2010Late 2009July 2009
  • 77. Anot-for-profit, user-run association to enable the SQL Server community to connect, share, and learnGet ongoing SQL Server learning from MVPs, top experts, and real-world users:Training webcasts, technical education, worldwide event info, and moreSign up for your FREE PASS membership today: www.sqlpass.orgGo to local PASS Chapter meetingsVisit the PASS Chapter booth to learn about upcoming local events, or visit www.sqlpass.org/PASSChaptersNo local Chapter? Start a Chapter with support and resources from PASSwww.sqlpass.org/getchapterinfoAttend PASS Summit 2010World's largest and best conference for SQL Server and BI technical education www.sqlpass.org/na2010Follow / Join us online: Twitter @sqlpass #sqlpass, LinkedIn group, Facebook group
  • 78. © 2009 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Editor's Notes

  • #4: Now more than ever, organizations have the need to use information management to compete and grow in a difficult market by reducing costs and identifying the highest value opportunities for their organization.  As we engage with customers, you explain the pressures you have to deliver more real-time information through rich applications while also reducing costs in this new economy. The converging IT trends of virtually free storage space, the rapid adoption of virtualization and the increasing capabilities of industry standard hardware, the emergence of the Cloud as a deployment option, and the need for real-time business information for all employees through easy to use tools are driving the data explosion we see today. You need a complete approach to managing, accessing and delivering information across your organization to accelerate and improve business decisions..  We also understand that at the center of delivering on these business needs there are people - IT Professionals, who support the expanding information needs of the business through IT services, Developers who build solutions in time to capture business opportunities in an increasingly competitive market and Business Users, who quickly mine volumes of data for business insights to help increase customer satisfaction and drive business results. Microsoft, along with our worldwide partners, is committed to deliver an Information Platform which enables your people and provides you with a complete set of technologies and tools to help you realize more value from your information at the lowest total cost of ownership. As we invest in the Information Platform we think about what we need to deliver to you in each of these 4 areas:  Mission-Critical Platform Mission-Critical Platform for all your application requirements, delivered with the industry’s best TCOEnsuring your applications and systems are reliable, highly available, secure and deliver superior, predictable performance is top priority for IT and for Microsoft. At our core, we are focused on delivering an information platform which meets the needs for performance, scalability, availability, and security for your most mission critical business applications at a lower cost of ownership, including acquisition costs and the ongoing costs of support, management and maintenance. From the server to the datacenter we offer our customers a reliable information platform that grows with their needs at a third of the cost of our enterprise DB competitor.Secure and available infrastructureWe have seen tremendous growth in our Enterprise business – investing significantly in our datacenter capability on the Windows Server platform, building out the industry’s most widely deployed database platform. The largest enterprises on the planet are now running their top-tier applications on the Microsoft platform and seeing sustained high-performance and uptime that directly benefits their businesses’ bottom line. Scales to all business requirementsWith storage costs declining, and increasing data volumes, IT departments need the ability to scale up seamlessly to process an increasing number of transactions, as well as storing and processing larger volumes of information. Microsoft’s Information Platform provides high scalability and performance for OLTP and BI as well as new Data Warehousing capabilities to scale to hundreds of terabytes to deliver on the most critical business needs. A complete and interoperable platform that empowers IT to be more productive and agile The boundaries of the IT environment continue to be stretched and IT Professionals have increased responsibility to manage application requirements for the datacenter, across mobile devices and the desktop, and now out in the cloud. To successfully manage these resources across the enterprise IT professionals require a consistent, and productive platform, including easy to use and robust tools.  Increased DBA Productivity and ControlSQL Server has long had a focus on DBA productivity – by providing rich management tools that empower administrators to take control of their environment. We continue to invest in tools that enable administrators to manage multiple servers at once via policies and to proactively manage system performance. We’re also investing to provide complementary tools for areas such as data integration and master data management.  Consolidation and VirtualizationConsolidation and virtualization can deliver significant resource and operational benefits in the datacenter, particularly at a time when IT professionals are facing budget pressure along with the need to continue the same level of service. Together, Windows Server, System Center and SQL Server can deliver a virtualized Data Center, providing increased utilization of server resources to reduce costs, greater standardization to reduce administration overhead and greater agility to dynamically scale to support changing and growing business needs.  The Power of Choice - Harnessing the CloudThe cloud offers new ways for IT to reduce the friction of connecting with customers and partners, the ability to quickly provision resources, and a way to reduce operational costs. Microsoft is delivering SQL Azure as part of the Windows Azure Platform to enable IT to manage these resources with a platform and tools that are consistent with their existing SQL Server environment.Dynamic DevelopmentIntegrated tools to help Developers more quickly build rich, intuitive and connected applications Developers are continually asked to deliver richer applications and services while lowering the time-to-solution to adapt to business needs and opportunities. With Visual Studio, the .NET Framework, and SQL Server developers have a highly productive platform to deliver data through their applications and to collaborate more efficiently with IT on deployment needs and requirements. The consistent development experience also gives developers the power to build applications for deployment across devices, desktops, the datacenter, and the cloud.  Tight Integration across the stackSQL Server has deep integration with Visual Studio and .NET to provide developers with a rich, seamless development experience. Developers can use familiar tools and the power of a model-driven approach to vastly improve their productivity, by abstracting away from database specifics and instead focusing on the business logic and outcomes required.  Platform for all DataBeing able to bring unstructured data alongside structured data in a single application gives developers the power to bring the relational model to new types of data. They can extend existing applications and develop new types of applications that incorporate location aware services, real time streaming data – all in a secure, synchronized way.  Rich and embeddable user experiencesDevelopers can embed powerful user experiences into their applications through components such as spatial data for rich mapping scenarios, embeddable BI controls and data synchronization. Looking ahead, developers can integrate value-added cloud services into applications for a differentiated value prop and additional services opportunities.Pervasive InsightA complete Business Intelligence platform that enables users across the organization to derive greater insights through familiar toolsBusiness Intelligence continues to be the #1 priority for CIOs. Even as budgets are cut IT is being asked to do more to deliver information to the business. Getting the right information to the right person at the right time is critical for success now more than ever. This requires providing access through familiar tools to end users while also providing IT the ability to manage and secure access to the information. By enabling access to all types of users through familiar tools, in a secure and well managed way – businesses can get more value from their information than ever before. Microsoft helps companies consolidate information, deliver access and empower users at all levels of the business: strategic, tactical and operational decision makers. Integrate all your data and scale your reporting systemsWith SQL Server, you can integrate the many sources of data in your organization into large scale data warehouses and deliver rich, high-performance reporting to your whole organization.  Enable users to derive insights through familiar toolsIncreased processing power and memory for desktops and laptops are enabling information workers to do more advanced data mining and analysis to improve decision making. We are extending our capabilities to deliver the power of self-service business intelligence to individual users through the familiar tools they use everyday such as Microsoft Excel. Enable collaborative decision making Today organizations have relevant data that lives in the datacenter, on user devices and desktops, and through external services. It is critical for users to be able to draw upon the wealth of information that is distributed throughout the organization and to do analysis and reporting with the data sources that are most relevant. The real value is that individual insight can be easily shared across work groups and across the organization. With Microsoft Office SharePoint, individual information workers can share and publish insights and analysis tools to scale reach and deliver greater value to the organization.ClosingLooking across the Information Platform, we think about how these capabilities can better support our customers’ information needs. For example a national retailer could use technology to track the demographics, volume and location of customers throughout stores across the country.  By processing large volume of data in real-time, they could then evaluate the needs of their customer base at any given moment and make changes to promotions or the store environment like the background music, to better appeal to the audience and drive real-time purchase.  Looking across the Information Platform, the ability to dynamically respond to customer needs could be built by working with your development organization to develop a new application or extending an existing application, partnering with IT to support the application through greater utilization of existing assets, and delivering information to business users through familiar tools. By providing business information pervasively throughout the organization in real-time this organization would be able to much more quickly identify and capture business opportunities.The Information Platform delivers the rich capabilities of SQL Server and SQL Azure to enable IT, developers and end users to deliver on your most critical business needs and maximize the value of your information throughout the organization at a low cost of ownership.
  • #5: The purpose of this slide is to communicate the next wave of SQL innovation and how it should be messaged. There are three key areas of innovation: SQL Server 2008 R2 – the next generation release of the SQL Server database platform, Parallel Data Warehouse, appliances for high scale data warehousing and SQL Azure – scalable relational database platform service in the cloud. When you talk to each of these innovations, you want to emphasize that each is built on the solid foundation of SQL Server 2008.SQL Server 2008 R2 enables businesses to make more timely, better informed decisions by enabling users to access, integrate, analyze and share information using tools they are already familiar with – Microsoft Office. DBAs can more efficiently manage databases and applications at scale with multi-server management. Enhanced support for Virtualization will provide opportunities to further optimize resources through consolidation.SQL Azure – delivers on the Microsoft Data Platform vision of extending the SQL Server capabilities to the cloud as web-based services. SQL Azure provides an internet-facing database and advanced query processing services and is ideal solution for customers building new applications or integrating with existing investments in the cloud. Built on SQL Server technologies, SQL Azure provides the same enterprise-class availability, scalability , and security with the benefits of built-in data protection, self healing and disaster recovery as well as a consistent SQL Server programming model &amp; tools. SQL Azure is scheduled for release later this year.Parallel Data Warehouse is a highly scalable data warehouse appliance. It uses Massively Parallel Processing (MPP) to deliver high performance and scalability on SQL Server 2008, Windows Server 2008 and industry-standard hardware. Parallel Data Warehouse is a separate release/edition but will launch jointly with R2 in the first half of 2010.
  • #6: The “hero” offering that we’ll really sell broadly is SQL Server 2008 R2. You’ll notice that the messaging pillars for R2 are aligned with the Trusted, Productive, Intelligent messaging pillars for SQL Server 2008.To provide a comprehensive view of the R2 release (especially for SA discussions) this slide focuses on the key technology investments for each of the pillars. Trusted, Scalable Platform, it’s important to re-emphasize the enterprise-level security, high availability and scale delivered in SQL 2008 for mission critical applications. What’s new to the R2 release is StreamInsight for Complex Event Processing, Master Data Services for data consistency across heterogeneous systems, SQL Server support for up to 256 Logical Processors – providing greater flexibility in hardware choice, and enhanced data compression including Unicode compression for greater storage efficiency.IT &amp; Developer Efficiency, the release-defining scenarios for R2 are Virtualization and Multi-server Management to increase IT productivity and reduce data management costs. This is enabled by the new manageability enhancements delivered in Management Studio plus R2 support for Windows Server 2008 R2 Hyper-V Virtualization and Live Migration. With R2, we introduce a new concept to the market, a single unit of deployment which will significantly increase the efficiencies around data-tier application deployments and upgrades resulting in dramatically streamlined consolidation and management efforts. Managed Self Service BI – Self-service analytics is delivered with PowerPivot – which is about enabling users to get the data they need without IT having to do a 6-month project to create a new application. PowerPivot gives users the power and flexibility to take internal data, integrate it with other information – and within Excel do all the slicing and dicing you need to get to the view of information you really need for decision making. This is all done “in memory” through really high compression in RAM – which is very powerful. None of the other major BI vendors can do this. User can easily share their application with others by publishing it to SharePoint.Once published, there’s a PowerPivot Operations Dashboard in SharePoint that provides IT Pros with the ability to manage business intelligence through SharePoint like it was just another service they provide. This new dashboard allows IT Pros to look at which reports are being run, who’s running them, how often are they running them, is the server being over utilized, how can I move the app dynamically to another server…BI is basically another managed object for IT. The reports the users publish is the object and we enable IT to understand how it is being used and apply rules and policies to that.
  • #30: Your free PASS membership enables access to 12 Virtual Chapters, 24 Hours of PASS broadcasts, local PASS Chapters, professional development resources, newsletters, events calendar, and much moreMeet up with like-minded professionals throughout the year at face-to-face PASS Chapter meetings, discuss topical SQL Server issues, share tips and tricks, network, enjoy special guest speakers and get access to all things PASSAt PASS Summit,meet top industry experts , learn about best practices, effective troubleshooting, how to prevent issues, save money, and build a better SQL Server environment