Enabling Real-Time Analytics for IoT
1 like567 views
Rick Negrin discusses enabling real-time analytics for IoT applications. He describes how industries are increasingly needing real-time analytics due to trends like the on-demand economy and rise of IoT. He then outlines an architecture using Kafka for messaging and MemSQL for real-time analytics. MemSQL is presented as a SQL database that can ingest millions of events per second while analyzing petabytes of data. Finally, Negrin demonstrates an IoT application called MemEx that combines MemSQL, Kafka and Spark to enable predictive analytics on sensor data for supply chain management.
Enabling Real-Time Analytics for IoT
- 1. Rick Negrin, Director of Product Management, MemSQL March 3, 2017 Enabling Real-Time Analytics for IoT Building Real-Time Data Pipelines with Kafka and MemSQL
- 2. The Rise of Real-Time Analytics On-demand economy Internet of Things New technologies
- 3. Retail Delivery Financial Energy Auto and Transportation And more... Industries that Need Real Time
- 4. Data Producers (simulating sensor activity) User Interface Architecting for Real-Time Analytics Database ... Data Transformation Message Queue
- 5. About MemSQL
- 6. 6
- 7. 7 Real-Time Architecture and Ecosystem Real-Time Data Warehouse Streaming Ingest Real-time data pipelines Live Data Memory optimized tables Historical Data Disk optimized tables Applications Embed custom visualizations and reports for analytic applications BI Dashboards Tableau, Looker, Zoomdata, MicroStrategy, and Qlik On-Premises or Cloud Freely deploy on- premises, Amazon AWS, Microsoft Azure, Google Cloud Platform and beyond Containers and VMs Deploy on virtualization and container services like Docker, Mesosphere, VMware, Kubernetes, Cisco, Dell and HP Historical Data HDFS, Amazon S3, SQL Server, SAP, Oracle, MySQL Real-Time Data Operational Apps and web services Messaging and Transforms Kafka and Spark MemSQL is the SQL database capable of ingesting millions of events per second while analyzing petabytes of data for industry-leading time to insight results
- 8. 8 Community Free Forever Enterprise Free 30-day Trial Cloud Managed Service ▪ Unlimited capacity and scale ▪ Comprehensive SQL features ▪ 24/7 support ▪ Enterprise functionality ▪ High availability ▪ Cluster replication ▪ Granular access controls ▪ Security features ▪ Fully managed ▪ Enterprise functionality ▪ Currently in Pre-Release (GA in 2017) MemSQL Editions
- 9. Data Producers (simulating sensor activity) User Interface Architecting for Real-Time Analytics MemSQL ... Data Transformation Message Queue
- 10. MemEx
- 11. MemEx: IoT Showcase Application - Combines MemSQL, Apache Kafka, and Spark for global supply chain management - Enables enterprises to predict throughput of supply warehouses - Processes 2 million data points, based on 2,000 sensors across 1,000 warehouses
- 13. Data Producers (simulating sensor activity) MemEx UI (OpenMaps) MemEx Architecture ... Data Transformation Apache Spark Spark MLlib Predictive Model Raw Sensor 1 + Predictive Score 1 S1 P1 1
- 14. Q&A
- 15. Thank You