Real-Time Geospatial Intelligence at Scale
Download as PPTX, PDF1 like504 views
This document introduces MemSQL 5, a real-time database platform for transactions and analytics. It discusses how MemSQL is designed for modern workloads by providing scalable SQL on in-memory and solid-state storage across distributed data centers or the cloud. MemSQL allows for real-time processing through features like stream processing and real-time dashboards. Examples are given of using MemSQL for Internet of Things applications to monitor wind turbines and taxi ride data.
Real-Time Geospatial Intelligence at Scale
- 1. Real-Time Geospatial Intelligence at Scale 1
- 2. Mike Kilrain President, MemSQL USG 2
- 3. We live in an on-demand economy 3
- 5. Data scientists need to carry the world forward 5
- 6. Too often stuck with batch processing and slow ETL 6
- 7. Slow Loading Slow Queries No Concurrency On-going Data Processing Barriers 7
- 8. There is a shift underway… the move to real time 8
- 9. INTRODUCING MEMSQL 5 The Real-Time Database Platform for Transactions and Analytics memsql.com/download
- 10. 10 MemSQL is Designed for Modern Workloads Scalable SQL In-Memory and Solid- State Distributed Datacenter or Cloud Multi-mode OLTP, OLAP, HTAP Multi-model ANSI SQL Key-value Document/JSON Geospatial In-Memory rowstore Solid-state columnstore Stream directly to rowstore or columnstore Distributed query optimizer and execution Scale-out on commodity hardware Deploy on-premises Cloud agnostic Amazon Microsoft Google Digital Ocean Simple Real-Time Affordable Flexible SSD
- 11. 11
- 12. Real-time dashboards are just the first step 12
- 14. Spark MLlib Predictive Model Raw Sensor 1 + Predictive Score 1 Real-Time Scoring for Predictive Applications ID S1 S2 P1 P2 1 … Real- Time Inputs Apache Spark STREAMLINER Business Logic 14
- 15. Hadoop Apache Spark STREAMLINER Extending Hadoop to Real-Time Processing 15
- 16. Putting Streamliner to work for IoT applications 16
- 17. Internet-of-Things simulation depicting health of wind turbines globally. 7 machines - AWS C4-2X large instances, at $0.311 per hour per machine, annual cost ~ $19,000. MemSQL PowerStream 17
- 18. Sensors Wind Turbine Wind Farm MemSQL PowerStream 197,000 wind turbines around the world 18
- 19. 1 to 2 million data points per second with MemSQL Streamliner 19
- 20. Apache Spark STREAMLINER Data Producers (simulating sensor activity) PowerStream User Interface MemSQL PowerStream Architecture 20
- 21. 21
- 22. 22
- 23. Real-time Business Intelligence dashboard Simulated pickup/ drop-off data streamed into MemSQL as rides complete TaxiStats 23
- 24. Real-time data on pickups by ZIP code Total ride volume Rides by time of day ZoomData Dashboard 24
- 26. THANK YOU