MySQL InnoDB + NDB Cluster - 2018 MySQL Days
0 likes134 views
This document discusses MySQL high availability options including InnoDB Cluster and NDB Cluster. It provides an overview of the two technologies, comparing their architectures and features. InnoDB Cluster provides high availability using Group Replication within MySQL servers, while NDB Cluster uses a shared-nothing architecture and the NDB storage engine to provide high availability and automatic sharding of data. The document outlines Oracle's vision for enhancing MySQL with more integrated high availability and scaling capabilities.
MySQL InnoDB + NDB Cluster - 2018 MySQL Days
- 6. Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | How Do The Two Compare II MySQL InnoDB Cluster MySQL NDB Cluster Storage Engine InnoDB NDBCLUSTER Distributed Architecture Shared nothing Shared nothing Consistency Model Fairly Strong Consistency Strong Consistency Sharding No Yes Arbitration No Yes Load Balancing No Yes NoSQL APIs MySQL Document Store Native NDB API Operational Complexity Medium High Administration Standard (MySQL) Custom (MySQL + NDB)
- 10. Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | 10 A single product: MySQL • All components created together • Tested together • Packaged together Flexible and Modern • C++ 11 • Protocol Buffers • Developer friendly MySQL InnoDB Cluster – Goals Easy to use • A single client: MySQL Shell • Easy packaging • Homogenous servers Scale-out • Sharded clusters • Federated system of N replica sets • Each replica set manages a shard
- 15. Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | • One Product: MySQL – All components created together – Tested together – Packaged together • Easy to Use – One client: MySQL Shell – Easy packaging – Integrated orchestration – Homogenous servers • Flexible and Modern – SQL and NoSQL together – Protocol Buffers – Developer friendly • Support Read/Write Scale Out – Sharded clusters – Federated system of N replica sets – Each replica set manages a shard 15 MySQL InnoDB Cluster: Goals
- 18. Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | MySQL Group Replication: What Is It? • Group Replication library – Implementation of Replicated Database State Machine theory • MySQL GCS is based on Paxos (variant of Mencius) – Provides virtually synchronous replication for MySQL 5.7+ – Supported on all MySQL platforms • Linux, Windows, Solaris, OSX, FreeBSD “Multi-master update anywhere replication plugin for MySQL with built-in conflict detection and resolution, automatic distributed recovery, and group membership.” 18 App Servers with MySQL Router MySQL Group Replication MySQL Shell Setup, Manage, Orchestrate
- 21. Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | 21 MySQL Server: Full Stack
- 23. Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | MySQL Router: 2.1 • Native support for InnoDB clusters – Understands Group Replication topology – Utilizes metadata schema stored on each member • Bootstraps itself and sets up client routing for the InnoDB cluster • Allows for intelligent client routing into the InnoDB cluster • Supports multi-master and single primary modes • Core improvements – Logging – Monitoring – Performance – Security 23 App Servers with MySQL Router MySQL Group Replication MySQL Shell Setup, Manage, Orchestrate labs.mysql.com
- 25. Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | MySQL Shell 25 A single unified client for all administrative and operations tasks App Servers with MySQL Router MySQL Group Replication MySQL Shell Setup, Manage, Orchestrate • Multi-Language: JavaScript, Python, and SQL – Naturally scriptable • Supports both Document and Relational models • Exposes full Development and Admin API ”MySQL Shell provides the developer and DBA with a single intuitive, flexible, and powerfull interface for all MySQL related tasks!”
- 26. Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | MySQL Shell: Admin API • mysql-js> dba.help() • The global variable 'dba' is used to access the MySQL AdminAPI • Perform DBA operations – Manage MySQL InnoDB clusters • Create clusters • Deploy MySQL instances • Get cluster info • Start/Stop MySQL Instances • Validate MySQL instances … Database Administration Interface labs.mysql.com App Servers with MySQL Router MySQL Group Replication MySQL Shell Setup, Manage, Orchestrate
- 30. Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | MySQL Enterprise Monitor • Native holistic support for InnoDB clusters – Topology views – Detailed metrics and graphs – Best Practice advice • Monitoring of MySQL Routers • Monitoring of Group Replication 30
- 33. Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | HLR / HSS Billing, AuC, VLR AuC, Call Routing, Billing Location Updates Pre & Post Paid • Massive volumes of write traffic • < 3ms database response • Downtime & lost transactions = lost $ • Extremly cost sensitive market MySQL Cluster in Action: http://bit.ly/oRI5tF No Trade-Offs: Cellular Network
- 34. Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | MySQL Cluster Overview • Memory optimized tables with durability • Predictable Low-Latency, Bounded Access Time REAL-TIME • Auto-Sharding, Active-Active • ACID Compliant, OLTP + Real-Time Analytics HIGH SCALE, READS + WRITES FULLY ELASTIC • Active-Active, Shared nothing, no Single Point of Failure • Self Healing + On-Line Operations 99.999% AVAILABILITY • Key/Value + Complex, Relational Queries • SQL + Memcached + JavaScript + Java + HTTP/REST & C++ SQL + NoSQL • Open Source + Commercial Editions, Easy to use and deploy • Commodity hardware + Management, Monitoring Tools LOW TCO 9th April 2015 Copyright 2015, oracle and/or its affiliates. All rights reserved 34 • Add and remove storage and performance capacity in seconds • Fully cloud enabled
- 37. Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | Data Partitioning / Auto-sharding 23/02/18 Copyright 2015, oracle and/or its affiliates. All rights reserved 37 User-id (PK) Service (PK) Data 1773467253 chat xxx 6257346892 chat xxx 1773467253 photos xxx 7234782739 photos xxx 8235602099 reminders xxx 8437829249 location xxx MySQL Cluster Data Nodes
- 38. Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | Data Partitioning / Auto-sharding 23/02/18 Copyright 2015, oracle and/or its affiliates. All rights reserved 38 User-id (PK) Service (PK) Data 1773467253 chat xxx 6257346892 chat xxx 1773467253 photos xxx 7234782739 photos xxx 8235602099 reminders xxx 8437829249 location xxx MySQL Cluster Data Nodes Shard Key
- 39. Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | Data Partitioning / Auto-sharding 23/02/18 Copyright 2015, oracle and/or its affiliates. All rights reserved 39 User-id (PK) Service (PK) Data 1773467253 chat xxx 6257346892 chat xxx 1773467253 photos xxx 7234782739 photos xxx 8235602099 reminders xxx 8437829249 location xxx MySQL Cluster Data Nodes Shard Key
- 40. Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | Node Group Data Node 1 • Data transparently sharded between Node Groups • Each fragment active in one Data Node with synchronous replication to 2nd Data Node in same Node Group 23/02/18 Copyright 2015, oracle and/or its affiliates. All rights reserved 40 Data Node 2 Node Group Data Node 3 Data Node 4 Data Partitioning / Auto-sharding
- 41. Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | Data Partitioning / Auto-sharding • DBA chooses which part of Primary Key to use as shard key • Fragment for each row decided by hashing the sharding key 23/02/18 Copyright 2015, oracle and/or its affiliates. All rights reserved 41 User-id (PK) Service (PK) Data 1773467253 chat xxx 6257346892 chat xxx 1773467253 photos xxx 7234782739 photos xxx 8235602099 reminders xxx 8437829249 location xxx Shard Key Node Group Data Node 1 Data Node 2 Node Group Data Node 3 Data Node 4
- 42. Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | • Data automatically rearranged to use new capacity • Designed to be a slow background process not impacting real-time performance. 23/02/18 Copyright 2015, oracle and/or its affiliates. All rights reserved 42 Node Group Data Node 1 Data Node 2 Node Group Data Node 3 Data Node 4 Node Group Data Node 5 Data Node 6 On-line Scaling and Elasticity Re-partioning
- 43. Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | MySQL Cluster 7.2: 1.2 Billion UPDATEs per Minute • NoSQL C++ API, flexaSynch benchmark • 30 x Intel E5-2600 Intel Servers, 2 socket, 64GB • ACID Transactions, with Synchronous Replication http://www.mysql.com/why-mysql/ white-papers/mysql-cluster- benchmarks-1-billion-writes-per-minute/ 0 5 10 15 20 25 2 4 6 8 10 12 14 16 18 20 22 24 26 28 30 MillionsofUPDATEsperSecond MySQL Cluster Data Nodes 9th April 2015 Copyright 2015, oracle and/or its affiliates. All rights reserved 43
- 45. Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | • Reading from backup allows to read from any copy • Previously all reads were directed towards the primary fragment only Confidential – Oracle Internal/Restricted/Highly Restricted 45 MySQL NDB 7.5: Reading from backup Node Group Data Node 1 Data Node 2
- 46. Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | Next Steps Learn More • www.mysql.com/cluster • https://dev.mysql.com/doc/mysql-innodb-cluster/en/ • Authentic MySQL Curriculum: http://oracle.com/education/mysql Try it Out • dev.mysql.com/downloads/cluster/ 7.4 GA and 7.5 DMR 1 • https://labs.mysql.com/ Let us know what you think • http://mysqlhighavailability.com/ • forums.mysql.com/list.php?25 9th April 2015 Copyright 2015, oracle and/or its affiliates. All rights reserved 46