20180420 hk-the powerofmysql8

Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
Ivan Ma
Ivan-cs.ma@oracle.com
2018-04-20

Safe Harbor Statement
The following is intended to outline our general product direction. It is intended for
information purposes only, and may not be incorporated into any contract. It is not a
commitment to deliver any material, code, or functionality, and should not be relied upon
in making purchasing decisions. The development, release, and timing of any features or
functionality described for Oracle’s products remains at the sole discretion of Oracle.

The world's most popular open source database
8.0

Scalable &Stable
Better handling of high
contention, improved
security, and minimizing
downtime
Data Driven
Optimizing services with real
time data analysis
Developer First
Hybrid data model and data
access APIs for flexibility for
developers
Mobile Friendly
Ready for location based
services. Handling Emoji
and Unicode characters
MySQL 8.0 : Enables Modern Web Applications
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | 7
24x7at Scale

Before MySQL 8.0
Transactional Data Dictionary in MySQL 8.0
Atomic DDL
9
Data Dictionary
Data Dict
Storage
Engine
SQL
DD TableDD TableDD Table

Example - DROP SCHEMA at high level
10
MySQL 5.7
• Delete tables
– Metadata, TRN/TRG/FRM files
– Data, InnoDB tables
• Delete stored programs
– Metadata, rows in MyISAM (non-
transactional)
• Delete schema
– Metadata, DB.OPT file
Mix of filesystem, non-
transactional/transactional
storage and multiple commits
MySQL 8.0
• Delete tables
– Metadata, rows in InnoDB
– Data, InnoDB tables
• Delete stored programs
• Delete schema
Updates to transactional storage,
one commit

100 schemas times 50 tables (5000 tables)
INFORMATION_SCHEMA Performance
0 0.5 1 1.5 2 2.5 3 3.5 4
Count All Schemas
Schema aggregate size stats
All Dynamic Table Info
All Static Table Info
Auto Increments Near Limit
Count All Columns
Count All Indexes
MySQL 8.0
MySQL 5.7
Time in Seconds (Lower is better)

MySQL 8.0 : Flexibility for Developers
Hybrid APISQL FunctionData Type
MySQL X DevAPIJSON FunctionsJSON Datatype
13
Hybrid CRUD API of both SQL
and NoSQL provides more
flexibility for development
Various SQL functions
to search and modify JSON.
Analysing JSON with SQL by
converting into table with
JSON_TABLE()
Seamlessly managing
“unstructured” data in
RDBMS tables with efficient
update performance
{ } ();

Flexible Schema
CREATE TABLE seats (
id INT not null PRIMARY KEY,
venue_id INT,
doc JSON )
ENGINE=INNODB;

• MySQL Server 5.7 or 8.0
• JSON Datatype, JSON Function (5.7)
• Added Partial in-place JSON update (8.0)
• Replication Efficiency :
binlog_row_value_options=PARTIAL_JSON (8.0)
• more JSON functions (8.0)
JSON_TABLE, JSON_STORAGE_FREE,
JSON_STORAGE_SIZE, JSON_MERGE_PATH, …
• MySQL X Plugin & X Protocol
• Introduces X Protocol for relational- and
document operations
• Maps CRUD operations to standard SQL (relational
tables, JSON datatype and functions)
• X DevAPI
• New, modern, async developer API for CRUD and
SQL operations on top of X Protocol
• Introduces Collections as new Schema obj.
• MySQL Shell
• Offers interactive X DevAPI mode for app
prototyping
• MySQL Connectors
• Support for X DevAPI and X Session
15
MySQL Document Store – Components

JSON Functions
17
MySQL 5.7 and 8.0
JSON_ARRAY_APPEND()
JSON_ARRAY_INSERT()
JSON_ARRAY()
JSON_CONTAINS_PATH()
JSON_CONTAINS()
JSON_DEPTH()
JSON_EXTRACT()
JSON_INSERT()
JSON_KEYS()
JSON_LENGTH()
JSON_MERGE[_PRESERVE]()
JSON_OBJECT()
JSON_QUOTE()
JSON_REMOVE()
JSON_REPLACE()
JSON_SEARCH()
JSON_SET()
JSON_TYPE()
JSON_UNQUOTE()
JSON_VALID()
JSON_PRETTY()
JSON_STORAGE_SIZE()
JSON_STORAGE_FREE()
JSON_ARRAYAGG()
JSON_OBJECTAGG()
JSON_MERGE_PATCH()
JSON_TABLE()

Table  JSON
18
https://mysqlserverteam.com/mysql-8-0-from-sql-tables-to-json-documents-and-back-again/

JSONTABLE

X Dev API
• MySQL Connectors include X Dev API
• Use SQL, CRUD APIs
20
Operation Document Relational
Create Collection.add() Table.insert()
Read Collection.find() Table.select()
Update Collection.modify() Table.update()
Delete Collection.remove() Table.delete()
http://dev.mysql.com/doc/x-devapi-userguide/en/crud-operations-overview.html

Window FunctionCommon Table Expressions (CTEs)
• Alternative to derived table of subquery,
so called “WITH clause”
• For improvement of readability and
performance
• Frequently requested feature for data
analysis like ranking of data
• Calculation across a set of rows that are
related to the current row
WITH tickets_filtered AS (
SELECT tickets.*, seats.doc
FROM tickets
INNER JOIN seats ON
tickets.seat_id = seats.id
WHERE tickets.event_id = 3
)
SELECT * FROM tickets_filtered
WHERE doc->"$.section" = 201G
SELECT name, dept_id, salary,
RANK() OVER w AS `rank`
FROM employee
WINDOW w AS
(PARTITION BY dept_id
ORDER BY salary DESC);

Window function: RANK
22
SELECT name, dept_id AS dept, salary,
RANK() OVER w AS `rank`
FROM employee
WINDOW w AS (PARTITION BY dept_id
ORDER BY salary DESC);
name dept_id salary rank
Newt NULL 75000 1
Ed 10 100000 1
Newt 10 80000 2
Fred 10 70000 3
Michael 10 70000 3
Jon 10 60000 5
Dag 10 NULL 6
Pete 20 65000 1
Lebedev 20 65000 1
Jeff 30 300000 1
Will 30 70000 2

SELECT MONTH(date), SUM(sale),
AVG(SUM(sale)) OVER w AS sliding_avg
FROM sales
GROUP BY MONTH(date)
WINDOW w AS (ORDER BY MONTH(date)
RANGE BETWEEN 1 PRECEDING AND 1 FOLLOWING);
23
v
Month = 7
Month = 7
Month = 8
Month = 8
Sum (month 8) = 250
Sum (month 7) = 1200
可读性-高！
Windows Function – Moving Average

WITH tickets_filtered AS (
SELECT tickets.*, seats.doc
FROM tickets
INNER JOIN seats ON tickets.seat_id=seats.id
WHERE tickets.event_id = 3
)
SELECT * FROM tickets_filtered
WHERE doc->"$.section" = 201G
*************************** 1. row ***************************
id: 14447
event_id: 3
seat_id: 16430
order_id: NULL
doc: {"row": 2, "seat": 1, "section": 201, "properties": {"amenities":
[{"type": "washroom", "distance_in_meters": 171.80304788220957}, {"type": "bar",
"distance_in_meters": 58.53288591702737}, {"type": "snacks",
"distance_in_meters":
..
24
Common Table Expression
Using “WITH”

SQL to define SUDOKU problem statement
SELECT myproblem :=
'53..7....6..195....98....6.8...6...34..8.3..17...2...6.6....28....419..5....8..79' ;
25
Recursive CTE

Using Recursive CTE
Align into 9 X 9 box
26
WITH RECURSIVE
input(sud) as ( select @myproblem ),
digits(z,lp) as ( select '1', 1
union all
select cast(lp+1 as char), lp+1 from digits where lp<9 ),
x(s,ind) as ( select sud, instr(sud,'.') from input
union all
select concat(substr(s,1, ind-1), z, substr(s, ind+1)),
instr( concat(substr(s,1,ind-1), z, substr(s, ind+1)), '.')
from x, digits as z
where ind> 0
and not exists (
select 1 from digits as lp
where z.z = substr(s, ((ind-1) div 9) *9 + lp, 1)
or z.z = substr(s, ((ind-1)%9) + (lp-1) *9 + 1, 1)
or z.z = substr(s, (((ind-1) div 3) %3) * 3
+ ((ind-1) div 27 ) * 27 + lp
+ ((lp-1) div 3) * 6, 1)
) ),
my19(n) AS (
SELECT 1 AS n
UNION ALL
SELECT 1+n FROM my19 WHERE n<9)
SELECT substr(s,(n-1)*9 + 1,9) as ans from x, my19 where ind=0 ;

Performance
Schema
More instrumentation enabled by
default and better response to
view with indexes added
Invisible
Indexes
Indexes hidden from optimizer,
enables “soft delete” and “staged
rollout” of indexes
Solving
Contention
NOWAIT and SKIP LOCKED
options of SELECT FOR
UPDATE provides better handling
of hot row contention
MySQL 8.0 : Developers to Accelerate Applications
Expanded
Hints
Hints to control table orders for
join and indexes to be merged
without reorganize queries
Descending
Indexes
Faster by avoiding sorting data in
composite index using different
sorting orders
Set Session
Variables
Set a session variable for the
duration of a single statement with
new hint option SET_VAR

Resource Group
shell> cat /proc/cpuinfo | grep processor
processor : 0
processor : 1
mysql> CREATE RESOURCE GROUP CPU1 TYPE=USER VCPU=1;
Query OK, 0 rows affected (0.24 sec)
mysql> SELECT * from INFORMATION_SCHEMA.RESOURCE_GROUPS;
+---------------------+---------------------+------------------------+----------+-----------------+
| RESOURCE_GROUP_NAME | RESOURCE_GROUP_TYPE | RESOURCE_GROUP_ENABLED | VCPU_IDS | THREAD_PRIORITY |
+---------------------+---------------------+------------------------+----------+-----------------+
| USR_default | USER | 1 | 0-1 | 0 |
| SYS_default | SYSTEM | 1 | 0-1 | 0 |
| CPU0 | USER | 1 | 0 | 0 |
| CPU1 | USER | 1 | 1 | 0 |
+---------------------+---------------------+------------------------+----------+-----------------+
4 rows in set (0.00 sec)
mysql> SET RESOURCE GROUP CPU0;select "This user connection will use Processor 0 Only";
mysql> SELECT /*+ RESOURCE_GROUP(CPU0) */ "This user connection will use Processor 0 Only";
30
Creating CPU group and assign to query!!!
WL#9467: Resource Groups
https://dev.mysql.com/worklog/task/?id=9467

Write set parallelization
Highly Efficient Replication Applier
31
0
5000
10000
15000
20000
25000
30000
35000
40000
45000
50000
1 2 4 8 16 32 64 128 256
Updates/secondAppliesontheReplica
Number of Clients on the Master
Applier Throughput: Sysbench Update Index
COMMIT_ORDER WRITESET WRITESET_SESSION

Highly Efficient Replication Applier
• WRITESET dependency tracking allows applying a single threaded
workload in parallel.
– Delivers the best throughput of the three dependency trackers, at any concurrency
level.
• WRITESET_SESSION in addition to writesets tracks sessions dependencies
as well. Two transactions executed on the same session are always
scheduled in execution order on replica servers.
• Fast Group Replication recovery – time to catch up.
Write set parallelization
32

Replica quickly online by using WRITESET
Fast Group Replication Recovery
33
0
1
2
3
4
5
6
7
8
9
10
Sysbench RW at 33% capacity
(workload: 9K TPS on 64 threads)
Timetocacth-uppertimeofworloadmissing(ratio)
Group Replication Recovery Time: Sysbench
Update Index (durable settings)
MySQL 5.7.20 MySQL 8.0.3
0
1
2
3
4
5
6
7
8
9
10
Timetocacth-uppertimeofworloadmissing(ratio)
Group Replication Recovery Time: Sysbench
RW (durable settings)
MySQL 5.7.20 MySQL 8.0.3

More transactions per second while sustaining zero lag on any replica
High Cluster Throughput
34
8 16 32 64
Asynchronous Replication Sustained Throughput
(Sysbench Update Index, non-durable settings)
MySQL 5.7 MySQL 8.0.3
0
5000
10000
15000
20000
25000
30000
35000
40000
45000
8 16 32 64
Updatespersecond
Asynchronous Replication Sustained Throughput
(Sysbench Update Index, durable settings)
MySQL 5.7 MySQL 8.0.3

Replicate only changed fields of documents (Partial JSON Updates)
Efficient Replication of JSON Documents
35
0
10000
20000
30000
40000
50000
60000
Entire JSON Partial JSON
Bytespertransaction
Binary Log Space Per Transaction
FULL MINIMAL
• Numbers are from a specially
designed benchmark:
• tables have 10 JSON fields,
• each transaction modifies
around 10% of the data

0.0
500.0
1000.0
1500.0
2000.0
2500.0
1 2 3 4
Transactionspersecond
Throughput on the Master:
Partial JSON vs Complete JSON
4 8 16 32 64
Replicate only fields of the document that changed (Partial JSON Updates)
Efficient Replication of JSON Documents
36
0
1000
2000
3000
4000
5000
6000
7000
8000
9000
Throughput on the Slave:
Partial JSON vs Ccomplete JSON
4 8 16 32 64
FULL MINIMAL FULL MINIMAL FULL MINIMAL FULL MINIMAL
COMPLETE JSON PARTIAL JSON COMPLETE JSON PARTIAL JSON

Changes to defaults in MySQL 8
• Binary log is on by default.
• Logging of slave updates is on by default.
• Replication metadata is stored in InnoDB tables by default instead of files.
• Row-based applier uses hash scans to find rows instead of table scans.
• Transaction write-set extraction is on by default.
• Binary log expiration is set to 30 days by default.
• Server-id is set to 1 by default instead of 0.
High performance replication enabled out-of-the-box
37

David Jiang – Director of DB Development & Operation Group, Tencent

MySQL InnoDB Cluster: Architecture Example
M
M M
MySQL Connector
Apache / PHP
MySQL Router
MySQL Connector
Apache / PHP
MySQL Router
MySQL Shell
HA
Group Replication
41
MySQL Enterprise Monitor

Setup MySQL InnoDB Cluster with Word Press

MySQL 8 – InnoDB Cluster
• Single Primary Mode –
– group_replication_member_weight : 0 to 100  influence the primary member
election

MySQL Shell 8.0.11

MySQL Cloud Service

MySQL Cloud Capabilities
Full Control and Automated Management
MYSQL
ORACLE CLOUD
BACKUP/RECOVERY
PLUS HA & DR
AND Architects and IT
Ops
AUTOMATED
DBA AND PATCHING
SUPPORT ALL MYSQL
ENTERPRISE
EDITION FEATURES
SELF-SERVICE
PROVISIONING
FULL CONTROL WITH
SHELL ACCESS
ELASTIC SCALING
IN THE CLOUD

Capacity Planning: Scale Up CPU, RAM, and Storage
No need to Buy New
Hardware!

Simplified Deployment: Creating Your Service
Create your service with a
push-button interface

Simplified Deployment: Patching
User-Initiated Patching:
Informs you that an update is
available (Pre-installed)

Tools: MySQL Enterprise Backup
Backup the database by clicking
on ‘Back up Now’

Tools: MySQL Enterprise Monitor
Access MySQL Enterprise
Monitor by clicking on
‘Enterprise Monitor URL’

Tools: MySQL Enterprise Monitor

Extra Tools: Enterprise Monitor
• Real-time query performance
• Visual correlation graphs
• Find & fix expensive queries
• Detailed query statistics

MySQL Cloud Service + MySQL Enterprise !!!
Data
Protection
Authentication
Audit
Enterprise Encryption &
TDE
MySQL Firewall
MySQL Enterprise Backup
（MEB）
Monitoring
& Tooling
MySQLEnterprise Monitor
（MEM）
MGR + InnoDB Support
MEB- Online Backup
MEB-Incremental Backup
Performance
MEM- Query Analyzer
MEB-Faster Backup
Thread Pool Plugin
Enterprise
Support
Oracle MySQL Engineering
Consultative Support
Oracle Certified
Oracle Confidential – Internal/Restricted/Highly Restricted 54

MySQL 8.0 - Transformation Age
• General Available & What is New in MySQL 8.0
– https://dev.mysql.com/doc/refman/8.0/en/mysql-nutshell.html
• Highly Robust, Scalable, Reliable and Secure
• Ease of Management & Performance
• Trendy, Data Driven – Supporting GIS, Window Function and Recursive CTE …
• Flexible Data Architecture – JSON / Document Store, Hybrid Database
• Cross platforms with Enterprise Features and Tools
– MySQL Enterprise Monitor 8.0 GA
– MySQL Shell 8.0 GA
https://dev.mysql.com/downloads/mysql/8.0.html
https://www.mysql.com/products/enterprise/
Download Now
MySQL Enterprise Edition for MySQL 8.0

20180420 hk-the powerofmysql8

More Related Content

What's hot (20)

Similar to 20180420 hk-the powerofmysql8 (20)

More from Ivan Ma (12)

Recently uploaded (20)

20180420 hk-the powerofmysql8