Experience sql server on l inux and docker
- 2. End-to-end mobile BI on any device Choice of platform and language Most secure over the last 7 years 0 20 40 60 80 100 120 140 160 180 200 Vulnerabilities(2010-2016) A fraction of the cost Self-serviceBIperuser Only commercial DB with AI built-in Microsoft Tableau Oracle $120 $480 $2,230 Industry-leading performance 1/10 Most consistent data platform #1 TPC-H performance 1TB, 10TB, 30TB #1 TPC-E performance #1 price/performance T-SQL Java C/C++ C#/VB.NET PHP Node.js Python Ruby R R and Python + in-memory at massive scale Native T-SQL scoring S Q L S E R V E R 2 0 1 7 I N D U S T R Y - L E A D I N G P E R F O R M A N C E A N D S E C U R I T Y N O W O N L I N U X A N D D O C K E R Private cloud Public cloud In-memory across all workloads 1/10th the cost of Oracle
- 3. F L E X I B L E , R E L I A B L E D ATA M A N A G E M E N T SQL Server on the platform of your choice Support for RedHat Enterprise Linux (RHEL), Ubuntu, and SUSE Enterprise Linux (SLES) Linux and Windows Docker containers Windows Server / Windows 10 Package-based installation: Yum Install, Apt-Get, and Zypper Database Compatibility on all Platforms Choice of platform and language
- 4. Windows Linux Editions Developer, Express, Web, Standard, Enterprise Services Database Engine, Integration Services, SQL Server Agent ML Services, Analysis Services, Reporting Services, MDS, DQS Mission critical performance and HADR Maximum number of cores Unlimited Unlimited Maximum memory utilized per instance 24 TB 12 TB Maximum database size 524 PB 524 PB Basic OLTP (Basic In-Memory OLTP, Basic operational analytics) Advanced OLTP (Advanced In-Memory OLTP, Advanced operational analytics, adaptive query processing) SQL Server Replication Basic high availability (2-node single database failover, non-readable secondary) Advanced HA (Always On - multi-node, multi-db failover, readable secondaries) Security Basic security (Basic auditing, Row-level security, Data masking, Always Encrypted, Active Directory Authentication) Advanced security (Transparent Data Encryption) Data warehousing PolyBase Basic data warehousing/data marts (Basic In-Memory ColumnStore, Partitioning, Compression) Advanced data warehousing (Advanced In-Memory ColumnStore) Advanced data integration (Fuzzy grouping and look ups) Tools Windows ecosystem: Full-fidelity Management & Dev Tool (SSMS & SSDT), command line tools Linux/OSX/Windows ecosystem: Dev tools (VS Code), DB Admin GUI tool, command line tools Developer Programmability (T-SQL, CLR, Data Types, JSON, Graph) Distributed Transactions What’s in SQL Server on Linux
- 5. Linux loves packages • Major Linux distributions follow the pattern of using a package manager. • RHEL: RPM and yum. • Ubuntu: Debian and apt-get • SUSE: RPM and zypper. • Package: binaries + instructions to install. • Benefits: dependency management, automatic versioning, one-tool-to-rule- them-all, architecture control. mssql- server mssql- tools mssql- server-fts mssql- server-ha mssql- server-is
- 6. mssql-conf • mssql-conf is a configuration script that installs with SQL Server 2017 on RHEL, SUSE, and Ubuntu. This utility can be used to set: • Enable SQL Server Agent • TCP port • Default data directory • Default log directory • Default dump directory • Default backup directory • Core dump type • Enable Availability Groups • Set startup traceflags • Set collation SQL Server also supports config through environment variables
- 7. Offline simple and easy Go for the complete unattended experience with SQLCAT Simple update to the latest release Rollback to a previous update Uninstall is easy The Installation suite Updates based on CU or GDR repositories rm –rf /var/opt/mssql
- 8. SQL Server Linux Architecture LibOS (Win API and Kernel) Host Extension mapping to OS system calls (IO, Memory, CPU scheduling) SQLOS (SQLPAL) SQL PAL Everything else System Resource & Latency Sensitive Code Paths SQL Platform Abstraction Layer (SQLPAL) Linux Kernel SQLSERVRSQLAGENT ABI API Linux APIs (mmap, pthread_create, …) Linux Process (Ring 3) Ring 0 Based on Microsoft Research Drawbridge Project Parent “Watchdog” processfork
- 10. Does it perform? Go read what our customers say #1 TPC-H Benchmark1 at 1,009,065 QphH with price/performance of $0.47 USD per QphH World’s First Enterprise Class Diskless Database Columnstore Indexes and In-Memory OLTP full capabilities 180 Billon Rows scanned in < 20 secs with 480 CPUs Adaptive Query Processing and Automatic Tuning Linux Performance Best Practice Guidance 1 #1 non-clustered 1TB TPC-H (http://www.tpc.org/3331)
- 11. S Q L S E R V E R 2 0 1 7 : I N D U S T R Y - L E A D I N G S E C U R I T Y SECURITY Comprehensive, easy-to-use security to implement enterprise-grade protection (Getting started: https://docs.microsoft.com/en-us/sql/linux/sql-server-linux-security-get-started) Information Protection Access Management Threat Protection 0 20 40 60 80 100 120 140 160 180 200 Vulnerabilities(2010-2016) + Database access SQL Server Logins Active Directory Authentication Roles and permissions Schemas Application access Row-Level Security Dynamic Data Masking Encryption-at-rest Transparent data encryption (TDE) Backup encryption Cell-level encryption Encryption in transit Transport Layer Security (TLS 1.2) Client-side encryption Always Encrypted Tracking & investigation Fine-grained audit openssl and linux config
- 12. AD Authentication on Linux • Setup + Config requires Linux specifics (e.g. realm to join the domain) • Built on Kerberos and GSSAPI • The steps are…. Join SQL Server host to AD domain Create AD user for SQL Server and set SPN Configure SQL Server service keytab Create AD-based logins in Transact-SQL Connect to SQL Server using AD Authentication
- 13. SQL Server on Linux: HADR CLUSTER_TYPE = EXTERNAL Auto failover Pacemaker SQL resource agent (mssql-server-ha) 3 replicas required Configuration only replica for metadata Full AG capabilities Pacemaker and Corosync Single SQL Server instance SQL resource agent (mssql-server-ha) Shared Storage ISCI, NFS, SMB CLUSTER_TYPE=NONE No clustering required Manual or forced failover Sync or async replicas Read scale routing Cross-Platform Failover Cluster Instance High Availability Availability Group Read-Scale Availability Group SQL Server HADR partners Github open source repo
- 14. • Existing command line tools • sqlcmd, bcp, sqlpackage • Visual Studio Code mssql extension • SQL Operations Studio • mssql-cli • mssql-scripter SQL Server 2017 on Linux Tools and programmability • Windows SQL Server Management Studio (SSMS) • Windows SQL Server Data Tools (SSDT) • 3rd party tools continue to work • Existing drivers/frameworks supported
- 15. Docker Containers: What and why? • Docker: Multi-platform container engine based on Linux and Windows Containers. • NOT virtualization • Image • lightweight, stand-alone, executable package that includes everything needed to run a piece of software, including the code, a runtime, libraries, environment variables, and config files • Container • runtime instance of an image—what the image becomes in memory when actually executed • Imagine a world of “database containers” • What is all this talk about DevOps and CI/CD? • Kubernetes and Containers for HA
- 16. Persisted Storage VM VM VM Container Container Container Portable • Run anywhere Docker is supported Lightweight • Reduced disk, CPU, and memory footprint Consistent • Build a consistent image of SQL Server, scripts, and tools Efficient • Faster deployment, reduced patching, and less downtime
- 17. Node Node Persistent Volume Claim Node Kubernetes Deployment “Shared storage” HA in Kubernetes Pod SQL Server Deployment Load Balancer Service Pod SQL Server Pod SQL Server SQL Server Containers Built-in HADR (No Clustering required) Built-in HADR (No Clustering required)
- 19. Migrating to SQL Server on Linux SQL Server | SQL VM | Azure SQL Database | Azure SQL Data Warehouse SQL Server Migration Assistant (SSMA) Legacy SQL Server Data Migration Assistant Database Backup Log Shipping Clusterless AG (2017+ only) Bulk Import SSIS Database Experimentation Assistant SQL Server 2017 on Linux
- 20. Challenge • Technology solutions company incurred high hardware and storage expenses • Tier-two workloads of archived data hampered profitability Impact • Cut costs 80% and time to ROI 70% with white box servers running SQL Server on Linux R E D U C E D H A R D W A R E A N D S T O R A G E C O S T S B Y 8 0 % Easy migration from Windows to Linux “Moving SQL Server from Windows to Linux was actually one of the easiest migration experiences that we've had.” Chris Amaris, Chief Technology Officer, Convergent Computing
- 21. S Q L S E R V E R v N E X T I N V E S T M E N T T H E M E S Reason over any data, anywhere Choice of language and platform Industry leading performance and security Only commercial database with AI built-in Continued improvements to SQL Server on Linux
- 22. posts on Linux Microsoft Virtual Academy Training here repo show on Channel9 post http://aka.ms/sqlchannel
Editor's Notes
- #3: #1 price/performance in TPC-H non-clustered as of 1/12/2018 - http://www.tpc.org/3331 #1 1TB TPC-H non-clustered benchmark as of 1/19/2018 - http://www.tpc.org/3331 #1 TPC-E performance as of 1/19/2018 - http://www.tpc.org/4081
- #4: Bob presents this Choose your platform based on the platform not SQL Server running on that platform.
- #5: Collapse BI and AA into one single row AA: “single R integration BI: Corporate business intelligence and mobile BI
- #8: mins
- #10: Follow the instructions in readme.md in demo1_explore_sql_linux
- #11: 1 #1 non-clustered 1TB TPC-H (http://www.tpc.org/3331)
- #13: Available on Windows, but the config and setup has changed on Linux. On Windows – password policy was the one that was available on your machine. On linux we have a hard coded password policy (complexity, expliration time etc.). Use MIT’s implementation of Kerberos Open source modules of id mapping
- #14: Technically we only support Pacemaker for Linux but we have other partners building HADR solutions for Linux. In addition, we have created an open source project for our resource agent so other vendors can build their own solutions based on it.
- #16: Database Containers – Imagine a world where a self-contained image was running SQL Server with your database and you don’t care about the OS platform that supports the contained image. DevOps – CI/CD Kubernates and HA – A new paradigm for HA for SQL Server using containers. Note: Windows Containers not supported in production today
- #17: A container is a standardized unit of software that includes everything needed to run it
- #18: Kubernetes is a container hosting platform Benefits of containers and Kubernetes fast to deploy self-contained – no installation required upgrades are easy because just upload a new image scalable, multi-tenant, designed for elasticity
- #19: Follow the instructions in readme.md in demo3_sql_docker
- #20: 2 mins
- #21: http://customers.microsoft.com/en-us/story/convergentcomputing