SlideShare a Scribd company logo
© Copyright EnterpriseDB Corporation, 2019. All rights reserved.
Running Highly
Available Postgres
Databases in
Containers
Aziz Rahman, Lead Architect, EDB Postgres
Container Platform
Marc Linster, SVP, Product Development
and Support
1
© Copyright EnterpriseDB Corporation, 2019. All rights reserved.2
AGENDA
• Who is EDB?
• EDB Postgres Platform
• Cattle and Pets
• EDB Postgres Container Platform and Architecture
• Demo
• EDB Postgres Container Strategy
© Copyright EnterpriseDB Corporation, 2019. All rights reserved.
WHO IS EDB?
The world leader in
open-source based Postgres
software and services.
• Founded in 2004
• Recognized RDBMS leader by:
• Gartner
• Forrester
• Customer base > 4000
• 300+ employees
• Offices worldwide
• PostgreSQL community leader
3
© Copyright EnterpriseDB Corporation, 2019. All rights reserved.4
OVER 4,000 CUSTOMERS
U.S Customers
EMEA Customers APAC Customers
92
of the Fortune 500
311
of the Forbes
Global 2000
Our customers benefit from the most reliable, high-performing, flexible, open,
and cost-effective data management platform available.
© Copyright EnterpriseDB Corporation, 2019. All rights reserved.
5
ONLY OPEN SOURCE
BASED RDBMS IN
GARTNER MQ
EDB Recognized
6 Years In A Row on
Gartner’s Magic
Quadrant
© Copyright EnterpriseDB Corporation, 2019. All rights reserved.
EDB OPEN SOURCE LEADERSHIP
Named EDB open source committers and contributors
CONTRIBUTORS
Akshay Joshi Amul Sul Ashesh Vashi Ashutosh
Sharma
Dilip Kumar Jeevan Ladhe Mithun Cy M. Usama
Rushabh
Lathia
MAJOR CONTRIBUTORSCORE TEAM
Andres Freund Devrim Gündüz
Thomas Munro
Amit Kapila
Bruce Momjian
Dave Page
Robert Haas
6
© Copyright EnterpriseDB Corporation, 2019. All rights reserved.7
EDB POSTGRES PLATFORM
© Copyright EnterpriseDB Corporation, 2019. All rights reserved.8
EDB POSTGRES ADVANCED SERVER
Enterprise
capabilities add to
the strengths of
community
PostgreSQL
• Items in GREY are available
in Community PostgreSQL
• Items in RED are proprietary
additions in Advanced Server
© Copyright EnterpriseDB Corporation, 2019. All rights reserved.9
EDB POSTGRES PLATFORM
Today’s Focus
© Copyright EnterpriseDB Corporation, 2019. All rights reserved.10
Survey:
Are you running databases in containers today?
1) For production (10.11%)
1) Development (22.74%)
1) No (67.15%)
© Copyright EnterpriseDB Corporation, 2019. All rights reserved.11
Cattle and Pets
● Containers support an ephemeral and
fungible model
○ Need more? Make more!
○ Acting up? Replace it!
● Applications are fungible, like cattle - databases
are not
● Databases are
○ Persistent
○ Take a long time to warm up (cache loading)
○ When disconnected, they impact applications (disconnects,
transaction restarts, errors visible to the users, …)
● Treat databases lovingly - just like pets
© Copyright EnterpriseDB Corporation, 2019. All rights reserved.12
High Availability for Databases
● Things to consider
○ Do you need streaming replication with query routing, load balancing and/or read
scaling?
○ Do you need synchronous replication?
○ Double (triple?) check that the database container is really down (get consensus and
avoid false failover)
○ Promote carefully and make 100% sure that no application remains connected
(STONITH)
● Options:
○ Custom scripting
○ Stolon https://github.com/sorintlab/stolon
○ Patroni https://github.com/zalando/patroni/
○ EDB Failover Manager
© Copyright EnterpriseDB Corporation, 2019. All rights reserved.13
Survey:
How are you handling high availability in
database containers?
1) No HA (62.37%)
2) Stolon (1.55%)
3) Patroni (4.12%)
4) EDB Failover Manager (9.28%)
5) Other (22.68%)
© Copyright EnterpriseDB Corporation, 2019. All rights reserved.14
EDB Postgres Container Platform:
Components
Highly Available Data
Management
EDB Postgres Advanced
Server
● 9.5 - 11
● PostGIS optional
Always includes EDB
Failover Manager
Read Scalability
pgPool 4
● Query routing
● Load balancing
Backup and Recovery
EDB Backup and
Recovery
● Full and
incremental
backup
● Point in time
recovery
Tooling
Upgrade tool
● Migration paths
for older EPAS
versions
Monitoring & Management
Postgres Enterprise Manager
● Dashboards and Alerts
● Performance
management
© Copyright EnterpriseDB Corporation, 2019. All rights reserved.
Master Node
15
EDB Postgres Container Platform:
Architecture Overview
k8s Cluster
Management
Components
edb-service
Master Node
Client
Anti-affinity
BART
edb-as
Master
EPAS
+EFM Agent
+PEM Agent
PgPool +EFM
Agent
edb-pgpool
Master Node
PEMServer
edb-as
Standby
EPAS
+EFM Agent
+PEM Agent
PgPool
+EFM Agent
edb-pgpool
edb-pemserver
Master Node
edb-as
Standby
EPAS
+EFM Agent
+PEM Agent
Storage Subsystem
.
.
.
Worker Node 1
Worker Node 2
Worker Node 3
Shared Storageedb-bart
© Copyright EnterpriseDB Corporation, 2019. All rights reserved.16
EDB Postgres Container Platform:
Architecture Discussion
• Kubernetes features we used to create a
highly available containerized database
platform
• Stateful Sets
• Pod Anti-affinity
• Config Maps
• Secrets
• Dynamic Persistent Volume
© Copyright EnterpriseDB Corporation, 2019. All rights reserved.17
EDB Postgres Container Platform:
Architecture Discussion
● Deployment Methods
• Helm charts for Google Kubernetes Engine
• Operators (all Kubernetes environments) coming soon
• Deployment Options
• EDB Postgres Advanced Server (w. EDB Failover Manager)
• EFM enabled or disabled
• pgPool
• EDB Backup/Recovery Tool
• EDB Postgres Enterprise Manager
© Copyright EnterpriseDB Corporation, 2019. All rights reserved.18
Demo
© Copyright EnterpriseDB Corporation, 2019. All rights reserved.19
EDB Container Strategy
● Containers are becoming a key database deployment platform
○ Current focus: Development, some production deployments
○ Expectation 2020: Major production deployment for EDB Postgres platform
● Database best practices for containers are emerging
● EDB supports
○ GKE
○ OpenShift
○ IBM Cloud Private
○ Pivotal Cloud Foundry (planned for H2 2019)
© Copyright EnterpriseDB Corporation, 2019. All rights reserved.20
Next Steps
● EDB Container Platform 2.4 GA plan date: March 19 2019
○ Current scripts and V 2.4 containers are beta versions!
● Get your containers from EDB https://www.enterprisedb.com/advanced-
downloads
● Get the sample Helm chart https://get.enterprisedb.com/helm-charts/edb-
demo-0.1.1.tgz
https://get.enterprisedb.com/helm-charts/demo-values.yaml
○ Accesses the demo repo - will not be available after GA
● Join us at Postgres Vision in Boston June 24 - 26
○ Pre-conference workshop will be about databases in containers
© Copyright EnterpriseDB Corporation, 2019. All rights reserved.21
© Copyright EnterpriseDB Corporation, 2019. All rights reserved.
THANK YOU
info@enterprisedb.com
www.enterprisedb.com
22
Ad

Recommended

New Enterprise Cloud Database Options for 2019
New Enterprise Cloud Database Options for 2019
EDB
 
New Strategies for Database Modernization
New Strategies for Database Modernization
EDB
 
Migrate Today: Proactive Steps to Unhook from Oracle
Migrate Today: Proactive Steps to Unhook from Oracle
EDB
 
Whats New in Postgres 12
Whats New in Postgres 12
EDB
 
Advanced Database Patterns for Kubernetes
Advanced Database Patterns for Kubernetes
EDB
 
Exploring Postgres with Bruce Momjian
Exploring Postgres with Bruce Momjian
EDB
 
Best Practices for Monitoring Postgres
Best Practices for Monitoring Postgres
EDB
 
PostgreSQL to Accelerate Innovation
PostgreSQL to Accelerate Innovation
EDB
 
Zero-to-Hero: Running Postgres in Kubernetes
Zero-to-Hero: Running Postgres in Kubernetes
EDB
 
Les nouveautés d'EDB Postgres 11
Les nouveautés d'EDB Postgres 11
EDB
 
Keynote: The Postgres Ecosystem
Keynote: The Postgres Ecosystem
EDB
 
EDB Postgres & Tools in a Smart City Project
EDB Postgres & Tools in a Smart City Project
EDB
 
Preview of the EDB Postgres Roadmap
Preview of the EDB Postgres Roadmap
EDB
 
No Time to Waste: Migrate from Oracle to Postgres in Minutes
No Time to Waste: Migrate from Oracle to Postgres in Minutes
EDB
 
Webinar: Managing Postgres at Scale
Webinar: Managing Postgres at Scale
EDB
 
How to Build On-demand Oracle Compatible Postgres Database in Minutes
How to Build On-demand Oracle Compatible Postgres Database in Minutes
EDB
 
Remote DBA Service: Powering your DBA needs
Remote DBA Service: Powering your DBA needs
EDB
 
Zero-to-hero: Running Postgres in Kubernetes, Enterprise Postgres Day
Zero-to-hero: Running Postgres in Kubernetes, Enterprise Postgres Day
EDB
 
Managing Postgres at Scale With Postgres Enterprise Manager
Managing Postgres at Scale With Postgres Enterprise Manager
EDB
 
Cloud Native PostgreSQL - APJ
Cloud Native PostgreSQL - APJ
EDB
 
EDB Postgres Platform 11 Webinar
EDB Postgres Platform 11 Webinar
EDB
 
KT/KTDS Case Study: Open Source Database Adoption in Telecom
KT/KTDS Case Study: Open Source Database Adoption in Telecom
EDB
 
Database Dumps and Backups
Database Dumps and Backups
EDB
 
New Approaches to Migrating from Oracle to Enterprise-Ready Postgres in the C...
New Approaches to Migrating from Oracle to Enterprise-Ready Postgres in the C...
EDB
 
No Time to Waste: Migrate from Oracle to EDB Postgres in Minutes
No Time to Waste: Migrate from Oracle to EDB Postgres in Minutes
EDB
 
HTAP By Accident: Getting More From PostgreSQL Using Hardware Acceleration
HTAP By Accident: Getting More From PostgreSQL Using Hardware Acceleration
EDB
 
New enhancements for security and usability in EDB 13
New enhancements for security and usability in EDB 13
EDB
 
Optimizing Performance and Security with Platform Native Packaging
Optimizing Performance and Security with Platform Native Packaging
EDB
 
EDB Postgres with Containers
EDB Postgres with Containers
EDB
 
Best Practices for a Complete Postgres Enterprise Architecture Setup
Best Practices for a Complete Postgres Enterprise Architecture Setup
EDB
 

More Related Content

What's hot (20)

Zero-to-Hero: Running Postgres in Kubernetes
Zero-to-Hero: Running Postgres in Kubernetes
EDB
 
Les nouveautés d'EDB Postgres 11
Les nouveautés d'EDB Postgres 11
EDB
 
Keynote: The Postgres Ecosystem
Keynote: The Postgres Ecosystem
EDB
 
EDB Postgres & Tools in a Smart City Project
EDB Postgres & Tools in a Smart City Project
EDB
 
Preview of the EDB Postgres Roadmap
Preview of the EDB Postgres Roadmap
EDB
 
No Time to Waste: Migrate from Oracle to Postgres in Minutes
No Time to Waste: Migrate from Oracle to Postgres in Minutes
EDB
 
Webinar: Managing Postgres at Scale
Webinar: Managing Postgres at Scale
EDB
 
How to Build On-demand Oracle Compatible Postgres Database in Minutes
How to Build On-demand Oracle Compatible Postgres Database in Minutes
EDB
 
Remote DBA Service: Powering your DBA needs
Remote DBA Service: Powering your DBA needs
EDB
 
Zero-to-hero: Running Postgres in Kubernetes, Enterprise Postgres Day
Zero-to-hero: Running Postgres in Kubernetes, Enterprise Postgres Day
EDB
 
Managing Postgres at Scale With Postgres Enterprise Manager
Managing Postgres at Scale With Postgres Enterprise Manager
EDB
 
Cloud Native PostgreSQL - APJ
Cloud Native PostgreSQL - APJ
EDB
 
EDB Postgres Platform 11 Webinar
EDB Postgres Platform 11 Webinar
EDB
 
KT/KTDS Case Study: Open Source Database Adoption in Telecom
KT/KTDS Case Study: Open Source Database Adoption in Telecom
EDB
 
Database Dumps and Backups
Database Dumps and Backups
EDB
 
New Approaches to Migrating from Oracle to Enterprise-Ready Postgres in the C...
New Approaches to Migrating from Oracle to Enterprise-Ready Postgres in the C...
EDB
 
No Time to Waste: Migrate from Oracle to EDB Postgres in Minutes
No Time to Waste: Migrate from Oracle to EDB Postgres in Minutes
EDB
 
HTAP By Accident: Getting More From PostgreSQL Using Hardware Acceleration
HTAP By Accident: Getting More From PostgreSQL Using Hardware Acceleration
EDB
 
New enhancements for security and usability in EDB 13
New enhancements for security and usability in EDB 13
EDB
 
Optimizing Performance and Security with Platform Native Packaging
Optimizing Performance and Security with Platform Native Packaging
EDB
 
Zero-to-Hero: Running Postgres in Kubernetes
Zero-to-Hero: Running Postgres in Kubernetes
EDB
 
Les nouveautés d'EDB Postgres 11
Les nouveautés d'EDB Postgres 11
EDB
 
Keynote: The Postgres Ecosystem
Keynote: The Postgres Ecosystem
EDB
 
EDB Postgres & Tools in a Smart City Project
EDB Postgres & Tools in a Smart City Project
EDB
 
Preview of the EDB Postgres Roadmap
Preview of the EDB Postgres Roadmap
EDB
 
No Time to Waste: Migrate from Oracle to Postgres in Minutes
No Time to Waste: Migrate from Oracle to Postgres in Minutes
EDB
 
Webinar: Managing Postgres at Scale
Webinar: Managing Postgres at Scale
EDB
 
How to Build On-demand Oracle Compatible Postgres Database in Minutes
How to Build On-demand Oracle Compatible Postgres Database in Minutes
EDB
 
Remote DBA Service: Powering your DBA needs
Remote DBA Service: Powering your DBA needs
EDB
 
Zero-to-hero: Running Postgres in Kubernetes, Enterprise Postgres Day
Zero-to-hero: Running Postgres in Kubernetes, Enterprise Postgres Day
EDB
 
Managing Postgres at Scale With Postgres Enterprise Manager
Managing Postgres at Scale With Postgres Enterprise Manager
EDB
 
Cloud Native PostgreSQL - APJ
Cloud Native PostgreSQL - APJ
EDB
 
EDB Postgres Platform 11 Webinar
EDB Postgres Platform 11 Webinar
EDB
 
KT/KTDS Case Study: Open Source Database Adoption in Telecom
KT/KTDS Case Study: Open Source Database Adoption in Telecom
EDB
 
Database Dumps and Backups
Database Dumps and Backups
EDB
 
New Approaches to Migrating from Oracle to Enterprise-Ready Postgres in the C...
New Approaches to Migrating from Oracle to Enterprise-Ready Postgres in the C...
EDB
 
No Time to Waste: Migrate from Oracle to EDB Postgres in Minutes
No Time to Waste: Migrate from Oracle to EDB Postgres in Minutes
EDB
 
HTAP By Accident: Getting More From PostgreSQL Using Hardware Acceleration
HTAP By Accident: Getting More From PostgreSQL Using Hardware Acceleration
EDB
 
New enhancements for security and usability in EDB 13
New enhancements for security and usability in EDB 13
EDB
 
Optimizing Performance and Security with Platform Native Packaging
Optimizing Performance and Security with Platform Native Packaging
EDB
 

Similar to Running Highly Available Postgres Databases in Containers (20)

EDB Postgres with Containers
EDB Postgres with Containers
EDB
 
Best Practices for a Complete Postgres Enterprise Architecture Setup
Best Practices for a Complete Postgres Enterprise Architecture Setup
EDB
 
Neuerungen in EDB Postgres 11
Neuerungen in EDB Postgres 11
EDB
 
EDB Postgres in DBaaS & Container Platforms
EDB Postgres in DBaaS & Container Platforms
Ashnikbiz
 
Which PostgreSQL is right for your multi cloud strategy? P2
Which PostgreSQL is right for your multi cloud strategy? P2
Ashnikbiz
 
Business Continuity Considerations for a More Reliable Postgres Environment
Business Continuity Considerations for a More Reliable Postgres Environment
EDB
 
Cloud Native PostgreSQL
Cloud Native PostgreSQL
EDB
 
10/ EnterpriseDB @ OPEN'16
10/ EnterpriseDB @ OPEN'16
Kangaroot
 
Public Sector Virtual Town Hall
Public Sector Virtual Town Hall
EDB
 
Postgres Integrates Effectively in the "Enterprise Sandbox"
Postgres Integrates Effectively in the "Enterprise Sandbox"
EDB
 
Deploy, move and manage Postgres across cloud platforms
Deploy, move and manage Postgres across cloud platforms
Ashnikbiz
 
Optimizing Your Postgres ROI Through Best Practices
Optimizing Your Postgres ROI Through Best Practices
EDB
 
PostgreSQL as a Strategic Tool
PostgreSQL as a Strategic Tool
EDB
 
PostgreSQL High Availability in a Containerized World
PostgreSQL High Availability in a Containerized World
Jignesh Shah
 
Doing More with Postgres - Yesterday's Vision Becomes Today's Reality
Doing More with Postgres - Yesterday's Vision Becomes Today's Reality
EDB
 
OPEN'17_4_Postgres: The Centerpiece for Modernising IT Infrastructures
OPEN'17_4_Postgres: The Centerpiece for Modernising IT Infrastructures
Kangaroot
 
EDB Postgres Ark
EDB Postgres Ark
EDB
 
Top 10 Tips for an Effective Postgres Deployment
Top 10 Tips for an Effective Postgres Deployment
EDB
 
Integrating Hybrid Cloud Database-as-a-Service with Cloud Foundry’s Service​ ...
Integrating Hybrid Cloud Database-as-a-Service with Cloud Foundry’s Service​ ...
VMware Tanzu
 
EDB Postgres Platform
EDB Postgres Platform
EDB
 
EDB Postgres with Containers
EDB Postgres with Containers
EDB
 
Best Practices for a Complete Postgres Enterprise Architecture Setup
Best Practices for a Complete Postgres Enterprise Architecture Setup
EDB
 
Neuerungen in EDB Postgres 11
Neuerungen in EDB Postgres 11
EDB
 
EDB Postgres in DBaaS & Container Platforms
EDB Postgres in DBaaS & Container Platforms
Ashnikbiz
 
Which PostgreSQL is right for your multi cloud strategy? P2
Which PostgreSQL is right for your multi cloud strategy? P2
Ashnikbiz
 
Business Continuity Considerations for a More Reliable Postgres Environment
Business Continuity Considerations for a More Reliable Postgres Environment
EDB
 
Cloud Native PostgreSQL
Cloud Native PostgreSQL
EDB
 
10/ EnterpriseDB @ OPEN'16
10/ EnterpriseDB @ OPEN'16
Kangaroot
 
Public Sector Virtual Town Hall
Public Sector Virtual Town Hall
EDB
 
Postgres Integrates Effectively in the "Enterprise Sandbox"
Postgres Integrates Effectively in the "Enterprise Sandbox"
EDB
 
Deploy, move and manage Postgres across cloud platforms
Deploy, move and manage Postgres across cloud platforms
Ashnikbiz
 
Optimizing Your Postgres ROI Through Best Practices
Optimizing Your Postgres ROI Through Best Practices
EDB
 
PostgreSQL as a Strategic Tool
PostgreSQL as a Strategic Tool
EDB
 
PostgreSQL High Availability in a Containerized World
PostgreSQL High Availability in a Containerized World
Jignesh Shah
 
Doing More with Postgres - Yesterday's Vision Becomes Today's Reality
Doing More with Postgres - Yesterday's Vision Becomes Today's Reality
EDB
 
OPEN'17_4_Postgres: The Centerpiece for Modernising IT Infrastructures
OPEN'17_4_Postgres: The Centerpiece for Modernising IT Infrastructures
Kangaroot
 
EDB Postgres Ark
EDB Postgres Ark
EDB
 
Top 10 Tips for an Effective Postgres Deployment
Top 10 Tips for an Effective Postgres Deployment
EDB
 
Integrating Hybrid Cloud Database-as-a-Service with Cloud Foundry’s Service​ ...
Integrating Hybrid Cloud Database-as-a-Service with Cloud Foundry’s Service​ ...
VMware Tanzu
 
EDB Postgres Platform
EDB Postgres Platform
EDB
 
Ad

More from EDB (20)

Cloud Migration Paths: Kubernetes, IaaS, or DBaaS
Cloud Migration Paths: Kubernetes, IaaS, or DBaaS
EDB
 
Die 10 besten PostgreSQL-Replikationsstrategien für Ihr Unternehmen
Die 10 besten PostgreSQL-Replikationsstrategien für Ihr Unternehmen
EDB
 
Migre sus bases de datos Oracle a la nube
Migre sus bases de datos Oracle a la nube
EDB
 
EFM Office Hours - APJ - July 29, 2021
EFM Office Hours - APJ - July 29, 2021
EDB
 
Benchmarking Cloud Native PostgreSQL
Benchmarking Cloud Native PostgreSQL
EDB
 
Las Variaciones de la Replicación de PostgreSQL
Las Variaciones de la Replicación de PostgreSQL
EDB
 
NoSQL and Spatial Database Capabilities using PostgreSQL
NoSQL and Spatial Database Capabilities using PostgreSQL
EDB
 
Is There Anything PgBouncer Can’t Do?
Is There Anything PgBouncer Can’t Do?
EDB
 
Data Analysis with TensorFlow in PostgreSQL
Data Analysis with TensorFlow in PostgreSQL
EDB
 
Practical Partitioning in Production with Postgres
Practical Partitioning in Production with Postgres
EDB
 
A Deeper Dive into EXPLAIN
A Deeper Dive into EXPLAIN
EDB
 
IOT with PostgreSQL
IOT with PostgreSQL
EDB
 
A Journey from Oracle to PostgreSQL
A Journey from Oracle to PostgreSQL
EDB
 
Psql is awesome!
Psql is awesome!
EDB
 
EDB 13 - New Enhancements for Security and Usability - APJ
EDB 13 - New Enhancements for Security and Usability - APJ
EDB
 
Comment sauvegarder correctement vos données
Comment sauvegarder correctement vos données
EDB
 
Cloud Native PostgreSQL - Italiano
Cloud Native PostgreSQL - Italiano
EDB
 
Best Practices in Security with PostgreSQL
Best Practices in Security with PostgreSQL
EDB
 
Best Practices in Security with PostgreSQL
Best Practices in Security with PostgreSQL
EDB
 
All you need to know about CREATE STATISTICS
All you need to know about CREATE STATISTICS
EDB
 
Cloud Migration Paths: Kubernetes, IaaS, or DBaaS
Cloud Migration Paths: Kubernetes, IaaS, or DBaaS
EDB
 
Die 10 besten PostgreSQL-Replikationsstrategien für Ihr Unternehmen
Die 10 besten PostgreSQL-Replikationsstrategien für Ihr Unternehmen
EDB
 
Migre sus bases de datos Oracle a la nube
Migre sus bases de datos Oracle a la nube
EDB
 
EFM Office Hours - APJ - July 29, 2021
EFM Office Hours - APJ - July 29, 2021
EDB
 
Benchmarking Cloud Native PostgreSQL
Benchmarking Cloud Native PostgreSQL
EDB
 
Las Variaciones de la Replicación de PostgreSQL
Las Variaciones de la Replicación de PostgreSQL
EDB
 
NoSQL and Spatial Database Capabilities using PostgreSQL
NoSQL and Spatial Database Capabilities using PostgreSQL
EDB
 
Is There Anything PgBouncer Can’t Do?
Is There Anything PgBouncer Can’t Do?
EDB
 
Data Analysis with TensorFlow in PostgreSQL
Data Analysis with TensorFlow in PostgreSQL
EDB
 
Practical Partitioning in Production with Postgres
Practical Partitioning in Production with Postgres
EDB
 
A Deeper Dive into EXPLAIN
A Deeper Dive into EXPLAIN
EDB
 
IOT with PostgreSQL
IOT with PostgreSQL
EDB
 
A Journey from Oracle to PostgreSQL
A Journey from Oracle to PostgreSQL
EDB
 
Psql is awesome!
Psql is awesome!
EDB
 
EDB 13 - New Enhancements for Security and Usability - APJ
EDB 13 - New Enhancements for Security and Usability - APJ
EDB
 
Comment sauvegarder correctement vos données
Comment sauvegarder correctement vos données
EDB
 
Cloud Native PostgreSQL - Italiano
Cloud Native PostgreSQL - Italiano
EDB
 
Best Practices in Security with PostgreSQL
Best Practices in Security with PostgreSQL
EDB
 
Best Practices in Security with PostgreSQL
Best Practices in Security with PostgreSQL
EDB
 
All you need to know about CREATE STATISTICS
All you need to know about CREATE STATISTICS
EDB
 
Ad

Recently uploaded (20)

Viral>Wondershare Filmora 14.5.18.12900 Crack Free Download
Viral>Wondershare Filmora 14.5.18.12900 Crack Free Download
Puppy jhon
 
Enabling BIM / GIS integrations with Other Systems with FME
Enabling BIM / GIS integrations with Other Systems with FME
Safe Software
 
Crypto Super 500 - 14th Report - June2025.pdf
Crypto Super 500 - 14th Report - June2025.pdf
Stephen Perrenod
 
Mastering AI Workflows with FME - Peak of Data & AI 2025
Mastering AI Workflows with FME - Peak of Data & AI 2025
Safe Software
 
FIDO Seminar: Targeting Trust: The Future of Identity in the Workforce.pptx
FIDO Seminar: Targeting Trust: The Future of Identity in the Workforce.pptx
FIDO Alliance
 
AudGram Review: Build Visually Appealing, AI-Enhanced Audiograms to Engage Yo...
AudGram Review: Build Visually Appealing, AI-Enhanced Audiograms to Engage Yo...
SOFTTECHHUB
 
Data Validation and System Interoperability
Data Validation and System Interoperability
Safe Software
 
“From Enterprise to Makers: Driving Vision AI Innovation at the Extreme Edge,...
“From Enterprise to Makers: Driving Vision AI Innovation at the Extreme Edge,...
Edge AI and Vision Alliance
 
MuleSoft for AgentForce : Topic Center and API Catalog
MuleSoft for AgentForce : Topic Center and API Catalog
shyamraj55
 
Reducing Conflicts and Increasing Safety Along the Cycling Networks of East-F...
Reducing Conflicts and Increasing Safety Along the Cycling Networks of East-F...
Safe Software
 
AI vs Human Writing: Can You Tell the Difference?
AI vs Human Writing: Can You Tell the Difference?
Shashi Sathyanarayana, Ph.D
 
Integration of Utility Data into 3D BIM Models Using a 3D Solids Modeling Wor...
Integration of Utility Data into 3D BIM Models Using a 3D Solids Modeling Wor...
Safe Software
 
Bridging the divide: A conversation on tariffs today in the book industry - T...
Bridging the divide: A conversation on tariffs today in the book industry - T...
BookNet Canada
 
vertical-cnc-processing-centers-drillteq-v-200-en.pdf
vertical-cnc-processing-centers-drillteq-v-200-en.pdf
AmirStern2
 
Down the Rabbit Hole – Solving 5 Training Roadblocks
Down the Rabbit Hole – Solving 5 Training Roadblocks
Rustici Software
 
Supporting the NextGen 911 Digital Transformation with FME
Supporting the NextGen 911 Digital Transformation with FME
Safe Software
 
ENERGY CONSUMPTION CALCULATION IN ENERGY-EFFICIENT AIR CONDITIONER.pdf
ENERGY CONSUMPTION CALCULATION IN ENERGY-EFFICIENT AIR CONDITIONER.pdf
Muhammad Rizwan Akram
 
“Addressing Evolving AI Model Challenges Through Memory and Storage,” a Prese...
“Addressing Evolving AI Model Challenges Through Memory and Storage,” a Prese...
Edge AI and Vision Alliance
 
War_And_Cyber_3_Years_Of_Struggle_And_Lessons_For_Global_Security.pdf
War_And_Cyber_3_Years_Of_Struggle_And_Lessons_For_Global_Security.pdf
biswajitbanerjee38
 
FME for Distribution & Transmission Integrity Management Program (DIMP & TIMP)
FME for Distribution & Transmission Integrity Management Program (DIMP & TIMP)
Safe Software
 
Viral>Wondershare Filmora 14.5.18.12900 Crack Free Download
Viral>Wondershare Filmora 14.5.18.12900 Crack Free Download
Puppy jhon
 
Enabling BIM / GIS integrations with Other Systems with FME
Enabling BIM / GIS integrations with Other Systems with FME
Safe Software
 
Crypto Super 500 - 14th Report - June2025.pdf
Crypto Super 500 - 14th Report - June2025.pdf
Stephen Perrenod
 
Mastering AI Workflows with FME - Peak of Data & AI 2025
Mastering AI Workflows with FME - Peak of Data & AI 2025
Safe Software
 
FIDO Seminar: Targeting Trust: The Future of Identity in the Workforce.pptx
FIDO Seminar: Targeting Trust: The Future of Identity in the Workforce.pptx
FIDO Alliance
 
AudGram Review: Build Visually Appealing, AI-Enhanced Audiograms to Engage Yo...
AudGram Review: Build Visually Appealing, AI-Enhanced Audiograms to Engage Yo...
SOFTTECHHUB
 
Data Validation and System Interoperability
Data Validation and System Interoperability
Safe Software
 
“From Enterprise to Makers: Driving Vision AI Innovation at the Extreme Edge,...
“From Enterprise to Makers: Driving Vision AI Innovation at the Extreme Edge,...
Edge AI and Vision Alliance
 
MuleSoft for AgentForce : Topic Center and API Catalog
MuleSoft for AgentForce : Topic Center and API Catalog
shyamraj55
 
Reducing Conflicts and Increasing Safety Along the Cycling Networks of East-F...
Reducing Conflicts and Increasing Safety Along the Cycling Networks of East-F...
Safe Software
 
AI vs Human Writing: Can You Tell the Difference?
AI vs Human Writing: Can You Tell the Difference?
Shashi Sathyanarayana, Ph.D
 
Integration of Utility Data into 3D BIM Models Using a 3D Solids Modeling Wor...
Integration of Utility Data into 3D BIM Models Using a 3D Solids Modeling Wor...
Safe Software
 
Bridging the divide: A conversation on tariffs today in the book industry - T...
Bridging the divide: A conversation on tariffs today in the book industry - T...
BookNet Canada
 
vertical-cnc-processing-centers-drillteq-v-200-en.pdf
vertical-cnc-processing-centers-drillteq-v-200-en.pdf
AmirStern2
 
Down the Rabbit Hole – Solving 5 Training Roadblocks
Down the Rabbit Hole – Solving 5 Training Roadblocks
Rustici Software
 
Supporting the NextGen 911 Digital Transformation with FME
Supporting the NextGen 911 Digital Transformation with FME
Safe Software
 
ENERGY CONSUMPTION CALCULATION IN ENERGY-EFFICIENT AIR CONDITIONER.pdf
ENERGY CONSUMPTION CALCULATION IN ENERGY-EFFICIENT AIR CONDITIONER.pdf
Muhammad Rizwan Akram
 
“Addressing Evolving AI Model Challenges Through Memory and Storage,” a Prese...
“Addressing Evolving AI Model Challenges Through Memory and Storage,” a Prese...
Edge AI and Vision Alliance
 
War_And_Cyber_3_Years_Of_Struggle_And_Lessons_For_Global_Security.pdf
War_And_Cyber_3_Years_Of_Struggle_And_Lessons_For_Global_Security.pdf
biswajitbanerjee38
 
FME for Distribution & Transmission Integrity Management Program (DIMP & TIMP)
FME for Distribution & Transmission Integrity Management Program (DIMP & TIMP)
Safe Software
 

Running Highly Available Postgres Databases in Containers

  • 1. © Copyright EnterpriseDB Corporation, 2019. All rights reserved. Running Highly Available Postgres Databases in Containers Aziz Rahman, Lead Architect, EDB Postgres Container Platform Marc Linster, SVP, Product Development and Support 1
  • 2. © Copyright EnterpriseDB Corporation, 2019. All rights reserved.2 AGENDA • Who is EDB? • EDB Postgres Platform • Cattle and Pets • EDB Postgres Container Platform and Architecture • Demo • EDB Postgres Container Strategy
  • 3. © Copyright EnterpriseDB Corporation, 2019. All rights reserved. WHO IS EDB? The world leader in open-source based Postgres software and services. • Founded in 2004 • Recognized RDBMS leader by: • Gartner • Forrester • Customer base > 4000 • 300+ employees • Offices worldwide • PostgreSQL community leader 3
  • 4. © Copyright EnterpriseDB Corporation, 2019. All rights reserved.4 OVER 4,000 CUSTOMERS U.S Customers EMEA Customers APAC Customers 92 of the Fortune 500 311 of the Forbes Global 2000 Our customers benefit from the most reliable, high-performing, flexible, open, and cost-effective data management platform available.
  • 5. © Copyright EnterpriseDB Corporation, 2019. All rights reserved. 5 ONLY OPEN SOURCE BASED RDBMS IN GARTNER MQ EDB Recognized 6 Years In A Row on Gartner’s Magic Quadrant
  • 6. © Copyright EnterpriseDB Corporation, 2019. All rights reserved. EDB OPEN SOURCE LEADERSHIP Named EDB open source committers and contributors CONTRIBUTORS Akshay Joshi Amul Sul Ashesh Vashi Ashutosh Sharma Dilip Kumar Jeevan Ladhe Mithun Cy M. Usama Rushabh Lathia MAJOR CONTRIBUTORSCORE TEAM Andres Freund Devrim Gündüz Thomas Munro Amit Kapila Bruce Momjian Dave Page Robert Haas 6
  • 7. © Copyright EnterpriseDB Corporation, 2019. All rights reserved.7 EDB POSTGRES PLATFORM
  • 8. © Copyright EnterpriseDB Corporation, 2019. All rights reserved.8 EDB POSTGRES ADVANCED SERVER Enterprise capabilities add to the strengths of community PostgreSQL • Items in GREY are available in Community PostgreSQL • Items in RED are proprietary additions in Advanced Server
  • 9. © Copyright EnterpriseDB Corporation, 2019. All rights reserved.9 EDB POSTGRES PLATFORM Today’s Focus
  • 10. © Copyright EnterpriseDB Corporation, 2019. All rights reserved.10 Survey: Are you running databases in containers today? 1) For production (10.11%) 1) Development (22.74%) 1) No (67.15%)
  • 11. © Copyright EnterpriseDB Corporation, 2019. All rights reserved.11 Cattle and Pets ● Containers support an ephemeral and fungible model ○ Need more? Make more! ○ Acting up? Replace it! ● Applications are fungible, like cattle - databases are not ● Databases are ○ Persistent ○ Take a long time to warm up (cache loading) ○ When disconnected, they impact applications (disconnects, transaction restarts, errors visible to the users, …) ● Treat databases lovingly - just like pets
  • 12. © Copyright EnterpriseDB Corporation, 2019. All rights reserved.12 High Availability for Databases ● Things to consider ○ Do you need streaming replication with query routing, load balancing and/or read scaling? ○ Do you need synchronous replication? ○ Double (triple?) check that the database container is really down (get consensus and avoid false failover) ○ Promote carefully and make 100% sure that no application remains connected (STONITH) ● Options: ○ Custom scripting ○ Stolon https://github.com/sorintlab/stolon ○ Patroni https://github.com/zalando/patroni/ ○ EDB Failover Manager
  • 13. © Copyright EnterpriseDB Corporation, 2019. All rights reserved.13 Survey: How are you handling high availability in database containers? 1) No HA (62.37%) 2) Stolon (1.55%) 3) Patroni (4.12%) 4) EDB Failover Manager (9.28%) 5) Other (22.68%)
  • 14. © Copyright EnterpriseDB Corporation, 2019. All rights reserved.14 EDB Postgres Container Platform: Components Highly Available Data Management EDB Postgres Advanced Server ● 9.5 - 11 ● PostGIS optional Always includes EDB Failover Manager Read Scalability pgPool 4 ● Query routing ● Load balancing Backup and Recovery EDB Backup and Recovery ● Full and incremental backup ● Point in time recovery Tooling Upgrade tool ● Migration paths for older EPAS versions Monitoring & Management Postgres Enterprise Manager ● Dashboards and Alerts ● Performance management
  • 15. © Copyright EnterpriseDB Corporation, 2019. All rights reserved. Master Node 15 EDB Postgres Container Platform: Architecture Overview k8s Cluster Management Components edb-service Master Node Client Anti-affinity BART edb-as Master EPAS +EFM Agent +PEM Agent PgPool +EFM Agent edb-pgpool Master Node PEMServer edb-as Standby EPAS +EFM Agent +PEM Agent PgPool +EFM Agent edb-pgpool edb-pemserver Master Node edb-as Standby EPAS +EFM Agent +PEM Agent Storage Subsystem . . . Worker Node 1 Worker Node 2 Worker Node 3 Shared Storageedb-bart
  • 16. © Copyright EnterpriseDB Corporation, 2019. All rights reserved.16 EDB Postgres Container Platform: Architecture Discussion • Kubernetes features we used to create a highly available containerized database platform • Stateful Sets • Pod Anti-affinity • Config Maps • Secrets • Dynamic Persistent Volume
  • 17. © Copyright EnterpriseDB Corporation, 2019. All rights reserved.17 EDB Postgres Container Platform: Architecture Discussion ● Deployment Methods • Helm charts for Google Kubernetes Engine • Operators (all Kubernetes environments) coming soon • Deployment Options • EDB Postgres Advanced Server (w. EDB Failover Manager) • EFM enabled or disabled • pgPool • EDB Backup/Recovery Tool • EDB Postgres Enterprise Manager
  • 18. © Copyright EnterpriseDB Corporation, 2019. All rights reserved.18 Demo
  • 19. © Copyright EnterpriseDB Corporation, 2019. All rights reserved.19 EDB Container Strategy ● Containers are becoming a key database deployment platform ○ Current focus: Development, some production deployments ○ Expectation 2020: Major production deployment for EDB Postgres platform ● Database best practices for containers are emerging ● EDB supports ○ GKE ○ OpenShift ○ IBM Cloud Private ○ Pivotal Cloud Foundry (planned for H2 2019)
  • 20. © Copyright EnterpriseDB Corporation, 2019. All rights reserved.20 Next Steps ● EDB Container Platform 2.4 GA plan date: March 19 2019 ○ Current scripts and V 2.4 containers are beta versions! ● Get your containers from EDB https://www.enterprisedb.com/advanced- downloads ● Get the sample Helm chart https://get.enterprisedb.com/helm-charts/edb- demo-0.1.1.tgz https://get.enterprisedb.com/helm-charts/demo-values.yaml ○ Accesses the demo repo - will not be available after GA ● Join us at Postgres Vision in Boston June 24 - 26 ○ Pre-conference workshop will be about databases in containers
  • 21. © Copyright EnterpriseDB Corporation, 2019. All rights reserved.21
  • 22. © Copyright EnterpriseDB Corporation, 2019. All rights reserved. THANK YOU [email protected] www.enterprisedb.com 22