How to use postgresql.conf to configure and tune the PostgreSQL server
Download as PPTX, PDF0 likes4,463 views
This document discusses how to use the postgresql.conf configuration file to configure and tune a PostgreSQL server. It provides an overview of the postgresql.conf file, how to interact with and change settings in the file, classifications of different parameter types, tuning recommendations, and tools for automating configuration tuning. The presentation was given by EnterpriseDB to provide guidance on optimizing performance of a PostgreSQL database.
How to use postgresql.conf to configure and tune the PostgreSQL server
- 1. © Copyright EnterpriseDB Corporation, 2020. All rights reserved. How to use postgresql.conf to configure and tune the Postgres server Raghavendra Rao; Managing Consultant Marc Linster; SVP, Product Development and Support Bruce Momjian; Postgres Evangelist 1
- 2. Welcome – Housekeeping Items • Slides and recording will be available in next 48 hours • Submit questions via GotoWebinar – will be answering at end • We will be sharing info about EDB and Postgres later 2
- 3. Webinar Series Feb 19 2020 Conquering Data Migration from Oracle to Postgres March 4 2020 Using Terraform to deploy highly available Postgres March 18 2020 How to use postgresql.conf to configure and tune the Postgres server April 1 2020 Optimizing Performance and Security with Platform Native Packaging April 15 2020 Window Functions in Postgres 3
- 4. Agenda ● Who is EDB? ● About postgresql.conf ● Interacting with postgresql.conf ○ Allowed change context (reload, restart, recompile) ○ Ways to change and apply settings ● Parameters classification ● Tuning recommendations ● Tuning Tools ● Q & A © Copyright EnterpriseDB Corporation, 2020. All rights reserved.4
- 5. © Copyright EnterpriseDB Corporation, 2020. All rights reserved.5 About postgresql.conf
- 6. CONFIDENTIAL © Copyright EnterpriseDB Corporation, 2020. All rights reserved.6 About postgresql.conf A configuration parameter file that resides in Postgres cluster(data directory) to specify the server behavior on connection, memory, logging, vacuuming and other behaviors. File specifications: • Located in $PGDATA/postgresql.conf (some distro puts in /etc) • A plain text with tunable settings • Each parameter preceded by pound sign (‘#’) • At the beginning they are set with default values • Number of tunable parameters in postgresql.conf file - 270+
- 7. CONFIDENTIAL © Copyright EnterpriseDB Corporation, 2020. All rights reserved.7 Interacting with postgresql.conf • Every setting in file consists of name = value • “name” is a parameter name/Grand Unified Configuration(GUC) • “value” is a unit that parameter accepts, which can be boolean, integer, float, units(kB/MB/GB/TB), time(ms,s,min,h,d), strings and lists. Example: shared_buffers = 1GB
- 8. CONFIDENTIAL © Copyright EnterpriseDB Corporation, 2020. All rights reserved.8 Allowed change context Every configuration setting has an associated context in which it’s allowed to be changed. There are set of context types: • Internal - a parameter can only be set at compile time • postmaster - a parameter is updated only when a full server restart is done • signup - a parameter is changed by sending server a HUP signal(pg_ctl reload) • backend - a parameter is similar to “sighup”, however changes will not impact any already running database backend sessions. Only new sessions will accept the new changes. • superuser-backend - a parameter is similar to “sighup”, however changes will not impact any already running database backend sessions. Only new sessions will accept the new changes.(only super user change the settings) • superuser - a parameter can be changed by any database superuser • user - a parameter can be changed by the individual user in his session(per-session basis) Query to find specific configuration information:pg_settings.context distinct values:
- 9. CONFIDENTIAL © Copyright EnterpriseDB Corporation, 2020. All rights reserved.9 Ways to change and apply settings As per parameter context, to update values there two ways change • Reload • pg_reload_conf() • pg_ctl -D <data_directory> reload (SIGHUP) • HUP postmaster • Restart • pg_ctl restart • OS Service restart • Other Changes • ALTER SYSTEM • ALTER DATABASE <dbname> SET <parameter setting> • ALTER USER <username> SET <parameter setting> • Session Level • BEGIN.. SET <parameter setting>; END;
- 10. CONFIDENTIAL © Copyright EnterpriseDB Corporation, 2020. All rights reserved.10 Parameter classifications….1
- 11. CONFIDENTIAL © Copyright EnterpriseDB Corporation, 2020. All rights reserved.11 Parameter classifications….2
- 12. CONFIDENTIAL © Copyright EnterpriseDB Corporation, 2020. All rights reserved.12 Parameter classifications….3
- 13. CONFIDENTIAL © Copyright EnterpriseDB Corporation, 2020. All rights reserved.13 Parameter classifications….4
- 14. CONFIDENTIAL © Copyright EnterpriseDB Corporation, 2020. All rights reserved.14 Parameter classifications….5
- 15. CONFIDENTIAL © Copyright EnterpriseDB Corporation, 2020. All rights reserved.15 Parameter classifications….6
- 16. CONFIDENTIAL © Copyright EnterpriseDB Corporation, 2020. All rights reserved.16 Parameter classifications….7
- 17. CONFIDENTIAL © Copyright EnterpriseDB Corporation, 2020. All rights reserved.17 Parameter classifications….8
- 18. CONFIDENTIAL © Copyright EnterpriseDB Corporation, 2020. All rights reserved.18 Parameter classifications….9
- 19. CONFIDENTIAL © Copyright EnterpriseDB Corporation, 2020. All rights reserved.19 Tuning Recommendations...1 shared_buffers 15% to 25% of available RAM maintenance_work_mem Total RAM * 0.15 / autovacuum_max_workers work_mem Total RAM * 0.25 / max_connections max_connections Start with default 100, if required prefer connection pooler effective_cache_size 75% of Total RAM wal_buffers 1/32nd of shared_buffers capped at 16MB bgwriter_delay Default 200ms, lower it if heavy writes bgwriter_lru_maxpages bgwriter_lru_multiplier Increase multiplier on system with a heavy write load.
- 20. CONFIDENTIAL © Copyright EnterpriseDB Corporation, 2020. All rights reserved.20 Tuning Recommendations...2 wal_level Set according to the replication requirement min_wal_size (GB) max_wal_size (GB) Setting it too low means checkpoints will occur too frequently, increasing will beneficial for recovery times. checkpoint_completion_target Higher the value, the smoother the IO of the checkpoint checkpoint_timeout Increase this parameter can increase the amount of the time needed for crash recovery random_page_cost Increasing will result index being used over sequential scans cpu_tuple_cost Specifies the relative cost of the processing each row during a query.
- 21. © Copyright EnterpriseDB Corporation, 2020. All rights reserved.21 Tools
- 22. CONFIDENTIAL © Copyright EnterpriseDB Corporation, 2020. All rights reserved.22 Tuning Tools Few tools will automatically tune by analyzing the server resources and configure PostgreSQL server for optimal performance. • Open Source • pgtune - https://pgtune.leopard.in.ua/#/ • pgbadger (a Log Analyzer) - http://pgbadger.darold.net/ • For EDB Customers • EDB Postgres Enterprise Manager - Tuning Wizard/Postgres Expert Useful Links: • https://wiki.postgresql.org/wiki/Performance_Optimization • https://wiki.postgresql.org/wiki/Tuning_Your_PostgreSQL_Server
- 23. ONLY OPEN SOURCE BASED RDBMS IN GARTNER MQ EDB Recognized 7 Years In A Row on Gartner’s Magic Quadrant 23 CONFIDENTIAL © Copyright EnterpriseDB Corporation, 2020. All rights reserved.
- 24. 24 Customers working SMARTER, reducing RISK and being more PRODUCTIVE with EDB. OVER 4,000 CUSTOMERS U.S Customers EMEA Customers APAC Customers 102 of the Fortune 500 337 of the Forbes Global 2000
- 25. EDB OPEN SOURCE LEADERSHIP NAMED EDB OPEN SOURCE COMMITTERS AND CONTRIBUTORS 25 ● CORE TEAM ● ● ● ● MAJOR CONTRIBUTORS ● CONTRIBUTORS Akshay Joshi Amul Sul Ashesh Vashi Dilip Kumar Jeevan Ladhe Mithun Cy Devrim Gündüz Amit Kapila Bruce Momjian Dave Page Robert Haas Ashutosh Sharma Rushabh Lathia - designates committers
- 26. 26 EDB Postgres Database 24/7 Global Support Professional Services Postgres Contributions Tools & Innovation Security/performance
- 27. © Copyright EnterpriseDB Corporation, 2020. All rights reserved.27 QUESTIONS
- 28. © Copyright EnterpriseDB Corporation, 2028. All rights reserved.28 Tuning concerns or operational worries about Postgres? EDB can help! • DBA Services for Postgres in the Cloud or Postgres in your data centre • Advice and consulting for Postgres deployments • Technical Account Management to provide a knowledgeable point of contact between your team and the EDB technical team Email [email protected] to request a Remote DBA readiness review
- 29. © Copyright EnterpriseDB Corporation, 2020. All rights reserved.29 THANK YOU [email protected] www.enterprisedb.com