Postgres Vision 2018: Will Postgres Live Forever?

Will Postgres Live Forever?
Bruce Momjian
Senior Database Architect
EnterpriseDB
Creative Commons Attribution License http://momjian.us/presentations

2/44
Outline
1. Forever
2. Software life cycle
3. Open source adoption
4. Postgres innovation
5. Community structure
6. Conclusion

3/44
1. Forever
https://www.flickr.com/photos/gsfc/

4/44
Forever Is a Long Time
● Age of the Universe: 13.7 billion years
● Age of the Earth: 4.5 billion years
● Age of civilization: 6,000 years
● Civilized era vs. Earth years: 0.00001%
● Digital era vs. Earth years: ~0%

5/44
Brief Digital History
● 1804: Jacquard loom
● 1945: ENIAC
● 1970: E. F. Codd Relational Theory
● 1974: System R
● 1977: Ingres
● 1986: University-based Postgres
● 1994: Postgres95
● 1996: Internet-based Postgres

6/44
2. Software Life Cycle
https://www.flickr.com/photos/tarynmarie/

7/44
Proprietary Software Life Cycle
1.Innovation
2.Market growth
3.Market saturation
4.Maximize profit, minimize costs (development,
support)
5.End-of-life

8/44
Open Source Software Life Cycle
1.Parity with proprietary software, low cost
2.Market growth
3.Continue innovation or decline
4.Source code is always available to continue

9/44
Linux
Linux attained feature parity with:
● HP-UX
● AIX
● Solaris
and then went on to innovate beyond them.

10/44
Postgres
Postgres nearing feature parity with:
● Oracle
● DB2
● MS-SQL
and then going on to innovate beyond them.

11/44
When Does Software Die?
● Proprietary software dies when the owner of the
source code can no longer profit from it
● It declines long before death due to profit
maximization
● Open source cannot die in the same way
● Open source remains active while it serves a purpose
● It can always be resurrected if useful
● Postgres was given new life in 1996

12/44
Ideas Don’t Die
Ideas don’t die, as long as they are shared.

13/44
3. Open Source Adoption
https://www.flickr.com/photos/99438314@N02/

14/44
Open Source Survey, 2016
When the first survey launched 10 years ago, hardly anyone would have
predicted that open source use would be ubiquitous worldwide just a
decade later, but for many good reasons that’s what happened. Its value
in reducing development costs, in freeing internal developers to work on
higher-order tasks, and in accelerating time to market is undeniable.
Simply put, open source is the way applications are developed today.
Lou Shipley
President And CEO
Black Duck Software
https://www.slideshare.net/blackducksoftware/2016-future-of-open-source-survey-results

15/44
Advantages of Open Source
● Competitive features, innovation
● Freedom from vendor lock-in
● Quality of solutions
● Ability to customize and fix
● Cost
● Speed application development
● Reduce development costs
● Interoperability
● Breadth of solutions

16/44
Open Source Today
Open source today is unequivocally the engine of innovation;
whether that's powering technology like operating systems, cloud,
big data or IoT, or powering a new generation of open source
companies delivering compelling solutions to the market.
Paul Santinelli
General Partner
North Bridge

17/44
Open Source Usage, 2016
● Operating Systems
● Database
● Development tools
Database didn't appear in the top three the previous
year's survey (2015).

18/44
4. Postgres Innovation
https://www.flickr.com/photos/tomas_vondra/

19/44
Relational Innovation
● E. F. Codd introduces relational theory
● Row, column, table
● Constraints
● Normalization, joins
● Replaces key/value data storage systems
● Pre-Postgres
https://en.wikipedia.org/wiki/Edgar_F._Codd

20/44
University Postgres Innovation
● Stonebraker creates university Postgres
● Allows extendability via system table contents:
– Data types
– Indexing methods
– Server-side languages
https://en.wikipedia.org/wiki/Michael_Stonebraker

23/44
Postgres Server-Side Languages
● PL/Java
● PL/Perl
● PL/pgSQL (like PL/SQL)
● PL/PHP
● PL/Python
● PL/R (like SPSS)
● PL/Ruby
● PL/Scheme
● PL/sh
● PL/Tcl
● SPI (C )

24/44
Postgres Index Types
● BRIN
● BTree
● Hash
● GIN (generalized inverted index)
● GiST (generalized search tree)
● SP-GiST (space-partitioned GiST)
http://momjian.us/main/writings/pgsql/indexing.pdf

25/44
Postgres Innovation:
Full Text Search
● Supports full text search capabilities in a relational
database
● Whole-word, word prefix, and, or, and not searches
● Stemming for 15 languages
● Pgtrgm extension allows search of letter combinations
and similarity
● Specialized indexing, operators and functions
● Full transaction semantics
http://momjian.us/main/writings/pgsql/non-relational.pdf

26/44
Full Text Search
SELECT line
FROM fortune
WHERE to_tsvector(’english’, line) @@ to_tsquery(’pandas’);
line
----------------------------------------------------------------------
A giant panda bear is really a member of the raccoon family.
EXPLAIN SELECT line
FROM fortune
WHERE to_tsvector(’english’, line) @@ to_tsquery(’pandas’);
QUERY PLAN
------------------------------------------------------------------...
Bitmap Heap Scan on fortune (cost=12.41..94.25 rows=21 width=36)
Recheck Cond: (to_tsvector(’english’::regconfig, line) @@ to_ts...
→ Bitmap Index Scan on fortune_idx_ts (cost=0.00..12.40 rows...
Index Cond: (to_tsvector(’english’::regconfig, line) @@ t..

27/44
NoSQL
● Supports NoSQL capabilities in a relational
database
● Mix structured and unstructured data in the
same row and query; the best of both worlds
● Specialized indexing, operators, and functions
● Full transaction semantics
http://momjian.us/main/writings/pgsql/yesql.pdf

28/44
NoSQL
EXPLAIN SELECT data->>’last_name’
FROM friend2
WHERE data::jsonb @> ’{"first_name" : "Jane"}’
ORDER BY 1; QUERY PLAN
----------------------------------------------------------------...
Sort (cost=24.03..24.04 rows=1 width=139)
Sort Key: ((data ->> ’last_name’::text))
-> Bitmap Heap Scan on friend2 (cost=20.01..24.02 rows=1 ...
Recheck Cond: (data @> ’{"first_name": "Jane"}’::jsonb)
→ Bitmap Index Scan on friend2_idx (cost=0.00..20.01 ......
Index Cond: (data @> ’{"first_name": "Jane"}’::js...

29/44
Range Types
● Combines start and stop times into a single
field
● Allows sophisticated indexing and comparisons
● Allows automatic range overlap prevention

30/44
Range Types
EXPLAIN SELECT *
FROM car_rental
WHERE time_span @> ’2007-08-01 00:00:00’::timestamptz;
QUERY PLAN
----------------------------------------------------------
Index Scan using car_rental_idx on car_rental(cost=0.15...
Index Cond: (time_span @> ’2007-08-01 00:00:00-04’::...

31/44
Geometric Types
● Handle multi-dimensional data
– Points
– Lines
– Circles
– Polygons
● Multi-dimensional indexing and operators
● Allows efficient nearest neighbor searches
● Avoids using a separate geometric data store

32/44
Geometric Types
EXPLAIN SELECT *
FROM dart
ORDER BY location <-> ’(50, 50)’::point
LIMIT 2;
QUERY PLAN
-------------------------------------------------------------
Limit (cost=0.14..0.33 rows=2 width=20)
→ Index Scan using dart_idx on dart (cost=0.14..92.14...
Order By: (location <-> ’(50,50)’::point)

33/44
GIS
● PostGIS is a full-featured Geographical
Information System (GIS)
● Implemented as a extension
● Independent development team and community
https://postgis.net/

34/44
GIS
SELECT ST_Area(the_geom)/10000 AS hectares
FROM bc_municipality
WHERE name = 'PRINCE GEORGE';
hectares
------------------
32657.9103824927

35/44
Foreign Data Wrappers
● 100+ interfaces to foreign data
● Read/write
● Sophisticated push down of joins, sorts, and
aggregates

36/44
Foreign Data Wrappers

37/44
Data Analytics
● Aggregates
●
Optimizer
●
Server-side languages, e.g. PL/R
●
Window functions
●
Bitmap heap scans
●
Tablespaces
●
Data partitioning
●
Materialized views
●
Common table expressions (CTE)
●
BRIN indexes
●
GROUPING SETS
●
ROLLUP CUBE
●
Parallelism
●
Sharding (in progress)

38/44
Data Analytics

39/44
Sharding
● Allows multi-host databases
● Uses
– Partitioning
– Parallelism
– Foreign data wrappers
– Logical replication
– Global transaction manager
– Global snapshot manager
http://momjian.us/main/writings/pgsql/sharding.pdf

40/44
Sharding

41/44
5. Community Structure
https://www.flickr.com/photos/tomas_vondra/

42/44
Community Structure
● BSD license guarantees software will be
available forever, including for proprietary use
● Development and leadership is diversified
geographically, culturally, and is multi-company

43/44
Still Going Strong
● 22 years of yearly major releases
● ~180 features per major release
● Quarterly minor releases
● Most loved relational database
https://insights.stackoverflow.com/survey/2018/#technology-most-loved-dreaded-and-wanted-databases

44/44
6. Conclusion
https://www.flickr.com/photos/pagedooley/

Postgres Vision 2018: Will Postgres Live Forever?

Recommended

More Related Content

What's hot (20)

Similar to Postgres Vision 2018: Will Postgres Live Forever? (20)

More from EDB (20)

Recently uploaded (20)

Postgres Vision 2018: Will Postgres Live Forever?