Download as PDF, PPTX
Uploaded byEDB
Postgres Vision 2018: Will Postgres Live Forever?
The document discusses the longevity of PostgreSQL in the context of software life cycles, emphasizing the differences between proprietary and open-source models. It highlights PostgreSQL's innovations, including its adaptability and community structure, which contribute to its ongoing relevance and capability to evolve. The presentation argues that as long as it serves a purpose, open-source software like PostgreSQL can continue to thrive indefinitely.
More Related Content
Similar to Postgres Vision 2018: Will Postgres Live Forever?
Postgres Vision 2018: Will Postgres Live Forever?
- 1. Will Postgres LiveForever? Bruce Momjian Senior Database Architect EnterpriseDB Creative Commons Attribution License http://momjian.us/presentations
- 2. 2/44 Outline 1. Forever 2. Softwarelife cycle 3. Open source adoption 4. Postgres innovation 5. Community structure 6. Conclusion
- 3.
- 4. 4/44 Forever Is aLong Time ● Age of the Universe: 13.7 billion years ● Age of the Earth: 4.5 billion years ● Age of civilization: 6,000 years ● Civilized era vs. Earth years: 0.00001% ● Digital era vs. Earth years: ~0%
- 5. 5/44 Brief Digital History ●1804: Jacquard loom ● 1945: ENIAC ● 1970: E. F. Codd Relational Theory ● 1974: System R ● 1977: Ingres ● 1986: University-based Postgres ● 1994: Postgres95 ● 1996: Internet-based Postgres
- 6. 6/44 2. Software LifeCycle https://www.flickr.com/photos/tarynmarie/
- 7. 7/44 Proprietary Software LifeCycle 1.Innovation 2.Market growth 3.Market saturation 4.Maximize profit, minimize costs (development, support) 5.End-of-life
- 8. 8/44 Open Source SoftwareLife Cycle 1.Parity with proprietary software, low cost 2.Market growth 3.Continue innovation or decline 4.Source code is always available to continue
- 9. 9/44 Linux Linux attained featureparity with: ● HP-UX ● AIX ● Solaris and then went on to innovate beyond them.
- 10. 10/44 Postgres Postgres nearing featureparity with: ● Oracle ● DB2 ● MS-SQL and then going on to innovate beyond them.
- 11. 11/44 When Does SoftwareDie? ● Proprietary software dies when the owner of the source code can no longer profit from it ● It declines long before death due to profit maximization ● Open source cannot die in the same way ● Open source remains active while it serves a purpose ● It can always be resurrected if useful ● Postgres was given new life in 1996
- 12. 12/44 Ideas Don’t Die Ideasdon’t die, as long as they are shared.
- 13. 13/44 3. Open SourceAdoption https://www.flickr.com/photos/99438314@N02/
- 14. 14/44 Open Source Survey,2016 When the first survey launched 10 years ago, hardly anyone would have predicted that open source use would be ubiquitous worldwide just a decade later, but for many good reasons that’s what happened. Its value in reducing development costs, in freeing internal developers to work on higher-order tasks, and in accelerating time to market is undeniable. Simply put, open source is the way applications are developed today. Lou Shipley President And CEO Black Duck Software https://www.slideshare.net/blackducksoftware/2016-future-of-open-source-survey-results
- 15. 15/44 Advantages of OpenSource ● Competitive features, innovation ● Freedom from vendor lock-in ● Quality of solutions ● Ability to customize and fix ● Cost ● Speed application development ● Reduce development costs ● Interoperability ● Breadth of solutions https://www.slideshare.net/blackducksoftware/2016-future-of-open-source-survey-results
- 16. 16/44 Open Source Today Opensource today is unequivocally the engine of innovation; whether that's powering technology like operating systems, cloud, big data or IoT, or powering a new generation of open source companies delivering compelling solutions to the market. Paul Santinelli General Partner North Bridge https://www.slideshare.net/blackducksoftware/2016-future-of-open-source-survey-results
- 17. 17/44 Open Source Usage,2016 ● Operating Systems ● Database ● Development tools Database didn't appear in the top three the previous year's survey (2015). https://www.slideshare.net/blackducksoftware/2016-future-of-open-source-survey-results
- 18.
- 19. 19/44 Relational Innovation ● E.F. Codd introduces relational theory ● Row, column, table ● Constraints ● Normalization, joins ● Replaces key/value data storage systems ● Pre-Postgres https://en.wikipedia.org/wiki/Edgar_F._Codd
- 20. 20/44 University Postgres Innovation ●Stonebraker creates university Postgres ● Allows extendability via system table contents: – Data types – Indexing methods – Server-side languages https://en.wikipedia.org/wiki/Michael_Stonebraker
- 21.
- 22. 22/44 Postgres Extension DataType CREATE EXTENSION isn; dT List of data types Schema | Name | Description --------+--------+-------------------------------------------------- public | ean13 | International European Article Number (EAN 13) public | isbn | International Standard Book Number (ISBN) public | isbn13 | International Standard Book Number 13 (ISBN13) public | ismn | International Standard Music Number (ISMN) public | ismn13 | International Standard Music Number 13 (ISMN13) public | issn | International Standard Serial Number (ISSN) public | issn13 | International Standard Serial Number 13 (ISSN13) public | upc | Universal Product Code (UPC) http://momjian.us/main/writings/pgsql/central.pdf
- 23. 23/44 Postgres Server-Side Languages ●PL/Java ● PL/Perl ● PL/pgSQL (like PL/SQL) ● PL/PHP ● PL/Python ● PL/R (like SPSS) ● PL/Ruby ● PL/Scheme ● PL/sh ● PL/Tcl ● SPI (C ) http://momjian.us/main/writings/pgsql/central.pdf
- 24. 24/44 Postgres Index Types ●BRIN ● BTree ● Hash ● GIN (generalized inverted index) ● GiST (generalized search tree) ● SP-GiST (space-partitioned GiST) http://momjian.us/main/writings/pgsql/indexing.pdf
- 25. 25/44 Postgres Innovation: Full TextSearch ● Supports full text search capabilities in a relational database ● Whole-word, word prefix, and, or, and not searches ● Stemming for 15 languages ● Pgtrgm extension allows search of letter combinations and similarity ● Specialized indexing, operators and functions ● Full transaction semantics http://momjian.us/main/writings/pgsql/non-relational.pdf
- 26. 26/44 Postgres Innovation: Full TextSearch SELECT line FROM fortune WHERE to_tsvector(’english’, line) @@ to_tsquery(’pandas’); line ---------------------------------------------------------------------- A giant panda bear is really a member of the raccoon family. EXPLAIN SELECT line FROM fortune WHERE to_tsvector(’english’, line) @@ to_tsquery(’pandas’); QUERY PLAN ------------------------------------------------------------------... Bitmap Heap Scan on fortune (cost=12.41..94.25 rows=21 width=36) Recheck Cond: (to_tsvector(’english’::regconfig, line) @@ to_ts... → Bitmap Index Scan on fortune_idx_ts (cost=0.00..12.40 rows... Index Cond: (to_tsvector(’english’::regconfig, line) @@ t..
- 27. 27/44 Postgres Innovation: NoSQL ● SupportsNoSQL capabilities in a relational database ● Mix structured and unstructured data in the same row and query; the best of both worlds ● Specialized indexing, operators, and functions ● Full transaction semantics http://momjian.us/main/writings/pgsql/yesql.pdf
- 28. 28/44 Postgres Innovation: NoSQL EXPLAIN SELECTdata->>’last_name’ FROM friend2 WHERE data::jsonb @> ’{"first_name" : "Jane"}’ ORDER BY 1; QUERY PLAN ----------------------------------------------------------------... Sort (cost=24.03..24.04 rows=1 width=139) Sort Key: ((data ->> ’last_name’::text)) -> Bitmap Heap Scan on friend2 (cost=20.01..24.02 rows=1 ... Recheck Cond: (data @> ’{"first_name": "Jane"}’::jsonb) → Bitmap Index Scan on friend2_idx (cost=0.00..20.01 ...... Index Cond: (data @> ’{"first_name": "Jane"}’::js...
- 29. 29/44 Postgres Innovation: Range Types ●Combines start and stop times into a single field ● Allows sophisticated indexing and comparisons ● Allows automatic range overlap prevention http://momjian.us/main/writings/pgsql/non-relational.pdf
- 30. 30/44 Postgres Innovation: Range Types EXPLAINSELECT * FROM car_rental WHERE time_span @> ’2007-08-01 00:00:00’::timestamptz; QUERY PLAN ---------------------------------------------------------- Index Scan using car_rental_idx on car_rental(cost=0.15... Index Cond: (time_span @> ’2007-08-01 00:00:00-04’::...
- 31. 31/44 Postgres Innovation: Geometric Types ●Handle multi-dimensional data – Points – Lines – Circles – Polygons ● Multi-dimensional indexing and operators ● Allows efficient nearest neighbor searches ● Avoids using a separate geometric data store http://momjian.us/main/writings/pgsql/non-relational.pdf
- 32. 32/44 Postgres Innovation: Geometric Types EXPLAINSELECT * FROM dart ORDER BY location <-> ’(50, 50)’::point LIMIT 2; QUERY PLAN ------------------------------------------------------------- Limit (cost=0.14..0.33 rows=2 width=20) → Index Scan using dart_idx on dart (cost=0.14..92.14... Order By: (location <-> ’(50,50)’::point)
- 33. 33/44 Postgres Innovation: GIS ● PostGISis a full-featured Geographical Information System (GIS) ● Implemented as a extension ● Independent development team and community https://postgis.net/
- 34. 34/44 Postgres Innovation: GIS SELECT ST_Area(the_geom)/10000AS hectares FROM bc_municipality WHERE name = 'PRINCE GEORGE'; hectares ------------------ 32657.9103824927
- 35. 35/44 Postgres Innovation: Foreign DataWrappers ● 100+ interfaces to foreign data ● Read/write ● Sophisticated push down of joins, sorts, and aggregates http://momjian.us/main/writings/pgsql/central.pdf
- 36.
- 37. 37/44 Postgres Innovation: Data Analytics ●Aggregates ● Optimizer ● Server-side languages, e.g. PL/R ● Window functions ● Bitmap heap scans ● Tablespaces ● Data partitioning ● Materialized views ● Common table expressions (CTE) ● BRIN indexes ● GROUPING SETS ● ROLLUP CUBE ● Parallelism ● Sharding (in progress) http://momjian.us/main/writings/pgsql/central.pdf
- 38.
- 39. 39/44 Postgres Innovation: Sharding ● Allowsmulti-host databases ● Uses – Partitioning – Parallelism – Foreign data wrappers – Logical replication – Global transaction manager – Global snapshot manager http://momjian.us/main/writings/pgsql/sharding.pdf
- 40.
- 41.
- 42. 42/44 Community Structure ● BSDlicense guarantees software will be available forever, including for proprietary use ● Development and leadership is diversified geographically, culturally, and is multi-company
- 43. 43/44 Still Going Strong ●22 years of yearly major releases ● ~180 features per major release ● Quarterly minor releases ● Most loved relational database https://insights.stackoverflow.com/survey/2018/#technology-most-loved-dreaded-and-wanted-databases
- 44.