205 pointsby dlt10 hours ago9 comments
  • cdiamand5 hours ago
    Linking to the postgresql docs since they are very well written and surprisingly enjoyable to read.

    https://www.postgresql.org/docs/current/indexes-intro.html

  • brudgers3 hours ago
    Related, Use the Index Luke

    https://use-the-index-luke.com/

  • 34 minutes ago
    undefined
  • 21 minutes ago
    undefined
  • zozbot2344 hours ago
    It would be nice to see out-of-the-box support in PostgreSQL for what's known as incremental view maintenance. It's very much an index in that it gets updated automatically when the underlying data changes, but it supports that for arbitrary views - not just special-cased like ordinary database indexes.
    • lispisok11 minutes ago
      If you have timeseries data TimescaleDB has this with continuous aggregates
    • BenoitP3 hours ago
      A hard problem, especially wrt to transactions on a moving target.

      From memory, handful of projects just dedicated to this dimension of databases: Noria, Materialize, Apache Flink, GCP's Continuous Queries, Apache Spark Streaming Tables, Delta Tables, ClickHouse streaming tables, TimescaleDB, ksqlDB, StreamSQL; and dozens more probably. IIRC, since this is about postgres, there is recently created extension trying to deal with this: pg_ivm

  • Anonyneko38 minutes ago
    Is there a use-the-index-luke for MongoDB...?
  • jihadjihad5 hours ago
    The section on multi-column indexes mirrors how I was taught and how I’ve generally handled such indexes in the past. But is it still true for more recent PG versions? I had an index and query similar to the third example, and IIRC PG was able to use an index, though I believe it was a bitmap index scan.

    I am also unsure of the specific perf tradeoffs between index scan types in that case, but when I saw that happen in the EXPLAIN plan it was enough for me to call into question what had been hardcoded wisdom in my mind for quite some time.

    Further essential reading is the classic Use The Index, Luke [0] site, and the book is a great buy for the whole team.

    0: https://use-the-index-luke.com/

    • petergeoghegan3 hours ago
      > The section on multi-column indexes mirrors how I was taught and how I’ve generally handled such indexes in the past. But is it still true for more recent PG versions?

      No, it isn't. PostgreSQL 18 added support for index skip scan:

      https://youtu.be/RTXeA5svapg?si=_6q3mj1sJL8oLEWC&t=1366

      It's actually possible to use a multicolumn index with a query that only has operators on its lower-order columns in earlier versions. But that requires a full index scan, which is usually very inefficient.

      • dlt2 hours ago
        Hi Peter, author here. Thanks for weighing in with the extra context on index skip scan, and huge thanks for adding this to Postgres.

        I’m going to revise the multi-column index section to be more precise about when leftmost-prefix rules apply, and I’ll include a note on how skip scan changes the picture

    • glenjamin2 hours ago
      A bitmap index scan allows the database to narrow down which pages could include the data, but then still has to recheck the condition on the contents of those pages - so will still not be as performant as an proper index scan
  • turbocon5 hours ago
    This looks really awesome for Postgres

    For general B Tree index resources this has been my got to site for years https://use-the-index-luke.com/

  • joaomsa6 hours ago
    Essential reading. More in-depth than an introduction, but without being overly impenetrable except to those dealing with the internals.